2026-03-25 16:30:04 [scrapy.utils.log] INFO: Scrapy 2.11.2 started (bot: SourcingV2)
2026-03-25 16:30:04 [scrapy.utils.log] INFO: Versions: lxml 5.2.2.0, libxml2 2.12.6, cssselect 1.2.0, parsel 1.9.1, w3lib 2.1.2, Twisted 24.3.0, Python 3.11.2 (main, Mar 13 2023, 12:18:29) [GCC 12.2.0], pyOpenSSL 24.1.0 (OpenSSL 3.2.1 30 Jan 2024), cryptography 42.0.7, Platform Linux-5.15.0-1098-azure-x86_64-with-glibc2.36
2026-03-25 16:30:04 [ayvens.it] INFO: Starting spider ayvens.it
2026-03-25 16:30:04 [scrapy.addons] INFO: Enabled addons:
[]
2026-03-25 16:30:04 [asyncio] DEBUG: Using selector: EpollSelector
2026-03-25 16:30:04 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2026-03-25 16:30:04 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2026-03-25 16:30:04 [scrapy.extensions.telnet] INFO: Telnet Password: ade7c248c0720029
2026-03-25 16:30:04 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
'scrapy.extensions.telnet.TelnetConsole',
'scrapy.extensions.memusage.MemoryUsage',
'scrapy.extensions.feedexport.FeedExporter',
'scrapy.extensions.logstats.LogStats',
'scrapy.extensions.closespider.CloseSpider']
2026-03-25 16:30:04 [scrapy.crawler] INFO: Overridden settings:
{'BOT_NAME': 'SourcingV2',
'CLOSESPIDER_TIMEOUT': 7200,
'DOWNLOAD_MAXSIZE': 52428800,
'DOWNLOAD_WARNSIZE': 10485760,
'FEED_EXPORT_ENCODING': 'utf-8',
'LOG_FILE': '/var/log/scrapyd/logs/sourcing_v2/ayvens.it/task_39_2026-03-25T16_30_00.log',
'LOG_FORMATTER': 'crawlers.log_formatter.SourcingLogFormatter',
'MEMUSAGE_LIMIT_MB': 2048,
'MEMUSAGE_WARNING_MB': 1536,
'NEWSPIDER_MODULE': 'spiders',
'REQUEST_FINGERPRINTER_CLASS': 'scrapy_zyte_api.ScrapyZyteAPIRequestFingerprinter',
'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7',
'SPIDER_MODULES': ['spiders', 'auth_check'],
'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor',
'USER_AGENT': ''}
2026-03-25 16:30:04 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-25 16:30:04 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-25 16:30:04 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
'scrapy_zyte_api.ScrapyZyteAPIDownloaderMiddleware',
'scrapy.downloadermiddlewares.retry.RetryMiddleware',
'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-03-25 16:30:04 [crawlers.middlewares.id_gen_middleware] INFO: Setting up IdGenerationMiddleware
2026-03-25 16:30:04 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
'scrapy_zyte_api.ScrapyZyteAPISpiderMiddleware',
'crawlers.middlewares.monitoring_spider_middleware.MonitoringSpiderMiddleware',
'scrapy.spidermiddlewares.referer.RefererMiddleware',
'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
'scrapy.spidermiddlewares.depth.DepthMiddleware',
'crawlers.middlewares.photo_download_middleware.PhotoDownloadMiddleware',
'crawlers.middlewares.report_download_middleware.ReportDownloadMiddleware',
'crawlers.middlewares.id_gen_middleware.IdGenMiddleware']
2026-03-25 16:30:04 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_CLIENT_ID, AZURE_TENANT_ID
2026-03-25 16:30:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-25 16:30:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2121
2026-03-25 16:30:04 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2026-03-25 16:30:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxsourcingstorageprod.table.core.windows.net:443
2026-03-25 16:30:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:05 [crawlers.pipelines.translation_pipeline] INFO: Loading translations for language: en
2026-03-25 16:30:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /Translations()?$filter=PartitionKey%20eq%20%27en%27%20and%20RowKey%20eq%20%27en%27 HTTP/1.1" 200 None
2026-03-25 16:30:05 [crawlers.pipelines.item_rules_pipeline] INFO: Setting up ItemRules Pipeline
2026-03-25 16:30:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_location_for_country.json
2026-03-25 16:30:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_cars_from_auction_title.json
2026-03-25 16:30:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_country.json
2026-03-25 16:30:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_fr.json
2026-03-25 16:30:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_photos.json
2026-03-25 16:30:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_from_info.json
2026-03-25 16:30:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_not_allowed.json
2026-03-25 16:30:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: not_operable_from_info.json
2026-03-25 16:30:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_models_not_allowed.json
2026-03-25 16:30:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_title.json
2026-03-25 16:30:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: imported_cars.json
2026-03-25 16:30:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_currency.json
2026-03-25 16:30:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_mileage.json
2026-03-25 16:30:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_auction_title.json
2026-03-25 16:30:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_country_of_origin.json
2026-03-25 16:30:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_pt.json
2026-03-25 16:30:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: electric_cars.json
2026-03-25 16:30:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_color.json
2026-03-25 16:30:05 [crawlers.pipelines.post_to_api] INFO: Setting up PostToApi Pipeline pointing to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-03-25 16:30:05 [scrapy.middleware] INFO: Enabled item pipelines:
['crawlers.pipelines.translation_pipeline.TranslationPipeline',
'crawlers.pipelines.item_rules_pipeline.ItemRulesPipeline',
'crawlers.pipelines.post_to_api.PostToApiPipeline']
2026-03-25 16:30:05 [scrapy.core.engine] INFO: Spider opened
2026-03-25 16:30:05 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-03-25 16:30:05 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-03-25 16:30:05 [scrapy.extensions.memusage] INFO: Peak memory usage is 140MiB
2026-03-25 16:30:05 [scrapy-playwright] INFO: Starting download handler
2026-03-25 16:30:05 [scrapy-playwright] INFO: Starting download handler
2026-03-25 16:30:10 [scrapy-playwright] INFO: Launching browser firefox
2026-03-25 16:30:10 [scrapy-playwright] INFO: Browser firefox launched
2026-03-25 16:30:10 [scrapy-playwright] DEBUG: Browser context started: 'default' (persistent=False, remote=False)
2026-03-25 16:30:11 [scrapy-playwright] DEBUG: [Context=default] New page created, page count is 1 (1 for all contexts)
2026-03-25 16:30:11 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/en-gb/lots> (resource type: document)
2026-03-25 16:30:11 [scrapy-playwright] DEBUG: [Context=default] Response: <407 https://carmarket.ayvens.com/en-gb/lots>
2026-03-25 16:30:11 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/en-gb/lots> (resource type: document)
2026-03-25 16:30:13 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/en-gb/lots>
2026-03-25 16:30:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/Chillax-Medium.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-25 16:30:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/Chillax-Regular.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-25 16:30:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/Chillax-Semibold.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-25 16:30:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/SourceSans3-Bold.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-25 16:30:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/SourceSans3-Medium.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-25 16:30:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/SourceSans3-Regular.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-25 16:30:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/SourceSans3-SemiBold.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-25 16:30:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/styles-ETA5EMQJ.css> (resource type: stylesheet, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-25 16:30:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-R5GGQAWE.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-25 16:30:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-YI6GGZZZ.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-25 16:30:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-NAGGRITV.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-25 16:30:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-BBQ7R2BV.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-25 16:30:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-HPL7GXW6.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-25 16:30:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-ADG3G2OJ.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-25 16:30:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-7JYRLYWD.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-25 16:30:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-2S63FZXS.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-25 16:30:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-K7GQAXGO.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-25 16:30:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-PMQRMPGY.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-25 16:30:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/polyfills-FFHMD2TL.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-25 16:30:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/main-NKPAFEH2.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-25 16:30:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/Chillax-Regular-IWU2LEHA.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-25 16:30:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/Chillax-Medium-NIVAGDSI.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-25 16:30:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/Chillax-Semibold-YNVWM5XA.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-25 16:30:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/logo-ayvens-carmarket.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-25 16:30:14 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/logo-ayvens-carmarket.svg>
2026-03-25 16:30:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/flags/round-gb.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-25 16:30:14 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/flags/round-gb.svg>
2026-03-25 16:30:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/line.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-25 16:30:14 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/line.svg>
2026-03-25 16:30:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/chevron-down.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-25 16:30:14 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/chevron-down.svg>
2026-03-25 16:30:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/loader.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-25 16:30:14 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/loader.svg>
2026-03-25 16:30:14 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/Chillax-Medium.woff2>
2026-03-25 16:30:14 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/Chillax-Regular.woff2>
2026-03-25 16:30:14 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/SourceSans3-Bold.woff2>
2026-03-25 16:30:14 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/Chillax-Semibold.woff2>
2026-03-25 16:30:14 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/SourceSans3-Medium.woff2>
2026-03-25 16:30:14 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/SourceSans3-Regular.woff2>
2026-03-25 16:30:14 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/SourceSans3-SemiBold.woff2>
2026-03-25 16:30:14 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-R5GGQAWE.js>
2026-03-25 16:30:14 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/styles-ETA5EMQJ.css>
2026-03-25 16:30:14 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-YI6GGZZZ.js>
2026-03-25 16:30:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-NAGGRITV.js>
2026-03-25 16:30:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-ADG3G2OJ.js>
2026-03-25 16:30:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-BBQ7R2BV.js>
2026-03-25 16:30:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-HPL7GXW6.js>
2026-03-25 16:30:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-2S63FZXS.js>
2026-03-25 16:30:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-7JYRLYWD.js>
2026-03-25 16:30:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-K7GQAXGO.js>
2026-03-25 16:30:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-PMQRMPGY.js>
2026-03-25 16:30:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/polyfills-FFHMD2TL.js>
2026-03-25 16:30:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-QV3UPEBS.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-R5GGQAWE.js)
2026-03-25 16:30:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-AQBI4CYB.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-R5GGQAWE.js)
2026-03-25 16:30:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-EIXBRKXP.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-R5GGQAWE.js)
2026-03-25 16:30:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-5567JMUS.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-R5GGQAWE.js)
2026-03-25 16:30:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-4CLCTAJ7.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-YI6GGZZZ.js)
2026-03-25 16:30:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/Chillax-Regular-IWU2LEHA.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/styles-ETA5EMQJ.css)
2026-03-25 16:30:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/Chillax-Medium-NIVAGDSI.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/styles-ETA5EMQJ.css)
2026-03-25 16:30:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/SourceSans3-Bold-OH3V3LEB.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/styles-ETA5EMQJ.css)
2026-03-25 16:30:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/SourceSans3-Regular-VMJBJIXS.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/styles-ETA5EMQJ.css)
2026-03-25 16:30:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/Chillax-Semibold-YNVWM5XA.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/styles-ETA5EMQJ.css)
2026-03-25 16:30:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/SourceSans3-SemiBold-NPKTOIJ5.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/styles-ETA5EMQJ.css)
2026-03-25 16:30:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-QZ2M64VL.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-BBQ7R2BV.js)
2026-03-25 16:30:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-HQZHDCQG.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-BBQ7R2BV.js)
2026-03-25 16:30:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-CQOH37XC.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-7JYRLYWD.js)
2026-03-25 16:30:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-SALCXTDR.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-K7GQAXGO.js)
2026-03-25 16:30:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-EVZDJ3YH.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-HPL7GXW6.js)
2026-03-25 16:30:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-2BYH6G4C.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-HPL7GXW6.js)
2026-03-25 16:30:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-AHM2LY2L.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-HPL7GXW6.js)
2026-03-25 16:30:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-VGUEXTON.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-HPL7GXW6.js)
2026-03-25 16:30:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-SUQC6PCL.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-HPL7GXW6.js)
2026-03-25 16:30:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-7DYAUIPQ.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-HPL7GXW6.js)
2026-03-25 16:30:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-6BXXUPPN.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-HPL7GXW6.js)
2026-03-25 16:30:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/Chillax-Semibold-YNVWM5XA.woff2>
2026-03-25 16:30:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/Chillax-Regular-IWU2LEHA.woff2>
2026-03-25 16:30:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/Chillax-Medium-NIVAGDSI.woff2>
2026-03-25 16:30:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/main-NKPAFEH2.js>
2026-03-25 16:30:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-OF6JT4KC.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-25 16:30:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-Y6LYHJ33.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-25 16:30:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-ELPOVYM7.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-25 16:30:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-VBU7AOHF.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-25 16:30:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-SPE4D2IX.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-25 16:30:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-N2FZW7V7.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-25 16:30:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-VPLHK2CL.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-25 16:30:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-AVZZH6AV.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-25 16:30:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-KLKMSQPH.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-25 16:30:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-2FANG3NP.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-25 16:30:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-ABBXN5WQ.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-25 16:30:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-NPJHDJ36.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-25 16:30:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-MLMYZRAG.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-25 16:30:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-5D4JF6DX.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-25 16:30:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-7IEPAGTW.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-25 16:30:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-ZYL3EWWF.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-25 16:30:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-WWYAPULQ.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-25 16:30:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-XXARMH2T.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-25 16:30:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-AYT4KML6.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-25 16:30:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-CX65R3QQ.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-25 16:30:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-XGLUMAK5.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-25 16:30:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-EHSUL3RU.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-25 16:30:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-7UDVUMWJ.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-25 16:30:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-WRLSZEDX.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-25 16:30:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-XCHSKDZH.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-25 16:30:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-QV3UPEBS.js>
2026-03-25 16:30:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-EIXBRKXP.js>
2026-03-25 16:30:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-AQBI4CYB.js>
2026-03-25 16:30:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-5567JMUS.js>
2026-03-25 16:30:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-4CLCTAJ7.js>
2026-03-25 16:30:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/Chillax-Regular-IWU2LEHA.woff2>
2026-03-25 16:30:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/Chillax-Medium-NIVAGDSI.woff2>
2026-03-25 16:30:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/SourceSans3-Bold-OH3V3LEB.woff2>
2026-03-25 16:30:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/SourceSans3-Regular-VMJBJIXS.woff2>
2026-03-25 16:30:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/Chillax-Semibold-YNVWM5XA.woff2>
2026-03-25 16:30:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/SourceSans3-SemiBold-NPKTOIJ5.woff2>
2026-03-25 16:30:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-QZ2M64VL.js>
2026-03-25 16:30:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-HQZHDCQG.js>
2026-03-25 16:30:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-SALCXTDR.js>
2026-03-25 16:30:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-CQOH37XC.js>
2026-03-25 16:30:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-EVZDJ3YH.js>
2026-03-25 16:30:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-2BYH6G4C.js>
2026-03-25 16:30:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-AHM2LY2L.js>
2026-03-25 16:30:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-VGUEXTON.js>
2026-03-25 16:30:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-SUQC6PCL.js>
2026-03-25 16:30:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-7DYAUIPQ.js>
2026-03-25 16:30:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-6BXXUPPN.js>
2026-03-25 16:30:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-Y6LYHJ33.js>
2026-03-25 16:30:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-OF6JT4KC.js>
2026-03-25 16:30:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-ELPOVYM7.js>
2026-03-25 16:30:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-VBU7AOHF.js>
2026-03-25 16:30:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-SPE4D2IX.js>
2026-03-25 16:30:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-N2FZW7V7.js>
2026-03-25 16:30:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-VPLHK2CL.js>
2026-03-25 16:30:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-AVZZH6AV.js>
2026-03-25 16:30:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-2FANG3NP.js>
2026-03-25 16:30:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-KLKMSQPH.js>
2026-03-25 16:30:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-NPJHDJ36.js>
2026-03-25 16:30:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-ABBXN5WQ.js>
2026-03-25 16:30:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-MLMYZRAG.js>
2026-03-25 16:30:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-5D4JF6DX.js>
2026-03-25 16:30:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-7IEPAGTW.js>
2026-03-25 16:30:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-ZYL3EWWF.js>
2026-03-25 16:30:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-WWYAPULQ.js>
2026-03-25 16:30:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-XXARMH2T.js>
2026-03-25 16:30:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-AYT4KML6.js>
2026-03-25 16:30:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-CX65R3QQ.js>
2026-03-25 16:30:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-XGLUMAK5.js>
2026-03-25 16:30:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-EHSUL3RU.js>
2026-03-25 16:30:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-7UDVUMWJ.js>
2026-03-25 16:30:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-WRLSZEDX.js>
2026-03-25 16:30:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-XCHSKDZH.js>
2026-03-25 16:30:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://js.monitor.azure.com/scripts/b/ai.config.1.cfg.json> (resource type: fetch, referrer: https://carmarket.ayvens.com/)
2026-03-25 16:30:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-U3DCL5KE.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-25 16:30:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-7HVTDVUE.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-25 16:30:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/favicon/ayvens-white-bg_192x192.png> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-25 16:30:17 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/favicon/ayvens-white-bg_192x192.png>
2026-03-25 16:30:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/favicon/ayvens.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-25 16:30:17 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/favicon/ayvens.svg>
2026-03-25 16:30:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-U3DCL5KE.js>
2026-03-25 16:30:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-7HVTDVUE.js>
2026-03-25 16:30:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-VPZ5PCFV.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-7HVTDVUE.js)
2026-03-25 16:30:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-VPZ5PCFV.js>
2026-03-25 16:30:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-R57BLUBZ.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-VPZ5PCFV.js)
2026-03-25 16:30:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-R57BLUBZ.js>
2026-03-25 16:30:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-XI7MA6UU.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-25 16:30:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-253AOQV4.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-25 16:30:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-Y26P6NOT.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-VPZ5PCFV.js)
2026-03-25 16:30:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-XI7MA6UU.js>
2026-03-25 16:30:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-E2QM5VHP.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-XI7MA6UU.js)
2026-03-25 16:30:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-QVU7EFJH.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-XI7MA6UU.js)
2026-03-25 16:30:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-CJQ6ZMFR.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-XI7MA6UU.js)
2026-03-25 16:30:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-253AOQV4.js>
2026-03-25 16:30:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-Y26P6NOT.js>
2026-03-25 16:30:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://js.monitor.azure.com/scripts/b/ai.config.1.cfg.json>
2026-03-25 16:30:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-PU5AH4GE.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-Y26P6NOT.js)
2026-03-25 16:30:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-6AWK7DQQ.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-Y26P6NOT.js)
2026-03-25 16:30:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-JMKQRIJX.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-Y26P6NOT.js)
2026-03-25 16:30:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-OXIZJZO4.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-Y26P6NOT.js)
2026-03-25 16:30:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-H7VMIGZK.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-Y26P6NOT.js)
2026-03-25 16:30:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-E2QM5VHP.js>
2026-03-25 16:30:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-QVU7EFJH.js>
2026-03-25 16:30:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-CJQ6ZMFR.js>
2026-03-25 16:30:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-PU5AH4GE.js>
2026-03-25 16:30:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-6AWK7DQQ.js>
2026-03-25 16:30:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-JMKQRIJX.js>
2026-03-25 16:30:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-H7VMIGZK.js>
2026-03-25 16:30:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-OXIZJZO4.js>
2026-03-25 16:30:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/loader.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-25 16:30:18 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/loader.svg>
2026-03-25 16:30:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/flags/round-gb.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-25 16:30:19 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/flags/round-gb.svg>
2026-03-25 16:30:19 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/line.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-25 16:30:19 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/chevron-down.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-25 16:30:19 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/line.svg>
2026-03-25 16:30:19 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/chevron-down.svg>
2026-03-25 16:30:19 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/logo-ayvens-carmarket.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-25 16:30:19 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/logo-ayvens-carmarket.svg>
2026-03-25 16:30:19 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://dc.services.visualstudio.com/v2/track> (resource type: xhr, referrer: https://carmarket.ayvens.com/)
2026-03-25 16:30:19 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-BQLC5RJD.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-Y26P6NOT.js)
2026-03-25 16:30:19 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-HGLYMGTS.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-PU5AH4GE.js)
2026-03-25 16:30:19 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-VNA57F7Z.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-253AOQV4.js)
2026-03-25 16:30:19 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-EXKYPD3J.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-253AOQV4.js)
2026-03-25 16:30:19 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://dc.services.visualstudio.com/v2/track> (resource type: xhr, referrer: https://carmarket.ayvens.com/)
2026-03-25 16:30:19 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-BQLC5RJD.js>
2026-03-25 16:30:19 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-HGLYMGTS.js>
2026-03-25 16:30:19 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-VNA57F7Z.js>
2026-03-25 16:30:19 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://dc.services.visualstudio.com/v2/track> (resource type: xhr, referrer: https://carmarket.ayvens.com/)
2026-03-25 16:30:19 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/down.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-25 16:30:19 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/down.svg>
2026-03-25 16:30:19 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-AZBPSD4I.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-HGLYMGTS.js)
2026-03-25 16:30:19 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-2NCM5KDW.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-HGLYMGTS.js)
2026-03-25 16:30:19 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/bell.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-25 16:30:19 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/bell.svg>
2026-03-25 16:30:19 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-EXKYPD3J.js>
2026-03-25 16:30:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://carmarket.ayvens.com/en-gb/lots> (referer: None) ['playwright']
2026-03-25 16:30:19 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/next-breadcrumb.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-25 16:30:19 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/next-breadcrumb.svg>
2026-03-25 16:30:19 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-BK6NFD4R.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-25 16:30:19 [ayvens.it] INFO: Cookies from Playwright: [{'name': 'ai_user', 'value': 'Js4AxFMtfumD/JSQox2tOU|2026-03-25T16:30:16.981Z', 'domain': 'carmarket.ayvens.com', 'path': '/', 'expires': 1805992216, 'httpOnly': False, 'secure': True, 'sameSite': 'None'}, {'name': 'user_culture', 'value': 'en-gb', 'domain': 'carmarket.ayvens.com', 'path': '/', 'expires': -1, 'httpOnly': False, 'secure': False, 'sameSite': 'None'}, {'name': 'ai_session', 'value': 'bN/xDRS0Yl/0tHJeJiYgfp|1774456218783|1774456218783', 'domain': 'carmarket.ayvens.com', 'path': '/', 'expires': 1774458018, 'httpOnly': False, 'secure': True, 'sameSite': 'None'}]
2026-03-25 16:30:19 [ayvens.it] INFO: Scrapy-formatted cookies: [{'name': 'ai_user', 'value': 'Js4AxFMtfumD/JSQox2tOU|2026-03-25T16:30:16.981Z', 'domain': 'carmarket.ayvens.com', 'path': '/'}, {'name': 'user_culture', 'value': 'en-gb', 'domain': 'carmarket.ayvens.com', 'path': '/'}, {'name': 'ai_session', 'value': 'bN/xDRS0Yl/0tHJeJiYgfp|1774456218783|1774456218783', 'domain': 'carmarket.ayvens.com', 'path': '/'}]
2026-03-25 16:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /SpiderData(PartitionKey='Ayvens',RowKey='cookies') HTTP/1.1" 204 0
2026-03-25 16:30:19 [ayvens.it] INFO: Intercepting token...
2026-03-25 16:30:19 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-AZBPSD4I.js>
2026-03-25 16:30:19 [ayvens.it] INFO: Scrolling element to trigger lazy load...
2026-03-25 16:30:20 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-2NCM5KDW.js>
2026-03-25 16:30:20 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://dc.services.visualstudio.com/v2/track>
2026-03-25 16:30:20 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/camera-icon.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-25 16:30:20 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/flags/be.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-25 16:30:20 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/flags/se.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-25 16:30:20 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-75KGV5DF.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-OXIZJZO4.js)
2026-03-25 16:30:20 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://dc.services.visualstudio.com/v2/track>
2026-03-25 16:30:20 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-BK6NFD4R.js>
2026-03-25 16:30:20 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/images/camera-icon.svg>
2026-03-25 16:30:20 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/images/flags/be.svg>
2026-03-25 16:30:20 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/images/flags/se.svg>
2026-03-25 16:30:20 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/down.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-25 16:30:20 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-VUZVFPNF.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-25 16:30:20 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-75KGV5DF.js>
2026-03-25 16:30:20 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/images/down.svg>
2026-03-25 16:30:20 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/logo-ayvens.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-25 16:30:20 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-fr.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-25 16:30:20 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-es.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-25 16:30:20 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-be.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-25 16:30:20 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-de.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-25 16:30:20 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-it.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-25 16:30:20 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/flags/fr.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-25 16:30:20 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://medias-carmarket.ayvens.com/lots/ald/2ad/86dee3bbbcd349019d792f32e45a7bc3/images/medium/0.jpg> (resource type: image, referrer: https://carmarket.ayvens.com/)
2026-03-25 16:30:20 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://medias-carmarket.ayvens.com/lots/ald/fy-/332b2dd03d2544dfaa16aa4b4c8d3915/images/medium/0.jpg> (resource type: image, referrer: https://carmarket.ayvens.com/)
2026-03-25 16:30:20 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/chevron-down.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-25 16:30:20 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-VUZVFPNF.js>
2026-03-25 16:30:20 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-FX6676C7.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-VUZVFPNF.js)
2026-03-25 16:30:20 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/images/logo-ayvens.svg>
2026-03-25 16:30:20 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://dc.services.visualstudio.com/v2/track>
2026-03-25 16:30:20 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/images/flags/fr.svg>
2026-03-25 16:30:20 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/images/chevron-down.svg>
2026-03-25 16:30:20 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-be.svg>
2026-03-25 16:30:20 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-es.svg>
2026-03-25 16:30:21 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-FX6676C7.js>
2026-03-25 16:30:21 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-it.svg>
2026-03-25 16:30:21 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-fr.svg>
2026-03-25 16:30:21 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-de.svg>
2026-03-25 16:30:21 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://cdn.cookielaw.org/scripttemplates/otSDKStub.js> (resource type: script, referrer: https://carmarket.ayvens.com/)
2026-03-25 16:30:21 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://medias-carmarket.ayvens.com/lots/ald/fy-/332b2dd03d2544dfaa16aa4b4c8d3915/images/medium/0.jpg>
2026-03-25 16:30:21 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://cdn.cookielaw.org/scripttemplates/otSDKStub.js>
2026-03-25 16:30:21 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://cdn.cookielaw.org/consent/019908df-58e4-7710-aaa7-4d6e79279bd9/019908df-58e4-7710-aaa7-4d6e79279bd9.json> (resource type: xhr, referrer: https://carmarket.ayvens.com/)
2026-03-25 16:30:21 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://medias-carmarket.ayvens.com/lots/ald/2ad/86dee3bbbcd349019d792f32e45a7bc3/images/medium/0.jpg>
2026-03-25 16:30:21 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://cdn.cookielaw.org/consent/019908df-58e4-7710-aaa7-4d6e79279bd9/019908df-58e4-7710-aaa7-4d6e79279bd9.json>
2026-03-25 16:30:21 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://cdn.cookielaw.org/scripttemplates/202601.1.0/otBannerSdk.js> (resource type: script, referrer: https://carmarket.ayvens.com/)
2026-03-25 16:30:21 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://cdn.cookielaw.org/scripttemplates/202601.1.0/otBannerSdk.js>
2026-03-25 16:30:22 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://cdn.cookielaw.org/consent/019908df-58e4-7710-aaa7-4d6e79279bd9/019b4fc7-396b-7b6c-9b76-7b67f1d26cca/en.json> (resource type: fetch, referrer: https://carmarket.ayvens.com/)
2026-03-25 16:30:22 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://cdn.cookielaw.org/consent/019908df-58e4-7710-aaa7-4d6e79279bd9/019b4fc7-396b-7b6c-9b76-7b67f1d26cca/en.json>
2026-03-25 16:30:22 [ayvens.it] INFO: GraphQL headers: {'host': 'api-carmarket.ayvens.com', 'user-agent': 'Mozilla/5.0 (X11; Linux x86_64; rv:125.0) Gecko/20100101 Firefox/125.0', 'accept': 'application/json, text/plain, */*', 'accept-language': 'en-US,en;q=0.5', 'accept-encoding': 'gzip, deflate, br', 'content-type': 'application/json', 'content-length': '839', 'referer': 'https://carmarket.ayvens.com/', 'x-ald-subscription-key': '3b2cc62fd26c4e29a762db3de181266b', 'x-tenant': 'ald', 'x-country': 'gb', 'origin': 'https://carmarket.ayvens.com', 'sec-fetch-dest': 'empty', 'sec-fetch-mode': 'cors', 'sec-fetch-site': 'same-site', 'proxy-authorization': 'Basic Y3VzdG9tZXItaW5maW5pdF9zb3VyY2luZ192Ml9XQjdOUi1jYy1HQjozY35+YWdLUmM2MlZaQUw=', 'connection': 'keep-alive'}
2026-03-25 16:30:22 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://api-carmarket.ayvens.com/graphql/saleevents> (resource type: xhr, referrer: https://carmarket.ayvens.com/)
2026-03-25 16:30:22 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://cdn.cookielaw.org/scripttemplates/202601.1.0/assets/otCenterRounded.json> (resource type: fetch, referrer: https://carmarket.ayvens.com/)
2026-03-25 16:30:22 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://cdn.cookielaw.org/scripttemplates/202601.1.0/assets/v2/otPcTab.json> (resource type: fetch, referrer: https://carmarket.ayvens.com/)
2026-03-25 16:30:22 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://cdn.cookielaw.org/scripttemplates/202601.1.0/assets/otCommonStyles.css> (resource type: fetch, referrer: https://carmarket.ayvens.com/)
2026-03-25 16:30:22 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://cdn.cookielaw.org/scripttemplates/202601.1.0/assets/otCenterRounded.json>
2026-03-25 16:30:22 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://cdn.cookielaw.org/scripttemplates/202601.1.0/assets/v2/otPcTab.json>
2026-03-25 16:30:22 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://cdn.cookielaw.org/scripttemplates/202601.1.0/assets/otCommonStyles.css>
2026-03-25 16:30:22 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://cdn.cookielaw.org/logos/14efa178-aa53-42e6-9a86-5229303798da/019908c4-f46e-7d64-b942-26aa1fec3635/2ab431a1-8f8c-4a55-9e1a-e5de23079c22/ayvens-logo.png> (resource type: image, referrer: https://carmarket.ayvens.com/)
2026-03-25 16:30:22 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://cdn.cookielaw.org/logos/static/powered_by_logo.svg> (resource type: image, referrer: https://carmarket.ayvens.com/)
2026-03-25 16:30:22 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://cdn.cookielaw.org/logos/static/ot_guard_logo.svg> (resource type: fetch, referrer: https://carmarket.ayvens.com/)
2026-03-25 16:30:22 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.googletagmanager.com/gtm.js?id=GTM-W3J7744> (resource type: script, referrer: https://carmarket.ayvens.com/)
2026-03-25 16:30:22 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://cdn.cookielaw.org/logos/14efa178-aa53-42e6-9a86-5229303798da/019908c4-f46e-7d64-b942-26aa1fec3635/2ab431a1-8f8c-4a55-9e1a-e5de23079c22/ayvens-logo.png>
2026-03-25 16:30:22 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://cdn.cookielaw.org/logos/static/ot_guard_logo.svg>
2026-03-25 16:30:22 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://cdn.cookielaw.org/logos/static/powered_by_logo.svg>
2026-03-25 16:30:23 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.googletagmanager.com/gtm.js?id=GTM-W3J7744>
2026-03-25 16:30:24 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.googletagmanager.com/gtag/destination?id=DC-4340043&cx=c>m=4e63n1> (resource type: script, referrer: https://carmarket.ayvens.com/)
2026-03-25 16:30:24 [ayvens.it] INFO: ✅ Intercepted token: 3b2cc62fd26c4e29a762db3de181266b
2026-03-25 16:30:24 [ayvens.it] INFO: Fetching listings with token: 3b2cc62fd26c4e29a762db3de181266b and skip: 0
2026-03-25 16:30:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-25 16:30:24 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.googletagmanager.com/gtag/destination?id=G-2R31MHSGCW&cx=c>m=4e63n1> (resource type: script)
2026-03-25 16:30:26 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.aldcarmarket.com/graphql/saleevents> (referer: https://carmarket.ayvens.com/) ['zyte-api']
2026-03-25 16:30:26 [ayvens.it] INFO: Found listing with ID: 1983501
2026-03-25 16:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983501%27 HTTP/1.1" 200 None
2026-03-25 16:30:26 [ayvens.it] INFO: Scrape type for 1983501: 1
2026-03-25 16:30:26 [ayvens.it] INFO: Extracting data for car ID: 1983501
2026-03-25 16:30:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ea488737-3fa1-5455-b703-5232c1c66c04 with identifier: 1983501
2026-03-25 16:30:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ea488737-3fa1-5455-b703-5232c1c66c04 with scrape type 1
2026-03-25 16:30:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ea488737-3fa1-5455-b703-5232c1c66c04
2026-03-25 16:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf2%252Fbf0eec58c6044b43ad801f754ee2ed8b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf2/bf0eec58c6044b43ad801f754ee2ed8b/images/large/1.jpg not downloaded yet
2026-03-25 16:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf2%252Fbf0eec58c6044b43ad801f754ee2ed8b%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf2/bf0eec58c6044b43ad801f754ee2ed8b/images/large/2.jpg not downloaded yet
2026-03-25 16:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf2%252Fbf0eec58c6044b43ad801f754ee2ed8b%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf2/bf0eec58c6044b43ad801f754ee2ed8b/images/large/3.jpg not downloaded yet
2026-03-25 16:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf2%252Fbf0eec58c6044b43ad801f754ee2ed8b%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf2/bf0eec58c6044b43ad801f754ee2ed8b/images/large/4.jpg not downloaded yet
2026-03-25 16:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf2%252Fbf0eec58c6044b43ad801f754ee2ed8b%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf2/bf0eec58c6044b43ad801f754ee2ed8b/images/large/5.jpg not downloaded yet
2026-03-25 16:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf2%252Fbf0eec58c6044b43ad801f754ee2ed8b%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf2/bf0eec58c6044b43ad801f754ee2ed8b/images/large/6.jpg not downloaded yet
2026-03-25 16:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf2%252Fbf0eec58c6044b43ad801f754ee2ed8b%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf2/bf0eec58c6044b43ad801f754ee2ed8b/images/large/7.jpg not downloaded yet
2026-03-25 16:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf2%252Fbf0eec58c6044b43ad801f754ee2ed8b%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf2/bf0eec58c6044b43ad801f754ee2ed8b/images/large/8.jpg not downloaded yet
2026-03-25 16:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf2%252Fbf0eec58c6044b43ad801f754ee2ed8b%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf2/bf0eec58c6044b43ad801f754ee2ed8b/images/large/9.jpg not downloaded yet
2026-03-25 16:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf2%252Fbf0eec58c6044b43ad801f754ee2ed8b%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf2/bf0eec58c6044b43ad801f754ee2ed8b/images/large/10.jpg not downloaded yet
2026-03-25 16:30:26 [ayvens.it] INFO: Found listing with ID: 1983502
2026-03-25 16:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983502%27 HTTP/1.1" 200 None
2026-03-25 16:30:26 [ayvens.it] INFO: Scrape type for 1983502: 1
2026-03-25 16:30:26 [ayvens.it] INFO: Extracting data for car ID: 1983502
2026-03-25 16:30:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b5f6ec2f-600d-5ef5-bb06-514534a30b59 with identifier: 1983502
2026-03-25 16:30:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b5f6ec2f-600d-5ef5-bb06-514534a30b59 with scrape type 1
2026-03-25 16:30:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b5f6ec2f-600d-5ef5-bb06-514534a30b59
2026-03-25 16:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft3%252F9b8e5509bc6a4834b2cacd5bdbe5132c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft3/9b8e5509bc6a4834b2cacd5bdbe5132c/images/large/1.jpg not downloaded yet
2026-03-25 16:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft3%252F9b8e5509bc6a4834b2cacd5bdbe5132c%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft3/9b8e5509bc6a4834b2cacd5bdbe5132c/images/large/2.jpg not downloaded yet
2026-03-25 16:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft3%252F9b8e5509bc6a4834b2cacd5bdbe5132c%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft3/9b8e5509bc6a4834b2cacd5bdbe5132c/images/large/3.jpg not downloaded yet
2026-03-25 16:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft3%252F9b8e5509bc6a4834b2cacd5bdbe5132c%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft3/9b8e5509bc6a4834b2cacd5bdbe5132c/images/large/4.jpg not downloaded yet
2026-03-25 16:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft3%252F9b8e5509bc6a4834b2cacd5bdbe5132c%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft3/9b8e5509bc6a4834b2cacd5bdbe5132c/images/large/5.jpg not downloaded yet
2026-03-25 16:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft3%252F9b8e5509bc6a4834b2cacd5bdbe5132c%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft3/9b8e5509bc6a4834b2cacd5bdbe5132c/images/large/6.jpg not downloaded yet
2026-03-25 16:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft3%252F9b8e5509bc6a4834b2cacd5bdbe5132c%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft3/9b8e5509bc6a4834b2cacd5bdbe5132c/images/large/7.jpg not downloaded yet
2026-03-25 16:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft3%252F9b8e5509bc6a4834b2cacd5bdbe5132c%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft3/9b8e5509bc6a4834b2cacd5bdbe5132c/images/large/8.jpg not downloaded yet
2026-03-25 16:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft3%252F9b8e5509bc6a4834b2cacd5bdbe5132c%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft3/9b8e5509bc6a4834b2cacd5bdbe5132c/images/large/9.jpg not downloaded yet
2026-03-25 16:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft3%252F9b8e5509bc6a4834b2cacd5bdbe5132c%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft3/9b8e5509bc6a4834b2cacd5bdbe5132c/images/large/10.jpg not downloaded yet
2026-03-25 16:30:27 [ayvens.it] INFO: Found listing with ID: 1983503
2026-03-25 16:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983503%27 HTTP/1.1" 200 None
2026-03-25 16:30:27 [ayvens.it] INFO: Scrape type for 1983503: 1
2026-03-25 16:30:27 [ayvens.it] INFO: Extracting data for car ID: 1983503
2026-03-25 16:30:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ae0e12b4-28af-5149-a440-3211217d2397 with identifier: 1983503
2026-03-25 16:30:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ae0e12b4-28af-5149-a440-3211217d2397 with scrape type 1
2026-03-25 16:30:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ae0e12b4-28af-5149-a440-3211217d2397
2026-03-25 16:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl2%252Ffb7565b99e9244cc8ec74937258f687e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl2/fb7565b99e9244cc8ec74937258f687e/images/large/1.jpg not downloaded yet
2026-03-25 16:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl2%252Ffb7565b99e9244cc8ec74937258f687e%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl2/fb7565b99e9244cc8ec74937258f687e/images/large/2.jpg not downloaded yet
2026-03-25 16:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl2%252Ffb7565b99e9244cc8ec74937258f687e%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl2/fb7565b99e9244cc8ec74937258f687e/images/large/3.jpg not downloaded yet
2026-03-25 16:30:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf2/bf0eec58c6044b43ad801f754ee2ed8b/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl2%252Ffb7565b99e9244cc8ec74937258f687e%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl2/fb7565b99e9244cc8ec74937258f687e/images/large/4.jpg not downloaded yet
2026-03-25 16:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl2%252Ffb7565b99e9244cc8ec74937258f687e%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl2/fb7565b99e9244cc8ec74937258f687e/images/large/5.jpg not downloaded yet
2026-03-25 16:30:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf2/bf0eec58c6044b43ad801f754ee2ed8b/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl2%252Ffb7565b99e9244cc8ec74937258f687e%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl2/fb7565b99e9244cc8ec74937258f687e/images/large/6.jpg not downloaded yet
2026-03-25 16:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl2%252Ffb7565b99e9244cc8ec74937258f687e%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl2/fb7565b99e9244cc8ec74937258f687e/images/large/7.jpg not downloaded yet
2026-03-25 16:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl2%252Ffb7565b99e9244cc8ec74937258f687e%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl2/fb7565b99e9244cc8ec74937258f687e/images/large/8.jpg not downloaded yet
2026-03-25 16:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl2%252Ffb7565b99e9244cc8ec74937258f687e%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl2/fb7565b99e9244cc8ec74937258f687e/images/large/9.jpg not downloaded yet
2026-03-25 16:30:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-03-25 16:30:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-03-25 16:30:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:30:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34d6b351d0>
2026-03-25 16:30:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:30:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-25 16:30:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2118
2026-03-25 16:30:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-03-25 16:30:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:30:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:30:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea488737-3fa1-5455-b703-5232c1c66c04/ea488737-3fa1-5455-b703-5232c1c66c04_image_2.jpg HTTP/1.1" 201 0
2026-03-25 16:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf2%252Fbf0eec58c6044b43ad801f754ee2ed8b%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 16:30:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf2/bf0eec58c6044b43ad801f754ee2ed8b/images/large/3.jpg saved to cache
2026-03-25 16:30:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ea488737-3fa1-5455-b703-5232c1c66c04
2026-03-25 16:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl2%252Ffb7565b99e9244cc8ec74937258f687e%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl2/fb7565b99e9244cc8ec74937258f687e/images/large/10.jpg not downloaded yet
2026-03-25 16:30:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf2/bf0eec58c6044b43ad801f754ee2ed8b/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf2/bf0eec58c6044b43ad801f754ee2ed8b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf2/bf0eec58c6044b43ad801f754ee2ed8b/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:27 [ayvens.it] INFO: Found listing with ID: 1983504
2026-03-25 16:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983504%27 HTTP/1.1" 200 None
2026-03-25 16:30:27 [ayvens.it] INFO: Scrape type for 1983504: 1
2026-03-25 16:30:27 [ayvens.it] INFO: Extracting data for car ID: 1983504
2026-03-25 16:30:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bdee08a9-57f6-5a9b-b706-c284e31883e1 with identifier: 1983504
2026-03-25 16:30:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bdee08a9-57f6-5a9b-b706-c284e31883e1 with scrape type 1
2026-03-25 16:30:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item bdee08a9-57f6-5a9b-b706-c284e31883e1
2026-03-25 16:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk4%252F95c036c998b44865ac295d4872553ed1%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk4/95c036c998b44865ac295d4872553ed1/images/large/1.jpg not downloaded yet
2026-03-25 16:30:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf2/bf0eec58c6044b43ad801f754ee2ed8b/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk4%252F95c036c998b44865ac295d4872553ed1%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk4/95c036c998b44865ac295d4872553ed1/images/large/2.jpg not downloaded yet
2026-03-25 16:30:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:30:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34d6b48d10>
2026-03-25 16:30:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:30:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:30:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:30:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea488737-3fa1-5455-b703-5232c1c66c04/ea488737-3fa1-5455-b703-5232c1c66c04_image_4.jpg HTTP/1.1" 201 0
2026-03-25 16:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf2%252Fbf0eec58c6044b43ad801f754ee2ed8b%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 16:30:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf2/bf0eec58c6044b43ad801f754ee2ed8b/images/large/5.jpg saved to cache
2026-03-25 16:30:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ea488737-3fa1-5455-b703-5232c1c66c04
2026-03-25 16:30:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf2/bf0eec58c6044b43ad801f754ee2ed8b/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk4%252F95c036c998b44865ac295d4872553ed1%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk4/95c036c998b44865ac295d4872553ed1/images/large/3.jpg not downloaded yet
2026-03-25 16:30:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf2/bf0eec58c6044b43ad801f754ee2ed8b/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf2/bf0eec58c6044b43ad801f754ee2ed8b/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk4%252F95c036c998b44865ac295d4872553ed1%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk4/95c036c998b44865ac295d4872553ed1/images/large/4.jpg not downloaded yet
2026-03-25 16:30:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:30:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34d6b58350>
2026-03-25 16:30:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:30:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:30:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:30:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea488737-3fa1-5455-b703-5232c1c66c04/ea488737-3fa1-5455-b703-5232c1c66c04_image_7.jpg HTTP/1.1" 201 0
2026-03-25 16:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf2%252Fbf0eec58c6044b43ad801f754ee2ed8b%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 16:30:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf2/bf0eec58c6044b43ad801f754ee2ed8b/images/large/8.jpg saved to cache
2026-03-25 16:30:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ea488737-3fa1-5455-b703-5232c1c66c04
2026-03-25 16:30:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:30:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc96bd50>
2026-03-25 16:30:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:30:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:30:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:30:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea488737-3fa1-5455-b703-5232c1c66c04/ea488737-3fa1-5455-b703-5232c1c66c04_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf2%252Fbf0eec58c6044b43ad801f754ee2ed8b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 16:30:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf2/bf0eec58c6044b43ad801f754ee2ed8b/images/large/1.jpg saved to cache
2026-03-25 16:30:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ea488737-3fa1-5455-b703-5232c1c66c04
2026-03-25 16:30:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:30:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc87b050>
2026-03-25 16:30:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:30:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:30:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:30:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea488737-3fa1-5455-b703-5232c1c66c04/ea488737-3fa1-5455-b703-5232c1c66c04_image_1.jpg HTTP/1.1" 201 0
2026-03-25 16:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf2%252Fbf0eec58c6044b43ad801f754ee2ed8b%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 16:30:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf2/bf0eec58c6044b43ad801f754ee2ed8b/images/large/2.jpg saved to cache
2026-03-25 16:30:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ea488737-3fa1-5455-b703-5232c1c66c04
2026-03-25 16:30:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:30:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc96bcd0>
2026-03-25 16:30:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:30:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:30:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:30:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea488737-3fa1-5455-b703-5232c1c66c04/ea488737-3fa1-5455-b703-5232c1c66c04_image_6.jpg HTTP/1.1" 201 0
2026-03-25 16:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf2%252Fbf0eec58c6044b43ad801f754ee2ed8b%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 16:30:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf2/bf0eec58c6044b43ad801f754ee2ed8b/images/large/7.jpg saved to cache
2026-03-25 16:30:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ea488737-3fa1-5455-b703-5232c1c66c04
2026-03-25 16:30:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf2/bf0eec58c6044b43ad801f754ee2ed8b/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk4%252F95c036c998b44865ac295d4872553ed1%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk4/95c036c998b44865ac295d4872553ed1/images/large/5.jpg not downloaded yet
2026-03-25 16:30:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:30:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc38d950>
2026-03-25 16:30:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:30:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:30:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:30:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea488737-3fa1-5455-b703-5232c1c66c04/ea488737-3fa1-5455-b703-5232c1c66c04_image_9.jpg HTTP/1.1" 201 0
2026-03-25 16:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf2%252Fbf0eec58c6044b43ad801f754ee2ed8b%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 16:30:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf2/bf0eec58c6044b43ad801f754ee2ed8b/images/large/10.jpg saved to cache
2026-03-25 16:30:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ea488737-3fa1-5455-b703-5232c1c66c04
2026-03-25 16:30:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:30:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc5892d0>
2026-03-25 16:30:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:30:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:30:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:30:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea488737-3fa1-5455-b703-5232c1c66c04/ea488737-3fa1-5455-b703-5232c1c66c04_image_3.jpg HTTP/1.1" 201 0
2026-03-25 16:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf2%252Fbf0eec58c6044b43ad801f754ee2ed8b%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 16:30:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf2/bf0eec58c6044b43ad801f754ee2ed8b/images/large/4.jpg saved to cache
2026-03-25 16:30:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ea488737-3fa1-5455-b703-5232c1c66c04
2026-03-25 16:30:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:30:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc5bd250>
2026-03-25 16:30:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:30:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:30:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:30:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea488737-3fa1-5455-b703-5232c1c66c04/ea488737-3fa1-5455-b703-5232c1c66c04_image_5.jpg HTTP/1.1" 201 0
2026-03-25 16:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf2%252Fbf0eec58c6044b43ad801f754ee2ed8b%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 16:30:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf2/bf0eec58c6044b43ad801f754ee2ed8b/images/large/6.jpg saved to cache
2026-03-25 16:30:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ea488737-3fa1-5455-b703-5232c1c66c04
2026-03-25 16:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk4%252F95c036c998b44865ac295d4872553ed1%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk4/95c036c998b44865ac295d4872553ed1/images/large/6.jpg not downloaded yet
2026-03-25 16:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk4%252F95c036c998b44865ac295d4872553ed1%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk4/95c036c998b44865ac295d4872553ed1/images/large/7.jpg not downloaded yet
2026-03-25 16:30:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:30:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc590990>
2026-03-25 16:30:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:30:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:30:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:30:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea488737-3fa1-5455-b703-5232c1c66c04/ea488737-3fa1-5455-b703-5232c1c66c04_image_8.jpg HTTP/1.1" 201 0
2026-03-25 16:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf2%252Fbf0eec58c6044b43ad801f754ee2ed8b%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 16:30:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf2/bf0eec58c6044b43ad801f754ee2ed8b/images/large/9.jpg saved to cache
2026-03-25 16:30:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ea488737-3fa1-5455-b703-5232c1c66c04
2026-03-25 16:30:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ea488737-3fa1-5455-b703-5232c1c66c04, skipping ID generation
2026-03-25 16:30:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ea488737-3fa1-5455-b703-5232c1c66c04 with scrape type 1
2026-03-25 16:30:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ea488737-3fa1-5455-b703-5232c1c66c04 sending to next pipeline
2026-03-25 16:30:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: ea488737-3fa1-5455-b703-5232c1c66c04, identifier: 1983501
2026-03-25 16:30:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ft3/9b8e5509bc6a4834b2cacd5bdbe5132c/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: ea488737-3fa1-5455-b703-5232c1c66c04 with identifier: 1983501
2026-03-25 16:30:28 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:30:28 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:30:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: ea488737-3fa1-5455-b703-5232c1c66c04 with identifier: 1983501
2026-03-25 16:30:29 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: ea488737-3fa1-5455-b703-5232c1c66c04 with identifier: 1983501 to the API
2026-03-25 16:30:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:30:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:30:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gf2/bf0eec58c6044b43ad801f754ee2ed8b/images/large/9.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'GREY MATTER METALLIZZATO',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-27T09:30:00Z',
'fuel_type': 'hybrid',
'id': 'ea488737-3fa1-5455-b703-5232c1c66c04',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41025',
'listing': 'auction',
'location': None,
'make': 'FORD',
'model': 'FORD PUMA 1.0 Ecoboost Hybrid 125CV ST-Line Sport utility vehicle '
'5-door (Euro 6.2)',
'odometer': 49382,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 75,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea488737-3fa1-5455-b703-5232c1c66c04/ea488737-3fa1-5455-b703-5232c1c66c04_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 750073,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf2/bf0eec58c6044b43ad801f754ee2ed8b/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea488737-3fa1-5455-b703-5232c1c66c04/ea488737-3fa1-5455-b703-5232c1c66c04_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 293828,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf2/bf0eec58c6044b43ad801f754ee2ed8b/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea488737-3fa1-5455-b703-5232c1c66c04/ea488737-3fa1-5455-b703-5232c1c66c04_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 498063,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf2/bf0eec58c6044b43ad801f754ee2ed8b/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea488737-3fa1-5455-b703-5232c1c66c04/ea488737-3fa1-5455-b703-5232c1c66c04_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 666643,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf2/bf0eec58c6044b43ad801f754ee2ed8b/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea488737-3fa1-5455-b703-5232c1c66c04/ea488737-3fa1-5455-b703-5232c1c66c04_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 413299,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf2/bf0eec58c6044b43ad801f754ee2ed8b/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea488737-3fa1-5455-b703-5232c1c66c04/ea488737-3fa1-5455-b703-5232c1c66c04_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 423160,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf2/bf0eec58c6044b43ad801f754ee2ed8b/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea488737-3fa1-5455-b703-5232c1c66c04/ea488737-3fa1-5455-b703-5232c1c66c04_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 464795,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf2/bf0eec58c6044b43ad801f754ee2ed8b/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea488737-3fa1-5455-b703-5232c1c66c04/ea488737-3fa1-5455-b703-5232c1c66c04_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 378055,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf2/bf0eec58c6044b43ad801f754ee2ed8b/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea488737-3fa1-5455-b703-5232c1c66c04/ea488737-3fa1-5455-b703-5232c1c66c04_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 784901,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf2/bf0eec58c6044b43ad801f754ee2ed8b/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea488737-3fa1-5455-b703-5232c1c66c04/ea488737-3fa1-5455-b703-5232c1c66c04_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 464031,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf2/bf0eec58c6044b43ad801f754ee2ed8b/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-04-19',
'seats_number': 5,
'seller_name': None,
'title': 'FORD FORD PUMA 1.0 Ecoboost Hybrid 125CV ST-Line Sport utility '
'vehicle 5-door (Euro 6.2) -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2021}
2026-03-25 16:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983501%27 HTTP/1.1" 200 None
2026-03-25 16:30:30 [ayvens.it] INFO: Saving data for 1983501: {'created_time': 1774456230.645275, 'last_price_update_time': 1774456230.645288, 'auction_closing_time': 1774603800.0}
2026-03-25 16:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1983501') HTTP/1.1" 204 0
2026-03-25 16:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk4%252F95c036c998b44865ac295d4872553ed1%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk4/95c036c998b44865ac295d4872553ed1/images/large/8.jpg not downloaded yet
2026-03-25 16:30:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ft3/9b8e5509bc6a4834b2cacd5bdbe5132c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ft3/9b8e5509bc6a4834b2cacd5bdbe5132c/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk4%252F95c036c998b44865ac295d4872553ed1%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk4/95c036c998b44865ac295d4872553ed1/images/large/9.jpg not downloaded yet
2026-03-25 16:30:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ft3/9b8e5509bc6a4834b2cacd5bdbe5132c/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ft3/9b8e5509bc6a4834b2cacd5bdbe5132c/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:30:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc82eb50>
2026-03-25 16:30:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:30:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:30:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:30:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b5f6ec2f-600d-5ef5-bb06-514534a30b59/b5f6ec2f-600d-5ef5-bb06-514534a30b59_image_1.jpg HTTP/1.1" 201 0
2026-03-25 16:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft3%252F9b8e5509bc6a4834b2cacd5bdbe5132c%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 16:30:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft3/9b8e5509bc6a4834b2cacd5bdbe5132c/images/large/2.jpg saved to cache
2026-03-25 16:30:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b5f6ec2f-600d-5ef5-bb06-514534a30b59
2026-03-25 16:30:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl2/fb7565b99e9244cc8ec74937258f687e/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk4%252F95c036c998b44865ac295d4872553ed1%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk4/95c036c998b44865ac295d4872553ed1/images/large/10.jpg not downloaded yet
2026-03-25 16:30:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ft3/9b8e5509bc6a4834b2cacd5bdbe5132c/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:30 [ayvens.it] INFO: Found listing with ID: 1983505
2026-03-25 16:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983505%27 HTTP/1.1" 200 None
2026-03-25 16:30:30 [ayvens.it] INFO: Scrape type for 1983505: 1
2026-03-25 16:30:30 [ayvens.it] INFO: Extracting data for car ID: 1983505
2026-03-25 16:30:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c2f24464-5695-5036-b10e-21afcde6ee17 with identifier: 1983505
2026-03-25 16:30:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c2f24464-5695-5036-b10e-21afcde6ee17 with scrape type 1
2026-03-25 16:30:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c2f24464-5695-5036-b10e-21afcde6ee17
2026-03-25 16:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr9%252F6b7c99bf54334552ba58c9c69ddab9d4%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr9/6b7c99bf54334552ba58c9c69ddab9d4/images/large/1.jpg not downloaded yet
2026-03-25 16:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr9%252F6b7c99bf54334552ba58c9c69ddab9d4%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr9/6b7c99bf54334552ba58c9c69ddab9d4/images/large/2.jpg not downloaded yet
2026-03-25 16:30:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:30:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc5d7f50>
2026-03-25 16:30:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:30:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:30:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:30:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b5f6ec2f-600d-5ef5-bb06-514534a30b59/b5f6ec2f-600d-5ef5-bb06-514534a30b59_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft3%252F9b8e5509bc6a4834b2cacd5bdbe5132c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 16:30:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft3/9b8e5509bc6a4834b2cacd5bdbe5132c/images/large/1.jpg saved to cache
2026-03-25 16:30:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b5f6ec2f-600d-5ef5-bb06-514534a30b59
2026-03-25 16:30:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:30:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc7d2dd0>
2026-03-25 16:30:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:30:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:30:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:30:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b5f6ec2f-600d-5ef5-bb06-514534a30b59/b5f6ec2f-600d-5ef5-bb06-514534a30b59_image_4.jpg HTTP/1.1" 201 0
2026-03-25 16:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft3%252F9b8e5509bc6a4834b2cacd5bdbe5132c%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 16:30:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft3/9b8e5509bc6a4834b2cacd5bdbe5132c/images/large/5.jpg saved to cache
2026-03-25 16:30:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b5f6ec2f-600d-5ef5-bb06-514534a30b59
2026-03-25 16:30:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl2/fb7565b99e9244cc8ec74937258f687e/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr9%252F6b7c99bf54334552ba58c9c69ddab9d4%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr9/6b7c99bf54334552ba58c9c69ddab9d4/images/large/3.jpg not downloaded yet
2026-03-25 16:30:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:30:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34de142f90>
2026-03-25 16:30:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:30:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:30:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:30:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b5f6ec2f-600d-5ef5-bb06-514534a30b59/b5f6ec2f-600d-5ef5-bb06-514534a30b59_image_2.jpg HTTP/1.1" 201 0
2026-03-25 16:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft3%252F9b8e5509bc6a4834b2cacd5bdbe5132c%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 16:30:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft3/9b8e5509bc6a4834b2cacd5bdbe5132c/images/large/3.jpg saved to cache
2026-03-25 16:30:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b5f6ec2f-600d-5ef5-bb06-514534a30b59
2026-03-25 16:30:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:30:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc5cc310>
2026-03-25 16:30:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:30:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:30:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:30:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b5f6ec2f-600d-5ef5-bb06-514534a30b59/b5f6ec2f-600d-5ef5-bb06-514534a30b59_image_3.jpg HTTP/1.1" 201 0
2026-03-25 16:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft3%252F9b8e5509bc6a4834b2cacd5bdbe5132c%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 16:30:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft3/9b8e5509bc6a4834b2cacd5bdbe5132c/images/large/4.jpg saved to cache
2026-03-25 16:30:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b5f6ec2f-600d-5ef5-bb06-514534a30b59
2026-03-25 16:30:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:30:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc825f90>
2026-03-25 16:30:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:30:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:30:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:30:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ae0e12b4-28af-5149-a440-3211217d2397/ae0e12b4-28af-5149-a440-3211217d2397_image_2.jpg HTTP/1.1" 201 0
2026-03-25 16:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl2%252Ffb7565b99e9244cc8ec74937258f687e%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 16:30:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl2/fb7565b99e9244cc8ec74937258f687e/images/large/3.jpg saved to cache
2026-03-25 16:30:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ae0e12b4-28af-5149-a440-3211217d2397
2026-03-25 16:30:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl2/fb7565b99e9244cc8ec74937258f687e/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr9%252F6b7c99bf54334552ba58c9c69ddab9d4%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr9/6b7c99bf54334552ba58c9c69ddab9d4/images/large/4.jpg not downloaded yet
2026-03-25 16:30:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:30:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc54ef10>
2026-03-25 16:30:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:30:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:30:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:30:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b5f6ec2f-600d-5ef5-bb06-514534a30b59/b5f6ec2f-600d-5ef5-bb06-514534a30b59_image_5.jpg HTTP/1.1" 201 0
2026-03-25 16:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft3%252F9b8e5509bc6a4834b2cacd5bdbe5132c%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 16:30:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft3/9b8e5509bc6a4834b2cacd5bdbe5132c/images/large/6.jpg saved to cache
2026-03-25 16:30:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b5f6ec2f-600d-5ef5-bb06-514534a30b59
2026-03-25 16:30:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:30:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc34e790>
2026-03-25 16:30:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:30:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:30:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:30:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ae0e12b4-28af-5149-a440-3211217d2397/ae0e12b4-28af-5149-a440-3211217d2397_image_3.jpg HTTP/1.1" 201 0
2026-03-25 16:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl2%252Ffb7565b99e9244cc8ec74937258f687e%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 16:30:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl2/fb7565b99e9244cc8ec74937258f687e/images/large/4.jpg saved to cache
2026-03-25 16:30:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ae0e12b4-28af-5149-a440-3211217d2397
2026-03-25 16:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr9%252F6b7c99bf54334552ba58c9c69ddab9d4%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr9/6b7c99bf54334552ba58c9c69ddab9d4/images/large/5.jpg not downloaded yet
2026-03-25 16:30:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl2/fb7565b99e9244cc8ec74937258f687e/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl2/fb7565b99e9244cc8ec74937258f687e/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk4/95c036c998b44865ac295d4872553ed1/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl2/fb7565b99e9244cc8ec74937258f687e/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr9%252F6b7c99bf54334552ba58c9c69ddab9d4%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr9/6b7c99bf54334552ba58c9c69ddab9d4/images/large/6.jpg not downloaded yet
2026-03-25 16:30:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:30:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34d74cd050>
2026-03-25 16:30:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:30:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:30:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:30:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ae0e12b4-28af-5149-a440-3211217d2397/ae0e12b4-28af-5149-a440-3211217d2397_image_7.jpg HTTP/1.1" 201 0
2026-03-25 16:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl2%252Ffb7565b99e9244cc8ec74937258f687e%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 16:30:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl2/fb7565b99e9244cc8ec74937258f687e/images/large/8.jpg saved to cache
2026-03-25 16:30:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ae0e12b4-28af-5149-a440-3211217d2397
2026-03-25 16:30:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl2/fb7565b99e9244cc8ec74937258f687e/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr9%252F6b7c99bf54334552ba58c9c69ddab9d4%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr9/6b7c99bf54334552ba58c9c69ddab9d4/images/large/7.jpg not downloaded yet
2026-03-25 16:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr9%252F6b7c99bf54334552ba58c9c69ddab9d4%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr9/6b7c99bf54334552ba58c9c69ddab9d4/images/large/8.jpg not downloaded yet
2026-03-25 16:30:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk4/95c036c998b44865ac295d4872553ed1/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk4/95c036c998b44865ac295d4872553ed1/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:30:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc591590>
2026-03-25 16:30:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:30:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:30:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:30:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ae0e12b4-28af-5149-a440-3211217d2397/ae0e12b4-28af-5149-a440-3211217d2397_image_8.jpg HTTP/1.1" 201 0
2026-03-25 16:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl2%252Ffb7565b99e9244cc8ec74937258f687e%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 16:30:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl2/fb7565b99e9244cc8ec74937258f687e/images/large/9.jpg saved to cache
2026-03-25 16:30:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ae0e12b4-28af-5149-a440-3211217d2397
2026-03-25 16:30:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:30:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc9b9e50>
2026-03-25 16:30:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:30:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:30:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:30:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ae0e12b4-28af-5149-a440-3211217d2397/ae0e12b4-28af-5149-a440-3211217d2397_image_6.jpg HTTP/1.1" 201 0
2026-03-25 16:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl2%252Ffb7565b99e9244cc8ec74937258f687e%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 16:30:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl2/fb7565b99e9244cc8ec74937258f687e/images/large/7.jpg saved to cache
2026-03-25 16:30:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ae0e12b4-28af-5149-a440-3211217d2397
2026-03-25 16:30:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:30:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc60c150>
2026-03-25 16:30:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:30:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:30:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:30:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bdee08a9-57f6-5a9b-b706-c284e31883e1/bdee08a9-57f6-5a9b-b706-c284e31883e1_image_1.jpg HTTP/1.1" 201 0
2026-03-25 16:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk4%252F95c036c998b44865ac295d4872553ed1%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 16:30:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk4/95c036c998b44865ac295d4872553ed1/images/large/2.jpg saved to cache
2026-03-25 16:30:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item bdee08a9-57f6-5a9b-b706-c284e31883e1
2026-03-25 16:30:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:30:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc82f250>
2026-03-25 16:30:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:30:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:30:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:30:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ae0e12b4-28af-5149-a440-3211217d2397/ae0e12b4-28af-5149-a440-3211217d2397_image_5.jpg HTTP/1.1" 201 0
2026-03-25 16:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl2%252Ffb7565b99e9244cc8ec74937258f687e%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 16:30:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl2/fb7565b99e9244cc8ec74937258f687e/images/large/6.jpg saved to cache
2026-03-25 16:30:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ae0e12b4-28af-5149-a440-3211217d2397
2026-03-25 16:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr9%252F6b7c99bf54334552ba58c9c69ddab9d4%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr9/6b7c99bf54334552ba58c9c69ddab9d4/images/large/9.jpg not downloaded yet
2026-03-25 16:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr9%252F6b7c99bf54334552ba58c9c69ddab9d4%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr9/6b7c99bf54334552ba58c9c69ddab9d4/images/large/10.jpg not downloaded yet
2026-03-25 16:30:31 [ayvens.it] INFO: Found listing with ID: 1983506
2026-03-25 16:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983506%27 HTTP/1.1" 200 None
2026-03-25 16:30:31 [ayvens.it] INFO: Scrape type for 1983506: 1
2026-03-25 16:30:31 [ayvens.it] INFO: Extracting data for car ID: 1983506
2026-03-25 16:30:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 10c92072-d9f9-589f-8a28-1d7a53aceee5 with identifier: 1983506
2026-03-25 16:30:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 10c92072-d9f9-589f-8a28-1d7a53aceee5 with scrape type 1
2026-03-25 16:30:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 10c92072-d9f9-589f-8a28-1d7a53aceee5
2026-03-25 16:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk3%252F1b8aec5f3e42454bb5cf527968275aca%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk3/1b8aec5f3e42454bb5cf527968275aca/images/large/1.jpg not downloaded yet
2026-03-25 16:30:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:30:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc635410>
2026-03-25 16:30:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:30:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:30:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:30:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ae0e12b4-28af-5149-a440-3211217d2397/ae0e12b4-28af-5149-a440-3211217d2397_image_9.jpg HTTP/1.1" 201 0
2026-03-25 16:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl2%252Ffb7565b99e9244cc8ec74937258f687e%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 16:30:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl2/fb7565b99e9244cc8ec74937258f687e/images/large/10.jpg saved to cache
2026-03-25 16:30:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ae0e12b4-28af-5149-a440-3211217d2397
2026-03-25 16:30:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:30:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc354a50>
2026-03-25 16:30:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:30:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:30:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:30:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bdee08a9-57f6-5a9b-b706-c284e31883e1/bdee08a9-57f6-5a9b-b706-c284e31883e1_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk4%252F95c036c998b44865ac295d4872553ed1%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 16:30:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk4/95c036c998b44865ac295d4872553ed1/images/large/1.jpg saved to cache
2026-03-25 16:30:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bdee08a9-57f6-5a9b-b706-c284e31883e1
2026-03-25 16:30:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:30:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc7d0a50>
2026-03-25 16:30:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:30:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:30:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:30:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bdee08a9-57f6-5a9b-b706-c284e31883e1/bdee08a9-57f6-5a9b-b706-c284e31883e1_image_3.jpg HTTP/1.1" 201 0
2026-03-25 16:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk4%252F95c036c998b44865ac295d4872553ed1%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 16:30:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk4/95c036c998b44865ac295d4872553ed1/images/large/4.jpg saved to cache
2026-03-25 16:30:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item bdee08a9-57f6-5a9b-b706-c284e31883e1
2026-03-25 16:30:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk4/95c036c998b44865ac295d4872553ed1/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk3%252F1b8aec5f3e42454bb5cf527968275aca%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk3/1b8aec5f3e42454bb5cf527968275aca/images/large/2.jpg not downloaded yet
2026-03-25 16:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk3%252F1b8aec5f3e42454bb5cf527968275aca%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk3/1b8aec5f3e42454bb5cf527968275aca/images/large/3.jpg not downloaded yet
2026-03-25 16:30:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk4/95c036c998b44865ac295d4872553ed1/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk4/95c036c998b44865ac295d4872553ed1/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk4/95c036c998b44865ac295d4872553ed1/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk4/95c036c998b44865ac295d4872553ed1/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk3%252F1b8aec5f3e42454bb5cf527968275aca%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk3/1b8aec5f3e42454bb5cf527968275aca/images/large/4.jpg not downloaded yet
2026-03-25 16:30:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk4/95c036c998b44865ac295d4872553ed1/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk4/95c036c998b44865ac295d4872553ed1/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk3%252F1b8aec5f3e42454bb5cf527968275aca%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk3/1b8aec5f3e42454bb5cf527968275aca/images/large/5.jpg not downloaded yet
2026-03-25 16:30:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fr9/6b7c99bf54334552ba58c9c69ddab9d4/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk3%252F1b8aec5f3e42454bb5cf527968275aca%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk3/1b8aec5f3e42454bb5cf527968275aca/images/large/6.jpg not downloaded yet
2026-03-25 16:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk3%252F1b8aec5f3e42454bb5cf527968275aca%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk3/1b8aec5f3e42454bb5cf527968275aca/images/large/7.jpg not downloaded yet
2026-03-25 16:30:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:30:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34d7443e10>
2026-03-25 16:30:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:30:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:30:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:30:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bdee08a9-57f6-5a9b-b706-c284e31883e1/bdee08a9-57f6-5a9b-b706-c284e31883e1_image_8.jpg HTTP/1.1" 201 0
2026-03-25 16:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk4%252F95c036c998b44865ac295d4872553ed1%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 16:30:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk4/95c036c998b44865ac295d4872553ed1/images/large/9.jpg saved to cache
2026-03-25 16:30:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item bdee08a9-57f6-5a9b-b706-c284e31883e1
2026-03-25 16:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk3%252F1b8aec5f3e42454bb5cf527968275aca%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk3/1b8aec5f3e42454bb5cf527968275aca/images/large/8.jpg not downloaded yet
2026-03-25 16:30:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:30:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc383590>
2026-03-25 16:30:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:30:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:30:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:30:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bdee08a9-57f6-5a9b-b706-c284e31883e1/bdee08a9-57f6-5a9b-b706-c284e31883e1_image_5.jpg HTTP/1.1" 201 0
2026-03-25 16:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk4%252F95c036c998b44865ac295d4872553ed1%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 16:30:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk4/95c036c998b44865ac295d4872553ed1/images/large/6.jpg saved to cache
2026-03-25 16:30:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item bdee08a9-57f6-5a9b-b706-c284e31883e1
2026-03-25 16:30:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:30:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34d7442810>
2026-03-25 16:30:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:30:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:30:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:30:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bdee08a9-57f6-5a9b-b706-c284e31883e1/bdee08a9-57f6-5a9b-b706-c284e31883e1_image_6.jpg HTTP/1.1" 201 0
2026-03-25 16:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk4%252F95c036c998b44865ac295d4872553ed1%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 16:30:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk4/95c036c998b44865ac295d4872553ed1/images/large/7.jpg saved to cache
2026-03-25 16:30:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item bdee08a9-57f6-5a9b-b706-c284e31883e1
2026-03-25 16:30:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:30:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc54f750>
2026-03-25 16:30:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:30:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:30:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:30:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bdee08a9-57f6-5a9b-b706-c284e31883e1/bdee08a9-57f6-5a9b-b706-c284e31883e1_image_4.jpg HTTP/1.1" 201 0
2026-03-25 16:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk4%252F95c036c998b44865ac295d4872553ed1%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 16:30:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk4/95c036c998b44865ac295d4872553ed1/images/large/5.jpg saved to cache
2026-03-25 16:30:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item bdee08a9-57f6-5a9b-b706-c284e31883e1
2026-03-25 16:30:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:30:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc3805d0>
2026-03-25 16:30:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:30:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:30:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:30:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bdee08a9-57f6-5a9b-b706-c284e31883e1/bdee08a9-57f6-5a9b-b706-c284e31883e1_image_2.jpg HTTP/1.1" 201 0
2026-03-25 16:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk4%252F95c036c998b44865ac295d4872553ed1%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 16:30:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk4/95c036c998b44865ac295d4872553ed1/images/large/3.jpg saved to cache
2026-03-25 16:30:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item bdee08a9-57f6-5a9b-b706-c284e31883e1
2026-03-25 16:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk3%252F1b8aec5f3e42454bb5cf527968275aca%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk3/1b8aec5f3e42454bb5cf527968275aca/images/large/9.jpg not downloaded yet
2026-03-25 16:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk3%252F1b8aec5f3e42454bb5cf527968275aca%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk3/1b8aec5f3e42454bb5cf527968275aca/images/large/10.jpg not downloaded yet
2026-03-25 16:30:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:30:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc37f490>
2026-03-25 16:30:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:30:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:30:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:30:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bdee08a9-57f6-5a9b-b706-c284e31883e1/bdee08a9-57f6-5a9b-b706-c284e31883e1_image_7.jpg HTTP/1.1" 201 0
2026-03-25 16:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk4%252F95c036c998b44865ac295d4872553ed1%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 16:30:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk4/95c036c998b44865ac295d4872553ed1/images/large/8.jpg saved to cache
2026-03-25 16:30:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item bdee08a9-57f6-5a9b-b706-c284e31883e1
2026-03-25 16:30:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:30:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34de16b690>
2026-03-25 16:30:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:30:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:30:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:30:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bdee08a9-57f6-5a9b-b706-c284e31883e1/bdee08a9-57f6-5a9b-b706-c284e31883e1_image_9.jpg HTTP/1.1" 201 0
2026-03-25 16:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk4%252F95c036c998b44865ac295d4872553ed1%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 16:30:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk4/95c036c998b44865ac295d4872553ed1/images/large/10.jpg saved to cache
2026-03-25 16:30:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item bdee08a9-57f6-5a9b-b706-c284e31883e1
2026-03-25 16:30:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bdee08a9-57f6-5a9b-b706-c284e31883e1, skipping ID generation
2026-03-25 16:30:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bdee08a9-57f6-5a9b-b706-c284e31883e1 with scrape type 1
2026-03-25 16:30:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bdee08a9-57f6-5a9b-b706-c284e31883e1 sending to next pipeline
2026-03-25 16:30:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: bdee08a9-57f6-5a9b-b706-c284e31883e1, identifier: 1983504
2026-03-25 16:30:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:30:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dce2e450>
2026-03-25 16:30:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:30:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:30:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:30:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c2f24464-5695-5036-b10e-21afcde6ee17/c2f24464-5695-5036-b10e-21afcde6ee17_image_1.jpg HTTP/1.1" 201 0
2026-03-25 16:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr9%252F6b7c99bf54334552ba58c9c69ddab9d4%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 16:30:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr9/6b7c99bf54334552ba58c9c69ddab9d4/images/large/2.jpg saved to cache
2026-03-25 16:30:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c2f24464-5695-5036-b10e-21afcde6ee17
2026-03-25 16:30:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: bdee08a9-57f6-5a9b-b706-c284e31883e1 with identifier: 1983504
2026-03-25 16:30:33 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:30:33 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:30:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: bdee08a9-57f6-5a9b-b706-c284e31883e1 with identifier: 1983504
2026-03-25 16:30:33 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: bdee08a9-57f6-5a9b-b706-c284e31883e1 with identifier: 1983504 to the API
2026-03-25 16:30:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:30:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:30:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gk4/95c036c998b44865ac295d4872553ed1/images/large/10.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Frozen White pastello',
'currency': 'EUR',
'doors_number': 4,
'engine': '2.0L',
'expiration_date': '2026-03-27T09:30:00Z',
'fuel_type': 'diesel',
'id': 'bdee08a9-57f6-5a9b-b706-c284e31883e1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41025',
'listing': 'auction',
'location': None,
'make': 'FORD',
'model': 'FORD TRANSIT 350 L2H2 Trend 2.0 Eco MHEV 130 Cv Furgone 4-door '
'(Euro 6.2)',
'odometer': 51959,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 41,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bdee08a9-57f6-5a9b-b706-c284e31883e1/bdee08a9-57f6-5a9b-b706-c284e31883e1_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 765101,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk4/95c036c998b44865ac295d4872553ed1/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bdee08a9-57f6-5a9b-b706-c284e31883e1/bdee08a9-57f6-5a9b-b706-c284e31883e1_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 380763,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk4/95c036c998b44865ac295d4872553ed1/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bdee08a9-57f6-5a9b-b706-c284e31883e1/bdee08a9-57f6-5a9b-b706-c284e31883e1_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 636071,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk4/95c036c998b44865ac295d4872553ed1/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bdee08a9-57f6-5a9b-b706-c284e31883e1/bdee08a9-57f6-5a9b-b706-c284e31883e1_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 453215,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk4/95c036c998b44865ac295d4872553ed1/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bdee08a9-57f6-5a9b-b706-c284e31883e1/bdee08a9-57f6-5a9b-b706-c284e31883e1_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 641818,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk4/95c036c998b44865ac295d4872553ed1/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bdee08a9-57f6-5a9b-b706-c284e31883e1/bdee08a9-57f6-5a9b-b706-c284e31883e1_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 586297,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk4/95c036c998b44865ac295d4872553ed1/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bdee08a9-57f6-5a9b-b706-c284e31883e1/bdee08a9-57f6-5a9b-b706-c284e31883e1_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 765101,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk4/95c036c998b44865ac295d4872553ed1/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bdee08a9-57f6-5a9b-b706-c284e31883e1/bdee08a9-57f6-5a9b-b706-c284e31883e1_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 764620,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk4/95c036c998b44865ac295d4872553ed1/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bdee08a9-57f6-5a9b-b706-c284e31883e1/bdee08a9-57f6-5a9b-b706-c284e31883e1_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 329082,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk4/95c036c998b44865ac295d4872553ed1/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bdee08a9-57f6-5a9b-b706-c284e31883e1/bdee08a9-57f6-5a9b-b706-c284e31883e1_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 425284,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk4/95c036c998b44865ac295d4872553ed1/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-07-19',
'seats_number': 5,
'seller_name': None,
'title': 'FORD FORD TRANSIT 350 L2H2 Trend 2.0 Eco MHEV 130 Cv Furgone 4-door '
'(Euro 6.2) -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-25 16:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983504%27 HTTP/1.1" 200 None
2026-03-25 16:30:34 [ayvens.it] INFO: Saving data for 1983504: {'created_time': 1774456234.699122, 'last_price_update_time': 1774456234.699135, 'auction_closing_time': 1774603800.0}
2026-03-25 16:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1983504') HTTP/1.1" 204 0
2026-03-25 16:30:34 [ayvens.it] INFO: Found listing with ID: 1983507
2026-03-25 16:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983507%27 HTTP/1.1" 200 None
2026-03-25 16:30:34 [ayvens.it] INFO: Scrape type for 1983507: 1
2026-03-25 16:30:34 [ayvens.it] INFO: Extracting data for car ID: 1983507
2026-03-25 16:30:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fd022ee5-c4cf-57f0-af02-793863899334 with identifier: 1983507
2026-03-25 16:30:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fd022ee5-c4cf-57f0-af02-793863899334 with scrape type 1
2026-03-25 16:30:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item fd022ee5-c4cf-57f0-af02-793863899334
2026-03-25 16:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp3%252Fcaf420a2f36047519d16362f0026ffed%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp3/caf420a2f36047519d16362f0026ffed/images/large/1.jpg not downloaded yet
2026-03-25 16:30:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fr9/6b7c99bf54334552ba58c9c69ddab9d4/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fr9/6b7c99bf54334552ba58c9c69ddab9d4/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl2/fb7565b99e9244cc8ec74937258f687e/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl2/fb7565b99e9244cc8ec74937258f687e/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fr9/6b7c99bf54334552ba58c9c69ddab9d4/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp3%252Fcaf420a2f36047519d16362f0026ffed%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp3/caf420a2f36047519d16362f0026ffed/images/large/2.jpg not downloaded yet
2026-03-25 16:30:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fr9/6b7c99bf54334552ba58c9c69ddab9d4/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fr9/6b7c99bf54334552ba58c9c69ddab9d4/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp3%252Fcaf420a2f36047519d16362f0026ffed%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp3/caf420a2f36047519d16362f0026ffed/images/large/3.jpg not downloaded yet
2026-03-25 16:30:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fr9/6b7c99bf54334552ba58c9c69ddab9d4/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp3%252Fcaf420a2f36047519d16362f0026ffed%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp3/caf420a2f36047519d16362f0026ffed/images/large/4.jpg not downloaded yet
2026-03-25 16:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp3%252Fcaf420a2f36047519d16362f0026ffed%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp3/caf420a2f36047519d16362f0026ffed/images/large/5.jpg not downloaded yet
2026-03-25 16:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp3%252Fcaf420a2f36047519d16362f0026ffed%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp3/caf420a2f36047519d16362f0026ffed/images/large/6.jpg not downloaded yet
2026-03-25 16:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp3%252Fcaf420a2f36047519d16362f0026ffed%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp3/caf420a2f36047519d16362f0026ffed/images/large/7.jpg not downloaded yet
2026-03-25 16:30:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:30:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34d6b4b390>
2026-03-25 16:30:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:30:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:30:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:30:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c2f24464-5695-5036-b10e-21afcde6ee17/c2f24464-5695-5036-b10e-21afcde6ee17_image_2.jpg HTTP/1.1" 201 0
2026-03-25 16:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr9%252F6b7c99bf54334552ba58c9c69ddab9d4%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 16:30:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr9/6b7c99bf54334552ba58c9c69ddab9d4/images/large/3.jpg saved to cache
2026-03-25 16:30:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c2f24464-5695-5036-b10e-21afcde6ee17
2026-03-25 16:30:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:30:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34de161450>
2026-03-25 16:30:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:30:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:30:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:30:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c2f24464-5695-5036-b10e-21afcde6ee17/c2f24464-5695-5036-b10e-21afcde6ee17_image_3.jpg HTTP/1.1" 201 0
2026-03-25 16:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr9%252F6b7c99bf54334552ba58c9c69ddab9d4%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 16:30:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr9/6b7c99bf54334552ba58c9c69ddab9d4/images/large/4.jpg saved to cache
2026-03-25 16:30:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c2f24464-5695-5036-b10e-21afcde6ee17
2026-03-25 16:30:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:30:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcc4d6d0>
2026-03-25 16:30:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:30:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:30:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:30:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ae0e12b4-28af-5149-a440-3211217d2397/ae0e12b4-28af-5149-a440-3211217d2397_image_1.jpg HTTP/1.1" 201 0
2026-03-25 16:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl2%252Ffb7565b99e9244cc8ec74937258f687e%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 16:30:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl2/fb7565b99e9244cc8ec74937258f687e/images/large/2.jpg saved to cache
2026-03-25 16:30:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ae0e12b4-28af-5149-a440-3211217d2397
2026-03-25 16:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp3%252Fcaf420a2f36047519d16362f0026ffed%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp3/caf420a2f36047519d16362f0026ffed/images/large/8.jpg not downloaded yet
2026-03-25 16:30:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:30:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dca27c10>
2026-03-25 16:30:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:30:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:30:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:30:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ae0e12b4-28af-5149-a440-3211217d2397/ae0e12b4-28af-5149-a440-3211217d2397_image_4.jpg HTTP/1.1" 201 0
2026-03-25 16:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl2%252Ffb7565b99e9244cc8ec74937258f687e%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 16:30:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl2/fb7565b99e9244cc8ec74937258f687e/images/large/5.jpg saved to cache
2026-03-25 16:30:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ae0e12b4-28af-5149-a440-3211217d2397
2026-03-25 16:30:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:30:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc8e2b50>
2026-03-25 16:30:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:30:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:30:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:30:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c2f24464-5695-5036-b10e-21afcde6ee17/c2f24464-5695-5036-b10e-21afcde6ee17_image_4.jpg HTTP/1.1" 201 0
2026-03-25 16:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr9%252F6b7c99bf54334552ba58c9c69ddab9d4%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 16:30:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr9/6b7c99bf54334552ba58c9c69ddab9d4/images/large/5.jpg saved to cache
2026-03-25 16:30:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c2f24464-5695-5036-b10e-21afcde6ee17
2026-03-25 16:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp3%252Fcaf420a2f36047519d16362f0026ffed%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp3/caf420a2f36047519d16362f0026ffed/images/large/9.jpg not downloaded yet
2026-03-25 16:30:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:30:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc629c10>
2026-03-25 16:30:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:30:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:30:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:30:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c2f24464-5695-5036-b10e-21afcde6ee17/c2f24464-5695-5036-b10e-21afcde6ee17_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr9%252F6b7c99bf54334552ba58c9c69ddab9d4%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 16:30:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr9/6b7c99bf54334552ba58c9c69ddab9d4/images/large/1.jpg saved to cache
2026-03-25 16:30:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c2f24464-5695-5036-b10e-21afcde6ee17
2026-03-25 16:30:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:30:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc7de210>
2026-03-25 16:30:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:30:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:30:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:30:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c2f24464-5695-5036-b10e-21afcde6ee17/c2f24464-5695-5036-b10e-21afcde6ee17_image_6.jpg HTTP/1.1" 201 0
2026-03-25 16:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr9%252F6b7c99bf54334552ba58c9c69ddab9d4%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 16:30:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr9/6b7c99bf54334552ba58c9c69ddab9d4/images/large/7.jpg saved to cache
2026-03-25 16:30:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c2f24464-5695-5036-b10e-21afcde6ee17
2026-03-25 16:30:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:30:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc326050>
2026-03-25 16:30:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:30:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:30:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:30:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c2f24464-5695-5036-b10e-21afcde6ee17/c2f24464-5695-5036-b10e-21afcde6ee17_image_5.jpg HTTP/1.1" 201 0
2026-03-25 16:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr9%252F6b7c99bf54334552ba58c9c69ddab9d4%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 16:30:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr9/6b7c99bf54334552ba58c9c69ddab9d4/images/large/6.jpg saved to cache
2026-03-25 16:30:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c2f24464-5695-5036-b10e-21afcde6ee17
2026-03-25 16:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp3%252Fcaf420a2f36047519d16362f0026ffed%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp3/caf420a2f36047519d16362f0026ffed/images/large/10.jpg not downloaded yet
2026-03-25 16:30:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk3/1b8aec5f3e42454bb5cf527968275aca/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk3/1b8aec5f3e42454bb5cf527968275aca/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk3/1b8aec5f3e42454bb5cf527968275aca/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:35 [ayvens.it] INFO: Found listing with ID: 1983508
2026-03-25 16:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983508%27 HTTP/1.1" 200 None
2026-03-25 16:30:35 [ayvens.it] INFO: Scrape type for 1983508: 1
2026-03-25 16:30:35 [ayvens.it] INFO: Extracting data for car ID: 1983508
2026-03-25 16:30:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 723c298a-81fe-5fcb-afb6-bcffcd868fb7 with identifier: 1983508
2026-03-25 16:30:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 723c298a-81fe-5fcb-afb6-bcffcd868fb7 with scrape type 1
2026-03-25 16:30:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 723c298a-81fe-5fcb-afb6-bcffcd868fb7
2026-03-25 16:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs4%252Fe02b3ef8971245959c29dd28ec0d6b62%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs4/e02b3ef8971245959c29dd28ec0d6b62/images/large/1.jpg not downloaded yet
2026-03-25 16:30:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk3/1b8aec5f3e42454bb5cf527968275aca/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fr9/6b7c99bf54334552ba58c9c69ddab9d4/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs4%252Fe02b3ef8971245959c29dd28ec0d6b62%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs4/e02b3ef8971245959c29dd28ec0d6b62/images/large/2.jpg not downloaded yet
2026-03-25 16:30:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk3/1b8aec5f3e42454bb5cf527968275aca/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fr9/6b7c99bf54334552ba58c9c69ddab9d4/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk3/1b8aec5f3e42454bb5cf527968275aca/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs4%252Fe02b3ef8971245959c29dd28ec0d6b62%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs4/e02b3ef8971245959c29dd28ec0d6b62/images/large/3.jpg not downloaded yet
2026-03-25 16:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs4%252Fe02b3ef8971245959c29dd28ec0d6b62%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs4/e02b3ef8971245959c29dd28ec0d6b62/images/large/4.jpg not downloaded yet
2026-03-25 16:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs4%252Fe02b3ef8971245959c29dd28ec0d6b62%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs4/e02b3ef8971245959c29dd28ec0d6b62/images/large/5.jpg not downloaded yet
2026-03-25 16:30:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:30:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34d6b3d850>
2026-03-25 16:30:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:30:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:30:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:30:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10c92072-d9f9-589f-8a28-1d7a53aceee5/10c92072-d9f9-589f-8a28-1d7a53aceee5_image_2.jpg HTTP/1.1" 201 0
2026-03-25 16:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk3%252F1b8aec5f3e42454bb5cf527968275aca%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 16:30:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk3/1b8aec5f3e42454bb5cf527968275aca/images/large/3.jpg saved to cache
2026-03-25 16:30:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 10c92072-d9f9-589f-8a28-1d7a53aceee5
2026-03-25 16:30:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:30:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc9c8190>
2026-03-25 16:30:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:30:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:30:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:30:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10c92072-d9f9-589f-8a28-1d7a53aceee5/10c92072-d9f9-589f-8a28-1d7a53aceee5_image_6.jpg HTTP/1.1" 201 0
2026-03-25 16:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk3%252F1b8aec5f3e42454bb5cf527968275aca%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 16:30:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk3/1b8aec5f3e42454bb5cf527968275aca/images/large/7.jpg saved to cache
2026-03-25 16:30:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 10c92072-d9f9-589f-8a28-1d7a53aceee5
2026-03-25 16:30:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:30:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc936250>
2026-03-25 16:30:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:30:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:30:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:30:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10c92072-d9f9-589f-8a28-1d7a53aceee5/10c92072-d9f9-589f-8a28-1d7a53aceee5_image_5.jpg HTTP/1.1" 201 0
2026-03-25 16:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk3%252F1b8aec5f3e42454bb5cf527968275aca%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 16:30:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk3/1b8aec5f3e42454bb5cf527968275aca/images/large/6.jpg saved to cache
2026-03-25 16:30:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 10c92072-d9f9-589f-8a28-1d7a53aceee5
2026-03-25 16:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs4%252Fe02b3ef8971245959c29dd28ec0d6b62%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs4/e02b3ef8971245959c29dd28ec0d6b62/images/large/6.jpg not downloaded yet
2026-03-25 16:30:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:30:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc547710>
2026-03-25 16:30:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:30:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:30:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:30:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10c92072-d9f9-589f-8a28-1d7a53aceee5/10c92072-d9f9-589f-8a28-1d7a53aceee5_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk3%252F1b8aec5f3e42454bb5cf527968275aca%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 16:30:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk3/1b8aec5f3e42454bb5cf527968275aca/images/large/1.jpg saved to cache
2026-03-25 16:30:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 10c92072-d9f9-589f-8a28-1d7a53aceee5
2026-03-25 16:30:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:30:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34d6b4b2d0>
2026-03-25 16:30:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:30:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:30:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:30:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c2f24464-5695-5036-b10e-21afcde6ee17/c2f24464-5695-5036-b10e-21afcde6ee17_image_8.jpg HTTP/1.1" 201 0
2026-03-25 16:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr9%252F6b7c99bf54334552ba58c9c69ddab9d4%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 16:30:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr9/6b7c99bf54334552ba58c9c69ddab9d4/images/large/9.jpg saved to cache
2026-03-25 16:30:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c2f24464-5695-5036-b10e-21afcde6ee17
2026-03-25 16:30:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:30:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc9b3f10>
2026-03-25 16:30:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:30:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:30:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:30:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10c92072-d9f9-589f-8a28-1d7a53aceee5/10c92072-d9f9-589f-8a28-1d7a53aceee5_image_7.jpg HTTP/1.1" 201 0
2026-03-25 16:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk3%252F1b8aec5f3e42454bb5cf527968275aca%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 16:30:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk3/1b8aec5f3e42454bb5cf527968275aca/images/large/8.jpg saved to cache
2026-03-25 16:30:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 10c92072-d9f9-589f-8a28-1d7a53aceee5
2026-03-25 16:30:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:30:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc937110>
2026-03-25 16:30:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:30:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:30:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:30:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c2f24464-5695-5036-b10e-21afcde6ee17/c2f24464-5695-5036-b10e-21afcde6ee17_image_9.jpg HTTP/1.1" 201 0
2026-03-25 16:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr9%252F6b7c99bf54334552ba58c9c69ddab9d4%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 16:30:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr9/6b7c99bf54334552ba58c9c69ddab9d4/images/large/10.jpg saved to cache
2026-03-25 16:30:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c2f24464-5695-5036-b10e-21afcde6ee17
2026-03-25 16:30:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:30:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc9f2b10>
2026-03-25 16:30:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:30:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:30:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:30:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10c92072-d9f9-589f-8a28-1d7a53aceee5/10c92072-d9f9-589f-8a28-1d7a53aceee5_image_1.jpg HTTP/1.1" 201 0
2026-03-25 16:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk3%252F1b8aec5f3e42454bb5cf527968275aca%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 16:30:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk3/1b8aec5f3e42454bb5cf527968275aca/images/large/2.jpg saved to cache
2026-03-25 16:30:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 10c92072-d9f9-589f-8a28-1d7a53aceee5
2026-03-25 16:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs4%252Fe02b3ef8971245959c29dd28ec0d6b62%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs4/e02b3ef8971245959c29dd28ec0d6b62/images/large/7.jpg not downloaded yet
2026-03-25 16:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs4%252Fe02b3ef8971245959c29dd28ec0d6b62%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs4/e02b3ef8971245959c29dd28ec0d6b62/images/large/8.jpg not downloaded yet
2026-03-25 16:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs4%252Fe02b3ef8971245959c29dd28ec0d6b62%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs4/e02b3ef8971245959c29dd28ec0d6b62/images/large/9.jpg not downloaded yet
2026-03-25 16:30:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk3/1b8aec5f3e42454bb5cf527968275aca/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fr9/6b7c99bf54334552ba58c9c69ddab9d4/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk3/1b8aec5f3e42454bb5cf527968275aca/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk3/1b8aec5f3e42454bb5cf527968275aca/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs4%252Fe02b3ef8971245959c29dd28ec0d6b62%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs4/e02b3ef8971245959c29dd28ec0d6b62/images/large/10.jpg not downloaded yet
2026-03-25 16:30:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp3/caf420a2f36047519d16362f0026ffed/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk3/1b8aec5f3e42454bb5cf527968275aca/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp3/caf420a2f36047519d16362f0026ffed/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:36 [ayvens.it] INFO: Found listing with ID: 1983509
2026-03-25 16:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983509%27 HTTP/1.1" 200 None
2026-03-25 16:30:36 [ayvens.it] INFO: Scrape type for 1983509: 1
2026-03-25 16:30:36 [ayvens.it] INFO: Extracting data for car ID: 1983509
2026-03-25 16:30:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e3274dd0-155e-521a-b1c2-71cb8a235c7e with identifier: 1983509
2026-03-25 16:30:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e3274dd0-155e-521a-b1c2-71cb8a235c7e with scrape type 1
2026-03-25 16:30:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e3274dd0-155e-521a-b1c2-71cb8a235c7e
2026-03-25 16:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl3%252Fc1213aa4241a47b1880e6f56096d3340%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl3/c1213aa4241a47b1880e6f56096d3340/images/large/1.jpg not downloaded yet
2026-03-25 16:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl3%252Fc1213aa4241a47b1880e6f56096d3340%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl3/c1213aa4241a47b1880e6f56096d3340/images/large/2.jpg not downloaded yet
2026-03-25 16:30:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp3/caf420a2f36047519d16362f0026ffed/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl3%252Fc1213aa4241a47b1880e6f56096d3340%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl3/c1213aa4241a47b1880e6f56096d3340/images/large/3.jpg not downloaded yet
2026-03-25 16:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl3%252Fc1213aa4241a47b1880e6f56096d3340%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl3/c1213aa4241a47b1880e6f56096d3340/images/large/4.jpg not downloaded yet
2026-03-25 16:30:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:30:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc8e07d0>
2026-03-25 16:30:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:30:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:30:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:30:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10c92072-d9f9-589f-8a28-1d7a53aceee5/10c92072-d9f9-589f-8a28-1d7a53aceee5_image_3.jpg HTTP/1.1" 201 0
2026-03-25 16:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk3%252F1b8aec5f3e42454bb5cf527968275aca%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 16:30:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk3/1b8aec5f3e42454bb5cf527968275aca/images/large/4.jpg saved to cache
2026-03-25 16:30:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 10c92072-d9f9-589f-8a28-1d7a53aceee5
2026-03-25 16:30:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:30:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc80c1d0>
2026-03-25 16:30:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:30:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:30:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:30:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c2f24464-5695-5036-b10e-21afcde6ee17/c2f24464-5695-5036-b10e-21afcde6ee17_image_7.jpg HTTP/1.1" 201 0
2026-03-25 16:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr9%252F6b7c99bf54334552ba58c9c69ddab9d4%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 16:30:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr9/6b7c99bf54334552ba58c9c69ddab9d4/images/large/8.jpg saved to cache
2026-03-25 16:30:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c2f24464-5695-5036-b10e-21afcde6ee17
2026-03-25 16:30:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c2f24464-5695-5036-b10e-21afcde6ee17, skipping ID generation
2026-03-25 16:30:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c2f24464-5695-5036-b10e-21afcde6ee17 with scrape type 1
2026-03-25 16:30:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c2f24464-5695-5036-b10e-21afcde6ee17 sending to next pipeline
2026-03-25 16:30:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: c2f24464-5695-5036-b10e-21afcde6ee17, identifier: 1983505
2026-03-25 16:30:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:30:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc764190>
2026-03-25 16:30:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:30:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:30:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:30:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10c92072-d9f9-589f-8a28-1d7a53aceee5/10c92072-d9f9-589f-8a28-1d7a53aceee5_image_8.jpg HTTP/1.1" 201 0
2026-03-25 16:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk3%252F1b8aec5f3e42454bb5cf527968275aca%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 16:30:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk3/1b8aec5f3e42454bb5cf527968275aca/images/large/9.jpg saved to cache
2026-03-25 16:30:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 10c92072-d9f9-589f-8a28-1d7a53aceee5
2026-03-25 16:30:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:30:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc825590>
2026-03-25 16:30:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:30:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:30:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:30:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10c92072-d9f9-589f-8a28-1d7a53aceee5/10c92072-d9f9-589f-8a28-1d7a53aceee5_image_4.jpg HTTP/1.1" 201 0
2026-03-25 16:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk3%252F1b8aec5f3e42454bb5cf527968275aca%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 16:30:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk3/1b8aec5f3e42454bb5cf527968275aca/images/large/5.jpg saved to cache
2026-03-25 16:30:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 10c92072-d9f9-589f-8a28-1d7a53aceee5
2026-03-25 16:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl3%252Fc1213aa4241a47b1880e6f56096d3340%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl3/c1213aa4241a47b1880e6f56096d3340/images/large/5.jpg not downloaded yet
2026-03-25 16:30:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: c2f24464-5695-5036-b10e-21afcde6ee17 with identifier: 1983505
2026-03-25 16:30:37 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:30:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: c2f24464-5695-5036-b10e-21afcde6ee17 with identifier: 1983505
2026-03-25 16:30:37 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: c2f24464-5695-5036-b10e-21afcde6ee17 with identifier: 1983505 to the API
2026-03-25 16:30:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:30:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:30:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fr9/6b7c99bf54334552ba58c9c69ddab9d4/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'BIANCO',
'currency': 'EUR',
'doors_number': 2,
'engine': '2.3L',
'expiration_date': '2026-03-27T09:30:00Z',
'fuel_type': 'diesel',
'id': 'c2f24464-5695-5036-b10e-21afcde6ee17',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41025',
'listing': 'auction',
'location': None,
'make': 'OPEL',
'model': 'OPEL MOVANO CAB 2.3 CDTI 130 QLI35 L2 EU6 RWD HD FP',
'odometer': 184955,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2f24464-5695-5036-b10e-21afcde6ee17/c2f24464-5695-5036-b10e-21afcde6ee17_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 584700,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fr9/6b7c99bf54334552ba58c9c69ddab9d4/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2f24464-5695-5036-b10e-21afcde6ee17/c2f24464-5695-5036-b10e-21afcde6ee17_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 495814,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fr9/6b7c99bf54334552ba58c9c69ddab9d4/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2f24464-5695-5036-b10e-21afcde6ee17/c2f24464-5695-5036-b10e-21afcde6ee17_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 535290,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fr9/6b7c99bf54334552ba58c9c69ddab9d4/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2f24464-5695-5036-b10e-21afcde6ee17/c2f24464-5695-5036-b10e-21afcde6ee17_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 414112,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fr9/6b7c99bf54334552ba58c9c69ddab9d4/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2f24464-5695-5036-b10e-21afcde6ee17/c2f24464-5695-5036-b10e-21afcde6ee17_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 563238,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fr9/6b7c99bf54334552ba58c9c69ddab9d4/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2f24464-5695-5036-b10e-21afcde6ee17/c2f24464-5695-5036-b10e-21afcde6ee17_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 651055,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fr9/6b7c99bf54334552ba58c9c69ddab9d4/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2f24464-5695-5036-b10e-21afcde6ee17/c2f24464-5695-5036-b10e-21afcde6ee17_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 584700,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fr9/6b7c99bf54334552ba58c9c69ddab9d4/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2f24464-5695-5036-b10e-21afcde6ee17/c2f24464-5695-5036-b10e-21afcde6ee17_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 484376,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fr9/6b7c99bf54334552ba58c9c69ddab9d4/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2f24464-5695-5036-b10e-21afcde6ee17/c2f24464-5695-5036-b10e-21afcde6ee17_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 547987,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fr9/6b7c99bf54334552ba58c9c69ddab9d4/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2f24464-5695-5036-b10e-21afcde6ee17/c2f24464-5695-5036-b10e-21afcde6ee17_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 535290,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fr9/6b7c99bf54334552ba58c9c69ddab9d4/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-09-10',
'seats_number': 5,
'seller_name': None,
'title': 'OPEL OPEL MOVANO CAB 2.3 CDTI 130 QLI35 L2 EU6 RWD HD FP -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2018}
2026-03-25 16:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983505%27 HTTP/1.1" 200 None
2026-03-25 16:30:37 [ayvens.it] INFO: Saving data for 1983505: {'created_time': 1774456237.744716, 'last_price_update_time': 1774456237.744728, 'auction_closing_time': 1774603800.0}
2026-03-25 16:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1983505') HTTP/1.1" 204 0
2026-03-25 16:30:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:30:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc9741d0>
2026-03-25 16:30:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:30:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:30:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:30:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd022ee5-c4cf-57f0-af02-793863899334/fd022ee5-c4cf-57f0-af02-793863899334_image_2.jpg HTTP/1.1" 201 0
2026-03-25 16:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp3%252Fcaf420a2f36047519d16362f0026ffed%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 16:30:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp3/caf420a2f36047519d16362f0026ffed/images/large/3.jpg saved to cache
2026-03-25 16:30:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item fd022ee5-c4cf-57f0-af02-793863899334
2026-03-25 16:30:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:30:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc5bd450>
2026-03-25 16:30:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:30:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:30:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:30:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10c92072-d9f9-589f-8a28-1d7a53aceee5/10c92072-d9f9-589f-8a28-1d7a53aceee5_image_9.jpg HTTP/1.1" 201 0
2026-03-25 16:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk3%252F1b8aec5f3e42454bb5cf527968275aca%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 16:30:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk3/1b8aec5f3e42454bb5cf527968275aca/images/large/10.jpg saved to cache
2026-03-25 16:30:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 10c92072-d9f9-589f-8a28-1d7a53aceee5
2026-03-25 16:30:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 10c92072-d9f9-589f-8a28-1d7a53aceee5, skipping ID generation
2026-03-25 16:30:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 10c92072-d9f9-589f-8a28-1d7a53aceee5 with scrape type 1
2026-03-25 16:30:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 10c92072-d9f9-589f-8a28-1d7a53aceee5 sending to next pipeline
2026-03-25 16:30:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 10c92072-d9f9-589f-8a28-1d7a53aceee5, identifier: 1983506
2026-03-25 16:30:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:30:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc7df610>
2026-03-25 16:30:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:30:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:30:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:30:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd022ee5-c4cf-57f0-af02-793863899334/fd022ee5-c4cf-57f0-af02-793863899334_image_1.jpg HTTP/1.1" 201 0
2026-03-25 16:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp3%252Fcaf420a2f36047519d16362f0026ffed%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 16:30:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp3/caf420a2f36047519d16362f0026ffed/images/large/2.jpg saved to cache
2026-03-25 16:30:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item fd022ee5-c4cf-57f0-af02-793863899334
2026-03-25 16:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl3%252Fc1213aa4241a47b1880e6f56096d3340%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl3/c1213aa4241a47b1880e6f56096d3340/images/large/6.jpg not downloaded yet
2026-03-25 16:30:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 10c92072-d9f9-589f-8a28-1d7a53aceee5 with identifier: 1983506
2026-03-25 16:30:38 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:30:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 10c92072-d9f9-589f-8a28-1d7a53aceee5 with identifier: 1983506
2026-03-25 16:30:38 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 10c92072-d9f9-589f-8a28-1d7a53aceee5 with identifier: 1983506 to the API
2026-03-25 16:30:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:30:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:30:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gk3/1b8aec5f3e42454bb5cf527968275aca/images/large/10.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'DARK METAL GREY METALLIC',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.3L',
'expiration_date': '2026-03-27T09:30:00Z',
'fuel_type': 'hybrid',
'id': '10c92072-d9f9-589f-8a28-1d7a53aceee5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41025',
'listing': 'auction',
'location': None,
'make': 'NISSAN',
'model': 'NISSAN QASHQAI 1.3 MHEV 158 N-Style Xtronic Cross over 5-door (Euro '
'6D)',
'odometer': 85108,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 18,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10c92072-d9f9-589f-8a28-1d7a53aceee5/10c92072-d9f9-589f-8a28-1d7a53aceee5_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 504594,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk3/1b8aec5f3e42454bb5cf527968275aca/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10c92072-d9f9-589f-8a28-1d7a53aceee5/10c92072-d9f9-589f-8a28-1d7a53aceee5_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 530361,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk3/1b8aec5f3e42454bb5cf527968275aca/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10c92072-d9f9-589f-8a28-1d7a53aceee5/10c92072-d9f9-589f-8a28-1d7a53aceee5_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 400092,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk3/1b8aec5f3e42454bb5cf527968275aca/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10c92072-d9f9-589f-8a28-1d7a53aceee5/10c92072-d9f9-589f-8a28-1d7a53aceee5_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 564828,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk3/1b8aec5f3e42454bb5cf527968275aca/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10c92072-d9f9-589f-8a28-1d7a53aceee5/10c92072-d9f9-589f-8a28-1d7a53aceee5_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 512930,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk3/1b8aec5f3e42454bb5cf527968275aca/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10c92072-d9f9-589f-8a28-1d7a53aceee5/10c92072-d9f9-589f-8a28-1d7a53aceee5_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 332934,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk3/1b8aec5f3e42454bb5cf527968275aca/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10c92072-d9f9-589f-8a28-1d7a53aceee5/10c92072-d9f9-589f-8a28-1d7a53aceee5_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 314754,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk3/1b8aec5f3e42454bb5cf527968275aca/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10c92072-d9f9-589f-8a28-1d7a53aceee5/10c92072-d9f9-589f-8a28-1d7a53aceee5_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 553707,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk3/1b8aec5f3e42454bb5cf527968275aca/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10c92072-d9f9-589f-8a28-1d7a53aceee5/10c92072-d9f9-589f-8a28-1d7a53aceee5_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 501824,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk3/1b8aec5f3e42454bb5cf527968275aca/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10c92072-d9f9-589f-8a28-1d7a53aceee5/10c92072-d9f9-589f-8a28-1d7a53aceee5_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 662504,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk3/1b8aec5f3e42454bb5cf527968275aca/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-06-27',
'seats_number': 5,
'seller_name': None,
'title': 'NISSAN NISSAN QASHQAI 1.3 MHEV 158 N-Style Xtronic Cross over '
'5-door (Euro 6D) -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-25 16:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983506%27 HTTP/1.1" 200 None
2026-03-25 16:30:38 [ayvens.it] INFO: Saving data for 1983506: {'created_time': 1774456238.488771, 'last_price_update_time': 1774456238.488785, 'auction_closing_time': 1774603800.0}
2026-03-25 16:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1983506') HTTP/1.1" 204 0
2026-03-25 16:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl3%252Fc1213aa4241a47b1880e6f56096d3340%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl3/c1213aa4241a47b1880e6f56096d3340/images/large/7.jpg not downloaded yet
2026-03-25 16:30:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:30:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc592710>
2026-03-25 16:30:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:30:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:30:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:30:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd022ee5-c4cf-57f0-af02-793863899334/fd022ee5-c4cf-57f0-af02-793863899334_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp3%252Fcaf420a2f36047519d16362f0026ffed%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 16:30:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp3/caf420a2f36047519d16362f0026ffed/images/large/1.jpg saved to cache
2026-03-25 16:30:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fd022ee5-c4cf-57f0-af02-793863899334
2026-03-25 16:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl3%252Fc1213aa4241a47b1880e6f56096d3340%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl3/c1213aa4241a47b1880e6f56096d3340/images/large/8.jpg not downloaded yet
2026-03-25 16:30:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fs4/e02b3ef8971245959c29dd28ec0d6b62/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl3%252Fc1213aa4241a47b1880e6f56096d3340%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl3/c1213aa4241a47b1880e6f56096d3340/images/large/9.jpg not downloaded yet
2026-03-25 16:30:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp3/caf420a2f36047519d16362f0026ffed/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp3/caf420a2f36047519d16362f0026ffed/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fs4/e02b3ef8971245959c29dd28ec0d6b62/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp3/caf420a2f36047519d16362f0026ffed/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl3%252Fc1213aa4241a47b1880e6f56096d3340%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl3/c1213aa4241a47b1880e6f56096d3340/images/large/10.jpg not downloaded yet
2026-03-25 16:30:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp3/caf420a2f36047519d16362f0026ffed/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp3/caf420a2f36047519d16362f0026ffed/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp3/caf420a2f36047519d16362f0026ffed/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:38 [ayvens.it] INFO: Found listing with ID: 1983510
2026-03-25 16:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983510%27 HTTP/1.1" 200 None
2026-03-25 16:30:38 [ayvens.it] INFO: Scrape type for 1983510: 1
2026-03-25 16:30:38 [ayvens.it] INFO: Extracting data for car ID: 1983510
2026-03-25 16:30:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c3e0a7ab-98de-54e3-9a43-eae4518a239d with identifier: 1983510
2026-03-25 16:30:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c3e0a7ab-98de-54e3-9a43-eae4518a239d with scrape type 1
2026-03-25 16:30:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c3e0a7ab-98de-54e3-9a43-eae4518a239d
2026-03-25 16:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl6%252F7d95e6721221477bb945ba499e92f351%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl6/7d95e6721221477bb945ba499e92f351/images/large/1.jpg not downloaded yet
2026-03-25 16:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl6%252F7d95e6721221477bb945ba499e92f351%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl6/7d95e6721221477bb945ba499e92f351/images/large/2.jpg not downloaded yet
2026-03-25 16:30:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:30:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc7dca50>
2026-03-25 16:30:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:30:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:30:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:30:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_723c298a-81fe-5fcb-afb6-bcffcd868fb7/723c298a-81fe-5fcb-afb6-bcffcd868fb7_image_1.jpg HTTP/1.1" 201 0
2026-03-25 16:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs4%252Fe02b3ef8971245959c29dd28ec0d6b62%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 16:30:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs4/e02b3ef8971245959c29dd28ec0d6b62/images/large/2.jpg saved to cache
2026-03-25 16:30:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 723c298a-81fe-5fcb-afb6-bcffcd868fb7
2026-03-25 16:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl6%252F7d95e6721221477bb945ba499e92f351%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl6/7d95e6721221477bb945ba499e92f351/images/large/3.jpg not downloaded yet
2026-03-25 16:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl6%252F7d95e6721221477bb945ba499e92f351%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl6/7d95e6721221477bb945ba499e92f351/images/large/4.jpg not downloaded yet
2026-03-25 16:30:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:30:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc5aea50>
2026-03-25 16:30:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:30:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:30:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:30:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd022ee5-c4cf-57f0-af02-793863899334/fd022ee5-c4cf-57f0-af02-793863899334_image_5.jpg HTTP/1.1" 201 0
2026-03-25 16:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp3%252Fcaf420a2f36047519d16362f0026ffed%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 16:30:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp3/caf420a2f36047519d16362f0026ffed/images/large/6.jpg saved to cache
2026-03-25 16:30:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item fd022ee5-c4cf-57f0-af02-793863899334
2026-03-25 16:30:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:30:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc868050>
2026-03-25 16:30:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:30:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:30:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:30:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd022ee5-c4cf-57f0-af02-793863899334/fd022ee5-c4cf-57f0-af02-793863899334_image_9.jpg HTTP/1.1" 201 0
2026-03-25 16:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp3%252Fcaf420a2f36047519d16362f0026ffed%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 16:30:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp3/caf420a2f36047519d16362f0026ffed/images/large/10.jpg saved to cache
2026-03-25 16:30:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item fd022ee5-c4cf-57f0-af02-793863899334
2026-03-25 16:30:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:30:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dca23310>
2026-03-25 16:30:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:30:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:30:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:30:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_723c298a-81fe-5fcb-afb6-bcffcd868fb7/723c298a-81fe-5fcb-afb6-bcffcd868fb7_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs4%252Fe02b3ef8971245959c29dd28ec0d6b62%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 16:30:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs4/e02b3ef8971245959c29dd28ec0d6b62/images/large/1.jpg saved to cache
2026-03-25 16:30:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 723c298a-81fe-5fcb-afb6-bcffcd868fb7
2026-03-25 16:30:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:30:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc86bc10>
2026-03-25 16:30:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:30:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:30:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:30:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd022ee5-c4cf-57f0-af02-793863899334/fd022ee5-c4cf-57f0-af02-793863899334_image_7.jpg HTTP/1.1" 201 0
2026-03-25 16:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp3%252Fcaf420a2f36047519d16362f0026ffed%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 16:30:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp3/caf420a2f36047519d16362f0026ffed/images/large/8.jpg saved to cache
2026-03-25 16:30:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item fd022ee5-c4cf-57f0-af02-793863899334
2026-03-25 16:30:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:30:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dca06d90>
2026-03-25 16:30:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:30:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:30:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:30:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd022ee5-c4cf-57f0-af02-793863899334/fd022ee5-c4cf-57f0-af02-793863899334_image_8.jpg HTTP/1.1" 201 0
2026-03-25 16:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp3%252Fcaf420a2f36047519d16362f0026ffed%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 16:30:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp3/caf420a2f36047519d16362f0026ffed/images/large/9.jpg saved to cache
2026-03-25 16:30:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item fd022ee5-c4cf-57f0-af02-793863899334
2026-03-25 16:30:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:30:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcc1b710>
2026-03-25 16:30:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:30:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:30:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:30:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd022ee5-c4cf-57f0-af02-793863899334/fd022ee5-c4cf-57f0-af02-793863899334_image_6.jpg HTTP/1.1" 201 0
2026-03-25 16:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp3%252Fcaf420a2f36047519d16362f0026ffed%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 16:30:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp3/caf420a2f36047519d16362f0026ffed/images/large/7.jpg saved to cache
2026-03-25 16:30:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item fd022ee5-c4cf-57f0-af02-793863899334
2026-03-25 16:30:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:30:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dca21f10>
2026-03-25 16:30:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:30:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:30:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:30:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd022ee5-c4cf-57f0-af02-793863899334/fd022ee5-c4cf-57f0-af02-793863899334_image_4.jpg HTTP/1.1" 201 0
2026-03-25 16:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp3%252Fcaf420a2f36047519d16362f0026ffed%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 16:30:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp3/caf420a2f36047519d16362f0026ffed/images/large/5.jpg saved to cache
2026-03-25 16:30:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item fd022ee5-c4cf-57f0-af02-793863899334
2026-03-25 16:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl6%252F7d95e6721221477bb945ba499e92f351%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl6/7d95e6721221477bb945ba499e92f351/images/large/5.jpg not downloaded yet
2026-03-25 16:30:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fs4/e02b3ef8971245959c29dd28ec0d6b62/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fs4/e02b3ef8971245959c29dd28ec0d6b62/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fs4/e02b3ef8971245959c29dd28ec0d6b62/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl6%252F7d95e6721221477bb945ba499e92f351%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl6/7d95e6721221477bb945ba499e92f351/images/large/6.jpg not downloaded yet
2026-03-25 16:30:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl3/c1213aa4241a47b1880e6f56096d3340/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fs4/e02b3ef8971245959c29dd28ec0d6b62/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fs4/e02b3ef8971245959c29dd28ec0d6b62/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fs4/e02b3ef8971245959c29dd28ec0d6b62/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl6%252F7d95e6721221477bb945ba499e92f351%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl6/7d95e6721221477bb945ba499e92f351/images/large/7.jpg not downloaded yet
2026-03-25 16:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl6%252F7d95e6721221477bb945ba499e92f351%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl6/7d95e6721221477bb945ba499e92f351/images/large/8.jpg not downloaded yet
2026-03-25 16:30:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fs4/e02b3ef8971245959c29dd28ec0d6b62/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl6%252F7d95e6721221477bb945ba499e92f351%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl6/7d95e6721221477bb945ba499e92f351/images/large/9.jpg not downloaded yet
2026-03-25 16:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl6%252F7d95e6721221477bb945ba499e92f351%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl6/7d95e6721221477bb945ba499e92f351/images/large/10.jpg not downloaded yet
2026-03-25 16:30:39 [ayvens.it] INFO: Found listing with ID: 1983511
2026-03-25 16:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983511%27 HTTP/1.1" 200 None
2026-03-25 16:30:39 [ayvens.it] INFO: Scrape type for 1983511: 1
2026-03-25 16:30:39 [ayvens.it] INFO: Extracting data for car ID: 1983511
2026-03-25 16:30:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3b0a908d-16f5-5e90-8bc9-b7f609ec4cc3 with identifier: 1983511
2026-03-25 16:30:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3b0a908d-16f5-5e90-8bc9-b7f609ec4cc3 with scrape type 1
2026-03-25 16:30:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3b0a908d-16f5-5e90-8bc9-b7f609ec4cc3
2026-03-25 16:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj3%252F1e4b2dcc50fd482a8c5150005050c7c5%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj3/1e4b2dcc50fd482a8c5150005050c7c5/images/large/1.jpg not downloaded yet
2026-03-25 16:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj3%252F1e4b2dcc50fd482a8c5150005050c7c5%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj3/1e4b2dcc50fd482a8c5150005050c7c5/images/large/2.jpg not downloaded yet
2026-03-25 16:30:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl3/c1213aa4241a47b1880e6f56096d3340/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:30:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc86be90>
2026-03-25 16:30:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:30:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:30:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:30:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_723c298a-81fe-5fcb-afb6-bcffcd868fb7/723c298a-81fe-5fcb-afb6-bcffcd868fb7_image_8.jpg HTTP/1.1" 201 0
2026-03-25 16:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs4%252Fe02b3ef8971245959c29dd28ec0d6b62%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 16:30:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs4/e02b3ef8971245959c29dd28ec0d6b62/images/large/9.jpg saved to cache
2026-03-25 16:30:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 723c298a-81fe-5fcb-afb6-bcffcd868fb7
2026-03-25 16:30:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:30:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc63f790>
2026-03-25 16:30:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:30:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:30:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:30:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_723c298a-81fe-5fcb-afb6-bcffcd868fb7/723c298a-81fe-5fcb-afb6-bcffcd868fb7_image_9.jpg HTTP/1.1" 201 0
2026-03-25 16:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs4%252Fe02b3ef8971245959c29dd28ec0d6b62%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 16:30:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs4/e02b3ef8971245959c29dd28ec0d6b62/images/large/10.jpg saved to cache
2026-03-25 16:30:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 723c298a-81fe-5fcb-afb6-bcffcd868fb7
2026-03-25 16:30:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:30:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcaf7b10>
2026-03-25 16:30:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:30:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:30:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:30:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_723c298a-81fe-5fcb-afb6-bcffcd868fb7/723c298a-81fe-5fcb-afb6-bcffcd868fb7_image_5.jpg HTTP/1.1" 201 0
2026-03-25 16:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs4%252Fe02b3ef8971245959c29dd28ec0d6b62%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 16:30:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs4/e02b3ef8971245959c29dd28ec0d6b62/images/large/6.jpg saved to cache
2026-03-25 16:30:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 723c298a-81fe-5fcb-afb6-bcffcd868fb7
2026-03-25 16:30:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:30:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcab0dd0>
2026-03-25 16:30:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:30:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:30:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:30:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e3274dd0-155e-521a-b1c2-71cb8a235c7e/e3274dd0-155e-521a-b1c2-71cb8a235c7e_image_4.jpg HTTP/1.1" 201 0
2026-03-25 16:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl3%252Fc1213aa4241a47b1880e6f56096d3340%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 16:30:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl3/c1213aa4241a47b1880e6f56096d3340/images/large/5.jpg saved to cache
2026-03-25 16:30:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e3274dd0-155e-521a-b1c2-71cb8a235c7e
2026-03-25 16:30:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:30:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc555590>
2026-03-25 16:30:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:30:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:30:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:30:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_723c298a-81fe-5fcb-afb6-bcffcd868fb7/723c298a-81fe-5fcb-afb6-bcffcd868fb7_image_3.jpg HTTP/1.1" 201 0
2026-03-25 16:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs4%252Fe02b3ef8971245959c29dd28ec0d6b62%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 16:30:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs4/e02b3ef8971245959c29dd28ec0d6b62/images/large/4.jpg saved to cache
2026-03-25 16:30:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 723c298a-81fe-5fcb-afb6-bcffcd868fb7
2026-03-25 16:30:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:30:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc371750>
2026-03-25 16:30:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:30:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:30:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:30:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_723c298a-81fe-5fcb-afb6-bcffcd868fb7/723c298a-81fe-5fcb-afb6-bcffcd868fb7_image_7.jpg HTTP/1.1" 201 0
2026-03-25 16:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs4%252Fe02b3ef8971245959c29dd28ec0d6b62%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 16:30:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs4/e02b3ef8971245959c29dd28ec0d6b62/images/large/8.jpg saved to cache
2026-03-25 16:30:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 723c298a-81fe-5fcb-afb6-bcffcd868fb7
2026-03-25 16:30:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:30:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcaebcd0>
2026-03-25 16:30:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:30:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:30:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:30:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_723c298a-81fe-5fcb-afb6-bcffcd868fb7/723c298a-81fe-5fcb-afb6-bcffcd868fb7_image_6.jpg HTTP/1.1" 201 0
2026-03-25 16:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs4%252Fe02b3ef8971245959c29dd28ec0d6b62%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 16:30:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs4/e02b3ef8971245959c29dd28ec0d6b62/images/large/7.jpg saved to cache
2026-03-25 16:30:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 723c298a-81fe-5fcb-afb6-bcffcd868fb7
2026-03-25 16:30:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:30:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34d6b5a290>
2026-03-25 16:30:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:30:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:30:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:30:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_723c298a-81fe-5fcb-afb6-bcffcd868fb7/723c298a-81fe-5fcb-afb6-bcffcd868fb7_image_4.jpg HTTP/1.1" 201 0
2026-03-25 16:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs4%252Fe02b3ef8971245959c29dd28ec0d6b62%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 16:30:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs4/e02b3ef8971245959c29dd28ec0d6b62/images/large/5.jpg saved to cache
2026-03-25 16:30:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 723c298a-81fe-5fcb-afb6-bcffcd868fb7
2026-03-25 16:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj3%252F1e4b2dcc50fd482a8c5150005050c7c5%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj3/1e4b2dcc50fd482a8c5150005050c7c5/images/large/3.jpg not downloaded yet
2026-03-25 16:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj3%252F1e4b2dcc50fd482a8c5150005050c7c5%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj3/1e4b2dcc50fd482a8c5150005050c7c5/images/large/4.jpg not downloaded yet
2026-03-25 16:30:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl3/c1213aa4241a47b1880e6f56096d3340/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj3%252F1e4b2dcc50fd482a8c5150005050c7c5%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj3/1e4b2dcc50fd482a8c5150005050c7c5/images/large/5.jpg not downloaded yet
2026-03-25 16:30:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:30:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcad8f90>
2026-03-25 16:30:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:30:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:30:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:30:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e3274dd0-155e-521a-b1c2-71cb8a235c7e/e3274dd0-155e-521a-b1c2-71cb8a235c7e_image_6.jpg HTTP/1.1" 201 0
2026-03-25 16:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl3%252Fc1213aa4241a47b1880e6f56096d3340%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 16:30:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl3/c1213aa4241a47b1880e6f56096d3340/images/large/7.jpg saved to cache
2026-03-25 16:30:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e3274dd0-155e-521a-b1c2-71cb8a235c7e
2026-03-25 16:30:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl3/c1213aa4241a47b1880e6f56096d3340/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj3%252F1e4b2dcc50fd482a8c5150005050c7c5%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj3/1e4b2dcc50fd482a8c5150005050c7c5/images/large/6.jpg not downloaded yet
2026-03-25 16:30:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl3/c1213aa4241a47b1880e6f56096d3340/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl3/c1213aa4241a47b1880e6f56096d3340/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl6/7d95e6721221477bb945ba499e92f351/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl6/7d95e6721221477bb945ba499e92f351/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj3%252F1e4b2dcc50fd482a8c5150005050c7c5%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj3/1e4b2dcc50fd482a8c5150005050c7c5/images/large/7.jpg not downloaded yet
2026-03-25 16:30:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:30:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcb1db90>
2026-03-25 16:30:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:30:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:30:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:30:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e3274dd0-155e-521a-b1c2-71cb8a235c7e/e3274dd0-155e-521a-b1c2-71cb8a235c7e_image_7.jpg HTTP/1.1" 201 0
2026-03-25 16:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl3%252Fc1213aa4241a47b1880e6f56096d3340%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 16:30:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl3/c1213aa4241a47b1880e6f56096d3340/images/large/8.jpg saved to cache
2026-03-25 16:30:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e3274dd0-155e-521a-b1c2-71cb8a235c7e
2026-03-25 16:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj3%252F1e4b2dcc50fd482a8c5150005050c7c5%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj3/1e4b2dcc50fd482a8c5150005050c7c5/images/large/8.jpg not downloaded yet
2026-03-25 16:30:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl6/7d95e6721221477bb945ba499e92f351/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj3%252F1e4b2dcc50fd482a8c5150005050c7c5%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj3/1e4b2dcc50fd482a8c5150005050c7c5/images/large/9.jpg not downloaded yet
2026-03-25 16:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj3%252F1e4b2dcc50fd482a8c5150005050c7c5%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj3/1e4b2dcc50fd482a8c5150005050c7c5/images/large/10.jpg not downloaded yet
2026-03-25 16:30:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:30:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc713150>
2026-03-25 16:30:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:30:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:30:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:30:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e3274dd0-155e-521a-b1c2-71cb8a235c7e/e3274dd0-155e-521a-b1c2-71cb8a235c7e_image_5.jpg HTTP/1.1" 201 0
2026-03-25 16:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl3%252Fc1213aa4241a47b1880e6f56096d3340%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 16:30:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl3/c1213aa4241a47b1880e6f56096d3340/images/large/6.jpg saved to cache
2026-03-25 16:30:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e3274dd0-155e-521a-b1c2-71cb8a235c7e
2026-03-25 16:30:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:30:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc868b10>
2026-03-25 16:30:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:30:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:30:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:30:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e3274dd0-155e-521a-b1c2-71cb8a235c7e/e3274dd0-155e-521a-b1c2-71cb8a235c7e_image_9.jpg HTTP/1.1" 201 0
2026-03-25 16:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl3%252Fc1213aa4241a47b1880e6f56096d3340%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 16:30:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl3/c1213aa4241a47b1880e6f56096d3340/images/large/10.jpg saved to cache
2026-03-25 16:30:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e3274dd0-155e-521a-b1c2-71cb8a235c7e
2026-03-25 16:30:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:30:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc8d5350>
2026-03-25 16:30:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:30:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:30:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:30:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e3274dd0-155e-521a-b1c2-71cb8a235c7e/e3274dd0-155e-521a-b1c2-71cb8a235c7e_image_8.jpg HTTP/1.1" 201 0
2026-03-25 16:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl3%252Fc1213aa4241a47b1880e6f56096d3340%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 16:30:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl3/c1213aa4241a47b1880e6f56096d3340/images/large/9.jpg saved to cache
2026-03-25 16:30:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e3274dd0-155e-521a-b1c2-71cb8a235c7e
2026-03-25 16:30:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:30:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc8d5010>
2026-03-25 16:30:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:30:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:30:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:30:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3e0a7ab-98de-54e3-9a43-eae4518a239d/c3e0a7ab-98de-54e3-9a43-eae4518a239d_image_1.jpg HTTP/1.1" 201 0
2026-03-25 16:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl6%252F7d95e6721221477bb945ba499e92f351%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 16:30:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl6/7d95e6721221477bb945ba499e92f351/images/large/2.jpg saved to cache
2026-03-25 16:30:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c3e0a7ab-98de-54e3-9a43-eae4518a239d
2026-03-25 16:30:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:30:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc8692d0>
2026-03-25 16:30:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:30:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:30:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:30:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3e0a7ab-98de-54e3-9a43-eae4518a239d/c3e0a7ab-98de-54e3-9a43-eae4518a239d_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl6%252F7d95e6721221477bb945ba499e92f351%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 16:30:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl6/7d95e6721221477bb945ba499e92f351/images/large/1.jpg saved to cache
2026-03-25 16:30:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c3e0a7ab-98de-54e3-9a43-eae4518a239d
2026-03-25 16:30:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl6/7d95e6721221477bb945ba499e92f351/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl3/c1213aa4241a47b1880e6f56096d3340/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:41 [ayvens.it] INFO: Found listing with ID: 1983512
2026-03-25 16:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983512%27 HTTP/1.1" 200 None
2026-03-25 16:30:41 [ayvens.it] INFO: Scrape type for 1983512: 1
2026-03-25 16:30:41 [ayvens.it] INFO: Extracting data for car ID: 1983512
2026-03-25 16:30:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ad2c32b9-5578-5fd3-9993-08aa9305e9e0 with identifier: 1983512
2026-03-25 16:30:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ad2c32b9-5578-5fd3-9993-08aa9305e9e0 with scrape type 1
2026-03-25 16:30:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ad2c32b9-5578-5fd3-9993-08aa9305e9e0
2026-03-25 16:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh6%252F106a200b436e4ad197fe602bb0788915%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh6/106a200b436e4ad197fe602bb0788915/images/large/1.jpg not downloaded yet
2026-03-25 16:30:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:30:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34d6b3fad0>
2026-03-25 16:30:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:30:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:30:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:30:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3e0a7ab-98de-54e3-9a43-eae4518a239d/c3e0a7ab-98de-54e3-9a43-eae4518a239d_image_2.jpg HTTP/1.1" 201 0
2026-03-25 16:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl6%252F7d95e6721221477bb945ba499e92f351%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 16:30:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl6/7d95e6721221477bb945ba499e92f351/images/large/3.jpg saved to cache
2026-03-25 16:30:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c3e0a7ab-98de-54e3-9a43-eae4518a239d
2026-03-25 16:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh6%252F106a200b436e4ad197fe602bb0788915%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh6/106a200b436e4ad197fe602bb0788915/images/large/2.jpg not downloaded yet
2026-03-25 16:30:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl3/c1213aa4241a47b1880e6f56096d3340/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:30:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc87a350>
2026-03-25 16:30:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:30:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:30:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:30:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3e0a7ab-98de-54e3-9a43-eae4518a239d/c3e0a7ab-98de-54e3-9a43-eae4518a239d_image_4.jpg HTTP/1.1" 201 0
2026-03-25 16:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl6%252F7d95e6721221477bb945ba499e92f351%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 16:30:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl6/7d95e6721221477bb945ba499e92f351/images/large/5.jpg saved to cache
2026-03-25 16:30:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c3e0a7ab-98de-54e3-9a43-eae4518a239d
2026-03-25 16:30:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:30:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc3029d0>
2026-03-25 16:30:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:30:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:30:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:30:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e3274dd0-155e-521a-b1c2-71cb8a235c7e/e3274dd0-155e-521a-b1c2-71cb8a235c7e_image_1.jpg HTTP/1.1" 201 0
2026-03-25 16:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl3%252Fc1213aa4241a47b1880e6f56096d3340%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 16:30:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl3/c1213aa4241a47b1880e6f56096d3340/images/large/2.jpg saved to cache
2026-03-25 16:30:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e3274dd0-155e-521a-b1c2-71cb8a235c7e
2026-03-25 16:30:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl3/c1213aa4241a47b1880e6f56096d3340/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh6%252F106a200b436e4ad197fe602bb0788915%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh6/106a200b436e4ad197fe602bb0788915/images/large/3.jpg not downloaded yet
2026-03-25 16:30:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl6/7d95e6721221477bb945ba499e92f351/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh6%252F106a200b436e4ad197fe602bb0788915%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh6/106a200b436e4ad197fe602bb0788915/images/large/4.jpg not downloaded yet
2026-03-25 16:30:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:30:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc5510d0>
2026-03-25 16:30:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:30:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:30:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:30:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e3274dd0-155e-521a-b1c2-71cb8a235c7e/e3274dd0-155e-521a-b1c2-71cb8a235c7e_image_3.jpg HTTP/1.1" 201 0
2026-03-25 16:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl3%252Fc1213aa4241a47b1880e6f56096d3340%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 16:30:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl3/c1213aa4241a47b1880e6f56096d3340/images/large/4.jpg saved to cache
2026-03-25 16:30:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e3274dd0-155e-521a-b1c2-71cb8a235c7e
2026-03-25 16:30:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl3/c1213aa4241a47b1880e6f56096d3340/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl6/7d95e6721221477bb945ba499e92f351/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh6%252F106a200b436e4ad197fe602bb0788915%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh6/106a200b436e4ad197fe602bb0788915/images/large/5.jpg not downloaded yet
2026-03-25 16:30:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl6/7d95e6721221477bb945ba499e92f351/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh6%252F106a200b436e4ad197fe602bb0788915%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh6/106a200b436e4ad197fe602bb0788915/images/large/6.jpg not downloaded yet
2026-03-25 16:30:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:30:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc60d5d0>
2026-03-25 16:30:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:30:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:30:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:30:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e3274dd0-155e-521a-b1c2-71cb8a235c7e/e3274dd0-155e-521a-b1c2-71cb8a235c7e_image_2.jpg HTTP/1.1" 201 0
2026-03-25 16:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl3%252Fc1213aa4241a47b1880e6f56096d3340%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 16:30:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl3/c1213aa4241a47b1880e6f56096d3340/images/large/3.jpg saved to cache
2026-03-25 16:30:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e3274dd0-155e-521a-b1c2-71cb8a235c7e
2026-03-25 16:30:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:30:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc5d4290>
2026-03-25 16:30:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:30:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:30:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:30:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3e0a7ab-98de-54e3-9a43-eae4518a239d/c3e0a7ab-98de-54e3-9a43-eae4518a239d_image_3.jpg HTTP/1.1" 201 0
2026-03-25 16:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl6%252F7d95e6721221477bb945ba499e92f351%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 16:30:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl6/7d95e6721221477bb945ba499e92f351/images/large/4.jpg saved to cache
2026-03-25 16:30:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c3e0a7ab-98de-54e3-9a43-eae4518a239d
2026-03-25 16:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh6%252F106a200b436e4ad197fe602bb0788915%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh6/106a200b436e4ad197fe602bb0788915/images/large/7.jpg not downloaded yet
2026-03-25 16:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh6%252F106a200b436e4ad197fe602bb0788915%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh6/106a200b436e4ad197fe602bb0788915/images/large/8.jpg not downloaded yet
2026-03-25 16:30:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj3/1e4b2dcc50fd482a8c5150005050c7c5/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj3/1e4b2dcc50fd482a8c5150005050c7c5/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh6%252F106a200b436e4ad197fe602bb0788915%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh6/106a200b436e4ad197fe602bb0788915/images/large/9.jpg not downloaded yet
2026-03-25 16:30:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:30:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc58a190>
2026-03-25 16:30:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:30:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:30:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:30:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e3274dd0-155e-521a-b1c2-71cb8a235c7e/e3274dd0-155e-521a-b1c2-71cb8a235c7e_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl3%252Fc1213aa4241a47b1880e6f56096d3340%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 16:30:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl3/c1213aa4241a47b1880e6f56096d3340/images/large/1.jpg saved to cache
2026-03-25 16:30:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e3274dd0-155e-521a-b1c2-71cb8a235c7e
2026-03-25 16:30:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e3274dd0-155e-521a-b1c2-71cb8a235c7e, skipping ID generation
2026-03-25 16:30:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e3274dd0-155e-521a-b1c2-71cb8a235c7e with scrape type 1
2026-03-25 16:30:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e3274dd0-155e-521a-b1c2-71cb8a235c7e sending to next pipeline
2026-03-25 16:30:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: e3274dd0-155e-521a-b1c2-71cb8a235c7e, identifier: 1983509
2026-03-25 16:30:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:30:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc5e9590>
2026-03-25 16:30:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:30:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:30:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:30:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3e0a7ab-98de-54e3-9a43-eae4518a239d/c3e0a7ab-98de-54e3-9a43-eae4518a239d_image_5.jpg HTTP/1.1" 201 0
2026-03-25 16:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl6%252F7d95e6721221477bb945ba499e92f351%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 16:30:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl6/7d95e6721221477bb945ba499e92f351/images/large/6.jpg saved to cache
2026-03-25 16:30:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c3e0a7ab-98de-54e3-9a43-eae4518a239d
2026-03-25 16:30:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:30:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc60f8d0>
2026-03-25 16:30:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:30:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:30:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:30:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3e0a7ab-98de-54e3-9a43-eae4518a239d/c3e0a7ab-98de-54e3-9a43-eae4518a239d_image_7.jpg HTTP/1.1" 201 0
2026-03-25 16:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl6%252F7d95e6721221477bb945ba499e92f351%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 16:30:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl6/7d95e6721221477bb945ba499e92f351/images/large/8.jpg saved to cache
2026-03-25 16:30:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c3e0a7ab-98de-54e3-9a43-eae4518a239d
2026-03-25 16:30:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: e3274dd0-155e-521a-b1c2-71cb8a235c7e with identifier: 1983509
2026-03-25 16:30:42 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:30:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: e3274dd0-155e-521a-b1c2-71cb8a235c7e with identifier: 1983509
2026-03-25 16:30:42 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: e3274dd0-155e-521a-b1c2-71cb8a235c7e with identifier: 1983509 to the API
2026-03-25 16:30:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:30:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:30:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gl3/c1213aa4241a47b1880e6f56096d3340/images/large/1.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Bianco Gelato pastello',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-27T09:30:00Z',
'fuel_type': 'diesel',
'id': 'e3274dd0-155e-521a-b1c2-71cb8a235c7e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41025',
'listing': 'auction',
'location': None,
'make': 'FIAT',
'model': 'FIAT 500X 1.3 Mjet 95cv E6D Club Cross over 5-door (Euro 6D)',
'odometer': 117704,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 74,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3274dd0-155e-521a-b1c2-71cb8a235c7e/e3274dd0-155e-521a-b1c2-71cb8a235c7e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 603608,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl3/c1213aa4241a47b1880e6f56096d3340/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3274dd0-155e-521a-b1c2-71cb8a235c7e/e3274dd0-155e-521a-b1c2-71cb8a235c7e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 187972,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl3/c1213aa4241a47b1880e6f56096d3340/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3274dd0-155e-521a-b1c2-71cb8a235c7e/e3274dd0-155e-521a-b1c2-71cb8a235c7e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 428680,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl3/c1213aa4241a47b1880e6f56096d3340/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3274dd0-155e-521a-b1c2-71cb8a235c7e/e3274dd0-155e-521a-b1c2-71cb8a235c7e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 391009,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl3/c1213aa4241a47b1880e6f56096d3340/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3274dd0-155e-521a-b1c2-71cb8a235c7e/e3274dd0-155e-521a-b1c2-71cb8a235c7e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 517920,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl3/c1213aa4241a47b1880e6f56096d3340/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3274dd0-155e-521a-b1c2-71cb8a235c7e/e3274dd0-155e-521a-b1c2-71cb8a235c7e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 295842,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl3/c1213aa4241a47b1880e6f56096d3340/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3274dd0-155e-521a-b1c2-71cb8a235c7e/e3274dd0-155e-521a-b1c2-71cb8a235c7e_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 231004,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl3/c1213aa4241a47b1880e6f56096d3340/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3274dd0-155e-521a-b1c2-71cb8a235c7e/e3274dd0-155e-521a-b1c2-71cb8a235c7e_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 435714,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl3/c1213aa4241a47b1880e6f56096d3340/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3274dd0-155e-521a-b1c2-71cb8a235c7e/e3274dd0-155e-521a-b1c2-71cb8a235c7e_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 669850,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl3/c1213aa4241a47b1880e6f56096d3340/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3274dd0-155e-521a-b1c2-71cb8a235c7e/e3274dd0-155e-521a-b1c2-71cb8a235c7e_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 439340,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl3/c1213aa4241a47b1880e6f56096d3340/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-10-27',
'seats_number': 5,
'seller_name': None,
'title': 'FIAT FIAT 500X 1.3 Mjet 95cv E6D Club Cross over 5-door (Euro 6D) -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-25 16:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983509%27 HTTP/1.1" 200 None
2026-03-25 16:30:42 [ayvens.it] INFO: Saving data for 1983509: {'created_time': 1774456242.867299, 'last_price_update_time': 1774456242.867313, 'auction_closing_time': 1774603800.0}
2026-03-25 16:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1983509') HTTP/1.1" 204 0
2026-03-25 16:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh6%252F106a200b436e4ad197fe602bb0788915%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh6/106a200b436e4ad197fe602bb0788915/images/large/10.jpg not downloaded yet
2026-03-25 16:30:42 [ayvens.it] INFO: Found listing with ID: 1983513
2026-03-25 16:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983513%27 HTTP/1.1" 200 None
2026-03-25 16:30:43 [ayvens.it] INFO: Scrape type for 1983513: 1
2026-03-25 16:30:43 [ayvens.it] INFO: Extracting data for car ID: 1983513
2026-03-25 16:30:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5acd321c-4a5a-5b6c-9bb3-c1c0f3b07ce1 with identifier: 1983513
2026-03-25 16:30:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5acd321c-4a5a-5b6c-9bb3-c1c0f3b07ce1 with scrape type 1
2026-03-25 16:30:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5acd321c-4a5a-5b6c-9bb3-c1c0f3b07ce1
2026-03-25 16:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp0%252F854ed155bbc04992b4ae22744a224d6a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp0/854ed155bbc04992b4ae22744a224d6a/images/large/1.jpg not downloaded yet
2026-03-25 16:30:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:30:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc592490>
2026-03-25 16:30:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:30:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:30:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:30:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b0a908d-16f5-5e90-8bc9-b7f609ec4cc3/3b0a908d-16f5-5e90-8bc9-b7f609ec4cc3_image_3.jpg HTTP/1.1" 201 0
2026-03-25 16:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj3%252F1e4b2dcc50fd482a8c5150005050c7c5%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 16:30:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj3/1e4b2dcc50fd482a8c5150005050c7c5/images/large/4.jpg saved to cache
2026-03-25 16:30:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3b0a908d-16f5-5e90-8bc9-b7f609ec4cc3
2026-03-25 16:30:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:30:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcc4db10>
2026-03-25 16:30:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:30:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:30:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:30:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b0a908d-16f5-5e90-8bc9-b7f609ec4cc3/3b0a908d-16f5-5e90-8bc9-b7f609ec4cc3_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj3%252F1e4b2dcc50fd482a8c5150005050c7c5%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 16:30:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj3/1e4b2dcc50fd482a8c5150005050c7c5/images/large/1.jpg saved to cache
2026-03-25 16:30:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3b0a908d-16f5-5e90-8bc9-b7f609ec4cc3
2026-03-25 16:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp0%252F854ed155bbc04992b4ae22744a224d6a%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp0/854ed155bbc04992b4ae22744a224d6a/images/large/2.jpg not downloaded yet
2026-03-25 16:30:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj3/1e4b2dcc50fd482a8c5150005050c7c5/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp0%252F854ed155bbc04992b4ae22744a224d6a%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp0/854ed155bbc04992b4ae22744a224d6a/images/large/3.jpg not downloaded yet
2026-03-25 16:30:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj3/1e4b2dcc50fd482a8c5150005050c7c5/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl6/7d95e6721221477bb945ba499e92f351/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj3/1e4b2dcc50fd482a8c5150005050c7c5/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp0%252F854ed155bbc04992b4ae22744a224d6a%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp0/854ed155bbc04992b4ae22744a224d6a/images/large/4.jpg not downloaded yet
2026-03-25 16:30:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj3/1e4b2dcc50fd482a8c5150005050c7c5/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj3/1e4b2dcc50fd482a8c5150005050c7c5/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj3/1e4b2dcc50fd482a8c5150005050c7c5/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj3/1e4b2dcc50fd482a8c5150005050c7c5/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp0%252F854ed155bbc04992b4ae22744a224d6a%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp0/854ed155bbc04992b4ae22744a224d6a/images/large/5.jpg not downloaded yet
2026-03-25 16:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp0%252F854ed155bbc04992b4ae22744a224d6a%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp0/854ed155bbc04992b4ae22744a224d6a/images/large/6.jpg not downloaded yet
2026-03-25 16:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp0%252F854ed155bbc04992b4ae22744a224d6a%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp0/854ed155bbc04992b4ae22744a224d6a/images/large/7.jpg not downloaded yet
2026-03-25 16:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp0%252F854ed155bbc04992b4ae22744a224d6a%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp0/854ed155bbc04992b4ae22744a224d6a/images/large/8.jpg not downloaded yet
2026-03-25 16:30:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:30:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34d74099d0>
2026-03-25 16:30:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:30:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:30:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:30:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b0a908d-16f5-5e90-8bc9-b7f609ec4cc3/3b0a908d-16f5-5e90-8bc9-b7f609ec4cc3_image_5.jpg HTTP/1.1" 201 0
2026-03-25 16:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj3%252F1e4b2dcc50fd482a8c5150005050c7c5%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 16:30:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj3/1e4b2dcc50fd482a8c5150005050c7c5/images/large/6.jpg saved to cache
2026-03-25 16:30:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3b0a908d-16f5-5e90-8bc9-b7f609ec4cc3
2026-03-25 16:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp0%252F854ed155bbc04992b4ae22744a224d6a%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp0/854ed155bbc04992b4ae22744a224d6a/images/large/9.jpg not downloaded yet
2026-03-25 16:30:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:30:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc8d49d0>
2026-03-25 16:30:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:30:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:30:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:30:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b0a908d-16f5-5e90-8bc9-b7f609ec4cc3/3b0a908d-16f5-5e90-8bc9-b7f609ec4cc3_image_4.jpg HTTP/1.1" 201 0
2026-03-25 16:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj3%252F1e4b2dcc50fd482a8c5150005050c7c5%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 16:30:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj3/1e4b2dcc50fd482a8c5150005050c7c5/images/large/5.jpg saved to cache
2026-03-25 16:30:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3b0a908d-16f5-5e90-8bc9-b7f609ec4cc3
2026-03-25 16:30:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:30:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34de565c10>
2026-03-25 16:30:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:30:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:30:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:30:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3e0a7ab-98de-54e3-9a43-eae4518a239d/c3e0a7ab-98de-54e3-9a43-eae4518a239d_image_9.jpg HTTP/1.1" 201 0
2026-03-25 16:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl6%252F7d95e6721221477bb945ba499e92f351%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 16:30:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl6/7d95e6721221477bb945ba499e92f351/images/large/10.jpg saved to cache
2026-03-25 16:30:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c3e0a7ab-98de-54e3-9a43-eae4518a239d
2026-03-25 16:30:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:30:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcaaaf50>
2026-03-25 16:30:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:30:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:30:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:30:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b0a908d-16f5-5e90-8bc9-b7f609ec4cc3/3b0a908d-16f5-5e90-8bc9-b7f609ec4cc3_image_2.jpg HTTP/1.1" 201 0
2026-03-25 16:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj3%252F1e4b2dcc50fd482a8c5150005050c7c5%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 16:30:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj3/1e4b2dcc50fd482a8c5150005050c7c5/images/large/3.jpg saved to cache
2026-03-25 16:30:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3b0a908d-16f5-5e90-8bc9-b7f609ec4cc3
2026-03-25 16:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp0%252F854ed155bbc04992b4ae22744a224d6a%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp0/854ed155bbc04992b4ae22744a224d6a/images/large/10.jpg not downloaded yet
2026-03-25 16:30:43 [ayvens.it] INFO: Found listing with ID: 1983514
2026-03-25 16:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983514%27 HTTP/1.1" 200 None
2026-03-25 16:30:43 [ayvens.it] INFO: Scrape type for 1983514: 1
2026-03-25 16:30:43 [ayvens.it] INFO: Extracting data for car ID: 1983514
2026-03-25 16:30:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 04dff106-874b-5215-9148-3413536a64e5 with identifier: 1983514
2026-03-25 16:30:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 04dff106-874b-5215-9148-3413536a64e5 with scrape type 1
2026-03-25 16:30:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 04dff106-874b-5215-9148-3413536a64e5
2026-03-25 16:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn9%252Fa7513ec17d1c41ccbe75fc5e723aa91c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn9/a7513ec17d1c41ccbe75fc5e723aa91c/images/large/1.jpg not downloaded yet
2026-03-25 16:30:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:30:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc9b0f10>
2026-03-25 16:30:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:30:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:30:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:30:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b0a908d-16f5-5e90-8bc9-b7f609ec4cc3/3b0a908d-16f5-5e90-8bc9-b7f609ec4cc3_image_1.jpg HTTP/1.1" 201 0
2026-03-25 16:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj3%252F1e4b2dcc50fd482a8c5150005050c7c5%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 16:30:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj3/1e4b2dcc50fd482a8c5150005050c7c5/images/large/2.jpg saved to cache
2026-03-25 16:30:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3b0a908d-16f5-5e90-8bc9-b7f609ec4cc3
2026-03-25 16:30:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:30:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc803910>
2026-03-25 16:30:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:30:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:30:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:30:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b0a908d-16f5-5e90-8bc9-b7f609ec4cc3/3b0a908d-16f5-5e90-8bc9-b7f609ec4cc3_image_6.jpg HTTP/1.1" 201 0
2026-03-25 16:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj3%252F1e4b2dcc50fd482a8c5150005050c7c5%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 16:30:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj3/1e4b2dcc50fd482a8c5150005050c7c5/images/large/7.jpg saved to cache
2026-03-25 16:30:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3b0a908d-16f5-5e90-8bc9-b7f609ec4cc3
2026-03-25 16:30:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:30:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc587ed0>
2026-03-25 16:30:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:30:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:30:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:30:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b0a908d-16f5-5e90-8bc9-b7f609ec4cc3/3b0a908d-16f5-5e90-8bc9-b7f609ec4cc3_image_9.jpg HTTP/1.1" 201 0
2026-03-25 16:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj3%252F1e4b2dcc50fd482a8c5150005050c7c5%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 16:30:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj3/1e4b2dcc50fd482a8c5150005050c7c5/images/large/10.jpg saved to cache
2026-03-25 16:30:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3b0a908d-16f5-5e90-8bc9-b7f609ec4cc3
2026-03-25 16:30:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:30:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc5fb750>
2026-03-25 16:30:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:30:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:30:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:30:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b0a908d-16f5-5e90-8bc9-b7f609ec4cc3/3b0a908d-16f5-5e90-8bc9-b7f609ec4cc3_image_8.jpg HTTP/1.1" 201 0
2026-03-25 16:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj3%252F1e4b2dcc50fd482a8c5150005050c7c5%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 16:30:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj3/1e4b2dcc50fd482a8c5150005050c7c5/images/large/9.jpg saved to cache
2026-03-25 16:30:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3b0a908d-16f5-5e90-8bc9-b7f609ec4cc3
2026-03-25 16:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn9%252Fa7513ec17d1c41ccbe75fc5e723aa91c%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn9/a7513ec17d1c41ccbe75fc5e723aa91c/images/large/2.jpg not downloaded yet
2026-03-25 16:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn9%252Fa7513ec17d1c41ccbe75fc5e723aa91c%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn9/a7513ec17d1c41ccbe75fc5e723aa91c/images/large/3.jpg not downloaded yet
2026-03-25 16:30:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh6/106a200b436e4ad197fe602bb0788915/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh6/106a200b436e4ad197fe602bb0788915/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh6/106a200b436e4ad197fe602bb0788915/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj3/1e4b2dcc50fd482a8c5150005050c7c5/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn9%252Fa7513ec17d1c41ccbe75fc5e723aa91c%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn9/a7513ec17d1c41ccbe75fc5e723aa91c/images/large/4.jpg not downloaded yet
2026-03-25 16:30:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh6/106a200b436e4ad197fe602bb0788915/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh6/106a200b436e4ad197fe602bb0788915/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh6/106a200b436e4ad197fe602bb0788915/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl6/7d95e6721221477bb945ba499e92f351/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn9%252Fa7513ec17d1c41ccbe75fc5e723aa91c%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn9/a7513ec17d1c41ccbe75fc5e723aa91c/images/large/5.jpg not downloaded yet
2026-03-25 16:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn9%252Fa7513ec17d1c41ccbe75fc5e723aa91c%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn9/a7513ec17d1c41ccbe75fc5e723aa91c/images/large/6.jpg not downloaded yet
2026-03-25 16:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn9%252Fa7513ec17d1c41ccbe75fc5e723aa91c%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn9/a7513ec17d1c41ccbe75fc5e723aa91c/images/large/7.jpg not downloaded yet
2026-03-25 16:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn9%252Fa7513ec17d1c41ccbe75fc5e723aa91c%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn9/a7513ec17d1c41ccbe75fc5e723aa91c/images/large/8.jpg not downloaded yet
2026-03-25 16:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn9%252Fa7513ec17d1c41ccbe75fc5e723aa91c%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn9/a7513ec17d1c41ccbe75fc5e723aa91c/images/large/9.jpg not downloaded yet
2026-03-25 16:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn9%252Fa7513ec17d1c41ccbe75fc5e723aa91c%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn9/a7513ec17d1c41ccbe75fc5e723aa91c/images/large/10.jpg not downloaded yet
2026-03-25 16:30:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:30:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc992350>
2026-03-25 16:30:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:30:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:30:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:30:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad2c32b9-5578-5fd3-9993-08aa9305e9e0/ad2c32b9-5578-5fd3-9993-08aa9305e9e0_image_7.jpg HTTP/1.1" 201 0
2026-03-25 16:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh6%252F106a200b436e4ad197fe602bb0788915%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 16:30:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh6/106a200b436e4ad197fe602bb0788915/images/large/8.jpg saved to cache
2026-03-25 16:30:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ad2c32b9-5578-5fd3-9993-08aa9305e9e0
2026-03-25 16:30:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:30:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc5b4950>
2026-03-25 16:30:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:30:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:30:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:30:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad2c32b9-5578-5fd3-9993-08aa9305e9e0/ad2c32b9-5578-5fd3-9993-08aa9305e9e0_image_6.jpg HTTP/1.1" 201 0
2026-03-25 16:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh6%252F106a200b436e4ad197fe602bb0788915%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 16:30:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh6/106a200b436e4ad197fe602bb0788915/images/large/7.jpg saved to cache
2026-03-25 16:30:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ad2c32b9-5578-5fd3-9993-08aa9305e9e0
2026-03-25 16:30:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:30:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc9f0e10>
2026-03-25 16:30:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:30:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:30:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:30:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad2c32b9-5578-5fd3-9993-08aa9305e9e0/ad2c32b9-5578-5fd3-9993-08aa9305e9e0_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh6%252F106a200b436e4ad197fe602bb0788915%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 16:30:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh6/106a200b436e4ad197fe602bb0788915/images/large/1.jpg saved to cache
2026-03-25 16:30:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ad2c32b9-5578-5fd3-9993-08aa9305e9e0
2026-03-25 16:30:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:30:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcae9250>
2026-03-25 16:30:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:30:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:30:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:30:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b0a908d-16f5-5e90-8bc9-b7f609ec4cc3/3b0a908d-16f5-5e90-8bc9-b7f609ec4cc3_image_7.jpg HTTP/1.1" 201 0
2026-03-25 16:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj3%252F1e4b2dcc50fd482a8c5150005050c7c5%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 16:30:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj3/1e4b2dcc50fd482a8c5150005050c7c5/images/large/8.jpg saved to cache
2026-03-25 16:30:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3b0a908d-16f5-5e90-8bc9-b7f609ec4cc3
2026-03-25 16:30:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3b0a908d-16f5-5e90-8bc9-b7f609ec4cc3, skipping ID generation
2026-03-25 16:30:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3b0a908d-16f5-5e90-8bc9-b7f609ec4cc3 with scrape type 1
2026-03-25 16:30:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3b0a908d-16f5-5e90-8bc9-b7f609ec4cc3 sending to next pipeline
2026-03-25 16:30:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 3b0a908d-16f5-5e90-8bc9-b7f609ec4cc3, identifier: 1983511
2026-03-25 16:30:45 [ayvens.it] INFO: Found listing with ID: 1983515
2026-03-25 16:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983515%27 HTTP/1.1" 200 None
2026-03-25 16:30:45 [ayvens.it] INFO: Scrape type for 1983515: 1
2026-03-25 16:30:45 [ayvens.it] INFO: Extracting data for car ID: 1983515
2026-03-25 16:30:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 378ffb94-f0ac-5fbd-b6eb-d3d9e6f9fcee with identifier: 1983515
2026-03-25 16:30:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 378ffb94-f0ac-5fbd-b6eb-d3d9e6f9fcee with scrape type 1
2026-03-25 16:30:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 378ffb94-f0ac-5fbd-b6eb-d3d9e6f9fcee
2026-03-25 16:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp2%252F5f254401a449415e9b19e693067aa410%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp2/5f254401a449415e9b19e693067aa410/images/large/1.jpg not downloaded yet
2026-03-25 16:30:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 3b0a908d-16f5-5e90-8bc9-b7f609ec4cc3 with identifier: 1983511
2026-03-25 16:30:45 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:30:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 3b0a908d-16f5-5e90-8bc9-b7f609ec4cc3 with identifier: 1983511
2026-03-25 16:30:45 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 3b0a908d-16f5-5e90-8bc9-b7f609ec4cc3 with identifier: 1983511 to the API
2026-03-25 16:30:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:30:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:30:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gj3/1e4b2dcc50fd482a8c5150005050c7c5/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Agate Black metallizzato',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-27T09:30:00Z',
'fuel_type': 'diesel',
'id': '3b0a908d-16f5-5e90-8bc9-b7f609ec4cc3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41025',
'listing': 'auction',
'location': None,
'make': 'FORD',
'model': 'FORD KUGA 1.5 EcoBlue 120CV 2WD Titanium Bus. Auto Sport utility '
'vehicle 5-door (Euro 6.2)',
'odometer': 141591,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 28,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b0a908d-16f5-5e90-8bc9-b7f609ec4cc3/3b0a908d-16f5-5e90-8bc9-b7f609ec4cc3_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 743873,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj3/1e4b2dcc50fd482a8c5150005050c7c5/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b0a908d-16f5-5e90-8bc9-b7f609ec4cc3/3b0a908d-16f5-5e90-8bc9-b7f609ec4cc3_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 743873,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj3/1e4b2dcc50fd482a8c5150005050c7c5/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b0a908d-16f5-5e90-8bc9-b7f609ec4cc3/3b0a908d-16f5-5e90-8bc9-b7f609ec4cc3_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 681300,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj3/1e4b2dcc50fd482a8c5150005050c7c5/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b0a908d-16f5-5e90-8bc9-b7f609ec4cc3/3b0a908d-16f5-5e90-8bc9-b7f609ec4cc3_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 734137,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj3/1e4b2dcc50fd482a8c5150005050c7c5/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b0a908d-16f5-5e90-8bc9-b7f609ec4cc3/3b0a908d-16f5-5e90-8bc9-b7f609ec4cc3_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 721325,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj3/1e4b2dcc50fd482a8c5150005050c7c5/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b0a908d-16f5-5e90-8bc9-b7f609ec4cc3/3b0a908d-16f5-5e90-8bc9-b7f609ec4cc3_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 594945,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj3/1e4b2dcc50fd482a8c5150005050c7c5/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b0a908d-16f5-5e90-8bc9-b7f609ec4cc3/3b0a908d-16f5-5e90-8bc9-b7f609ec4cc3_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 621142,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj3/1e4b2dcc50fd482a8c5150005050c7c5/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b0a908d-16f5-5e90-8bc9-b7f609ec4cc3/3b0a908d-16f5-5e90-8bc9-b7f609ec4cc3_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 626554,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj3/1e4b2dcc50fd482a8c5150005050c7c5/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b0a908d-16f5-5e90-8bc9-b7f609ec4cc3/3b0a908d-16f5-5e90-8bc9-b7f609ec4cc3_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 614708,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj3/1e4b2dcc50fd482a8c5150005050c7c5/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b0a908d-16f5-5e90-8bc9-b7f609ec4cc3/3b0a908d-16f5-5e90-8bc9-b7f609ec4cc3_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 559897,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj3/1e4b2dcc50fd482a8c5150005050c7c5/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-01-26',
'seats_number': 5,
'seller_name': None,
'title': 'FORD FORD KUGA 1.5 EcoBlue 120CV 2WD Titanium Bus. Auto Sport '
'utility vehicle 5-door (Euro 6.2) -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-25 16:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983511%27 HTTP/1.1" 200 None
2026-03-25 16:30:45 [ayvens.it] INFO: Saving data for 1983511: {'created_time': 1774456245.387689, 'last_price_update_time': 1774456245.387703, 'auction_closing_time': 1774603800.0}
2026-03-25 16:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1983511') HTTP/1.1" 204 0
2026-03-25 16:30:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:30:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc34f0d0>
2026-03-25 16:30:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:30:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:30:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:30:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad2c32b9-5578-5fd3-9993-08aa9305e9e0/ad2c32b9-5578-5fd3-9993-08aa9305e9e0_image_3.jpg HTTP/1.1" 201 0
2026-03-25 16:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh6%252F106a200b436e4ad197fe602bb0788915%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 16:30:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh6/106a200b436e4ad197fe602bb0788915/images/large/4.jpg saved to cache
2026-03-25 16:30:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ad2c32b9-5578-5fd3-9993-08aa9305e9e0
2026-03-25 16:30:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:30:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dca61c10>
2026-03-25 16:30:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:30:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:30:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:30:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad2c32b9-5578-5fd3-9993-08aa9305e9e0/ad2c32b9-5578-5fd3-9993-08aa9305e9e0_image_2.jpg HTTP/1.1" 201 0
2026-03-25 16:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh6%252F106a200b436e4ad197fe602bb0788915%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 16:30:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh6/106a200b436e4ad197fe602bb0788915/images/large/3.jpg saved to cache
2026-03-25 16:30:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ad2c32b9-5578-5fd3-9993-08aa9305e9e0
2026-03-25 16:30:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:30:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc82d450>
2026-03-25 16:30:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:30:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:30:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:30:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad2c32b9-5578-5fd3-9993-08aa9305e9e0/ad2c32b9-5578-5fd3-9993-08aa9305e9e0_image_1.jpg HTTP/1.1" 201 0
2026-03-25 16:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh6%252F106a200b436e4ad197fe602bb0788915%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 16:30:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh6/106a200b436e4ad197fe602bb0788915/images/large/2.jpg saved to cache
2026-03-25 16:30:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ad2c32b9-5578-5fd3-9993-08aa9305e9e0
2026-03-25 16:30:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:30:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc371490>
2026-03-25 16:30:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:30:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:30:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:30:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3e0a7ab-98de-54e3-9a43-eae4518a239d/c3e0a7ab-98de-54e3-9a43-eae4518a239d_image_8.jpg HTTP/1.1" 201 0
2026-03-25 16:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl6%252F7d95e6721221477bb945ba499e92f351%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 16:30:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl6/7d95e6721221477bb945ba499e92f351/images/large/9.jpg saved to cache
2026-03-25 16:30:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c3e0a7ab-98de-54e3-9a43-eae4518a239d
2026-03-25 16:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp2%252F5f254401a449415e9b19e693067aa410%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp2/5f254401a449415e9b19e693067aa410/images/large/2.jpg not downloaded yet
2026-03-25 16:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp2%252F5f254401a449415e9b19e693067aa410%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp2/5f254401a449415e9b19e693067aa410/images/large/3.jpg not downloaded yet
2026-03-25 16:30:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp0/854ed155bbc04992b4ae22744a224d6a/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp0/854ed155bbc04992b4ae22744a224d6a/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp0/854ed155bbc04992b4ae22744a224d6a/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp0/854ed155bbc04992b4ae22744a224d6a/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp2%252F5f254401a449415e9b19e693067aa410%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp2/5f254401a449415e9b19e693067aa410/images/large/4.jpg not downloaded yet
2026-03-25 16:30:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh6/106a200b436e4ad197fe602bb0788915/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp2%252F5f254401a449415e9b19e693067aa410%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp2/5f254401a449415e9b19e693067aa410/images/large/5.jpg not downloaded yet
2026-03-25 16:30:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp0/854ed155bbc04992b4ae22744a224d6a/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp0/854ed155bbc04992b4ae22744a224d6a/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp0/854ed155bbc04992b4ae22744a224d6a/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp2%252F5f254401a449415e9b19e693067aa410%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp2/5f254401a449415e9b19e693067aa410/images/large/6.jpg not downloaded yet
2026-03-25 16:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp2%252F5f254401a449415e9b19e693067aa410%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp2/5f254401a449415e9b19e693067aa410/images/large/7.jpg not downloaded yet
2026-03-25 16:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp2%252F5f254401a449415e9b19e693067aa410%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp2/5f254401a449415e9b19e693067aa410/images/large/8.jpg not downloaded yet
2026-03-25 16:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp2%252F5f254401a449415e9b19e693067aa410%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp2/5f254401a449415e9b19e693067aa410/images/large/9.jpg not downloaded yet
2026-03-25 16:30:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:30:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcb1cd90>
2026-03-25 16:30:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:30:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:30:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:30:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5acd321c-4a5a-5b6c-9bb3-c1c0f3b07ce1/5acd321c-4a5a-5b6c-9bb3-c1c0f3b07ce1_image_2.jpg HTTP/1.1" 201 0
2026-03-25 16:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp0%252F854ed155bbc04992b4ae22744a224d6a%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 16:30:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp0/854ed155bbc04992b4ae22744a224d6a/images/large/3.jpg saved to cache
2026-03-25 16:30:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5acd321c-4a5a-5b6c-9bb3-c1c0f3b07ce1
2026-03-25 16:30:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:30:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcc4e2d0>
2026-03-25 16:30:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:30:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:30:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:30:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5acd321c-4a5a-5b6c-9bb3-c1c0f3b07ce1/5acd321c-4a5a-5b6c-9bb3-c1c0f3b07ce1_image_8.jpg HTTP/1.1" 201 0
2026-03-25 16:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp0%252F854ed155bbc04992b4ae22744a224d6a%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 16:30:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp0/854ed155bbc04992b4ae22744a224d6a/images/large/9.jpg saved to cache
2026-03-25 16:30:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5acd321c-4a5a-5b6c-9bb3-c1c0f3b07ce1
2026-03-25 16:30:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:30:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc56e590>
2026-03-25 16:30:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:30:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:30:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:30:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5acd321c-4a5a-5b6c-9bb3-c1c0f3b07ce1/5acd321c-4a5a-5b6c-9bb3-c1c0f3b07ce1_image_5.jpg HTTP/1.1" 201 0
2026-03-25 16:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp0%252F854ed155bbc04992b4ae22744a224d6a%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 16:30:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp0/854ed155bbc04992b4ae22744a224d6a/images/large/6.jpg saved to cache
2026-03-25 16:30:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5acd321c-4a5a-5b6c-9bb3-c1c0f3b07ce1
2026-03-25 16:30:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:30:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc94e4d0>
2026-03-25 16:30:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:30:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:30:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:30:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5acd321c-4a5a-5b6c-9bb3-c1c0f3b07ce1/5acd321c-4a5a-5b6c-9bb3-c1c0f3b07ce1_image_7.jpg HTTP/1.1" 201 0
2026-03-25 16:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp0%252F854ed155bbc04992b4ae22744a224d6a%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 16:30:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp0/854ed155bbc04992b4ae22744a224d6a/images/large/8.jpg saved to cache
2026-03-25 16:30:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5acd321c-4a5a-5b6c-9bb3-c1c0f3b07ce1
2026-03-25 16:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp2%252F5f254401a449415e9b19e693067aa410%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp2/5f254401a449415e9b19e693067aa410/images/large/10.jpg not downloaded yet
2026-03-25 16:30:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:30:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34d6b1eb10>
2026-03-25 16:30:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:30:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:30:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:30:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad2c32b9-5578-5fd3-9993-08aa9305e9e0/ad2c32b9-5578-5fd3-9993-08aa9305e9e0_image_9.jpg HTTP/1.1" 201 0
2026-03-25 16:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh6%252F106a200b436e4ad197fe602bb0788915%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 16:30:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh6/106a200b436e4ad197fe602bb0788915/images/large/10.jpg saved to cache
2026-03-25 16:30:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ad2c32b9-5578-5fd3-9993-08aa9305e9e0
2026-03-25 16:30:46 [ayvens.it] INFO: Found listing with ID: 1983516
2026-03-25 16:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983516%27 HTTP/1.1" 200 None
2026-03-25 16:30:46 [ayvens.it] INFO: Scrape type for 1983516: 1
2026-03-25 16:30:46 [ayvens.it] INFO: Extracting data for car ID: 1983516
2026-03-25 16:30:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5ceaa04c-246a-55ae-bcd3-69360150fb1d with identifier: 1983516
2026-03-25 16:30:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5ceaa04c-246a-55ae-bcd3-69360150fb1d with scrape type 1
2026-03-25 16:30:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5ceaa04c-246a-55ae-bcd3-69360150fb1d
2026-03-25 16:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt1%252F2543eca7d44346b584da76cdcf10ae1c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt1/2543eca7d44346b584da76cdcf10ae1c/images/large/1.jpg not downloaded yet
2026-03-25 16:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt1%252F2543eca7d44346b584da76cdcf10ae1c%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt1/2543eca7d44346b584da76cdcf10ae1c/images/large/2.jpg not downloaded yet
2026-03-25 16:30:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:30:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc359d50>
2026-03-25 16:30:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:30:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:30:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:30:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5acd321c-4a5a-5b6c-9bb3-c1c0f3b07ce1/5acd321c-4a5a-5b6c-9bb3-c1c0f3b07ce1_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp0%252F854ed155bbc04992b4ae22744a224d6a%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 16:30:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp0/854ed155bbc04992b4ae22744a224d6a/images/large/1.jpg saved to cache
2026-03-25 16:30:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5acd321c-4a5a-5b6c-9bb3-c1c0f3b07ce1
2026-03-25 16:30:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:30:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc356890>
2026-03-25 16:30:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:30:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:30:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:30:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5acd321c-4a5a-5b6c-9bb3-c1c0f3b07ce1/5acd321c-4a5a-5b6c-9bb3-c1c0f3b07ce1_image_1.jpg HTTP/1.1" 201 0
2026-03-25 16:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp0%252F854ed155bbc04992b4ae22744a224d6a%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 16:30:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp0/854ed155bbc04992b4ae22744a224d6a/images/large/2.jpg saved to cache
2026-03-25 16:30:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5acd321c-4a5a-5b6c-9bb3-c1c0f3b07ce1
2026-03-25 16:30:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:30:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc56f0d0>
2026-03-25 16:30:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:30:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:30:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:30:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5acd321c-4a5a-5b6c-9bb3-c1c0f3b07ce1/5acd321c-4a5a-5b6c-9bb3-c1c0f3b07ce1_image_6.jpg HTTP/1.1" 201 0
2026-03-25 16:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp0%252F854ed155bbc04992b4ae22744a224d6a%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 16:30:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp0/854ed155bbc04992b4ae22744a224d6a/images/large/7.jpg saved to cache
2026-03-25 16:30:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5acd321c-4a5a-5b6c-9bb3-c1c0f3b07ce1
2026-03-25 16:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt1%252F2543eca7d44346b584da76cdcf10ae1c%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt1/2543eca7d44346b584da76cdcf10ae1c/images/large/3.jpg not downloaded yet
2026-03-25 16:30:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn9/a7513ec17d1c41ccbe75fc5e723aa91c/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn9/a7513ec17d1c41ccbe75fc5e723aa91c/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn9/a7513ec17d1c41ccbe75fc5e723aa91c/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn9/a7513ec17d1c41ccbe75fc5e723aa91c/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt1%252F2543eca7d44346b584da76cdcf10ae1c%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt1/2543eca7d44346b584da76cdcf10ae1c/images/large/4.jpg not downloaded yet
2026-03-25 16:30:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn9/a7513ec17d1c41ccbe75fc5e723aa91c/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn9/a7513ec17d1c41ccbe75fc5e723aa91c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp0/854ed155bbc04992b4ae22744a224d6a/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt1%252F2543eca7d44346b584da76cdcf10ae1c%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt1/2543eca7d44346b584da76cdcf10ae1c/images/large/5.jpg not downloaded yet
2026-03-25 16:30:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp2/5f254401a449415e9b19e693067aa410/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt1%252F2543eca7d44346b584da76cdcf10ae1c%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt1/2543eca7d44346b584da76cdcf10ae1c/images/large/6.jpg not downloaded yet
2026-03-25 16:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt1%252F2543eca7d44346b584da76cdcf10ae1c%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt1/2543eca7d44346b584da76cdcf10ae1c/images/large/7.jpg not downloaded yet
2026-03-25 16:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt1%252F2543eca7d44346b584da76cdcf10ae1c%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt1/2543eca7d44346b584da76cdcf10ae1c/images/large/8.jpg not downloaded yet
2026-03-25 16:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt1%252F2543eca7d44346b584da76cdcf10ae1c%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt1/2543eca7d44346b584da76cdcf10ae1c/images/large/9.jpg not downloaded yet
2026-03-25 16:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt1%252F2543eca7d44346b584da76cdcf10ae1c%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt1/2543eca7d44346b584da76cdcf10ae1c/images/large/10.jpg not downloaded yet
2026-03-25 16:30:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:30:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc94de10>
2026-03-25 16:30:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:30:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:30:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:30:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_04dff106-874b-5215-9148-3413536a64e5/04dff106-874b-5215-9148-3413536a64e5_image_2.jpg HTTP/1.1" 201 0
2026-03-25 16:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn9%252Fa7513ec17d1c41ccbe75fc5e723aa91c%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 16:30:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn9/a7513ec17d1c41ccbe75fc5e723aa91c/images/large/3.jpg saved to cache
2026-03-25 16:30:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 04dff106-874b-5215-9148-3413536a64e5
2026-03-25 16:30:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:30:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc784b10>
2026-03-25 16:30:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:30:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:30:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:30:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_04dff106-874b-5215-9148-3413536a64e5/04dff106-874b-5215-9148-3413536a64e5_image_1.jpg HTTP/1.1" 201 0
2026-03-25 16:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn9%252Fa7513ec17d1c41ccbe75fc5e723aa91c%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 16:30:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn9/a7513ec17d1c41ccbe75fc5e723aa91c/images/large/2.jpg saved to cache
2026-03-25 16:30:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 04dff106-874b-5215-9148-3413536a64e5
2026-03-25 16:30:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:30:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc9df390>
2026-03-25 16:30:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:30:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:30:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:30:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_04dff106-874b-5215-9148-3413536a64e5/04dff106-874b-5215-9148-3413536a64e5_image_9.jpg HTTP/1.1" 201 0
2026-03-25 16:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn9%252Fa7513ec17d1c41ccbe75fc5e723aa91c%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 16:30:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn9/a7513ec17d1c41ccbe75fc5e723aa91c/images/large/10.jpg saved to cache
2026-03-25 16:30:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 04dff106-874b-5215-9148-3413536a64e5
2026-03-25 16:30:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:30:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcae88d0>
2026-03-25 16:30:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:30:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:30:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:30:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_04dff106-874b-5215-9148-3413536a64e5/04dff106-874b-5215-9148-3413536a64e5_image_7.jpg HTTP/1.1" 201 0
2026-03-25 16:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn9%252Fa7513ec17d1c41ccbe75fc5e723aa91c%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 16:30:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn9/a7513ec17d1c41ccbe75fc5e723aa91c/images/large/8.jpg saved to cache
2026-03-25 16:30:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 04dff106-874b-5215-9148-3413536a64e5
2026-03-25 16:30:47 [ayvens.it] INFO: Found listing with ID: 1983517
2026-03-25 16:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983517%27 HTTP/1.1" 200 None
2026-03-25 16:30:47 [ayvens.it] INFO: Scrape type for 1983517: 1
2026-03-25 16:30:47 [ayvens.it] INFO: Extracting data for car ID: 1983517
2026-03-25 16:30:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 92894306-eabc-56a1-afdc-298c40030e71 with identifier: 1983517
2026-03-25 16:30:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 92894306-eabc-56a1-afdc-298c40030e71 with scrape type 1
2026-03-25 16:30:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 92894306-eabc-56a1-afdc-298c40030e71
2026-03-25 16:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl4%252F367794af31bf48d491bd243293843b96%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl4/367794af31bf48d491bd243293843b96/images/large/1.jpg not downloaded yet
2026-03-25 16:30:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:30:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcae9390>
2026-03-25 16:30:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:30:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:30:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:30:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_04dff106-874b-5215-9148-3413536a64e5/04dff106-874b-5215-9148-3413536a64e5_image_8.jpg HTTP/1.1" 201 0
2026-03-25 16:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn9%252Fa7513ec17d1c41ccbe75fc5e723aa91c%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 16:30:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn9/a7513ec17d1c41ccbe75fc5e723aa91c/images/large/9.jpg saved to cache
2026-03-25 16:30:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 04dff106-874b-5215-9148-3413536a64e5
2026-03-25 16:30:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:30:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc86bf50>
2026-03-25 16:30:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:30:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:30:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:30:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_04dff106-874b-5215-9148-3413536a64e5/04dff106-874b-5215-9148-3413536a64e5_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn9%252Fa7513ec17d1c41ccbe75fc5e723aa91c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 16:30:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn9/a7513ec17d1c41ccbe75fc5e723aa91c/images/large/1.jpg saved to cache
2026-03-25 16:30:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 04dff106-874b-5215-9148-3413536a64e5
2026-03-25 16:30:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:30:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dea7e5d0>
2026-03-25 16:30:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:30:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:30:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:30:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5acd321c-4a5a-5b6c-9bb3-c1c0f3b07ce1/5acd321c-4a5a-5b6c-9bb3-c1c0f3b07ce1_image_9.jpg HTTP/1.1" 201 0
2026-03-25 16:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp0%252F854ed155bbc04992b4ae22744a224d6a%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 16:30:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp0/854ed155bbc04992b4ae22744a224d6a/images/large/10.jpg saved to cache
2026-03-25 16:30:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5acd321c-4a5a-5b6c-9bb3-c1c0f3b07ce1
2026-03-25 16:30:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:30:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dca25410>
2026-03-25 16:30:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:30:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:30:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:30:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_378ffb94-f0ac-5fbd-b6eb-d3d9e6f9fcee/378ffb94-f0ac-5fbd-b6eb-d3d9e6f9fcee_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp2%252F5f254401a449415e9b19e693067aa410%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 16:30:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp2/5f254401a449415e9b19e693067aa410/images/large/1.jpg saved to cache
2026-03-25 16:30:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 378ffb94-f0ac-5fbd-b6eb-d3d9e6f9fcee
2026-03-25 16:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl4%252F367794af31bf48d491bd243293843b96%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl4/367794af31bf48d491bd243293843b96/images/large/2.jpg not downloaded yet
2026-03-25 16:30:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp2/5f254401a449415e9b19e693067aa410/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp2/5f254401a449415e9b19e693067aa410/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl4%252F367794af31bf48d491bd243293843b96%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl4/367794af31bf48d491bd243293843b96/images/large/3.jpg not downloaded yet
2026-03-25 16:30:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp2/5f254401a449415e9b19e693067aa410/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl4%252F367794af31bf48d491bd243293843b96%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl4/367794af31bf48d491bd243293843b96/images/large/4.jpg not downloaded yet
2026-03-25 16:30:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn9/a7513ec17d1c41ccbe75fc5e723aa91c/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn9/a7513ec17d1c41ccbe75fc5e723aa91c/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp2/5f254401a449415e9b19e693067aa410/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn9/a7513ec17d1c41ccbe75fc5e723aa91c/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl4%252F367794af31bf48d491bd243293843b96%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl4/367794af31bf48d491bd243293843b96/images/large/5.jpg not downloaded yet
2026-03-25 16:30:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn9/a7513ec17d1c41ccbe75fc5e723aa91c/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl4%252F367794af31bf48d491bd243293843b96%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl4/367794af31bf48d491bd243293843b96/images/large/6.jpg not downloaded yet
2026-03-25 16:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl4%252F367794af31bf48d491bd243293843b96%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl4/367794af31bf48d491bd243293843b96/images/large/7.jpg not downloaded yet
2026-03-25 16:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl4%252F367794af31bf48d491bd243293843b96%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl4/367794af31bf48d491bd243293843b96/images/large/8.jpg not downloaded yet
2026-03-25 16:30:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:30:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc80c1d0>
2026-03-25 16:30:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:30:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:30:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:30:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_378ffb94-f0ac-5fbd-b6eb-d3d9e6f9fcee/378ffb94-f0ac-5fbd-b6eb-d3d9e6f9fcee_image_1.jpg HTTP/1.1" 201 0
2026-03-25 16:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp2%252F5f254401a449415e9b19e693067aa410%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 16:30:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp2/5f254401a449415e9b19e693067aa410/images/large/2.jpg saved to cache
2026-03-25 16:30:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 378ffb94-f0ac-5fbd-b6eb-d3d9e6f9fcee
2026-03-25 16:30:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:30:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc545290>
2026-03-25 16:30:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:30:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:30:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:30:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_378ffb94-f0ac-5fbd-b6eb-d3d9e6f9fcee/378ffb94-f0ac-5fbd-b6eb-d3d9e6f9fcee_image_4.jpg HTTP/1.1" 201 0
2026-03-25 16:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp2%252F5f254401a449415e9b19e693067aa410%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 16:30:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp2/5f254401a449415e9b19e693067aa410/images/large/5.jpg saved to cache
2026-03-25 16:30:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 378ffb94-f0ac-5fbd-b6eb-d3d9e6f9fcee
2026-03-25 16:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl4%252F367794af31bf48d491bd243293843b96%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl4/367794af31bf48d491bd243293843b96/images/large/9.jpg not downloaded yet
2026-03-25 16:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl4%252F367794af31bf48d491bd243293843b96%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl4/367794af31bf48d491bd243293843b96/images/large/10.jpg not downloaded yet
2026-03-25 16:30:47 [ayvens.it] INFO: Found listing with ID: 1983518
2026-03-25 16:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983518%27 HTTP/1.1" 200 None
2026-03-25 16:30:47 [ayvens.it] INFO: Scrape type for 1983518: 1
2026-03-25 16:30:47 [ayvens.it] INFO: Extracting data for car ID: 1983518
2026-03-25 16:30:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 91bf1031-019b-58c8-991e-9e1a90bc1bea with identifier: 1983518
2026-03-25 16:30:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 91bf1031-019b-58c8-991e-9e1a90bc1bea with scrape type 1
2026-03-25 16:30:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 91bf1031-019b-58c8-991e-9e1a90bc1bea
2026-03-25 16:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga9%252F507aeb10cabf4d8ba026cc7a570c4b73%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga9/507aeb10cabf4d8ba026cc7a570c4b73/images/large/1.jpg not downloaded yet
2026-03-25 16:30:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:30:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc590c50>
2026-03-25 16:30:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:30:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:30:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:30:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_378ffb94-f0ac-5fbd-b6eb-d3d9e6f9fcee/378ffb94-f0ac-5fbd-b6eb-d3d9e6f9fcee_image_2.jpg HTTP/1.1" 201 0
2026-03-25 16:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp2%252F5f254401a449415e9b19e693067aa410%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 16:30:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp2/5f254401a449415e9b19e693067aa410/images/large/3.jpg saved to cache
2026-03-25 16:30:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 378ffb94-f0ac-5fbd-b6eb-d3d9e6f9fcee
2026-03-25 16:30:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:30:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34d74cccd0>
2026-03-25 16:30:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:30:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:30:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:30:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_04dff106-874b-5215-9148-3413536a64e5/04dff106-874b-5215-9148-3413536a64e5_image_6.jpg HTTP/1.1" 201 0
2026-03-25 16:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn9%252Fa7513ec17d1c41ccbe75fc5e723aa91c%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 16:30:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn9/a7513ec17d1c41ccbe75fc5e723aa91c/images/large/7.jpg saved to cache
2026-03-25 16:30:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 04dff106-874b-5215-9148-3413536a64e5
2026-03-25 16:30:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:30:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34d745a350>
2026-03-25 16:30:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:30:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:30:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:30:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_04dff106-874b-5215-9148-3413536a64e5/04dff106-874b-5215-9148-3413536a64e5_image_3.jpg HTTP/1.1" 201 0
2026-03-25 16:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn9%252Fa7513ec17d1c41ccbe75fc5e723aa91c%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 16:30:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn9/a7513ec17d1c41ccbe75fc5e723aa91c/images/large/4.jpg saved to cache
2026-03-25 16:30:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 04dff106-874b-5215-9148-3413536a64e5
2026-03-25 16:30:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:30:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc940750>
2026-03-25 16:30:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:30:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:30:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:30:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_378ffb94-f0ac-5fbd-b6eb-d3d9e6f9fcee/378ffb94-f0ac-5fbd-b6eb-d3d9e6f9fcee_image_3.jpg HTTP/1.1" 201 0
2026-03-25 16:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp2%252F5f254401a449415e9b19e693067aa410%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 16:30:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp2/5f254401a449415e9b19e693067aa410/images/large/4.jpg saved to cache
2026-03-25 16:30:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 378ffb94-f0ac-5fbd-b6eb-d3d9e6f9fcee
2026-03-25 16:30:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:30:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc5e8410>
2026-03-25 16:30:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:30:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:30:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:30:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_04dff106-874b-5215-9148-3413536a64e5/04dff106-874b-5215-9148-3413536a64e5_image_5.jpg HTTP/1.1" 201 0
2026-03-25 16:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn9%252Fa7513ec17d1c41ccbe75fc5e723aa91c%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 16:30:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn9/a7513ec17d1c41ccbe75fc5e723aa91c/images/large/6.jpg saved to cache
2026-03-25 16:30:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 04dff106-874b-5215-9148-3413536a64e5
2026-03-25 16:30:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:30:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc7fb350>
2026-03-25 16:30:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:30:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:30:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:30:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_04dff106-874b-5215-9148-3413536a64e5/04dff106-874b-5215-9148-3413536a64e5_image_4.jpg HTTP/1.1" 201 0
2026-03-25 16:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn9%252Fa7513ec17d1c41ccbe75fc5e723aa91c%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 16:30:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn9/a7513ec17d1c41ccbe75fc5e723aa91c/images/large/5.jpg saved to cache
2026-03-25 16:30:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 04dff106-874b-5215-9148-3413536a64e5
2026-03-25 16:30:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 04dff106-874b-5215-9148-3413536a64e5, skipping ID generation
2026-03-25 16:30:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 04dff106-874b-5215-9148-3413536a64e5 with scrape type 1
2026-03-25 16:30:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 04dff106-874b-5215-9148-3413536a64e5 sending to next pipeline
2026-03-25 16:30:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 04dff106-874b-5215-9148-3413536a64e5, identifier: 1983514
2026-03-25 16:30:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 04dff106-874b-5215-9148-3413536a64e5 with identifier: 1983514
2026-03-25 16:30:49 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:30:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 04dff106-874b-5215-9148-3413536a64e5 with identifier: 1983514
2026-03-25 16:30:49 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 04dff106-874b-5215-9148-3413536a64e5 with identifier: 1983514 to the API
2026-03-25 16:30:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:30:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:30:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gn9/a7513ec17d1c41ccbe75fc5e723aa91c/images/large/5.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'FROZEN WHITE',
'currency': 'EUR',
'doors_number': 4,
'engine': '1.5L',
'expiration_date': '2026-03-27T09:30:00Z',
'fuel_type': 'diesel',
'id': '04dff106-874b-5215-9148-3413536a64e5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41025',
'listing': 'auction',
'location': None,
'make': 'FORD',
'model': 'FORD TRANSIT COURIER 1.5 TDCI 75 CV TREND FP (PC)',
'odometer': 82181,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 20,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_04dff106-874b-5215-9148-3413536a64e5/04dff106-874b-5215-9148-3413536a64e5_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 550607,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn9/a7513ec17d1c41ccbe75fc5e723aa91c/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_04dff106-874b-5215-9148-3413536a64e5/04dff106-874b-5215-9148-3413536a64e5_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 559844,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn9/a7513ec17d1c41ccbe75fc5e723aa91c/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_04dff106-874b-5215-9148-3413536a64e5/04dff106-874b-5215-9148-3413536a64e5_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 550607,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn9/a7513ec17d1c41ccbe75fc5e723aa91c/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_04dff106-874b-5215-9148-3413536a64e5/04dff106-874b-5215-9148-3413536a64e5_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 489166,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn9/a7513ec17d1c41ccbe75fc5e723aa91c/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_04dff106-874b-5215-9148-3413536a64e5/04dff106-874b-5215-9148-3413536a64e5_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 535951,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn9/a7513ec17d1c41ccbe75fc5e723aa91c/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_04dff106-874b-5215-9148-3413536a64e5/04dff106-874b-5215-9148-3413536a64e5_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 541155,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn9/a7513ec17d1c41ccbe75fc5e723aa91c/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_04dff106-874b-5215-9148-3413536a64e5/04dff106-874b-5215-9148-3413536a64e5_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 486239,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn9/a7513ec17d1c41ccbe75fc5e723aa91c/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_04dff106-874b-5215-9148-3413536a64e5/04dff106-874b-5215-9148-3413536a64e5_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 486239,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn9/a7513ec17d1c41ccbe75fc5e723aa91c/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_04dff106-874b-5215-9148-3413536a64e5/04dff106-874b-5215-9148-3413536a64e5_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 532886,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn9/a7513ec17d1c41ccbe75fc5e723aa91c/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_04dff106-874b-5215-9148-3413536a64e5/04dff106-874b-5215-9148-3413536a64e5_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 505669,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn9/a7513ec17d1c41ccbe75fc5e723aa91c/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-03-16',
'seats_number': 5,
'seller_name': None,
'title': 'FORD FORD TRANSIT COURIER 1.5 TDCI 75 CV TREND FP (PC) -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2023}
2026-03-25 16:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983514%27 HTTP/1.1" 200 None
2026-03-25 16:30:49 [ayvens.it] INFO: Saving data for 1983514: {'created_time': 1774456249.299854, 'last_price_update_time': 1774456249.299866, 'auction_closing_time': 1774603800.0}
2026-03-25 16:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1983514') HTTP/1.1" 204 0
2026-03-25 16:30:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt1/2543eca7d44346b584da76cdcf10ae1c/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga9%252F507aeb10cabf4d8ba026cc7a570c4b73%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga9/507aeb10cabf4d8ba026cc7a570c4b73/images/large/2.jpg not downloaded yet
2026-03-25 16:30:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp2/5f254401a449415e9b19e693067aa410/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt1/2543eca7d44346b584da76cdcf10ae1c/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga9%252F507aeb10cabf4d8ba026cc7a570c4b73%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga9/507aeb10cabf4d8ba026cc7a570c4b73/images/large/3.jpg not downloaded yet
2026-03-25 16:30:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp2/5f254401a449415e9b19e693067aa410/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga9%252F507aeb10cabf4d8ba026cc7a570c4b73%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga9/507aeb10cabf4d8ba026cc7a570c4b73/images/large/4.jpg not downloaded yet
2026-03-25 16:30:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt1/2543eca7d44346b584da76cdcf10ae1c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt1/2543eca7d44346b584da76cdcf10ae1c/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp2/5f254401a449415e9b19e693067aa410/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga9%252F507aeb10cabf4d8ba026cc7a570c4b73%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga9/507aeb10cabf4d8ba026cc7a570c4b73/images/large/5.jpg not downloaded yet
2026-03-25 16:30:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt1/2543eca7d44346b584da76cdcf10ae1c/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga9%252F507aeb10cabf4d8ba026cc7a570c4b73%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga9/507aeb10cabf4d8ba026cc7a570c4b73/images/large/6.jpg not downloaded yet
2026-03-25 16:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga9%252F507aeb10cabf4d8ba026cc7a570c4b73%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga9/507aeb10cabf4d8ba026cc7a570c4b73/images/large/7.jpg not downloaded yet
2026-03-25 16:30:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:30:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcab10d0>
2026-03-25 16:30:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:30:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:30:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:30:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5ceaa04c-246a-55ae-bcd3-69360150fb1d/5ceaa04c-246a-55ae-bcd3-69360150fb1d_image_2.jpg HTTP/1.1" 201 0
2026-03-25 16:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt1%252F2543eca7d44346b584da76cdcf10ae1c%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 16:30:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt1/2543eca7d44346b584da76cdcf10ae1c/images/large/3.jpg saved to cache
2026-03-25 16:30:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5ceaa04c-246a-55ae-bcd3-69360150fb1d
2026-03-25 16:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga9%252F507aeb10cabf4d8ba026cc7a570c4b73%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga9/507aeb10cabf4d8ba026cc7a570c4b73/images/large/8.jpg not downloaded yet
2026-03-25 16:30:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:30:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc34ec50>
2026-03-25 16:30:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:30:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:30:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:30:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_378ffb94-f0ac-5fbd-b6eb-d3d9e6f9fcee/378ffb94-f0ac-5fbd-b6eb-d3d9e6f9fcee_image_8.jpg HTTP/1.1" 201 0
2026-03-25 16:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp2%252F5f254401a449415e9b19e693067aa410%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 16:30:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp2/5f254401a449415e9b19e693067aa410/images/large/9.jpg saved to cache
2026-03-25 16:30:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 378ffb94-f0ac-5fbd-b6eb-d3d9e6f9fcee
2026-03-25 16:30:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:30:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc9936d0>
2026-03-25 16:30:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:30:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:30:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:30:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5ceaa04c-246a-55ae-bcd3-69360150fb1d/5ceaa04c-246a-55ae-bcd3-69360150fb1d_image_4.jpg HTTP/1.1" 201 0
2026-03-25 16:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt1%252F2543eca7d44346b584da76cdcf10ae1c%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 16:30:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt1/2543eca7d44346b584da76cdcf10ae1c/images/large/5.jpg saved to cache
2026-03-25 16:30:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5ceaa04c-246a-55ae-bcd3-69360150fb1d
2026-03-25 16:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga9%252F507aeb10cabf4d8ba026cc7a570c4b73%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga9/507aeb10cabf4d8ba026cc7a570c4b73/images/large/9.jpg not downloaded yet
2026-03-25 16:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga9%252F507aeb10cabf4d8ba026cc7a570c4b73%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga9/507aeb10cabf4d8ba026cc7a570c4b73/images/large/10.jpg not downloaded yet
2026-03-25 16:30:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:30:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34d740a190>
2026-03-25 16:30:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:30:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:30:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:30:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_378ffb94-f0ac-5fbd-b6eb-d3d9e6f9fcee/378ffb94-f0ac-5fbd-b6eb-d3d9e6f9fcee_image_7.jpg HTTP/1.1" 201 0
2026-03-25 16:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp2%252F5f254401a449415e9b19e693067aa410%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 16:30:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp2/5f254401a449415e9b19e693067aa410/images/large/8.jpg saved to cache
2026-03-25 16:30:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 378ffb94-f0ac-5fbd-b6eb-d3d9e6f9fcee
2026-03-25 16:30:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:30:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc8242d0>
2026-03-25 16:30:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:30:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:30:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:30:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5ceaa04c-246a-55ae-bcd3-69360150fb1d/5ceaa04c-246a-55ae-bcd3-69360150fb1d_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt1%252F2543eca7d44346b584da76cdcf10ae1c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 16:30:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt1/2543eca7d44346b584da76cdcf10ae1c/images/large/1.jpg saved to cache
2026-03-25 16:30:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5ceaa04c-246a-55ae-bcd3-69360150fb1d
2026-03-25 16:30:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:30:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc2fc2d0>
2026-03-25 16:30:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:30:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:30:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:30:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5ceaa04c-246a-55ae-bcd3-69360150fb1d/5ceaa04c-246a-55ae-bcd3-69360150fb1d_image_3.jpg HTTP/1.1" 201 0
2026-03-25 16:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt1%252F2543eca7d44346b584da76cdcf10ae1c%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 16:30:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt1/2543eca7d44346b584da76cdcf10ae1c/images/large/4.jpg saved to cache
2026-03-25 16:30:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5ceaa04c-246a-55ae-bcd3-69360150fb1d
2026-03-25 16:30:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:30:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc825410>
2026-03-25 16:30:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:30:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:30:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:30:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_378ffb94-f0ac-5fbd-b6eb-d3d9e6f9fcee/378ffb94-f0ac-5fbd-b6eb-d3d9e6f9fcee_image_9.jpg HTTP/1.1" 201 0
2026-03-25 16:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp2%252F5f254401a449415e9b19e693067aa410%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 16:30:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp2/5f254401a449415e9b19e693067aa410/images/large/10.jpg saved to cache
2026-03-25 16:30:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 378ffb94-f0ac-5fbd-b6eb-d3d9e6f9fcee
2026-03-25 16:30:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:30:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc7d2f10>
2026-03-25 16:30:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:30:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:30:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:30:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5ceaa04c-246a-55ae-bcd3-69360150fb1d/5ceaa04c-246a-55ae-bcd3-69360150fb1d_image_1.jpg HTTP/1.1" 201 0
2026-03-25 16:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt1%252F2543eca7d44346b584da76cdcf10ae1c%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 16:30:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt1/2543eca7d44346b584da76cdcf10ae1c/images/large/2.jpg saved to cache
2026-03-25 16:30:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5ceaa04c-246a-55ae-bcd3-69360150fb1d
2026-03-25 16:30:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt1/2543eca7d44346b584da76cdcf10ae1c/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:50 [ayvens.it] INFO: Found listing with ID: 1983519
2026-03-25 16:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983519%27 HTTP/1.1" 200 None
2026-03-25 16:30:50 [ayvens.it] INFO: Scrape type for 1983519: 1
2026-03-25 16:30:50 [ayvens.it] INFO: Extracting data for car ID: 1983519
2026-03-25 16:30:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 312f756d-b76b-5bd7-9f78-3b8d0b0acfee with identifier: 1983519
2026-03-25 16:30:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 312f756d-b76b-5bd7-9f78-3b8d0b0acfee with scrape type 1
2026-03-25 16:30:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 312f756d-b76b-5bd7-9f78-3b8d0b0acfee
2026-03-25 16:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga4%252F07ac3bf3f570405b996339a4dc9f4b8b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga4/07ac3bf3f570405b996339a4dc9f4b8b/images/large/1.jpg not downloaded yet
2026-03-25 16:30:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl4/367794af31bf48d491bd243293843b96/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga4%252F07ac3bf3f570405b996339a4dc9f4b8b%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga4/07ac3bf3f570405b996339a4dc9f4b8b/images/large/2.jpg not downloaded yet
2026-03-25 16:30:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl4/367794af31bf48d491bd243293843b96/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt1/2543eca7d44346b584da76cdcf10ae1c/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga4%252F07ac3bf3f570405b996339a4dc9f4b8b%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga4/07ac3bf3f570405b996339a4dc9f4b8b/images/large/3.jpg not downloaded yet
2026-03-25 16:30:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl4/367794af31bf48d491bd243293843b96/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt1/2543eca7d44346b584da76cdcf10ae1c/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl4/367794af31bf48d491bd243293843b96/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt1/2543eca7d44346b584da76cdcf10ae1c/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga4%252F07ac3bf3f570405b996339a4dc9f4b8b%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga4/07ac3bf3f570405b996339a4dc9f4b8b/images/large/4.jpg not downloaded yet
2026-03-25 16:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga4%252F07ac3bf3f570405b996339a4dc9f4b8b%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga4/07ac3bf3f570405b996339a4dc9f4b8b/images/large/5.jpg not downloaded yet
2026-03-25 16:30:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:30:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34d6b49990>
2026-03-25 16:30:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:30:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:30:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:30:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5ceaa04c-246a-55ae-bcd3-69360150fb1d/5ceaa04c-246a-55ae-bcd3-69360150fb1d_image_8.jpg HTTP/1.1" 201 0
2026-03-25 16:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt1%252F2543eca7d44346b584da76cdcf10ae1c%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 16:30:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt1/2543eca7d44346b584da76cdcf10ae1c/images/large/9.jpg saved to cache
2026-03-25 16:30:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5ceaa04c-246a-55ae-bcd3-69360150fb1d
2026-03-25 16:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga4%252F07ac3bf3f570405b996339a4dc9f4b8b%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga4/07ac3bf3f570405b996339a4dc9f4b8b/images/large/6.jpg not downloaded yet
2026-03-25 16:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga4%252F07ac3bf3f570405b996339a4dc9f4b8b%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga4/07ac3bf3f570405b996339a4dc9f4b8b/images/large/7.jpg not downloaded yet
2026-03-25 16:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga4%252F07ac3bf3f570405b996339a4dc9f4b8b%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga4/07ac3bf3f570405b996339a4dc9f4b8b/images/large/8.jpg not downloaded yet
2026-03-25 16:30:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:30:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcc19c50>
2026-03-25 16:30:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:30:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:30:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:30:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92894306-eabc-56a1-afdc-298c40030e71/92894306-eabc-56a1-afdc-298c40030e71_image_1.jpg HTTP/1.1" 201 0
2026-03-25 16:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl4%252F367794af31bf48d491bd243293843b96%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 16:30:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl4/367794af31bf48d491bd243293843b96/images/large/2.jpg saved to cache
2026-03-25 16:30:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 92894306-eabc-56a1-afdc-298c40030e71
2026-03-25 16:30:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:30:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc5cfd90>
2026-03-25 16:30:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:30:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:30:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:30:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92894306-eabc-56a1-afdc-298c40030e71/92894306-eabc-56a1-afdc-298c40030e71_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl4%252F367794af31bf48d491bd243293843b96%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 16:30:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl4/367794af31bf48d491bd243293843b96/images/large/1.jpg saved to cache
2026-03-25 16:30:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 92894306-eabc-56a1-afdc-298c40030e71
2026-03-25 16:30:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:30:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc579250>
2026-03-25 16:30:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:30:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:30:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:30:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5ceaa04c-246a-55ae-bcd3-69360150fb1d/5ceaa04c-246a-55ae-bcd3-69360150fb1d_image_9.jpg HTTP/1.1" 201 0
2026-03-25 16:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt1%252F2543eca7d44346b584da76cdcf10ae1c%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 16:30:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt1/2543eca7d44346b584da76cdcf10ae1c/images/large/10.jpg saved to cache
2026-03-25 16:30:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5ceaa04c-246a-55ae-bcd3-69360150fb1d
2026-03-25 16:30:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:30:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc75a790>
2026-03-25 16:30:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:30:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:30:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:30:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92894306-eabc-56a1-afdc-298c40030e71/92894306-eabc-56a1-afdc-298c40030e71_image_2.jpg HTTP/1.1" 201 0
2026-03-25 16:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl4%252F367794af31bf48d491bd243293843b96%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 16:30:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl4/367794af31bf48d491bd243293843b96/images/large/3.jpg saved to cache
2026-03-25 16:30:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 92894306-eabc-56a1-afdc-298c40030e71
2026-03-25 16:30:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:30:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcb15a10>
2026-03-25 16:30:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:30:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:30:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:30:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5ceaa04c-246a-55ae-bcd3-69360150fb1d/5ceaa04c-246a-55ae-bcd3-69360150fb1d_image_7.jpg HTTP/1.1" 201 0
2026-03-25 16:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt1%252F2543eca7d44346b584da76cdcf10ae1c%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 16:30:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt1/2543eca7d44346b584da76cdcf10ae1c/images/large/8.jpg saved to cache
2026-03-25 16:30:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5ceaa04c-246a-55ae-bcd3-69360150fb1d
2026-03-25 16:30:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:30:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc5e9110>
2026-03-25 16:30:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:30:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:30:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:30:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92894306-eabc-56a1-afdc-298c40030e71/92894306-eabc-56a1-afdc-298c40030e71_image_3.jpg HTTP/1.1" 201 0
2026-03-25 16:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl4%252F367794af31bf48d491bd243293843b96%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 16:30:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl4/367794af31bf48d491bd243293843b96/images/large/4.jpg saved to cache
2026-03-25 16:30:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 92894306-eabc-56a1-afdc-298c40030e71
2026-03-25 16:30:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:30:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc977f90>
2026-03-25 16:30:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:30:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:30:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:30:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5ceaa04c-246a-55ae-bcd3-69360150fb1d/5ceaa04c-246a-55ae-bcd3-69360150fb1d_image_6.jpg HTTP/1.1" 201 0
2026-03-25 16:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt1%252F2543eca7d44346b584da76cdcf10ae1c%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 16:30:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt1/2543eca7d44346b584da76cdcf10ae1c/images/large/7.jpg saved to cache
2026-03-25 16:30:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5ceaa04c-246a-55ae-bcd3-69360150fb1d
2026-03-25 16:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga4%252F07ac3bf3f570405b996339a4dc9f4b8b%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga4/07ac3bf3f570405b996339a4dc9f4b8b/images/large/9.jpg not downloaded yet
2026-03-25 16:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga4%252F07ac3bf3f570405b996339a4dc9f4b8b%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga4/07ac3bf3f570405b996339a4dc9f4b8b/images/large/10.jpg not downloaded yet
2026-03-25 16:30:51 [ayvens.it] INFO: Found listing with ID: 1983520
2026-03-25 16:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983520%27 HTTP/1.1" 200 None
2026-03-25 16:30:51 [ayvens.it] INFO: Scrape type for 1983520: 1
2026-03-25 16:30:51 [ayvens.it] INFO: Extracting data for car ID: 1983520
2026-03-25 16:30:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8f8d6d0a-aec3-525a-8933-dd8d455542d8 with identifier: 1983520
2026-03-25 16:30:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8f8d6d0a-aec3-525a-8933-dd8d455542d8 with scrape type 1
2026-03-25 16:30:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8f8d6d0a-aec3-525a-8933-dd8d455542d8
2026-03-25 16:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj2%252Ff04195e24d4944b79acc13da774b8903%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj2/f04195e24d4944b79acc13da774b8903/images/large/1.jpg not downloaded yet
2026-03-25 16:30:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga9/507aeb10cabf4d8ba026cc7a570c4b73/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga9/507aeb10cabf4d8ba026cc7a570c4b73/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl4/367794af31bf48d491bd243293843b96/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl4/367794af31bf48d491bd243293843b96/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj2%252Ff04195e24d4944b79acc13da774b8903%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj2/f04195e24d4944b79acc13da774b8903/images/large/2.jpg not downloaded yet
2026-03-25 16:30:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl4/367794af31bf48d491bd243293843b96/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga9/507aeb10cabf4d8ba026cc7a570c4b73/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj2%252Ff04195e24d4944b79acc13da774b8903%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj2/f04195e24d4944b79acc13da774b8903/images/large/3.jpg not downloaded yet
2026-03-25 16:30:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga9/507aeb10cabf4d8ba026cc7a570c4b73/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl4/367794af31bf48d491bd243293843b96/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj2%252Ff04195e24d4944b79acc13da774b8903%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj2/f04195e24d4944b79acc13da774b8903/images/large/4.jpg not downloaded yet
2026-03-25 16:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj2%252Ff04195e24d4944b79acc13da774b8903%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj2/f04195e24d4944b79acc13da774b8903/images/large/5.jpg not downloaded yet
2026-03-25 16:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj2%252Ff04195e24d4944b79acc13da774b8903%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj2/f04195e24d4944b79acc13da774b8903/images/large/6.jpg not downloaded yet
2026-03-25 16:30:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:30:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc9b3310>
2026-03-25 16:30:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:30:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:30:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:30:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91bf1031-019b-58c8-991e-9e1a90bc1bea/91bf1031-019b-58c8-991e-9e1a90bc1bea_image_1.jpg HTTP/1.1" 201 0
2026-03-25 16:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga9%252F507aeb10cabf4d8ba026cc7a570c4b73%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 16:30:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga9/507aeb10cabf4d8ba026cc7a570c4b73/images/large/2.jpg saved to cache
2026-03-25 16:30:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 91bf1031-019b-58c8-991e-9e1a90bc1bea
2026-03-25 16:30:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:30:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dca06990>
2026-03-25 16:30:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:30:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:30:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:30:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91bf1031-019b-58c8-991e-9e1a90bc1bea/91bf1031-019b-58c8-991e-9e1a90bc1bea_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga9%252F507aeb10cabf4d8ba026cc7a570c4b73%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 16:30:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga9/507aeb10cabf4d8ba026cc7a570c4b73/images/large/1.jpg saved to cache
2026-03-25 16:30:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 91bf1031-019b-58c8-991e-9e1a90bc1bea
2026-03-25 16:30:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:30:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc327cd0>
2026-03-25 16:30:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:30:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:30:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:30:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92894306-eabc-56a1-afdc-298c40030e71/92894306-eabc-56a1-afdc-298c40030e71_image_9.jpg HTTP/1.1" 201 0
2026-03-25 16:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl4%252F367794af31bf48d491bd243293843b96%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 16:30:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl4/367794af31bf48d491bd243293843b96/images/large/10.jpg saved to cache
2026-03-25 16:30:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 92894306-eabc-56a1-afdc-298c40030e71
2026-03-25 16:30:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:30:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc354910>
2026-03-25 16:30:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:30:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:30:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:30:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92894306-eabc-56a1-afdc-298c40030e71/92894306-eabc-56a1-afdc-298c40030e71_image_7.jpg HTTP/1.1" 201 0
2026-03-25 16:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl4%252F367794af31bf48d491bd243293843b96%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 16:30:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl4/367794af31bf48d491bd243293843b96/images/large/8.jpg saved to cache
2026-03-25 16:30:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 92894306-eabc-56a1-afdc-298c40030e71
2026-03-25 16:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj2%252Ff04195e24d4944b79acc13da774b8903%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj2/f04195e24d4944b79acc13da774b8903/images/large/7.jpg not downloaded yet
2026-03-25 16:30:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:30:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc354190>
2026-03-25 16:30:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:30:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:30:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:30:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92894306-eabc-56a1-afdc-298c40030e71/92894306-eabc-56a1-afdc-298c40030e71_image_6.jpg HTTP/1.1" 201 0
2026-03-25 16:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl4%252F367794af31bf48d491bd243293843b96%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 16:30:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl4/367794af31bf48d491bd243293843b96/images/large/7.jpg saved to cache
2026-03-25 16:30:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 92894306-eabc-56a1-afdc-298c40030e71
2026-03-25 16:30:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:30:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34d74945d0>
2026-03-25 16:30:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:30:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:30:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:30:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91bf1031-019b-58c8-991e-9e1a90bc1bea/91bf1031-019b-58c8-991e-9e1a90bc1bea_image_3.jpg HTTP/1.1" 201 0
2026-03-25 16:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga9%252F507aeb10cabf4d8ba026cc7a570c4b73%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 16:30:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga9/507aeb10cabf4d8ba026cc7a570c4b73/images/large/4.jpg saved to cache
2026-03-25 16:30:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 91bf1031-019b-58c8-991e-9e1a90bc1bea
2026-03-25 16:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj2%252Ff04195e24d4944b79acc13da774b8903%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj2/f04195e24d4944b79acc13da774b8903/images/large/8.jpg not downloaded yet
2026-03-25 16:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj2%252Ff04195e24d4944b79acc13da774b8903%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj2/f04195e24d4944b79acc13da774b8903/images/large/9.jpg not downloaded yet
2026-03-25 16:30:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:30:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc942a90>
2026-03-25 16:30:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:30:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:30:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:30:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91bf1031-019b-58c8-991e-9e1a90bc1bea/91bf1031-019b-58c8-991e-9e1a90bc1bea_image_2.jpg HTTP/1.1" 201 0
2026-03-25 16:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga9%252F507aeb10cabf4d8ba026cc7a570c4b73%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 16:30:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga9/507aeb10cabf4d8ba026cc7a570c4b73/images/large/3.jpg saved to cache
2026-03-25 16:30:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 91bf1031-019b-58c8-991e-9e1a90bc1bea
2026-03-25 16:30:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:30:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc56c490>
2026-03-25 16:30:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:30:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:30:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:30:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92894306-eabc-56a1-afdc-298c40030e71/92894306-eabc-56a1-afdc-298c40030e71_image_8.jpg HTTP/1.1" 201 0
2026-03-25 16:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl4%252F367794af31bf48d491bd243293843b96%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 16:30:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl4/367794af31bf48d491bd243293843b96/images/large/9.jpg saved to cache
2026-03-25 16:30:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 92894306-eabc-56a1-afdc-298c40030e71
2026-03-25 16:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj2%252Ff04195e24d4944b79acc13da774b8903%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj2/f04195e24d4944b79acc13da774b8903/images/large/10.jpg not downloaded yet
2026-03-25 16:30:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga9/507aeb10cabf4d8ba026cc7a570c4b73/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga9/507aeb10cabf4d8ba026cc7a570c4b73/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga4/07ac3bf3f570405b996339a4dc9f4b8b/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga9/507aeb10cabf4d8ba026cc7a570c4b73/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:52 [ayvens.it] INFO: Found listing with ID: 1983521
2026-03-25 16:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983521%27 HTTP/1.1" 200 None
2026-03-25 16:30:52 [ayvens.it] INFO: Scrape type for 1983521: 1
2026-03-25 16:30:52 [ayvens.it] INFO: Extracting data for car ID: 1983521
2026-03-25 16:30:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 799a1ab9-9082-5ba3-bb6b-5bf6d4bb3144 with identifier: 1983521
2026-03-25 16:30:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 799a1ab9-9082-5ba3-bb6b-5bf6d4bb3144 with scrape type 1
2026-03-25 16:30:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 799a1ab9-9082-5ba3-bb6b-5bf6d4bb3144
2026-03-25 16:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk4%252F9ba2b33483494b6e8aa9557f4ce82987%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk4/9ba2b33483494b6e8aa9557f4ce82987/images/large/1.jpg not downloaded yet
2026-03-25 16:30:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga4/07ac3bf3f570405b996339a4dc9f4b8b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga4/07ac3bf3f570405b996339a4dc9f4b8b/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga4/07ac3bf3f570405b996339a4dc9f4b8b/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk4%252F9ba2b33483494b6e8aa9557f4ce82987%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk4/9ba2b33483494b6e8aa9557f4ce82987/images/large/2.jpg not downloaded yet
2026-03-25 16:30:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga4/07ac3bf3f570405b996339a4dc9f4b8b/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk4%252F9ba2b33483494b6e8aa9557f4ce82987%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk4/9ba2b33483494b6e8aa9557f4ce82987/images/large/3.jpg not downloaded yet
2026-03-25 16:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk4%252F9ba2b33483494b6e8aa9557f4ce82987%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk4/9ba2b33483494b6e8aa9557f4ce82987/images/large/4.jpg not downloaded yet
2026-03-25 16:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk4%252F9ba2b33483494b6e8aa9557f4ce82987%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk4/9ba2b33483494b6e8aa9557f4ce82987/images/large/5.jpg not downloaded yet
2026-03-25 16:30:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:30:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc9bb390>
2026-03-25 16:30:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:30:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:30:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:30:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91bf1031-019b-58c8-991e-9e1a90bc1bea/91bf1031-019b-58c8-991e-9e1a90bc1bea_image_8.jpg HTTP/1.1" 201 0
2026-03-25 16:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga9%252F507aeb10cabf4d8ba026cc7a570c4b73%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 16:30:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga9/507aeb10cabf4d8ba026cc7a570c4b73/images/large/9.jpg saved to cache
2026-03-25 16:30:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 91bf1031-019b-58c8-991e-9e1a90bc1bea
2026-03-25 16:30:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:30:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc5b5310>
2026-03-25 16:30:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:30:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:30:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:30:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91bf1031-019b-58c8-991e-9e1a90bc1bea/91bf1031-019b-58c8-991e-9e1a90bc1bea_image_7.jpg HTTP/1.1" 201 0
2026-03-25 16:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga9%252F507aeb10cabf4d8ba026cc7a570c4b73%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 16:30:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga9/507aeb10cabf4d8ba026cc7a570c4b73/images/large/8.jpg saved to cache
2026-03-25 16:30:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 91bf1031-019b-58c8-991e-9e1a90bc1bea
2026-03-25 16:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk4%252F9ba2b33483494b6e8aa9557f4ce82987%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk4/9ba2b33483494b6e8aa9557f4ce82987/images/large/6.jpg not downloaded yet
2026-03-25 16:30:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:30:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcb1e790>
2026-03-25 16:30:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:30:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:30:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:30:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_312f756d-b76b-5bd7-9f78-3b8d0b0acfee/312f756d-b76b-5bd7-9f78-3b8d0b0acfee_image_7.jpg HTTP/1.1" 201 0
2026-03-25 16:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga4%252F07ac3bf3f570405b996339a4dc9f4b8b%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 16:30:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga4/07ac3bf3f570405b996339a4dc9f4b8b/images/large/8.jpg saved to cache
2026-03-25 16:30:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 312f756d-b76b-5bd7-9f78-3b8d0b0acfee
2026-03-25 16:30:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:30:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34d7437ad0>
2026-03-25 16:30:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:30:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:30:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:30:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91bf1031-019b-58c8-991e-9e1a90bc1bea/91bf1031-019b-58c8-991e-9e1a90bc1bea_image_9.jpg HTTP/1.1" 201 0
2026-03-25 16:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga9%252F507aeb10cabf4d8ba026cc7a570c4b73%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 16:30:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga9/507aeb10cabf4d8ba026cc7a570c4b73/images/large/10.jpg saved to cache
2026-03-25 16:30:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 91bf1031-019b-58c8-991e-9e1a90bc1bea
2026-03-25 16:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk4%252F9ba2b33483494b6e8aa9557f4ce82987%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk4/9ba2b33483494b6e8aa9557f4ce82987/images/large/7.jpg not downloaded yet
2026-03-25 16:30:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:30:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34d7436050>
2026-03-25 16:30:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:30:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:30:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:30:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_312f756d-b76b-5bd7-9f78-3b8d0b0acfee/312f756d-b76b-5bd7-9f78-3b8d0b0acfee_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga4%252F07ac3bf3f570405b996339a4dc9f4b8b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 16:30:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga4/07ac3bf3f570405b996339a4dc9f4b8b/images/large/1.jpg saved to cache
2026-03-25 16:30:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 312f756d-b76b-5bd7-9f78-3b8d0b0acfee
2026-03-25 16:30:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:30:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcc18290>
2026-03-25 16:30:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:30:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:30:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:30:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_312f756d-b76b-5bd7-9f78-3b8d0b0acfee/312f756d-b76b-5bd7-9f78-3b8d0b0acfee_image_6.jpg HTTP/1.1" 201 0
2026-03-25 16:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga4%252F07ac3bf3f570405b996339a4dc9f4b8b%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 16:30:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga4/07ac3bf3f570405b996339a4dc9f4b8b/images/large/7.jpg saved to cache
2026-03-25 16:30:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 312f756d-b76b-5bd7-9f78-3b8d0b0acfee
2026-03-25 16:30:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:30:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc80cb50>
2026-03-25 16:30:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:30:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:30:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:30:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_312f756d-b76b-5bd7-9f78-3b8d0b0acfee/312f756d-b76b-5bd7-9f78-3b8d0b0acfee_image_8.jpg HTTP/1.1" 201 0
2026-03-25 16:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga4%252F07ac3bf3f570405b996339a4dc9f4b8b%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 16:30:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga4/07ac3bf3f570405b996339a4dc9f4b8b/images/large/9.jpg saved to cache
2026-03-25 16:30:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 312f756d-b76b-5bd7-9f78-3b8d0b0acfee
2026-03-25 16:30:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:30:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc355150>
2026-03-25 16:30:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:30:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:30:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:30:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_312f756d-b76b-5bd7-9f78-3b8d0b0acfee/312f756d-b76b-5bd7-9f78-3b8d0b0acfee_image_1.jpg HTTP/1.1" 201 0
2026-03-25 16:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga4%252F07ac3bf3f570405b996339a4dc9f4b8b%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 16:30:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga4/07ac3bf3f570405b996339a4dc9f4b8b/images/large/2.jpg saved to cache
2026-03-25 16:30:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 312f756d-b76b-5bd7-9f78-3b8d0b0acfee
2026-03-25 16:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk4%252F9ba2b33483494b6e8aa9557f4ce82987%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk4/9ba2b33483494b6e8aa9557f4ce82987/images/large/8.jpg not downloaded yet
2026-03-25 16:30:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga4/07ac3bf3f570405b996339a4dc9f4b8b/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk4%252F9ba2b33483494b6e8aa9557f4ce82987%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk4/9ba2b33483494b6e8aa9557f4ce82987/images/large/9.jpg not downloaded yet
2026-03-25 16:30:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj2/f04195e24d4944b79acc13da774b8903/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk4%252F9ba2b33483494b6e8aa9557f4ce82987%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk4/9ba2b33483494b6e8aa9557f4ce82987/images/large/10.jpg not downloaded yet
2026-03-25 16:30:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga4/07ac3bf3f570405b996339a4dc9f4b8b/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj2/f04195e24d4944b79acc13da774b8903/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga4/07ac3bf3f570405b996339a4dc9f4b8b/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj2/f04195e24d4944b79acc13da774b8903/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:53 [ayvens.it] INFO: Found listing with ID: 1983522
2026-03-25 16:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983522%27 HTTP/1.1" 200 None
2026-03-25 16:30:53 [ayvens.it] INFO: Scrape type for 1983522: 1
2026-03-25 16:30:53 [ayvens.it] INFO: Extracting data for car ID: 1983522
2026-03-25 16:30:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 74b9dd4c-1b53-5593-9ffd-d77d29d6b5c3 with identifier: 1983522
2026-03-25 16:30:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 74b9dd4c-1b53-5593-9ffd-d77d29d6b5c3 with scrape type 1
2026-03-25 16:30:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 74b9dd4c-1b53-5593-9ffd-d77d29d6b5c3
2026-03-25 16:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm0%252Fa5df3ca0bac54cd9bff0b2be397de3bf%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm0/a5df3ca0bac54cd9bff0b2be397de3bf/images/large/1.jpg not downloaded yet
2026-03-25 16:30:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj2/f04195e24d4944b79acc13da774b8903/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj2/f04195e24d4944b79acc13da774b8903/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm0%252Fa5df3ca0bac54cd9bff0b2be397de3bf%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm0/a5df3ca0bac54cd9bff0b2be397de3bf/images/large/2.jpg not downloaded yet
2026-03-25 16:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm0%252Fa5df3ca0bac54cd9bff0b2be397de3bf%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm0/a5df3ca0bac54cd9bff0b2be397de3bf/images/large/3.jpg not downloaded yet
2026-03-25 16:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm0%252Fa5df3ca0bac54cd9bff0b2be397de3bf%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm0/a5df3ca0bac54cd9bff0b2be397de3bf/images/large/4.jpg not downloaded yet
2026-03-25 16:30:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:30:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc7d1ed0>
2026-03-25 16:30:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:30:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:30:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:30:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_312f756d-b76b-5bd7-9f78-3b8d0b0acfee/312f756d-b76b-5bd7-9f78-3b8d0b0acfee_image_9.jpg HTTP/1.1" 201 0
2026-03-25 16:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga4%252F07ac3bf3f570405b996339a4dc9f4b8b%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 16:30:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga4/07ac3bf3f570405b996339a4dc9f4b8b/images/large/10.jpg saved to cache
2026-03-25 16:30:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 312f756d-b76b-5bd7-9f78-3b8d0b0acfee
2026-03-25 16:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm0%252Fa5df3ca0bac54cd9bff0b2be397de3bf%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm0/a5df3ca0bac54cd9bff0b2be397de3bf/images/large/5.jpg not downloaded yet
2026-03-25 16:30:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:30:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcc08650>
2026-03-25 16:30:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:30:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:30:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:30:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f8d6d0a-aec3-525a-8933-dd8d455542d8/8f8d6d0a-aec3-525a-8933-dd8d455542d8_image_6.jpg HTTP/1.1" 201 0
2026-03-25 16:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj2%252Ff04195e24d4944b79acc13da774b8903%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 16:30:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj2/f04195e24d4944b79acc13da774b8903/images/large/7.jpg saved to cache
2026-03-25 16:30:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8f8d6d0a-aec3-525a-8933-dd8d455542d8
2026-03-25 16:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm0%252Fa5df3ca0bac54cd9bff0b2be397de3bf%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm0/a5df3ca0bac54cd9bff0b2be397de3bf/images/large/6.jpg not downloaded yet
2026-03-25 16:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm0%252Fa5df3ca0bac54cd9bff0b2be397de3bf%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm0/a5df3ca0bac54cd9bff0b2be397de3bf/images/large/7.jpg not downloaded yet
2026-03-25 16:30:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:30:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34de9f3750>
2026-03-25 16:30:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:30:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:30:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:30:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_312f756d-b76b-5bd7-9f78-3b8d0b0acfee/312f756d-b76b-5bd7-9f78-3b8d0b0acfee_image_5.jpg HTTP/1.1" 201 0
2026-03-25 16:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga4%252F07ac3bf3f570405b996339a4dc9f4b8b%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 16:30:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga4/07ac3bf3f570405b996339a4dc9f4b8b/images/large/6.jpg saved to cache
2026-03-25 16:30:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 312f756d-b76b-5bd7-9f78-3b8d0b0acfee
2026-03-25 16:30:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:30:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcb2fdd0>
2026-03-25 16:30:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:30:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:30:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:30:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f8d6d0a-aec3-525a-8933-dd8d455542d8/8f8d6d0a-aec3-525a-8933-dd8d455542d8_image_3.jpg HTTP/1.1" 201 0
2026-03-25 16:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj2%252Ff04195e24d4944b79acc13da774b8903%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 16:30:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj2/f04195e24d4944b79acc13da774b8903/images/large/4.jpg saved to cache
2026-03-25 16:30:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8f8d6d0a-aec3-525a-8933-dd8d455542d8
2026-03-25 16:30:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:30:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc64bbd0>
2026-03-25 16:30:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:30:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:30:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:30:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_312f756d-b76b-5bd7-9f78-3b8d0b0acfee/312f756d-b76b-5bd7-9f78-3b8d0b0acfee_image_4.jpg HTTP/1.1" 201 0
2026-03-25 16:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga4%252F07ac3bf3f570405b996339a4dc9f4b8b%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 16:30:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga4/07ac3bf3f570405b996339a4dc9f4b8b/images/large/5.jpg saved to cache
2026-03-25 16:30:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 312f756d-b76b-5bd7-9f78-3b8d0b0acfee
2026-03-25 16:30:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:30:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc5a0890>
2026-03-25 16:30:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:30:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:30:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:30:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f8d6d0a-aec3-525a-8933-dd8d455542d8/8f8d6d0a-aec3-525a-8933-dd8d455542d8_image_5.jpg HTTP/1.1" 201 0
2026-03-25 16:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj2%252Ff04195e24d4944b79acc13da774b8903%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 16:30:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj2/f04195e24d4944b79acc13da774b8903/images/large/6.jpg saved to cache
2026-03-25 16:30:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8f8d6d0a-aec3-525a-8933-dd8d455542d8
2026-03-25 16:30:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:30:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc9b2d10>
2026-03-25 16:30:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:30:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:30:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:30:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f8d6d0a-aec3-525a-8933-dd8d455542d8/8f8d6d0a-aec3-525a-8933-dd8d455542d8_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj2%252Ff04195e24d4944b79acc13da774b8903%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 16:30:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj2/f04195e24d4944b79acc13da774b8903/images/large/1.jpg saved to cache
2026-03-25 16:30:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8f8d6d0a-aec3-525a-8933-dd8d455542d8
2026-03-25 16:30:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:30:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc37c110>
2026-03-25 16:30:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:30:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:30:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:30:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f8d6d0a-aec3-525a-8933-dd8d455542d8/8f8d6d0a-aec3-525a-8933-dd8d455542d8_image_4.jpg HTTP/1.1" 201 0
2026-03-25 16:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj2%252Ff04195e24d4944b79acc13da774b8903%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 16:30:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj2/f04195e24d4944b79acc13da774b8903/images/large/5.jpg saved to cache
2026-03-25 16:30:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8f8d6d0a-aec3-525a-8933-dd8d455542d8
2026-03-25 16:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm0%252Fa5df3ca0bac54cd9bff0b2be397de3bf%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm0/a5df3ca0bac54cd9bff0b2be397de3bf/images/large/8.jpg not downloaded yet
2026-03-25 16:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm0%252Fa5df3ca0bac54cd9bff0b2be397de3bf%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm0/a5df3ca0bac54cd9bff0b2be397de3bf/images/large/9.jpg not downloaded yet
2026-03-25 16:30:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj2/f04195e24d4944b79acc13da774b8903/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj2/f04195e24d4944b79acc13da774b8903/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj2/f04195e24d4944b79acc13da774b8903/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm0%252Fa5df3ca0bac54cd9bff0b2be397de3bf%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm0/a5df3ca0bac54cd9bff0b2be397de3bf/images/large/10.jpg not downloaded yet
2026-03-25 16:30:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj2/f04195e24d4944b79acc13da774b8903/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj2/f04195e24d4944b79acc13da774b8903/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:54 [ayvens.it] INFO: Found listing with ID: 1983523
2026-03-25 16:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983523%27 HTTP/1.1" 200 None
2026-03-25 16:30:54 [ayvens.it] INFO: Scrape type for 1983523: 1
2026-03-25 16:30:54 [ayvens.it] INFO: Extracting data for car ID: 1983523
2026-03-25 16:30:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7bdf5de7-25e5-5224-98be-306b66c3e43d with identifier: 1983523
2026-03-25 16:30:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7bdf5de7-25e5-5224-98be-306b66c3e43d with scrape type 1
2026-03-25 16:30:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7bdf5de7-25e5-5224-98be-306b66c3e43d
2026-03-25 16:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn3%252F614ed32e4c9440c883de6371709ed178%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn3/614ed32e4c9440c883de6371709ed178/images/large/1.jpg not downloaded yet
2026-03-25 16:30:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk4/9ba2b33483494b6e8aa9557f4ce82987/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn3%252F614ed32e4c9440c883de6371709ed178%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn3/614ed32e4c9440c883de6371709ed178/images/large/2.jpg not downloaded yet
2026-03-25 16:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn3%252F614ed32e4c9440c883de6371709ed178%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn3/614ed32e4c9440c883de6371709ed178/images/large/3.jpg not downloaded yet
2026-03-25 16:30:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk4/9ba2b33483494b6e8aa9557f4ce82987/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn3%252F614ed32e4c9440c883de6371709ed178%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn3/614ed32e4c9440c883de6371709ed178/images/large/4.jpg not downloaded yet
2026-03-25 16:30:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:30:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcc19c10>
2026-03-25 16:30:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:30:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:30:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:30:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f8d6d0a-aec3-525a-8933-dd8d455542d8/8f8d6d0a-aec3-525a-8933-dd8d455542d8_image_9.jpg HTTP/1.1" 201 0
2026-03-25 16:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj2%252Ff04195e24d4944b79acc13da774b8903%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 16:30:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj2/f04195e24d4944b79acc13da774b8903/images/large/10.jpg saved to cache
2026-03-25 16:30:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8f8d6d0a-aec3-525a-8933-dd8d455542d8
2026-03-25 16:30:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:30:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34d6b3f390>
2026-03-25 16:30:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:30:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:30:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:30:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f8d6d0a-aec3-525a-8933-dd8d455542d8/8f8d6d0a-aec3-525a-8933-dd8d455542d8_image_8.jpg HTTP/1.1" 201 0
2026-03-25 16:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj2%252Ff04195e24d4944b79acc13da774b8903%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 16:30:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj2/f04195e24d4944b79acc13da774b8903/images/large/9.jpg saved to cache
2026-03-25 16:30:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8f8d6d0a-aec3-525a-8933-dd8d455542d8
2026-03-25 16:30:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:30:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dca13390>
2026-03-25 16:30:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:30:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:30:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:30:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f8d6d0a-aec3-525a-8933-dd8d455542d8/8f8d6d0a-aec3-525a-8933-dd8d455542d8_image_7.jpg HTTP/1.1" 201 0
2026-03-25 16:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj2%252Ff04195e24d4944b79acc13da774b8903%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 16:30:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj2/f04195e24d4944b79acc13da774b8903/images/large/8.jpg saved to cache
2026-03-25 16:30:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8f8d6d0a-aec3-525a-8933-dd8d455542d8
2026-03-25 16:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn3%252F614ed32e4c9440c883de6371709ed178%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn3/614ed32e4c9440c883de6371709ed178/images/large/5.jpg not downloaded yet
2026-03-25 16:30:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:30:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34de458750>
2026-03-25 16:30:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:30:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:30:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:30:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f8d6d0a-aec3-525a-8933-dd8d455542d8/8f8d6d0a-aec3-525a-8933-dd8d455542d8_image_2.jpg HTTP/1.1" 201 0
2026-03-25 16:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj2%252Ff04195e24d4944b79acc13da774b8903%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 16:30:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj2/f04195e24d4944b79acc13da774b8903/images/large/3.jpg saved to cache
2026-03-25 16:30:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8f8d6d0a-aec3-525a-8933-dd8d455542d8
2026-03-25 16:30:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:30:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc8d7a10>
2026-03-25 16:30:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:30:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:30:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:30:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f8d6d0a-aec3-525a-8933-dd8d455542d8/8f8d6d0a-aec3-525a-8933-dd8d455542d8_image_1.jpg HTTP/1.1" 201 0
2026-03-25 16:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj2%252Ff04195e24d4944b79acc13da774b8903%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 16:30:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj2/f04195e24d4944b79acc13da774b8903/images/large/2.jpg saved to cache
2026-03-25 16:30:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8f8d6d0a-aec3-525a-8933-dd8d455542d8
2026-03-25 16:30:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8f8d6d0a-aec3-525a-8933-dd8d455542d8, skipping ID generation
2026-03-25 16:30:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8f8d6d0a-aec3-525a-8933-dd8d455542d8 with scrape type 1
2026-03-25 16:30:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8f8d6d0a-aec3-525a-8933-dd8d455542d8 sending to next pipeline
2026-03-25 16:30:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 8f8d6d0a-aec3-525a-8933-dd8d455542d8, identifier: 1983520
2026-03-25 16:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn3%252F614ed32e4c9440c883de6371709ed178%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn3/614ed32e4c9440c883de6371709ed178/images/large/6.jpg not downloaded yet
2026-03-25 16:30:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 8f8d6d0a-aec3-525a-8933-dd8d455542d8 with identifier: 1983520
2026-03-25 16:30:55 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:30:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 8f8d6d0a-aec3-525a-8933-dd8d455542d8 with identifier: 1983520
2026-03-25 16:30:55 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 8f8d6d0a-aec3-525a-8933-dd8d455542d8 with identifier: 1983520 to the API
2026-03-25 16:30:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:30:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:30:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gj2/f04195e24d4944b79acc13da774b8903/images/large/2.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'MAGNETIC GREY METALLIZZATO',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-27T09:30:00Z',
'fuel_type': 'diesel',
'id': '8f8d6d0a-aec3-525a-8933-dd8d455542d8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41025',
'listing': 'auction',
'location': None,
'make': 'FORD',
'model': 'FORD FOCUS 1.5 Ecoblue 120cv Business SW SW 5-door (Euro 6.2)',
'odometer': 184099,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 35,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f8d6d0a-aec3-525a-8933-dd8d455542d8/8f8d6d0a-aec3-525a-8933-dd8d455542d8_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 731895,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj2/f04195e24d4944b79acc13da774b8903/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f8d6d0a-aec3-525a-8933-dd8d455542d8/8f8d6d0a-aec3-525a-8933-dd8d455542d8_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 654027,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj2/f04195e24d4944b79acc13da774b8903/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f8d6d0a-aec3-525a-8933-dd8d455542d8/8f8d6d0a-aec3-525a-8933-dd8d455542d8_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 731895,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj2/f04195e24d4944b79acc13da774b8903/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f8d6d0a-aec3-525a-8933-dd8d455542d8/8f8d6d0a-aec3-525a-8933-dd8d455542d8_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 694490,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj2/f04195e24d4944b79acc13da774b8903/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f8d6d0a-aec3-525a-8933-dd8d455542d8/8f8d6d0a-aec3-525a-8933-dd8d455542d8_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 688273,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj2/f04195e24d4944b79acc13da774b8903/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f8d6d0a-aec3-525a-8933-dd8d455542d8/8f8d6d0a-aec3-525a-8933-dd8d455542d8_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 539524,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj2/f04195e24d4944b79acc13da774b8903/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f8d6d0a-aec3-525a-8933-dd8d455542d8/8f8d6d0a-aec3-525a-8933-dd8d455542d8_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 462934,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj2/f04195e24d4944b79acc13da774b8903/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f8d6d0a-aec3-525a-8933-dd8d455542d8/8f8d6d0a-aec3-525a-8933-dd8d455542d8_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 503828,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj2/f04195e24d4944b79acc13da774b8903/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f8d6d0a-aec3-525a-8933-dd8d455542d8/8f8d6d0a-aec3-525a-8933-dd8d455542d8_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 595740,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj2/f04195e24d4944b79acc13da774b8903/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f8d6d0a-aec3-525a-8933-dd8d455542d8/8f8d6d0a-aec3-525a-8933-dd8d455542d8_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 543675,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj2/f04195e24d4944b79acc13da774b8903/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-01-27',
'seats_number': 5,
'seller_name': None,
'title': 'FORD FORD FOCUS 1.5 Ecoblue 120cv Business SW SW 5-door (Euro 6.2) '
'-',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-25 16:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983520%27 HTTP/1.1" 200 None
2026-03-25 16:30:56 [ayvens.it] INFO: Saving data for 1983520: {'created_time': 1774456256.359094, 'last_price_update_time': 1774456256.359108, 'auction_closing_time': 1774603800.0}
2026-03-25 16:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1983520') HTTP/1.1" 204 0
2026-03-25 16:30:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:30:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc2fe090>
2026-03-25 16:30:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:30:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:30:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:30:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_799a1ab9-9082-5ba3-bb6b-5bf6d4bb3144/799a1ab9-9082-5ba3-bb6b-5bf6d4bb3144_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk4%252F9ba2b33483494b6e8aa9557f4ce82987%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 16:30:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk4/9ba2b33483494b6e8aa9557f4ce82987/images/large/1.jpg saved to cache
2026-03-25 16:30:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 799a1ab9-9082-5ba3-bb6b-5bf6d4bb3144
2026-03-25 16:30:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:30:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc8d59d0>
2026-03-25 16:30:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:30:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:30:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:30:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_799a1ab9-9082-5ba3-bb6b-5bf6d4bb3144/799a1ab9-9082-5ba3-bb6b-5bf6d4bb3144_image_1.jpg HTTP/1.1" 201 0
2026-03-25 16:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk4%252F9ba2b33483494b6e8aa9557f4ce82987%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 16:30:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk4/9ba2b33483494b6e8aa9557f4ce82987/images/large/2.jpg saved to cache
2026-03-25 16:30:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 799a1ab9-9082-5ba3-bb6b-5bf6d4bb3144
2026-03-25 16:30:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk4/9ba2b33483494b6e8aa9557f4ce82987/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk4/9ba2b33483494b6e8aa9557f4ce82987/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn3%252F614ed32e4c9440c883de6371709ed178%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn3/614ed32e4c9440c883de6371709ed178/images/large/7.jpg not downloaded yet
2026-03-25 16:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn3%252F614ed32e4c9440c883de6371709ed178%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn3/614ed32e4c9440c883de6371709ed178/images/large/8.jpg not downloaded yet
2026-03-25 16:30:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk4/9ba2b33483494b6e8aa9557f4ce82987/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk4/9ba2b33483494b6e8aa9557f4ce82987/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn3%252F614ed32e4c9440c883de6371709ed178%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn3/614ed32e4c9440c883de6371709ed178/images/large/9.jpg not downloaded yet
2026-03-25 16:30:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk4/9ba2b33483494b6e8aa9557f4ce82987/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn3%252F614ed32e4c9440c883de6371709ed178%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn3/614ed32e4c9440c883de6371709ed178/images/large/10.jpg not downloaded yet
2026-03-25 16:30:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga4/07ac3bf3f570405b996339a4dc9f4b8b/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk4/9ba2b33483494b6e8aa9557f4ce82987/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:56 [ayvens.it] INFO: Found listing with ID: 1983524
2026-03-25 16:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983524%27 HTTP/1.1" 200 None
2026-03-25 16:30:56 [ayvens.it] INFO: Scrape type for 1983524: 1
2026-03-25 16:30:56 [ayvens.it] INFO: Extracting data for car ID: 1983524
2026-03-25 16:30:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 50ecbe9d-4888-5140-beae-b470a63cd3cc with identifier: 1983524
2026-03-25 16:30:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 50ecbe9d-4888-5140-beae-b470a63cd3cc with scrape type 1
2026-03-25 16:30:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 50ecbe9d-4888-5140-beae-b470a63cd3cc
2026-03-25 16:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm3%252F1c561b1a28a0440e9b4cf48e58fc8ca3%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm3/1c561b1a28a0440e9b4cf48e58fc8ca3/images/large/1.jpg not downloaded yet
2026-03-25 16:30:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm0/a5df3ca0bac54cd9bff0b2be397de3bf/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm3%252F1c561b1a28a0440e9b4cf48e58fc8ca3%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm3/1c561b1a28a0440e9b4cf48e58fc8ca3/images/large/2.jpg not downloaded yet
2026-03-25 16:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm3%252F1c561b1a28a0440e9b4cf48e58fc8ca3%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm3/1c561b1a28a0440e9b4cf48e58fc8ca3/images/large/3.jpg not downloaded yet
2026-03-25 16:30:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:30:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcaab450>
2026-03-25 16:30:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:30:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:30:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:30:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_799a1ab9-9082-5ba3-bb6b-5bf6d4bb3144/799a1ab9-9082-5ba3-bb6b-5bf6d4bb3144_image_9.jpg HTTP/1.1" 201 0
2026-03-25 16:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk4%252F9ba2b33483494b6e8aa9557f4ce82987%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 16:30:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk4/9ba2b33483494b6e8aa9557f4ce82987/images/large/10.jpg saved to cache
2026-03-25 16:30:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 799a1ab9-9082-5ba3-bb6b-5bf6d4bb3144
2026-03-25 16:30:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:30:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc766750>
2026-03-25 16:30:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:30:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:30:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:30:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_799a1ab9-9082-5ba3-bb6b-5bf6d4bb3144/799a1ab9-9082-5ba3-bb6b-5bf6d4bb3144_image_7.jpg HTTP/1.1" 201 0
2026-03-25 16:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk4%252F9ba2b33483494b6e8aa9557f4ce82987%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 16:30:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk4/9ba2b33483494b6e8aa9557f4ce82987/images/large/8.jpg saved to cache
2026-03-25 16:30:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 799a1ab9-9082-5ba3-bb6b-5bf6d4bb3144
2026-03-25 16:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm3%252F1c561b1a28a0440e9b4cf48e58fc8ca3%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm3/1c561b1a28a0440e9b4cf48e58fc8ca3/images/large/4.jpg not downloaded yet
2026-03-25 16:30:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:30:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc86b8d0>
2026-03-25 16:30:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:30:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:30:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:30:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_799a1ab9-9082-5ba3-bb6b-5bf6d4bb3144/799a1ab9-9082-5ba3-bb6b-5bf6d4bb3144_image_8.jpg HTTP/1.1" 201 0
2026-03-25 16:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk4%252F9ba2b33483494b6e8aa9557f4ce82987%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 16:30:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk4/9ba2b33483494b6e8aa9557f4ce82987/images/large/9.jpg saved to cache
2026-03-25 16:30:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 799a1ab9-9082-5ba3-bb6b-5bf6d4bb3144
2026-03-25 16:30:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:30:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc584bd0>
2026-03-25 16:30:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:30:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:30:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:30:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_799a1ab9-9082-5ba3-bb6b-5bf6d4bb3144/799a1ab9-9082-5ba3-bb6b-5bf6d4bb3144_image_6.jpg HTTP/1.1" 201 0
2026-03-25 16:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk4%252F9ba2b33483494b6e8aa9557f4ce82987%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 16:30:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk4/9ba2b33483494b6e8aa9557f4ce82987/images/large/7.jpg saved to cache
2026-03-25 16:30:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 799a1ab9-9082-5ba3-bb6b-5bf6d4bb3144
2026-03-25 16:30:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:30:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc9ba310>
2026-03-25 16:30:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:30:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:30:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:30:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_799a1ab9-9082-5ba3-bb6b-5bf6d4bb3144/799a1ab9-9082-5ba3-bb6b-5bf6d4bb3144_image_5.jpg HTTP/1.1" 201 0
2026-03-25 16:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk4%252F9ba2b33483494b6e8aa9557f4ce82987%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 16:30:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk4/9ba2b33483494b6e8aa9557f4ce82987/images/large/6.jpg saved to cache
2026-03-25 16:30:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 799a1ab9-9082-5ba3-bb6b-5bf6d4bb3144
2026-03-25 16:30:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:30:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc5af550>
2026-03-25 16:30:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:30:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:30:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:30:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_312f756d-b76b-5bd7-9f78-3b8d0b0acfee/312f756d-b76b-5bd7-9f78-3b8d0b0acfee_image_3.jpg HTTP/1.1" 201 0
2026-03-25 16:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga4%252F07ac3bf3f570405b996339a4dc9f4b8b%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 16:30:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga4/07ac3bf3f570405b996339a4dc9f4b8b/images/large/4.jpg saved to cache
2026-03-25 16:30:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 312f756d-b76b-5bd7-9f78-3b8d0b0acfee
2026-03-25 16:30:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:30:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc9a55d0>
2026-03-25 16:30:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:30:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:30:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:30:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_799a1ab9-9082-5ba3-bb6b-5bf6d4bb3144/799a1ab9-9082-5ba3-bb6b-5bf6d4bb3144_image_4.jpg HTTP/1.1" 201 0
2026-03-25 16:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk4%252F9ba2b33483494b6e8aa9557f4ce82987%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 16:30:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk4/9ba2b33483494b6e8aa9557f4ce82987/images/large/5.jpg saved to cache
2026-03-25 16:30:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 799a1ab9-9082-5ba3-bb6b-5bf6d4bb3144
2026-03-25 16:30:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:30:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc9f3ad0>
2026-03-25 16:30:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:30:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:30:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:30:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74b9dd4c-1b53-5593-9ffd-d77d29d6b5c3/74b9dd4c-1b53-5593-9ffd-d77d29d6b5c3_image_4.jpg HTTP/1.1" 201 0
2026-03-25 16:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm0%252Fa5df3ca0bac54cd9bff0b2be397de3bf%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 16:30:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm0/a5df3ca0bac54cd9bff0b2be397de3bf/images/large/5.jpg saved to cache
2026-03-25 16:30:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 74b9dd4c-1b53-5593-9ffd-d77d29d6b5c3
2026-03-25 16:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm3%252F1c561b1a28a0440e9b4cf48e58fc8ca3%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm3/1c561b1a28a0440e9b4cf48e58fc8ca3/images/large/5.jpg not downloaded yet
2026-03-25 16:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm3%252F1c561b1a28a0440e9b4cf48e58fc8ca3%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm3/1c561b1a28a0440e9b4cf48e58fc8ca3/images/large/6.jpg not downloaded yet
2026-03-25 16:30:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm0/a5df3ca0bac54cd9bff0b2be397de3bf/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm0/a5df3ca0bac54cd9bff0b2be397de3bf/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm3%252F1c561b1a28a0440e9b4cf48e58fc8ca3%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm3/1c561b1a28a0440e9b4cf48e58fc8ca3/images/large/7.jpg not downloaded yet
2026-03-25 16:30:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm0/a5df3ca0bac54cd9bff0b2be397de3bf/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm0/a5df3ca0bac54cd9bff0b2be397de3bf/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm0/a5df3ca0bac54cd9bff0b2be397de3bf/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm3%252F1c561b1a28a0440e9b4cf48e58fc8ca3%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm3/1c561b1a28a0440e9b4cf48e58fc8ca3/images/large/8.jpg not downloaded yet
2026-03-25 16:30:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm0/a5df3ca0bac54cd9bff0b2be397de3bf/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm0/a5df3ca0bac54cd9bff0b2be397de3bf/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm3%252F1c561b1a28a0440e9b4cf48e58fc8ca3%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm3/1c561b1a28a0440e9b4cf48e58fc8ca3/images/large/9.jpg not downloaded yet
2026-03-25 16:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm3%252F1c561b1a28a0440e9b4cf48e58fc8ca3%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm3/1c561b1a28a0440e9b4cf48e58fc8ca3/images/large/10.jpg not downloaded yet
2026-03-25 16:30:57 [ayvens.it] INFO: Found listing with ID: 1983525
2026-03-25 16:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983525%27 HTTP/1.1" 200 None
2026-03-25 16:30:57 [ayvens.it] INFO: Scrape type for 1983525: 1
2026-03-25 16:30:57 [ayvens.it] INFO: Extracting data for car ID: 1983525
2026-03-25 16:30:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 49c42cb4-9bec-539c-bce9-e64e706a7783 with identifier: 1983525
2026-03-25 16:30:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 49c42cb4-9bec-539c-bce9-e64e706a7783 with scrape type 1
2026-03-25 16:30:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 49c42cb4-9bec-539c-bce9-e64e706a7783
2026-03-25 16:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn8%252Faf105d03dada454eb63bae555a500620%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn8/af105d03dada454eb63bae555a500620/images/large/1.jpg not downloaded yet
2026-03-25 16:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn8%252Faf105d03dada454eb63bae555a500620%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn8/af105d03dada454eb63bae555a500620/images/large/2.jpg not downloaded yet
2026-03-25 16:30:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:30:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc94e8d0>
2026-03-25 16:30:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:30:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:30:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:30:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74b9dd4c-1b53-5593-9ffd-d77d29d6b5c3/74b9dd4c-1b53-5593-9ffd-d77d29d6b5c3_image_6.jpg HTTP/1.1" 201 0
2026-03-25 16:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm0%252Fa5df3ca0bac54cd9bff0b2be397de3bf%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 16:30:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm0/a5df3ca0bac54cd9bff0b2be397de3bf/images/large/7.jpg saved to cache
2026-03-25 16:30:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 74b9dd4c-1b53-5593-9ffd-d77d29d6b5c3
2026-03-25 16:30:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:30:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc9b9290>
2026-03-25 16:30:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:30:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:30:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:30:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74b9dd4c-1b53-5593-9ffd-d77d29d6b5c3/74b9dd4c-1b53-5593-9ffd-d77d29d6b5c3_image_8.jpg HTTP/1.1" 201 0
2026-03-25 16:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm0%252Fa5df3ca0bac54cd9bff0b2be397de3bf%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 16:30:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm0/a5df3ca0bac54cd9bff0b2be397de3bf/images/large/9.jpg saved to cache
2026-03-25 16:30:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 74b9dd4c-1b53-5593-9ffd-d77d29d6b5c3
2026-03-25 16:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn8%252Faf105d03dada454eb63bae555a500620%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn8/af105d03dada454eb63bae555a500620/images/large/3.jpg not downloaded yet
2026-03-25 16:30:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:30:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34de458790>
2026-03-25 16:30:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:30:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:30:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:30:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74b9dd4c-1b53-5593-9ffd-d77d29d6b5c3/74b9dd4c-1b53-5593-9ffd-d77d29d6b5c3_image_3.jpg HTTP/1.1" 201 0
2026-03-25 16:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm0%252Fa5df3ca0bac54cd9bff0b2be397de3bf%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 16:30:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm0/a5df3ca0bac54cd9bff0b2be397de3bf/images/large/4.jpg saved to cache
2026-03-25 16:30:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 74b9dd4c-1b53-5593-9ffd-d77d29d6b5c3
2026-03-25 16:30:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:30:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc9d40d0>
2026-03-25 16:30:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:30:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:30:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:30:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74b9dd4c-1b53-5593-9ffd-d77d29d6b5c3/74b9dd4c-1b53-5593-9ffd-d77d29d6b5c3_image_9.jpg HTTP/1.1" 201 0
2026-03-25 16:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm0%252Fa5df3ca0bac54cd9bff0b2be397de3bf%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 16:30:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm0/a5df3ca0bac54cd9bff0b2be397de3bf/images/large/10.jpg saved to cache
2026-03-25 16:30:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 74b9dd4c-1b53-5593-9ffd-d77d29d6b5c3
2026-03-25 16:30:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:30:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34d6b49510>
2026-03-25 16:30:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:30:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:30:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:30:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74b9dd4c-1b53-5593-9ffd-d77d29d6b5c3/74b9dd4c-1b53-5593-9ffd-d77d29d6b5c3_image_7.jpg HTTP/1.1" 201 0
2026-03-25 16:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm0%252Fa5df3ca0bac54cd9bff0b2be397de3bf%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 16:30:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm0/a5df3ca0bac54cd9bff0b2be397de3bf/images/large/8.jpg saved to cache
2026-03-25 16:30:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 74b9dd4c-1b53-5593-9ffd-d77d29d6b5c3
2026-03-25 16:30:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn3/614ed32e4c9440c883de6371709ed178/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn8%252Faf105d03dada454eb63bae555a500620%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn8/af105d03dada454eb63bae555a500620/images/large/4.jpg not downloaded yet
2026-03-25 16:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn8%252Faf105d03dada454eb63bae555a500620%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn8/af105d03dada454eb63bae555a500620/images/large/5.jpg not downloaded yet
2026-03-25 16:30:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:30:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc9d7d10>
2026-03-25 16:30:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:30:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:30:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:30:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74b9dd4c-1b53-5593-9ffd-d77d29d6b5c3/74b9dd4c-1b53-5593-9ffd-d77d29d6b5c3_image_5.jpg HTTP/1.1" 201 0
2026-03-25 16:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm0%252Fa5df3ca0bac54cd9bff0b2be397de3bf%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 16:30:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm0/a5df3ca0bac54cd9bff0b2be397de3bf/images/large/6.jpg saved to cache
2026-03-25 16:30:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 74b9dd4c-1b53-5593-9ffd-d77d29d6b5c3
2026-03-25 16:30:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:30:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcb2f950>
2026-03-25 16:30:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:30:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:30:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:30:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74b9dd4c-1b53-5593-9ffd-d77d29d6b5c3/74b9dd4c-1b53-5593-9ffd-d77d29d6b5c3_image_2.jpg HTTP/1.1" 201 0
2026-03-25 16:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm0%252Fa5df3ca0bac54cd9bff0b2be397de3bf%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 16:30:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm0/a5df3ca0bac54cd9bff0b2be397de3bf/images/large/3.jpg saved to cache
2026-03-25 16:30:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 74b9dd4c-1b53-5593-9ffd-d77d29d6b5c3
2026-03-25 16:30:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn3/614ed32e4c9440c883de6371709ed178/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn8%252Faf105d03dada454eb63bae555a500620%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn8/af105d03dada454eb63bae555a500620/images/large/6.jpg not downloaded yet
2026-03-25 16:30:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn3/614ed32e4c9440c883de6371709ed178/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn8%252Faf105d03dada454eb63bae555a500620%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn8/af105d03dada454eb63bae555a500620/images/large/7.jpg not downloaded yet
2026-03-25 16:30:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn3/614ed32e4c9440c883de6371709ed178/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:30:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dca22d90>
2026-03-25 16:30:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:30:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:30:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:30:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7bdf5de7-25e5-5224-98be-306b66c3e43d/7bdf5de7-25e5-5224-98be-306b66c3e43d_image_2.jpg HTTP/1.1" 201 0
2026-03-25 16:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn3%252F614ed32e4c9440c883de6371709ed178%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 16:30:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn3/614ed32e4c9440c883de6371709ed178/images/large/3.jpg saved to cache
2026-03-25 16:30:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7bdf5de7-25e5-5224-98be-306b66c3e43d
2026-03-25 16:30:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn3/614ed32e4c9440c883de6371709ed178/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn8%252Faf105d03dada454eb63bae555a500620%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn8/af105d03dada454eb63bae555a500620/images/large/8.jpg not downloaded yet
2026-03-25 16:30:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn3/614ed32e4c9440c883de6371709ed178/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn3/614ed32e4c9440c883de6371709ed178/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn3/614ed32e4c9440c883de6371709ed178/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn8%252Faf105d03dada454eb63bae555a500620%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn8/af105d03dada454eb63bae555a500620/images/large/9.jpg not downloaded yet
2026-03-25 16:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn8%252Faf105d03dada454eb63bae555a500620%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn8/af105d03dada454eb63bae555a500620/images/large/10.jpg not downloaded yet
2026-03-25 16:30:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:30:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc8277d0>
2026-03-25 16:30:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:30:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:30:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:30:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7bdf5de7-25e5-5224-98be-306b66c3e43d/7bdf5de7-25e5-5224-98be-306b66c3e43d_image_7.jpg HTTP/1.1" 201 0
2026-03-25 16:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn3%252F614ed32e4c9440c883de6371709ed178%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 16:30:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn3/614ed32e4c9440c883de6371709ed178/images/large/8.jpg saved to cache
2026-03-25 16:30:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7bdf5de7-25e5-5224-98be-306b66c3e43d
2026-03-25 16:30:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:30:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcc08b10>
2026-03-25 16:30:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:30:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:30:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:30:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7bdf5de7-25e5-5224-98be-306b66c3e43d/7bdf5de7-25e5-5224-98be-306b66c3e43d_image_9.jpg HTTP/1.1" 201 0
2026-03-25 16:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn3%252F614ed32e4c9440c883de6371709ed178%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 16:30:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn3/614ed32e4c9440c883de6371709ed178/images/large/10.jpg saved to cache
2026-03-25 16:30:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7bdf5de7-25e5-5224-98be-306b66c3e43d
2026-03-25 16:30:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:30:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34d7400e90>
2026-03-25 16:30:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:30:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:30:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:30:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7bdf5de7-25e5-5224-98be-306b66c3e43d/7bdf5de7-25e5-5224-98be-306b66c3e43d_image_5.jpg HTTP/1.1" 201 0
2026-03-25 16:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn3%252F614ed32e4c9440c883de6371709ed178%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 16:30:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn3/614ed32e4c9440c883de6371709ed178/images/large/6.jpg saved to cache
2026-03-25 16:30:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7bdf5de7-25e5-5224-98be-306b66c3e43d
2026-03-25 16:30:59 [ayvens.it] INFO: Found listing with ID: 1983526
2026-03-25 16:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983526%27 HTTP/1.1" 200 None
2026-03-25 16:30:59 [ayvens.it] INFO: Scrape type for 1983526: 1
2026-03-25 16:30:59 [ayvens.it] INFO: Extracting data for car ID: 1983526
2026-03-25 16:30:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ea3eeccf-11a9-5b84-97ef-580000195f65 with identifier: 1983526
2026-03-25 16:30:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ea3eeccf-11a9-5b84-97ef-580000195f65 with scrape type 1
2026-03-25 16:30:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ea3eeccf-11a9-5b84-97ef-580000195f65
2026-03-25 16:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg3%252F61178f53f61d4e5e8249863493ede44b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg3/61178f53f61d4e5e8249863493ede44b/images/large/1.jpg not downloaded yet
2026-03-25 16:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg3%252F61178f53f61d4e5e8249863493ede44b%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg3/61178f53f61d4e5e8249863493ede44b/images/large/2.jpg not downloaded yet
2026-03-25 16:30:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:30:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc38ce50>
2026-03-25 16:30:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:30:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:30:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:30:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7bdf5de7-25e5-5224-98be-306b66c3e43d/7bdf5de7-25e5-5224-98be-306b66c3e43d_image_8.jpg HTTP/1.1" 201 0
2026-03-25 16:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn3%252F614ed32e4c9440c883de6371709ed178%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 16:30:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn3/614ed32e4c9440c883de6371709ed178/images/large/9.jpg saved to cache
2026-03-25 16:30:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7bdf5de7-25e5-5224-98be-306b66c3e43d
2026-03-25 16:30:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:30:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc57a790>
2026-03-25 16:30:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:30:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:30:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:30:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7bdf5de7-25e5-5224-98be-306b66c3e43d/7bdf5de7-25e5-5224-98be-306b66c3e43d_image_4.jpg HTTP/1.1" 201 0
2026-03-25 16:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn3%252F614ed32e4c9440c883de6371709ed178%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 16:30:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn3/614ed32e4c9440c883de6371709ed178/images/large/5.jpg saved to cache
2026-03-25 16:30:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7bdf5de7-25e5-5224-98be-306b66c3e43d
2026-03-25 16:30:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:30:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc96b5d0>
2026-03-25 16:30:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:30:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:30:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:30:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7bdf5de7-25e5-5224-98be-306b66c3e43d/7bdf5de7-25e5-5224-98be-306b66c3e43d_image_6.jpg HTTP/1.1" 201 0
2026-03-25 16:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn3%252F614ed32e4c9440c883de6371709ed178%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 16:30:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn3/614ed32e4c9440c883de6371709ed178/images/large/7.jpg saved to cache
2026-03-25 16:30:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7bdf5de7-25e5-5224-98be-306b66c3e43d
2026-03-25 16:30:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:30:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc5af6d0>
2026-03-25 16:30:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:30:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:30:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:30:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7bdf5de7-25e5-5224-98be-306b66c3e43d/7bdf5de7-25e5-5224-98be-306b66c3e43d_image_3.jpg HTTP/1.1" 201 0
2026-03-25 16:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn3%252F614ed32e4c9440c883de6371709ed178%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 16:30:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn3/614ed32e4c9440c883de6371709ed178/images/large/4.jpg saved to cache
2026-03-25 16:30:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7bdf5de7-25e5-5224-98be-306b66c3e43d
2026-03-25 16:30:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm3/1c561b1a28a0440e9b4cf48e58fc8ca3/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg3%252F61178f53f61d4e5e8249863493ede44b%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg3/61178f53f61d4e5e8249863493ede44b/images/large/3.jpg not downloaded yet
2026-03-25 16:30:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm3/1c561b1a28a0440e9b4cf48e58fc8ca3/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg3%252F61178f53f61d4e5e8249863493ede44b%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg3/61178f53f61d4e5e8249863493ede44b/images/large/4.jpg not downloaded yet
2026-03-25 16:30:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm3/1c561b1a28a0440e9b4cf48e58fc8ca3/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm3/1c561b1a28a0440e9b4cf48e58fc8ca3/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm3/1c561b1a28a0440e9b4cf48e58fc8ca3/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg3%252F61178f53f61d4e5e8249863493ede44b%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg3/61178f53f61d4e5e8249863493ede44b/images/large/5.jpg not downloaded yet
2026-03-25 16:30:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm3/1c561b1a28a0440e9b4cf48e58fc8ca3/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm3/1c561b1a28a0440e9b4cf48e58fc8ca3/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm3/1c561b1a28a0440e9b4cf48e58fc8ca3/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg3%252F61178f53f61d4e5e8249863493ede44b%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg3/61178f53f61d4e5e8249863493ede44b/images/large/6.jpg not downloaded yet
2026-03-25 16:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg3%252F61178f53f61d4e5e8249863493ede44b%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg3/61178f53f61d4e5e8249863493ede44b/images/large/7.jpg not downloaded yet
2026-03-25 16:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg3%252F61178f53f61d4e5e8249863493ede44b%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg3/61178f53f61d4e5e8249863493ede44b/images/large/8.jpg not downloaded yet
2026-03-25 16:30:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:30:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcb2c790>
2026-03-25 16:30:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:30:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:30:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:30:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_50ecbe9d-4888-5140-beae-b470a63cd3cc/50ecbe9d-4888-5140-beae-b470a63cd3cc_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm3%252F1c561b1a28a0440e9b4cf48e58fc8ca3%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 16:30:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm3/1c561b1a28a0440e9b4cf48e58fc8ca3/images/large/1.jpg saved to cache
2026-03-25 16:30:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 50ecbe9d-4888-5140-beae-b470a63cd3cc
2026-03-25 16:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg3%252F61178f53f61d4e5e8249863493ede44b%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg3/61178f53f61d4e5e8249863493ede44b/images/large/9.jpg not downloaded yet
2026-03-25 16:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg3%252F61178f53f61d4e5e8249863493ede44b%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg3/61178f53f61d4e5e8249863493ede44b/images/large/10.jpg not downloaded yet
2026-03-25 16:30:59 [ayvens.it] INFO: Found listing with ID: 1983527
2026-03-25 16:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983527%27 HTTP/1.1" 200 None
2026-03-25 16:30:59 [ayvens.it] INFO: Scrape type for 1983527: 1
2026-03-25 16:30:59 [ayvens.it] INFO: Extracting data for car ID: 1983527
2026-03-25 16:30:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6a1e0aad-b591-5079-a611-ab9a172a5b26 with identifier: 1983527
2026-03-25 16:30:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6a1e0aad-b591-5079-a611-ab9a172a5b26 with scrape type 1
2026-03-25 16:30:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6a1e0aad-b591-5079-a611-ab9a172a5b26
2026-03-25 16:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr9%252Fd30b2863678e432ab88d8780a2a7ad1a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:30:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr9/d30b2863678e432ab88d8780a2a7ad1a/images/large/1.jpg not downloaded yet
2026-03-25 16:30:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:30:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc327210>
2026-03-25 16:30:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:30:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:30:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:30:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_50ecbe9d-4888-5140-beae-b470a63cd3cc/50ecbe9d-4888-5140-beae-b470a63cd3cc_image_4.jpg HTTP/1.1" 201 0
2026-03-25 16:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm3%252F1c561b1a28a0440e9b4cf48e58fc8ca3%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 16:30:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm3/1c561b1a28a0440e9b4cf48e58fc8ca3/images/large/5.jpg saved to cache
2026-03-25 16:30:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 50ecbe9d-4888-5140-beae-b470a63cd3cc
2026-03-25 16:30:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:30:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc8e0650>
2026-03-25 16:30:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:30:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:30:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_50ecbe9d-4888-5140-beae-b470a63cd3cc/50ecbe9d-4888-5140-beae-b470a63cd3cc_image_7.jpg HTTP/1.1" 201 0
2026-03-25 16:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm3%252F1c561b1a28a0440e9b4cf48e58fc8ca3%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm3/1c561b1a28a0440e9b4cf48e58fc8ca3/images/large/8.jpg saved to cache
2026-03-25 16:31:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 50ecbe9d-4888-5140-beae-b470a63cd3cc
2026-03-25 16:31:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc5573d0>
2026-03-25 16:31:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_50ecbe9d-4888-5140-beae-b470a63cd3cc/50ecbe9d-4888-5140-beae-b470a63cd3cc_image_5.jpg HTTP/1.1" 201 0
2026-03-25 16:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm3%252F1c561b1a28a0440e9b4cf48e58fc8ca3%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm3/1c561b1a28a0440e9b4cf48e58fc8ca3/images/large/6.jpg saved to cache
2026-03-25 16:31:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 50ecbe9d-4888-5140-beae-b470a63cd3cc
2026-03-25 16:31:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc54e290>
2026-03-25 16:31:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_50ecbe9d-4888-5140-beae-b470a63cd3cc/50ecbe9d-4888-5140-beae-b470a63cd3cc_image_6.jpg HTTP/1.1" 201 0
2026-03-25 16:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm3%252F1c561b1a28a0440e9b4cf48e58fc8ca3%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm3/1c561b1a28a0440e9b4cf48e58fc8ca3/images/large/7.jpg saved to cache
2026-03-25 16:31:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 50ecbe9d-4888-5140-beae-b470a63cd3cc
2026-03-25 16:31:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34d74cc510>
2026-03-25 16:31:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_50ecbe9d-4888-5140-beae-b470a63cd3cc/50ecbe9d-4888-5140-beae-b470a63cd3cc_image_1.jpg HTTP/1.1" 201 0
2026-03-25 16:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm3%252F1c561b1a28a0440e9b4cf48e58fc8ca3%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm3/1c561b1a28a0440e9b4cf48e58fc8ca3/images/large/2.jpg saved to cache
2026-03-25 16:31:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 50ecbe9d-4888-5140-beae-b470a63cd3cc
2026-03-25 16:31:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dca1b090>
2026-03-25 16:31:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_50ecbe9d-4888-5140-beae-b470a63cd3cc/50ecbe9d-4888-5140-beae-b470a63cd3cc_image_2.jpg HTTP/1.1" 201 0
2026-03-25 16:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm3%252F1c561b1a28a0440e9b4cf48e58fc8ca3%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm3/1c561b1a28a0440e9b4cf48e58fc8ca3/images/large/3.jpg saved to cache
2026-03-25 16:31:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 50ecbe9d-4888-5140-beae-b470a63cd3cc
2026-03-25 16:31:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc5561d0>
2026-03-25 16:31:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_50ecbe9d-4888-5140-beae-b470a63cd3cc/50ecbe9d-4888-5140-beae-b470a63cd3cc_image_3.jpg HTTP/1.1" 201 0
2026-03-25 16:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm3%252F1c561b1a28a0440e9b4cf48e58fc8ca3%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm3/1c561b1a28a0440e9b4cf48e58fc8ca3/images/large/4.jpg saved to cache
2026-03-25 16:31:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 50ecbe9d-4888-5140-beae-b470a63cd3cc
2026-03-25 16:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr9%252Fd30b2863678e432ab88d8780a2a7ad1a%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr9/d30b2863678e432ab88d8780a2a7ad1a/images/large/2.jpg not downloaded yet
2026-03-25 16:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr9%252Fd30b2863678e432ab88d8780a2a7ad1a%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr9/d30b2863678e432ab88d8780a2a7ad1a/images/large/3.jpg not downloaded yet
2026-03-25 16:31:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn8/af105d03dada454eb63bae555a500620/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn8/af105d03dada454eb63bae555a500620/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr9%252Fd30b2863678e432ab88d8780a2a7ad1a%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr9/d30b2863678e432ab88d8780a2a7ad1a/images/large/4.jpg not downloaded yet
2026-03-25 16:31:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn8/af105d03dada454eb63bae555a500620/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn8/af105d03dada454eb63bae555a500620/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr9%252Fd30b2863678e432ab88d8780a2a7ad1a%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr9/d30b2863678e432ab88d8780a2a7ad1a/images/large/5.jpg not downloaded yet
2026-03-25 16:31:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn8/af105d03dada454eb63bae555a500620/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr9%252Fd30b2863678e432ab88d8780a2a7ad1a%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr9/d30b2863678e432ab88d8780a2a7ad1a/images/large/6.jpg not downloaded yet
2026-03-25 16:31:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn8/af105d03dada454eb63bae555a500620/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn8/af105d03dada454eb63bae555a500620/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr9%252Fd30b2863678e432ab88d8780a2a7ad1a%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr9/d30b2863678e432ab88d8780a2a7ad1a/images/large/7.jpg not downloaded yet
2026-03-25 16:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr9%252Fd30b2863678e432ab88d8780a2a7ad1a%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr9/d30b2863678e432ab88d8780a2a7ad1a/images/large/8.jpg not downloaded yet
2026-03-25 16:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr9%252Fd30b2863678e432ab88d8780a2a7ad1a%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr9/d30b2863678e432ab88d8780a2a7ad1a/images/large/9.jpg not downloaded yet
2026-03-25 16:31:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc555690>
2026-03-25 16:31:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49c42cb4-9bec-539c-bce9-e64e706a7783/49c42cb4-9bec-539c-bce9-e64e706a7783_image_5.jpg HTTP/1.1" 201 0
2026-03-25 16:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn8%252Faf105d03dada454eb63bae555a500620%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn8/af105d03dada454eb63bae555a500620/images/large/6.jpg saved to cache
2026-03-25 16:31:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 49c42cb4-9bec-539c-bce9-e64e706a7783
2026-03-25 16:31:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc787b90>
2026-03-25 16:31:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49c42cb4-9bec-539c-bce9-e64e706a7783/49c42cb4-9bec-539c-bce9-e64e706a7783_image_4.jpg HTTP/1.1" 201 0
2026-03-25 16:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn8%252Faf105d03dada454eb63bae555a500620%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn8/af105d03dada454eb63bae555a500620/images/large/5.jpg saved to cache
2026-03-25 16:31:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 49c42cb4-9bec-539c-bce9-e64e706a7783
2026-03-25 16:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr9%252Fd30b2863678e432ab88d8780a2a7ad1a%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr9/d30b2863678e432ab88d8780a2a7ad1a/images/large/10.jpg not downloaded yet
2026-03-25 16:31:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcaa8a50>
2026-03-25 16:31:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49c42cb4-9bec-539c-bce9-e64e706a7783/49c42cb4-9bec-539c-bce9-e64e706a7783_image_6.jpg HTTP/1.1" 201 0
2026-03-25 16:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn8%252Faf105d03dada454eb63bae555a500620%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn8/af105d03dada454eb63bae555a500620/images/large/7.jpg saved to cache
2026-03-25 16:31:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 49c42cb4-9bec-539c-bce9-e64e706a7783
2026-03-25 16:31:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc3706d0>
2026-03-25 16:31:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49c42cb4-9bec-539c-bce9-e64e706a7783/49c42cb4-9bec-539c-bce9-e64e706a7783_image_7.jpg HTTP/1.1" 201 0
2026-03-25 16:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn8%252Faf105d03dada454eb63bae555a500620%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn8/af105d03dada454eb63bae555a500620/images/large/8.jpg saved to cache
2026-03-25 16:31:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 49c42cb4-9bec-539c-bce9-e64e706a7783
2026-03-25 16:31:01 [ayvens.it] INFO: Found listing with ID: 1983528
2026-03-25 16:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983528%27 HTTP/1.1" 200 None
2026-03-25 16:31:01 [ayvens.it] INFO: Scrape type for 1983528: 1
2026-03-25 16:31:01 [ayvens.it] INFO: Extracting data for car ID: 1983528
2026-03-25 16:31:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d46e9d87-218d-517b-b7f3-56f47d1410fe with identifier: 1983528
2026-03-25 16:31:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d46e9d87-218d-517b-b7f3-56f47d1410fe with scrape type 1
2026-03-25 16:31:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d46e9d87-218d-517b-b7f3-56f47d1410fe
2026-03-25 16:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh1%252F7f6b54621abf4b2f882a8346d33293ee%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh1/7f6b54621abf4b2f882a8346d33293ee/images/large/1.jpg not downloaded yet
2026-03-25 16:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh1%252F7f6b54621abf4b2f882a8346d33293ee%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh1/7f6b54621abf4b2f882a8346d33293ee/images/large/2.jpg not downloaded yet
2026-03-25 16:31:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc64acd0>
2026-03-25 16:31:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49c42cb4-9bec-539c-bce9-e64e706a7783/49c42cb4-9bec-539c-bce9-e64e706a7783_image_3.jpg HTTP/1.1" 201 0
2026-03-25 16:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn8%252Faf105d03dada454eb63bae555a500620%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn8/af105d03dada454eb63bae555a500620/images/large/4.jpg saved to cache
2026-03-25 16:31:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 49c42cb4-9bec-539c-bce9-e64e706a7783
2026-03-25 16:31:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcaeba10>
2026-03-25 16:31:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49c42cb4-9bec-539c-bce9-e64e706a7783/49c42cb4-9bec-539c-bce9-e64e706a7783_image_2.jpg HTTP/1.1" 201 0
2026-03-25 16:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn8%252Faf105d03dada454eb63bae555a500620%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn8/af105d03dada454eb63bae555a500620/images/large/3.jpg saved to cache
2026-03-25 16:31:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 49c42cb4-9bec-539c-bce9-e64e706a7783
2026-03-25 16:31:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcaeb850>
2026-03-25 16:31:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49c42cb4-9bec-539c-bce9-e64e706a7783/49c42cb4-9bec-539c-bce9-e64e706a7783_image_1.jpg HTTP/1.1" 201 0
2026-03-25 16:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn8%252Faf105d03dada454eb63bae555a500620%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn8/af105d03dada454eb63bae555a500620/images/large/2.jpg saved to cache
2026-03-25 16:31:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 49c42cb4-9bec-539c-bce9-e64e706a7783
2026-03-25 16:31:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg3/61178f53f61d4e5e8249863493ede44b/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh1%252F7f6b54621abf4b2f882a8346d33293ee%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh1/7f6b54621abf4b2f882a8346d33293ee/images/large/3.jpg not downloaded yet
2026-03-25 16:31:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg3/61178f53f61d4e5e8249863493ede44b/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh1%252F7f6b54621abf4b2f882a8346d33293ee%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh1/7f6b54621abf4b2f882a8346d33293ee/images/large/4.jpg not downloaded yet
2026-03-25 16:31:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg3/61178f53f61d4e5e8249863493ede44b/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg3/61178f53f61d4e5e8249863493ede44b/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn8/af105d03dada454eb63bae555a500620/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg3/61178f53f61d4e5e8249863493ede44b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh1%252F7f6b54621abf4b2f882a8346d33293ee%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh1/7f6b54621abf4b2f882a8346d33293ee/images/large/5.jpg not downloaded yet
2026-03-25 16:31:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg3/61178f53f61d4e5e8249863493ede44b/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh1%252F7f6b54621abf4b2f882a8346d33293ee%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh1/7f6b54621abf4b2f882a8346d33293ee/images/large/6.jpg not downloaded yet
2026-03-25 16:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh1%252F7f6b54621abf4b2f882a8346d33293ee%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh1/7f6b54621abf4b2f882a8346d33293ee/images/large/7.jpg not downloaded yet
2026-03-25 16:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh1%252F7f6b54621abf4b2f882a8346d33293ee%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh1/7f6b54621abf4b2f882a8346d33293ee/images/large/8.jpg not downloaded yet
2026-03-25 16:31:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcae9b50>
2026-03-25 16:31:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea3eeccf-11a9-5b84-97ef-580000195f65/ea3eeccf-11a9-5b84-97ef-580000195f65_image_2.jpg HTTP/1.1" 201 0
2026-03-25 16:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg3%252F61178f53f61d4e5e8249863493ede44b%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg3/61178f53f61d4e5e8249863493ede44b/images/large/3.jpg saved to cache
2026-03-25 16:31:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ea3eeccf-11a9-5b84-97ef-580000195f65
2026-03-25 16:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh1%252F7f6b54621abf4b2f882a8346d33293ee%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh1/7f6b54621abf4b2f882a8346d33293ee/images/large/9.jpg not downloaded yet
2026-03-25 16:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh1%252F7f6b54621abf4b2f882a8346d33293ee%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh1/7f6b54621abf4b2f882a8346d33293ee/images/large/10.jpg not downloaded yet
2026-03-25 16:31:01 [ayvens.it] INFO: Found listing with ID: 1983529
2026-03-25 16:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983529%27 HTTP/1.1" 200 None
2026-03-25 16:31:01 [ayvens.it] INFO: Scrape type for 1983529: 1
2026-03-25 16:31:01 [ayvens.it] INFO: Extracting data for car ID: 1983529
2026-03-25 16:31:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a975a62e-0bec-51a8-b8b4-9d6385e3554b with identifier: 1983529
2026-03-25 16:31:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a975a62e-0bec-51a8-b8b4-9d6385e3554b with scrape type 1
2026-03-25 16:31:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a975a62e-0bec-51a8-b8b4-9d6385e3554b
2026-03-25 16:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh1%252F5fa5989f7a1941a78396c5e6485e3e96%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh1/5fa5989f7a1941a78396c5e6485e3e96/images/large/1.jpg not downloaded yet
2026-03-25 16:31:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34d6b59010>
2026-03-25 16:31:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea3eeccf-11a9-5b84-97ef-580000195f65/ea3eeccf-11a9-5b84-97ef-580000195f65_image_7.jpg HTTP/1.1" 201 0
2026-03-25 16:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg3%252F61178f53f61d4e5e8249863493ede44b%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg3/61178f53f61d4e5e8249863493ede44b/images/large/8.jpg saved to cache
2026-03-25 16:31:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ea3eeccf-11a9-5b84-97ef-580000195f65
2026-03-25 16:31:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc54f0d0>
2026-03-25 16:31:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea3eeccf-11a9-5b84-97ef-580000195f65/ea3eeccf-11a9-5b84-97ef-580000195f65_image_3.jpg HTTP/1.1" 201 0
2026-03-25 16:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg3%252F61178f53f61d4e5e8249863493ede44b%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg3/61178f53f61d4e5e8249863493ede44b/images/large/4.jpg saved to cache
2026-03-25 16:31:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ea3eeccf-11a9-5b84-97ef-580000195f65
2026-03-25 16:31:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc578390>
2026-03-25 16:31:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea3eeccf-11a9-5b84-97ef-580000195f65/ea3eeccf-11a9-5b84-97ef-580000195f65_image_8.jpg HTTP/1.1" 201 0
2026-03-25 16:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg3%252F61178f53f61d4e5e8249863493ede44b%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg3/61178f53f61d4e5e8249863493ede44b/images/large/9.jpg saved to cache
2026-03-25 16:31:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ea3eeccf-11a9-5b84-97ef-580000195f65
2026-03-25 16:31:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcb2eb10>
2026-03-25 16:31:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49c42cb4-9bec-539c-bce9-e64e706a7783/49c42cb4-9bec-539c-bce9-e64e706a7783_image_9.jpg HTTP/1.1" 201 0
2026-03-25 16:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn8%252Faf105d03dada454eb63bae555a500620%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn8/af105d03dada454eb63bae555a500620/images/large/10.jpg saved to cache
2026-03-25 16:31:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 49c42cb4-9bec-539c-bce9-e64e706a7783
2026-03-25 16:31:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc76d0d0>
2026-03-25 16:31:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea3eeccf-11a9-5b84-97ef-580000195f65/ea3eeccf-11a9-5b84-97ef-580000195f65_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg3%252F61178f53f61d4e5e8249863493ede44b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg3/61178f53f61d4e5e8249863493ede44b/images/large/1.jpg saved to cache
2026-03-25 16:31:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ea3eeccf-11a9-5b84-97ef-580000195f65
2026-03-25 16:31:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc54bf50>
2026-03-25 16:31:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea3eeccf-11a9-5b84-97ef-580000195f65/ea3eeccf-11a9-5b84-97ef-580000195f65_image_1.jpg HTTP/1.1" 201 0
2026-03-25 16:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg3%252F61178f53f61d4e5e8249863493ede44b%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg3/61178f53f61d4e5e8249863493ede44b/images/large/2.jpg saved to cache
2026-03-25 16:31:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ea3eeccf-11a9-5b84-97ef-580000195f65
2026-03-25 16:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh1%252F5fa5989f7a1941a78396c5e6485e3e96%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh1/5fa5989f7a1941a78396c5e6485e3e96/images/large/2.jpg not downloaded yet
2026-03-25 16:31:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg3/61178f53f61d4e5e8249863493ede44b/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh1%252F5fa5989f7a1941a78396c5e6485e3e96%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh1/5fa5989f7a1941a78396c5e6485e3e96/images/large/3.jpg not downloaded yet
2026-03-25 16:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh1%252F5fa5989f7a1941a78396c5e6485e3e96%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh1/5fa5989f7a1941a78396c5e6485e3e96/images/large/4.jpg not downloaded yet
2026-03-25 16:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh1%252F5fa5989f7a1941a78396c5e6485e3e96%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh1/5fa5989f7a1941a78396c5e6485e3e96/images/large/5.jpg not downloaded yet
2026-03-25 16:31:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg3/61178f53f61d4e5e8249863493ede44b/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr9/d30b2863678e432ab88d8780a2a7ad1a/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr9/d30b2863678e432ab88d8780a2a7ad1a/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh1%252F5fa5989f7a1941a78396c5e6485e3e96%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh1/5fa5989f7a1941a78396c5e6485e3e96/images/large/6.jpg not downloaded yet
2026-03-25 16:31:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr9/d30b2863678e432ab88d8780a2a7ad1a/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr9/d30b2863678e432ab88d8780a2a7ad1a/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh1%252F5fa5989f7a1941a78396c5e6485e3e96%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh1/5fa5989f7a1941a78396c5e6485e3e96/images/large/7.jpg not downloaded yet
2026-03-25 16:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh1%252F5fa5989f7a1941a78396c5e6485e3e96%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh1/5fa5989f7a1941a78396c5e6485e3e96/images/large/8.jpg not downloaded yet
2026-03-25 16:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh1%252F5fa5989f7a1941a78396c5e6485e3e96%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh1/5fa5989f7a1941a78396c5e6485e3e96/images/large/9.jpg not downloaded yet
2026-03-25 16:31:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc54db10>
2026-03-25 16:31:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea3eeccf-11a9-5b84-97ef-580000195f65/ea3eeccf-11a9-5b84-97ef-580000195f65_image_6.jpg HTTP/1.1" 201 0
2026-03-25 16:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg3%252F61178f53f61d4e5e8249863493ede44b%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg3/61178f53f61d4e5e8249863493ede44b/images/large/7.jpg saved to cache
2026-03-25 16:31:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ea3eeccf-11a9-5b84-97ef-580000195f65
2026-03-25 16:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh1%252F5fa5989f7a1941a78396c5e6485e3e96%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh1/5fa5989f7a1941a78396c5e6485e3e96/images/large/10.jpg not downloaded yet
2026-03-25 16:31:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr9/d30b2863678e432ab88d8780a2a7ad1a/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:02 [ayvens.it] INFO: Found listing with ID: 1983530
2026-03-25 16:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983530%27 HTTP/1.1" 200 None
2026-03-25 16:31:02 [ayvens.it] INFO: Scrape type for 1983530: 1
2026-03-25 16:31:02 [ayvens.it] INFO: Extracting data for car ID: 1983530
2026-03-25 16:31:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 22e95673-3e1e-5a1b-a53d-30c1fa432ef7 with identifier: 1983530
2026-03-25 16:31:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 22e95673-3e1e-5a1b-a53d-30c1fa432ef7 with scrape type 1
2026-03-25 16:31:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 22e95673-3e1e-5a1b-a53d-30c1fa432ef7
2026-03-25 16:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge2%252F72e741275e1345cbb0c1e6b40e1fef0c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge2/72e741275e1345cbb0c1e6b40e1fef0c/images/large/1.jpg not downloaded yet
2026-03-25 16:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge2%252F72e741275e1345cbb0c1e6b40e1fef0c%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge2/72e741275e1345cbb0c1e6b40e1fef0c/images/large/2.jpg not downloaded yet
2026-03-25 16:31:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34d7437950>
2026-03-25 16:31:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea3eeccf-11a9-5b84-97ef-580000195f65/ea3eeccf-11a9-5b84-97ef-580000195f65_image_9.jpg HTTP/1.1" 201 0
2026-03-25 16:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg3%252F61178f53f61d4e5e8249863493ede44b%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg3/61178f53f61d4e5e8249863493ede44b/images/large/10.jpg saved to cache
2026-03-25 16:31:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ea3eeccf-11a9-5b84-97ef-580000195f65
2026-03-25 16:31:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc9dca10>
2026-03-25 16:31:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a1e0aad-b591-5079-a611-ab9a172a5b26/6a1e0aad-b591-5079-a611-ab9a172a5b26_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr9%252Fd30b2863678e432ab88d8780a2a7ad1a%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr9/d30b2863678e432ab88d8780a2a7ad1a/images/large/1.jpg saved to cache
2026-03-25 16:31:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6a1e0aad-b591-5079-a611-ab9a172a5b26
2026-03-25 16:31:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcad9090>
2026-03-25 16:31:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a1e0aad-b591-5079-a611-ab9a172a5b26/6a1e0aad-b591-5079-a611-ab9a172a5b26_image_4.jpg HTTP/1.1" 201 0
2026-03-25 16:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr9%252Fd30b2863678e432ab88d8780a2a7ad1a%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr9/d30b2863678e432ab88d8780a2a7ad1a/images/large/5.jpg saved to cache
2026-03-25 16:31:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6a1e0aad-b591-5079-a611-ab9a172a5b26
2026-03-25 16:31:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc80c390>
2026-03-25 16:31:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a1e0aad-b591-5079-a611-ab9a172a5b26/6a1e0aad-b591-5079-a611-ab9a172a5b26_image_1.jpg HTTP/1.1" 201 0
2026-03-25 16:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr9%252Fd30b2863678e432ab88d8780a2a7ad1a%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr9/d30b2863678e432ab88d8780a2a7ad1a/images/large/2.jpg saved to cache
2026-03-25 16:31:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6a1e0aad-b591-5079-a611-ab9a172a5b26
2026-03-25 16:31:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34d7437b50>
2026-03-25 16:31:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a1e0aad-b591-5079-a611-ab9a172a5b26/6a1e0aad-b591-5079-a611-ab9a172a5b26_image_3.jpg HTTP/1.1" 201 0
2026-03-25 16:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr9%252Fd30b2863678e432ab88d8780a2a7ad1a%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr9/d30b2863678e432ab88d8780a2a7ad1a/images/large/4.jpg saved to cache
2026-03-25 16:31:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6a1e0aad-b591-5079-a611-ab9a172a5b26
2026-03-25 16:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge2%252F72e741275e1345cbb0c1e6b40e1fef0c%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge2/72e741275e1345cbb0c1e6b40e1fef0c/images/large/3.jpg not downloaded yet
2026-03-25 16:31:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg3/61178f53f61d4e5e8249863493ede44b/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge2%252F72e741275e1345cbb0c1e6b40e1fef0c%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge2/72e741275e1345cbb0c1e6b40e1fef0c/images/large/4.jpg not downloaded yet
2026-03-25 16:31:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc8d44d0>
2026-03-25 16:31:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a1e0aad-b591-5079-a611-ab9a172a5b26/6a1e0aad-b591-5079-a611-ab9a172a5b26_image_2.jpg HTTP/1.1" 201 0
2026-03-25 16:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr9%252Fd30b2863678e432ab88d8780a2a7ad1a%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr9/d30b2863678e432ab88d8780a2a7ad1a/images/large/3.jpg saved to cache
2026-03-25 16:31:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6a1e0aad-b591-5079-a611-ab9a172a5b26
2026-03-25 16:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge2%252F72e741275e1345cbb0c1e6b40e1fef0c%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge2/72e741275e1345cbb0c1e6b40e1fef0c/images/large/5.jpg not downloaded yet
2026-03-25 16:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge2%252F72e741275e1345cbb0c1e6b40e1fef0c%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge2/72e741275e1345cbb0c1e6b40e1fef0c/images/large/6.jpg not downloaded yet
2026-03-25 16:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge2%252F72e741275e1345cbb0c1e6b40e1fef0c%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge2/72e741275e1345cbb0c1e6b40e1fef0c/images/large/7.jpg not downloaded yet
2026-03-25 16:31:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc590cd0>
2026-03-25 16:31:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea3eeccf-11a9-5b84-97ef-580000195f65/ea3eeccf-11a9-5b84-97ef-580000195f65_image_5.jpg HTTP/1.1" 201 0
2026-03-25 16:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg3%252F61178f53f61d4e5e8249863493ede44b%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg3/61178f53f61d4e5e8249863493ede44b/images/large/6.jpg saved to cache
2026-03-25 16:31:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ea3eeccf-11a9-5b84-97ef-580000195f65
2026-03-25 16:31:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh1/7f6b54621abf4b2f882a8346d33293ee/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr9/d30b2863678e432ab88d8780a2a7ad1a/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh1/7f6b54621abf4b2f882a8346d33293ee/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr9/d30b2863678e432ab88d8780a2a7ad1a/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge2%252F72e741275e1345cbb0c1e6b40e1fef0c%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge2/72e741275e1345cbb0c1e6b40e1fef0c/images/large/8.jpg not downloaded yet
2026-03-25 16:31:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh1/7f6b54621abf4b2f882a8346d33293ee/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh1/7f6b54621abf4b2f882a8346d33293ee/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge2%252F72e741275e1345cbb0c1e6b40e1fef0c%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge2/72e741275e1345cbb0c1e6b40e1fef0c/images/large/9.jpg not downloaded yet
2026-03-25 16:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge2%252F72e741275e1345cbb0c1e6b40e1fef0c%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge2/72e741275e1345cbb0c1e6b40e1fef0c/images/large/10.jpg not downloaded yet
2026-03-25 16:31:03 [ayvens.it] INFO: Found listing with ID: 1983531
2026-03-25 16:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983531%27 HTTP/1.1" 200 None
2026-03-25 16:31:03 [ayvens.it] INFO: Scrape type for 1983531: 1
2026-03-25 16:31:03 [ayvens.it] INFO: Extracting data for car ID: 1983531
2026-03-25 16:31:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c42a761d-f342-5525-82fc-f02240b53738 with identifier: 1983531
2026-03-25 16:31:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c42a761d-f342-5525-82fc-f02240b53738 with scrape type 1
2026-03-25 16:31:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c42a761d-f342-5525-82fc-f02240b53738
2026-03-25 16:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh3%252Fa0e901441c134d389858d8b128bf99d3%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh3/a0e901441c134d389858d8b128bf99d3/images/large/1.jpg not downloaded yet
2026-03-25 16:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh3%252Fa0e901441c134d389858d8b128bf99d3%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh3/a0e901441c134d389858d8b128bf99d3/images/large/2.jpg not downloaded yet
2026-03-25 16:31:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dca259d0>
2026-03-25 16:31:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d46e9d87-218d-517b-b7f3-56f47d1410fe/d46e9d87-218d-517b-b7f3-56f47d1410fe_image_1.jpg HTTP/1.1" 201 0
2026-03-25 16:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh1%252F7f6b54621abf4b2f882a8346d33293ee%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh1/7f6b54621abf4b2f882a8346d33293ee/images/large/2.jpg saved to cache
2026-03-25 16:31:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d46e9d87-218d-517b-b7f3-56f47d1410fe
2026-03-25 16:31:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc713710>
2026-03-25 16:31:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a1e0aad-b591-5079-a611-ab9a172a5b26/6a1e0aad-b591-5079-a611-ab9a172a5b26_image_9.jpg HTTP/1.1" 201 0
2026-03-25 16:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr9%252Fd30b2863678e432ab88d8780a2a7ad1a%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr9/d30b2863678e432ab88d8780a2a7ad1a/images/large/10.jpg saved to cache
2026-03-25 16:31:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6a1e0aad-b591-5079-a611-ab9a172a5b26
2026-03-25 16:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh3%252Fa0e901441c134d389858d8b128bf99d3%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh3/a0e901441c134d389858d8b128bf99d3/images/large/3.jpg not downloaded yet
2026-03-25 16:31:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc58aa90>
2026-03-25 16:31:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d46e9d87-218d-517b-b7f3-56f47d1410fe/d46e9d87-218d-517b-b7f3-56f47d1410fe_image_3.jpg HTTP/1.1" 201 0
2026-03-25 16:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh1%252F7f6b54621abf4b2f882a8346d33293ee%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh1/7f6b54621abf4b2f882a8346d33293ee/images/large/4.jpg saved to cache
2026-03-25 16:31:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d46e9d87-218d-517b-b7f3-56f47d1410fe
2026-03-25 16:31:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc9cb910>
2026-03-25 16:31:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a1e0aad-b591-5079-a611-ab9a172a5b26/6a1e0aad-b591-5079-a611-ab9a172a5b26_image_8.jpg HTTP/1.1" 201 0
2026-03-25 16:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr9%252Fd30b2863678e432ab88d8780a2a7ad1a%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr9/d30b2863678e432ab88d8780a2a7ad1a/images/large/9.jpg saved to cache
2026-03-25 16:31:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6a1e0aad-b591-5079-a611-ab9a172a5b26
2026-03-25 16:31:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc5e9b50>
2026-03-25 16:31:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d46e9d87-218d-517b-b7f3-56f47d1410fe/d46e9d87-218d-517b-b7f3-56f47d1410fe_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh1%252F7f6b54621abf4b2f882a8346d33293ee%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh1/7f6b54621abf4b2f882a8346d33293ee/images/large/1.jpg saved to cache
2026-03-25 16:31:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d46e9d87-218d-517b-b7f3-56f47d1410fe
2026-03-25 16:31:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc3660d0>
2026-03-25 16:31:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d46e9d87-218d-517b-b7f3-56f47d1410fe/d46e9d87-218d-517b-b7f3-56f47d1410fe_image_2.jpg HTTP/1.1" 201 0
2026-03-25 16:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh1%252F7f6b54621abf4b2f882a8346d33293ee%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh1/7f6b54621abf4b2f882a8346d33293ee/images/large/3.jpg saved to cache
2026-03-25 16:31:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d46e9d87-218d-517b-b7f3-56f47d1410fe
2026-03-25 16:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh3%252Fa0e901441c134d389858d8b128bf99d3%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh3/a0e901441c134d389858d8b128bf99d3/images/large/4.jpg not downloaded yet
2026-03-25 16:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh3%252Fa0e901441c134d389858d8b128bf99d3%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh3/a0e901441c134d389858d8b128bf99d3/images/large/5.jpg not downloaded yet
2026-03-25 16:31:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh1/5fa5989f7a1941a78396c5e6485e3e96/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh1/5fa5989f7a1941a78396c5e6485e3e96/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh3%252Fa0e901441c134d389858d8b128bf99d3%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh3/a0e901441c134d389858d8b128bf99d3/images/large/6.jpg not downloaded yet
2026-03-25 16:31:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh1/5fa5989f7a1941a78396c5e6485e3e96/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh3%252Fa0e901441c134d389858d8b128bf99d3%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh3/a0e901441c134d389858d8b128bf99d3/images/large/7.jpg not downloaded yet
2026-03-25 16:31:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh1/5fa5989f7a1941a78396c5e6485e3e96/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh1/5fa5989f7a1941a78396c5e6485e3e96/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh1/5fa5989f7a1941a78396c5e6485e3e96/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh3%252Fa0e901441c134d389858d8b128bf99d3%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh3/a0e901441c134d389858d8b128bf99d3/images/large/8.jpg not downloaded yet
2026-03-25 16:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh3%252Fa0e901441c134d389858d8b128bf99d3%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh3/a0e901441c134d389858d8b128bf99d3/images/large/9.jpg not downloaded yet
2026-03-25 16:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh3%252Fa0e901441c134d389858d8b128bf99d3%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh3/a0e901441c134d389858d8b128bf99d3/images/large/10.jpg not downloaded yet
2026-03-25 16:31:04 [ayvens.it] INFO: Found listing with ID: 1983532
2026-03-25 16:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983532%27 HTTP/1.1" 200 None
2026-03-25 16:31:04 [ayvens.it] INFO: Scrape type for 1983532: 1
2026-03-25 16:31:05 [ayvens.it] INFO: Extracting data for car ID: 1983532
2026-03-25 16:31:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 90b7cd71-97b3-5904-a37d-7882f072bf3b with identifier: 1983532
2026-03-25 16:31:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 90b7cd71-97b3-5904-a37d-7882f072bf3b with scrape type 1
2026-03-25 16:31:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 90b7cd71-97b3-5904-a37d-7882f072bf3b
2026-03-25 16:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj5%252Fc90e8392b0d2431cb709805b7f1f4616%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj5/c90e8392b0d2431cb709805b7f1f4616/images/large/1.jpg not downloaded yet
2026-03-25 16:31:05 [scrapy.extensions.logstats] INFO: Crawled 8 pages (at 8 pages/min), scraped 8 items (at 8 items/min)
2026-03-25 16:31:05 [scrapy.extensions.memusage] INFO: Peak memory usage is 181MiB
2026-03-25 16:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj5%252Fc90e8392b0d2431cb709805b7f1f4616%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj5/c90e8392b0d2431cb709805b7f1f4616/images/large/2.jpg not downloaded yet
2026-03-25 16:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj5%252Fc90e8392b0d2431cb709805b7f1f4616%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj5/c90e8392b0d2431cb709805b7f1f4616/images/large/3.jpg not downloaded yet
2026-03-25 16:31:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcb2c410>
2026-03-25 16:31:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a975a62e-0bec-51a8-b8b4-9d6385e3554b/a975a62e-0bec-51a8-b8b4-9d6385e3554b_image_1.jpg HTTP/1.1" 201 0
2026-03-25 16:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh1%252F5fa5989f7a1941a78396c5e6485e3e96%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh1/5fa5989f7a1941a78396c5e6485e3e96/images/large/2.jpg saved to cache
2026-03-25 16:31:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a975a62e-0bec-51a8-b8b4-9d6385e3554b
2026-03-25 16:31:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcac8d10>
2026-03-25 16:31:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a975a62e-0bec-51a8-b8b4-9d6385e3554b/a975a62e-0bec-51a8-b8b4-9d6385e3554b_image_4.jpg HTTP/1.1" 201 0
2026-03-25 16:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh1%252F5fa5989f7a1941a78396c5e6485e3e96%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh1/5fa5989f7a1941a78396c5e6485e3e96/images/large/5.jpg saved to cache
2026-03-25 16:31:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a975a62e-0bec-51a8-b8b4-9d6385e3554b
2026-03-25 16:31:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc94d690>
2026-03-25 16:31:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a975a62e-0bec-51a8-b8b4-9d6385e3554b/a975a62e-0bec-51a8-b8b4-9d6385e3554b_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh1%252F5fa5989f7a1941a78396c5e6485e3e96%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh1/5fa5989f7a1941a78396c5e6485e3e96/images/large/1.jpg saved to cache
2026-03-25 16:31:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a975a62e-0bec-51a8-b8b4-9d6385e3554b
2026-03-25 16:31:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc301f90>
2026-03-25 16:31:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a975a62e-0bec-51a8-b8b4-9d6385e3554b/a975a62e-0bec-51a8-b8b4-9d6385e3554b_image_5.jpg HTTP/1.1" 201 0
2026-03-25 16:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh1%252F5fa5989f7a1941a78396c5e6485e3e96%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh1/5fa5989f7a1941a78396c5e6485e3e96/images/large/6.jpg saved to cache
2026-03-25 16:31:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a975a62e-0bec-51a8-b8b4-9d6385e3554b
2026-03-25 16:31:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc94f610>
2026-03-25 16:31:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a975a62e-0bec-51a8-b8b4-9d6385e3554b/a975a62e-0bec-51a8-b8b4-9d6385e3554b_image_2.jpg HTTP/1.1" 201 0
2026-03-25 16:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh1%252F5fa5989f7a1941a78396c5e6485e3e96%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh1/5fa5989f7a1941a78396c5e6485e3e96/images/large/3.jpg saved to cache
2026-03-25 16:31:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a975a62e-0bec-51a8-b8b4-9d6385e3554b
2026-03-25 16:31:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc94c850>
2026-03-25 16:31:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a975a62e-0bec-51a8-b8b4-9d6385e3554b/a975a62e-0bec-51a8-b8b4-9d6385e3554b_image_3.jpg HTTP/1.1" 201 0
2026-03-25 16:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh1%252F5fa5989f7a1941a78396c5e6485e3e96%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh1/5fa5989f7a1941a78396c5e6485e3e96/images/large/4.jpg saved to cache
2026-03-25 16:31:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a975a62e-0bec-51a8-b8b4-9d6385e3554b
2026-03-25 16:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj5%252Fc90e8392b0d2431cb709805b7f1f4616%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj5/c90e8392b0d2431cb709805b7f1f4616/images/large/4.jpg not downloaded yet
2026-03-25 16:31:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh1/5fa5989f7a1941a78396c5e6485e3e96/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj5%252Fc90e8392b0d2431cb709805b7f1f4616%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj5/c90e8392b0d2431cb709805b7f1f4616/images/large/5.jpg not downloaded yet
2026-03-25 16:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj5%252Fc90e8392b0d2431cb709805b7f1f4616%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj5/c90e8392b0d2431cb709805b7f1f4616/images/large/6.jpg not downloaded yet
2026-03-25 16:31:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge2/72e741275e1345cbb0c1e6b40e1fef0c/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge2/72e741275e1345cbb0c1e6b40e1fef0c/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn8/af105d03dada454eb63bae555a500620/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj5%252Fc90e8392b0d2431cb709805b7f1f4616%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj5/c90e8392b0d2431cb709805b7f1f4616/images/large/7.jpg not downloaded yet
2026-03-25 16:31:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge2/72e741275e1345cbb0c1e6b40e1fef0c/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge2/72e741275e1345cbb0c1e6b40e1fef0c/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge2/72e741275e1345cbb0c1e6b40e1fef0c/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh1/7f6b54621abf4b2f882a8346d33293ee/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj5%252Fc90e8392b0d2431cb709805b7f1f4616%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj5/c90e8392b0d2431cb709805b7f1f4616/images/large/8.jpg not downloaded yet
2026-03-25 16:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj5%252Fc90e8392b0d2431cb709805b7f1f4616%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj5/c90e8392b0d2431cb709805b7f1f4616/images/large/9.jpg not downloaded yet
2026-03-25 16:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj5%252Fc90e8392b0d2431cb709805b7f1f4616%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj5/c90e8392b0d2431cb709805b7f1f4616/images/large/10.jpg not downloaded yet
2026-03-25 16:31:05 [ayvens.it] INFO: Found listing with ID: 1983533
2026-03-25 16:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983533%27 HTTP/1.1" 200 None
2026-03-25 16:31:05 [ayvens.it] INFO: Scrape type for 1983533: 1
2026-03-25 16:31:05 [ayvens.it] INFO: Extracting data for car ID: 1983533
2026-03-25 16:31:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d9a73218-f66c-5a83-a8ea-fa64869e0144 with identifier: 1983533
2026-03-25 16:31:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d9a73218-f66c-5a83-a8ea-fa64869e0144 with scrape type 1
2026-03-25 16:31:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d9a73218-f66c-5a83-a8ea-fa64869e0144
2026-03-25 16:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk2%252F320cdccf462b48a8bf6363e34a5a1ac5%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk2/320cdccf462b48a8bf6363e34a5a1ac5/images/large/1.jpg not downloaded yet
2026-03-25 16:31:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc9e5d10>
2026-03-25 16:31:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a975a62e-0bec-51a8-b8b4-9d6385e3554b/a975a62e-0bec-51a8-b8b4-9d6385e3554b_image_9.jpg HTTP/1.1" 201 0
2026-03-25 16:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh1%252F5fa5989f7a1941a78396c5e6485e3e96%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh1/5fa5989f7a1941a78396c5e6485e3e96/images/large/10.jpg saved to cache
2026-03-25 16:31:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a975a62e-0bec-51a8-b8b4-9d6385e3554b
2026-03-25 16:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk2%252F320cdccf462b48a8bf6363e34a5a1ac5%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk2/320cdccf462b48a8bf6363e34a5a1ac5/images/large/2.jpg not downloaded yet
2026-03-25 16:31:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc9cb8d0>
2026-03-25 16:31:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22e95673-3e1e-5a1b-a53d-30c1fa432ef7/22e95673-3e1e-5a1b-a53d-30c1fa432ef7_image_6.jpg HTTP/1.1" 201 0
2026-03-25 16:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge2%252F72e741275e1345cbb0c1e6b40e1fef0c%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge2/72e741275e1345cbb0c1e6b40e1fef0c/images/large/7.jpg saved to cache
2026-03-25 16:31:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 22e95673-3e1e-5a1b-a53d-30c1fa432ef7
2026-03-25 16:31:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc5ad090>
2026-03-25 16:31:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22e95673-3e1e-5a1b-a53d-30c1fa432ef7/22e95673-3e1e-5a1b-a53d-30c1fa432ef7_image_5.jpg HTTP/1.1" 201 0
2026-03-25 16:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge2%252F72e741275e1345cbb0c1e6b40e1fef0c%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge2/72e741275e1345cbb0c1e6b40e1fef0c/images/large/6.jpg saved to cache
2026-03-25 16:31:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 22e95673-3e1e-5a1b-a53d-30c1fa432ef7
2026-03-25 16:31:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc548f10>
2026-03-25 16:31:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49c42cb4-9bec-539c-bce9-e64e706a7783/49c42cb4-9bec-539c-bce9-e64e706a7783_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn8%252Faf105d03dada454eb63bae555a500620%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn8/af105d03dada454eb63bae555a500620/images/large/1.jpg saved to cache
2026-03-25 16:31:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 49c42cb4-9bec-539c-bce9-e64e706a7783
2026-03-25 16:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk2%252F320cdccf462b48a8bf6363e34a5a1ac5%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk2/320cdccf462b48a8bf6363e34a5a1ac5/images/large/3.jpg not downloaded yet
2026-03-25 16:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk2%252F320cdccf462b48a8bf6363e34a5a1ac5%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk2/320cdccf462b48a8bf6363e34a5a1ac5/images/large/4.jpg not downloaded yet
2026-03-25 16:31:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc80c5d0>
2026-03-25 16:31:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22e95673-3e1e-5a1b-a53d-30c1fa432ef7/22e95673-3e1e-5a1b-a53d-30c1fa432ef7_image_4.jpg HTTP/1.1" 201 0
2026-03-25 16:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge2%252F72e741275e1345cbb0c1e6b40e1fef0c%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge2/72e741275e1345cbb0c1e6b40e1fef0c/images/large/5.jpg saved to cache
2026-03-25 16:31:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 22e95673-3e1e-5a1b-a53d-30c1fa432ef7
2026-03-25 16:31:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dca9f710>
2026-03-25 16:31:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22e95673-3e1e-5a1b-a53d-30c1fa432ef7/22e95673-3e1e-5a1b-a53d-30c1fa432ef7_image_3.jpg HTTP/1.1" 201 0
2026-03-25 16:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge2%252F72e741275e1345cbb0c1e6b40e1fef0c%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge2/72e741275e1345cbb0c1e6b40e1fef0c/images/large/4.jpg saved to cache
2026-03-25 16:31:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 22e95673-3e1e-5a1b-a53d-30c1fa432ef7
2026-03-25 16:31:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc34d950>
2026-03-25 16:31:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22e95673-3e1e-5a1b-a53d-30c1fa432ef7/22e95673-3e1e-5a1b-a53d-30c1fa432ef7_image_2.jpg HTTP/1.1" 201 0
2026-03-25 16:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge2%252F72e741275e1345cbb0c1e6b40e1fef0c%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge2/72e741275e1345cbb0c1e6b40e1fef0c/images/large/3.jpg saved to cache
2026-03-25 16:31:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 22e95673-3e1e-5a1b-a53d-30c1fa432ef7
2026-03-25 16:31:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc5fa890>
2026-03-25 16:31:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d46e9d87-218d-517b-b7f3-56f47d1410fe/d46e9d87-218d-517b-b7f3-56f47d1410fe_image_4.jpg HTTP/1.1" 201 0
2026-03-25 16:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh1%252F7f6b54621abf4b2f882a8346d33293ee%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh1/7f6b54621abf4b2f882a8346d33293ee/images/large/5.jpg saved to cache
2026-03-25 16:31:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d46e9d87-218d-517b-b7f3-56f47d1410fe
2026-03-25 16:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk2%252F320cdccf462b48a8bf6363e34a5a1ac5%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk2/320cdccf462b48a8bf6363e34a5a1ac5/images/large/5.jpg not downloaded yet
2026-03-25 16:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk2%252F320cdccf462b48a8bf6363e34a5a1ac5%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk2/320cdccf462b48a8bf6363e34a5a1ac5/images/large/6.jpg not downloaded yet
2026-03-25 16:31:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh3/a0e901441c134d389858d8b128bf99d3/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk2%252F320cdccf462b48a8bf6363e34a5a1ac5%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk2/320cdccf462b48a8bf6363e34a5a1ac5/images/large/7.jpg not downloaded yet
2026-03-25 16:31:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh3/a0e901441c134d389858d8b128bf99d3/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge2/72e741275e1345cbb0c1e6b40e1fef0c/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh3/a0e901441c134d389858d8b128bf99d3/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh3/a0e901441c134d389858d8b128bf99d3/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh3/a0e901441c134d389858d8b128bf99d3/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk2%252F320cdccf462b48a8bf6363e34a5a1ac5%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk2/320cdccf462b48a8bf6363e34a5a1ac5/images/large/8.jpg not downloaded yet
2026-03-25 16:31:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh3/a0e901441c134d389858d8b128bf99d3/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh3/a0e901441c134d389858d8b128bf99d3/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk2%252F320cdccf462b48a8bf6363e34a5a1ac5%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk2/320cdccf462b48a8bf6363e34a5a1ac5/images/large/9.jpg not downloaded yet
2026-03-25 16:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk2%252F320cdccf462b48a8bf6363e34a5a1ac5%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk2/320cdccf462b48a8bf6363e34a5a1ac5/images/large/10.jpg not downloaded yet
2026-03-25 16:31:06 [ayvens.it] INFO: Found listing with ID: 1983534
2026-03-25 16:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983534%27 HTTP/1.1" 200 None
2026-03-25 16:31:06 [ayvens.it] INFO: Scrape type for 1983534: 1
2026-03-25 16:31:06 [ayvens.it] INFO: Extracting data for car ID: 1983534
2026-03-25 16:31:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 37d4646d-a37d-5f42-ae38-314944b69880 with identifier: 1983534
2026-03-25 16:31:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 37d4646d-a37d-5f42-ae38-314944b69880 with scrape type 1
2026-03-25 16:31:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 37d4646d-a37d-5f42-ae38-314944b69880
2026-03-25 16:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj6%252F711f6153f8b540088cd306cb3f7e4a30%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj6/711f6153f8b540088cd306cb3f7e4a30/images/large/1.jpg not downloaded yet
2026-03-25 16:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj6%252F711f6153f8b540088cd306cb3f7e4a30%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj6/711f6153f8b540088cd306cb3f7e4a30/images/large/2.jpg not downloaded yet
2026-03-25 16:31:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc64a750>
2026-03-25 16:31:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c42a761d-f342-5525-82fc-f02240b53738/c42a761d-f342-5525-82fc-f02240b53738_image_6.jpg HTTP/1.1" 201 0
2026-03-25 16:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh3%252Fa0e901441c134d389858d8b128bf99d3%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh3/a0e901441c134d389858d8b128bf99d3/images/large/7.jpg saved to cache
2026-03-25 16:31:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c42a761d-f342-5525-82fc-f02240b53738
2026-03-25 16:31:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc370b50>
2026-03-25 16:31:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c42a761d-f342-5525-82fc-f02240b53738/c42a761d-f342-5525-82fc-f02240b53738_image_5.jpg HTTP/1.1" 201 0
2026-03-25 16:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh3%252Fa0e901441c134d389858d8b128bf99d3%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh3/a0e901441c134d389858d8b128bf99d3/images/large/6.jpg saved to cache
2026-03-25 16:31:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c42a761d-f342-5525-82fc-f02240b53738
2026-03-25 16:31:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc787a50>
2026-03-25 16:31:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22e95673-3e1e-5a1b-a53d-30c1fa432ef7/22e95673-3e1e-5a1b-a53d-30c1fa432ef7_image_1.jpg HTTP/1.1" 201 0
2026-03-25 16:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge2%252F72e741275e1345cbb0c1e6b40e1fef0c%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge2/72e741275e1345cbb0c1e6b40e1fef0c/images/large/2.jpg saved to cache
2026-03-25 16:31:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 22e95673-3e1e-5a1b-a53d-30c1fa432ef7
2026-03-25 16:31:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc371c90>
2026-03-25 16:31:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c42a761d-f342-5525-82fc-f02240b53738/c42a761d-f342-5525-82fc-f02240b53738_image_3.jpg HTTP/1.1" 201 0
2026-03-25 16:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh3%252Fa0e901441c134d389858d8b128bf99d3%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh3/a0e901441c134d389858d8b128bf99d3/images/large/4.jpg saved to cache
2026-03-25 16:31:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c42a761d-f342-5525-82fc-f02240b53738
2026-03-25 16:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj6%252F711f6153f8b540088cd306cb3f7e4a30%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj6/711f6153f8b540088cd306cb3f7e4a30/images/large/3.jpg not downloaded yet
2026-03-25 16:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj6%252F711f6153f8b540088cd306cb3f7e4a30%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj6/711f6153f8b540088cd306cb3f7e4a30/images/large/4.jpg not downloaded yet
2026-03-25 16:31:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc2ffe90>
2026-03-25 16:31:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c42a761d-f342-5525-82fc-f02240b53738/c42a761d-f342-5525-82fc-f02240b53738_image_2.jpg HTTP/1.1" 201 0
2026-03-25 16:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh3%252Fa0e901441c134d389858d8b128bf99d3%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh3/a0e901441c134d389858d8b128bf99d3/images/large/3.jpg saved to cache
2026-03-25 16:31:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c42a761d-f342-5525-82fc-f02240b53738
2026-03-25 16:31:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34d6b48ad0>
2026-03-25 16:31:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c42a761d-f342-5525-82fc-f02240b53738/c42a761d-f342-5525-82fc-f02240b53738_image_1.jpg HTTP/1.1" 201 0
2026-03-25 16:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh3%252Fa0e901441c134d389858d8b128bf99d3%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh3/a0e901441c134d389858d8b128bf99d3/images/large/2.jpg saved to cache
2026-03-25 16:31:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c42a761d-f342-5525-82fc-f02240b53738
2026-03-25 16:31:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcab0690>
2026-03-25 16:31:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c42a761d-f342-5525-82fc-f02240b53738/c42a761d-f342-5525-82fc-f02240b53738_image_4.jpg HTTP/1.1" 201 0
2026-03-25 16:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh3%252Fa0e901441c134d389858d8b128bf99d3%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh3/a0e901441c134d389858d8b128bf99d3/images/large/5.jpg saved to cache
2026-03-25 16:31:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c42a761d-f342-5525-82fc-f02240b53738
2026-03-25 16:31:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dca1b8d0>
2026-03-25 16:31:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c42a761d-f342-5525-82fc-f02240b53738/c42a761d-f342-5525-82fc-f02240b53738_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh3%252Fa0e901441c134d389858d8b128bf99d3%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh3/a0e901441c134d389858d8b128bf99d3/images/large/1.jpg saved to cache
2026-03-25 16:31:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c42a761d-f342-5525-82fc-f02240b53738
2026-03-25 16:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj6%252F711f6153f8b540088cd306cb3f7e4a30%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj6/711f6153f8b540088cd306cb3f7e4a30/images/large/5.jpg not downloaded yet
2026-03-25 16:31:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj5/c90e8392b0d2431cb709805b7f1f4616/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj5/c90e8392b0d2431cb709805b7f1f4616/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj5/c90e8392b0d2431cb709805b7f1f4616/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj6%252F711f6153f8b540088cd306cb3f7e4a30%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj6/711f6153f8b540088cd306cb3f7e4a30/images/large/6.jpg not downloaded yet
2026-03-25 16:31:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj5/c90e8392b0d2431cb709805b7f1f4616/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj6%252F711f6153f8b540088cd306cb3f7e4a30%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj6/711f6153f8b540088cd306cb3f7e4a30/images/large/7.jpg not downloaded yet
2026-03-25 16:31:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj5/c90e8392b0d2431cb709805b7f1f4616/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj5/c90e8392b0d2431cb709805b7f1f4616/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk2/320cdccf462b48a8bf6363e34a5a1ac5/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj6%252F711f6153f8b540088cd306cb3f7e4a30%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj6/711f6153f8b540088cd306cb3f7e4a30/images/large/8.jpg not downloaded yet
2026-03-25 16:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj6%252F711f6153f8b540088cd306cb3f7e4a30%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj6/711f6153f8b540088cd306cb3f7e4a30/images/large/9.jpg not downloaded yet
2026-03-25 16:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj6%252F711f6153f8b540088cd306cb3f7e4a30%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj6/711f6153f8b540088cd306cb3f7e4a30/images/large/10.jpg not downloaded yet
2026-03-25 16:31:07 [ayvens.it] INFO: Found listing with ID: 1983535
2026-03-25 16:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983535%27 HTTP/1.1" 200 None
2026-03-25 16:31:07 [ayvens.it] INFO: Scrape type for 1983535: 1
2026-03-25 16:31:07 [ayvens.it] INFO: Extracting data for car ID: 1983535
2026-03-25 16:31:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 75bec01e-91fa-50ed-ad7e-b7c43b81a0f6 with identifier: 1983535
2026-03-25 16:31:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 75bec01e-91fa-50ed-ad7e-b7c43b81a0f6 with scrape type 1
2026-03-25 16:31:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 75bec01e-91fa-50ed-ad7e-b7c43b81a0f6
2026-03-25 16:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh2%252Ffa34f88aad8942da835070feaf318c10%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh2/fa34f88aad8942da835070feaf318c10/images/large/1.jpg not downloaded yet
2026-03-25 16:31:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk2/320cdccf462b48a8bf6363e34a5a1ac5/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh2%252Ffa34f88aad8942da835070feaf318c10%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh2/fa34f88aad8942da835070feaf318c10/images/large/2.jpg not downloaded yet
2026-03-25 16:31:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcab23d0>
2026-03-25 16:31:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_90b7cd71-97b3-5904-a37d-7882f072bf3b/90b7cd71-97b3-5904-a37d-7882f072bf3b_image_3.jpg HTTP/1.1" 201 0
2026-03-25 16:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj5%252Fc90e8392b0d2431cb709805b7f1f4616%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj5/c90e8392b0d2431cb709805b7f1f4616/images/large/4.jpg saved to cache
2026-03-25 16:31:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 90b7cd71-97b3-5904-a37d-7882f072bf3b
2026-03-25 16:31:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34d7437550>
2026-03-25 16:31:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_90b7cd71-97b3-5904-a37d-7882f072bf3b/90b7cd71-97b3-5904-a37d-7882f072bf3b_image_1.jpg HTTP/1.1" 201 0
2026-03-25 16:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj5%252Fc90e8392b0d2431cb709805b7f1f4616%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj5/c90e8392b0d2431cb709805b7f1f4616/images/large/2.jpg saved to cache
2026-03-25 16:31:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 90b7cd71-97b3-5904-a37d-7882f072bf3b
2026-03-25 16:31:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc554f90>
2026-03-25 16:31:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_90b7cd71-97b3-5904-a37d-7882f072bf3b/90b7cd71-97b3-5904-a37d-7882f072bf3b_image_5.jpg HTTP/1.1" 201 0
2026-03-25 16:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj5%252Fc90e8392b0d2431cb709805b7f1f4616%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj5/c90e8392b0d2431cb709805b7f1f4616/images/large/6.jpg saved to cache
2026-03-25 16:31:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 90b7cd71-97b3-5904-a37d-7882f072bf3b
2026-03-25 16:31:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc5d5910>
2026-03-25 16:31:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_90b7cd71-97b3-5904-a37d-7882f072bf3b/90b7cd71-97b3-5904-a37d-7882f072bf3b_image_2.jpg HTTP/1.1" 201 0
2026-03-25 16:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj5%252Fc90e8392b0d2431cb709805b7f1f4616%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj5/c90e8392b0d2431cb709805b7f1f4616/images/large/3.jpg saved to cache
2026-03-25 16:31:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 90b7cd71-97b3-5904-a37d-7882f072bf3b
2026-03-25 16:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh2%252Ffa34f88aad8942da835070feaf318c10%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh2/fa34f88aad8942da835070feaf318c10/images/large/3.jpg not downloaded yet
2026-03-25 16:31:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34d74404d0>
2026-03-25 16:31:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_90b7cd71-97b3-5904-a37d-7882f072bf3b/90b7cd71-97b3-5904-a37d-7882f072bf3b_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj5%252Fc90e8392b0d2431cb709805b7f1f4616%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj5/c90e8392b0d2431cb709805b7f1f4616/images/large/1.jpg saved to cache
2026-03-25 16:31:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 90b7cd71-97b3-5904-a37d-7882f072bf3b
2026-03-25 16:31:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc53f710>
2026-03-25 16:31:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_90b7cd71-97b3-5904-a37d-7882f072bf3b/90b7cd71-97b3-5904-a37d-7882f072bf3b_image_4.jpg HTTP/1.1" 201 0
2026-03-25 16:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj5%252Fc90e8392b0d2431cb709805b7f1f4616%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj5/c90e8392b0d2431cb709805b7f1f4616/images/large/5.jpg saved to cache
2026-03-25 16:31:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 90b7cd71-97b3-5904-a37d-7882f072bf3b
2026-03-25 16:31:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc63ea10>
2026-03-25 16:31:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9a73218-f66c-5a83-a8ea-fa64869e0144/d9a73218-f66c-5a83-a8ea-fa64869e0144_image_1.jpg HTTP/1.1" 201 0
2026-03-25 16:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk2%252F320cdccf462b48a8bf6363e34a5a1ac5%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk2/320cdccf462b48a8bf6363e34a5a1ac5/images/large/2.jpg saved to cache
2026-03-25 16:31:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d9a73218-f66c-5a83-a8ea-fa64869e0144
2026-03-25 16:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh2%252Ffa34f88aad8942da835070feaf318c10%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh2/fa34f88aad8942da835070feaf318c10/images/large/4.jpg not downloaded yet
2026-03-25 16:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh2%252Ffa34f88aad8942da835070feaf318c10%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh2/fa34f88aad8942da835070feaf318c10/images/large/5.jpg not downloaded yet
2026-03-25 16:31:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dca9c0d0>
2026-03-25 16:31:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9a73218-f66c-5a83-a8ea-fa64869e0144/d9a73218-f66c-5a83-a8ea-fa64869e0144_image_2.jpg HTTP/1.1" 201 0
2026-03-25 16:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk2%252F320cdccf462b48a8bf6363e34a5a1ac5%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk2/320cdccf462b48a8bf6363e34a5a1ac5/images/large/3.jpg saved to cache
2026-03-25 16:31:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d9a73218-f66c-5a83-a8ea-fa64869e0144
2026-03-25 16:31:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk2/320cdccf462b48a8bf6363e34a5a1ac5/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh2%252Ffa34f88aad8942da835070feaf318c10%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh2/fa34f88aad8942da835070feaf318c10/images/large/6.jpg not downloaded yet
2026-03-25 16:31:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk2/320cdccf462b48a8bf6363e34a5a1ac5/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk2/320cdccf462b48a8bf6363e34a5a1ac5/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk2/320cdccf462b48a8bf6363e34a5a1ac5/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj5/c90e8392b0d2431cb709805b7f1f4616/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh2%252Ffa34f88aad8942da835070feaf318c10%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh2/fa34f88aad8942da835070feaf318c10/images/large/7.jpg not downloaded yet
2026-03-25 16:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh2%252Ffa34f88aad8942da835070feaf318c10%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh2/fa34f88aad8942da835070feaf318c10/images/large/8.jpg not downloaded yet
2026-03-25 16:31:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk2/320cdccf462b48a8bf6363e34a5a1ac5/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj6/711f6153f8b540088cd306cb3f7e4a30/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh2%252Ffa34f88aad8942da835070feaf318c10%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh2/fa34f88aad8942da835070feaf318c10/images/large/9.jpg not downloaded yet
2026-03-25 16:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh2%252Ffa34f88aad8942da835070feaf318c10%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh2/fa34f88aad8942da835070feaf318c10/images/large/10.jpg not downloaded yet
2026-03-25 16:31:09 [ayvens.it] INFO: Found listing with ID: 1983536
2026-03-25 16:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983536%27 HTTP/1.1" 200 None
2026-03-25 16:31:09 [ayvens.it] INFO: Scrape type for 1983536: 1
2026-03-25 16:31:09 [ayvens.it] INFO: Extracting data for car ID: 1983536
2026-03-25 16:31:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fdd0122e-d0e5-564b-894a-8b39d1a44fd3 with identifier: 1983536
2026-03-25 16:31:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fdd0122e-d0e5-564b-894a-8b39d1a44fd3 with scrape type 1
2026-03-25 16:31:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item fdd0122e-d0e5-564b-894a-8b39d1a44fd3
2026-03-25 16:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm2%252F366ce01643ef4f14ad5c9a03d4b2e727%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm2/366ce01643ef4f14ad5c9a03d4b2e727/images/large/1.jpg not downloaded yet
2026-03-25 16:31:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc9d4850>
2026-03-25 16:31:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9a73218-f66c-5a83-a8ea-fa64869e0144/d9a73218-f66c-5a83-a8ea-fa64869e0144_image_6.jpg HTTP/1.1" 201 0
2026-03-25 16:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk2%252F320cdccf462b48a8bf6363e34a5a1ac5%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk2/320cdccf462b48a8bf6363e34a5a1ac5/images/large/7.jpg saved to cache
2026-03-25 16:31:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d9a73218-f66c-5a83-a8ea-fa64869e0144
2026-03-25 16:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm2%252F366ce01643ef4f14ad5c9a03d4b2e727%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm2/366ce01643ef4f14ad5c9a03d4b2e727/images/large/2.jpg not downloaded yet
2026-03-25 16:31:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj6/711f6153f8b540088cd306cb3f7e4a30/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc9f3c10>
2026-03-25 16:31:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9a73218-f66c-5a83-a8ea-fa64869e0144/d9a73218-f66c-5a83-a8ea-fa64869e0144_image_3.jpg HTTP/1.1" 201 0
2026-03-25 16:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk2%252F320cdccf462b48a8bf6363e34a5a1ac5%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk2/320cdccf462b48a8bf6363e34a5a1ac5/images/large/4.jpg saved to cache
2026-03-25 16:31:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d9a73218-f66c-5a83-a8ea-fa64869e0144
2026-03-25 16:31:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34d6b59790>
2026-03-25 16:31:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9a73218-f66c-5a83-a8ea-fa64869e0144/d9a73218-f66c-5a83-a8ea-fa64869e0144_image_4.jpg HTTP/1.1" 201 0
2026-03-25 16:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk2%252F320cdccf462b48a8bf6363e34a5a1ac5%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk2/320cdccf462b48a8bf6363e34a5a1ac5/images/large/5.jpg saved to cache
2026-03-25 16:31:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d9a73218-f66c-5a83-a8ea-fa64869e0144
2026-03-25 16:31:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34d6b5bdd0>
2026-03-25 16:31:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9a73218-f66c-5a83-a8ea-fa64869e0144/d9a73218-f66c-5a83-a8ea-fa64869e0144_image_5.jpg HTTP/1.1" 201 0
2026-03-25 16:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk2%252F320cdccf462b48a8bf6363e34a5a1ac5%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk2/320cdccf462b48a8bf6363e34a5a1ac5/images/large/6.jpg saved to cache
2026-03-25 16:31:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d9a73218-f66c-5a83-a8ea-fa64869e0144
2026-03-25 16:31:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc545790>
2026-03-25 16:31:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_90b7cd71-97b3-5904-a37d-7882f072bf3b/90b7cd71-97b3-5904-a37d-7882f072bf3b_image_9.jpg HTTP/1.1" 201 0
2026-03-25 16:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj5%252Fc90e8392b0d2431cb709805b7f1f4616%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj5/c90e8392b0d2431cb709805b7f1f4616/images/large/10.jpg saved to cache
2026-03-25 16:31:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 90b7cd71-97b3-5904-a37d-7882f072bf3b
2026-03-25 16:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm2%252F366ce01643ef4f14ad5c9a03d4b2e727%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm2/366ce01643ef4f14ad5c9a03d4b2e727/images/large/3.jpg not downloaded yet
2026-03-25 16:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm2%252F366ce01643ef4f14ad5c9a03d4b2e727%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm2/366ce01643ef4f14ad5c9a03d4b2e727/images/large/4.jpg not downloaded yet
2026-03-25 16:31:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc9b0ed0>
2026-03-25 16:31:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9a73218-f66c-5a83-a8ea-fa64869e0144/d9a73218-f66c-5a83-a8ea-fa64869e0144_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk2%252F320cdccf462b48a8bf6363e34a5a1ac5%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk2/320cdccf462b48a8bf6363e34a5a1ac5/images/large/1.jpg saved to cache
2026-03-25 16:31:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d9a73218-f66c-5a83-a8ea-fa64869e0144
2026-03-25 16:31:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc9c2ed0>
2026-03-25 16:31:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37d4646d-a37d-5f42-ae38-314944b69880/37d4646d-a37d-5f42-ae38-314944b69880_image_2.jpg HTTP/1.1" 201 0
2026-03-25 16:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj6%252F711f6153f8b540088cd306cb3f7e4a30%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj6/711f6153f8b540088cd306cb3f7e4a30/images/large/3.jpg saved to cache
2026-03-25 16:31:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 37d4646d-a37d-5f42-ae38-314944b69880
2026-03-25 16:31:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc968190>
2026-03-25 16:31:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37d4646d-a37d-5f42-ae38-314944b69880/37d4646d-a37d-5f42-ae38-314944b69880_image_1.jpg HTTP/1.1" 201 0
2026-03-25 16:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj6%252F711f6153f8b540088cd306cb3f7e4a30%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj6/711f6153f8b540088cd306cb3f7e4a30/images/large/2.jpg saved to cache
2026-03-25 16:31:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 37d4646d-a37d-5f42-ae38-314944b69880
2026-03-25 16:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm2%252F366ce01643ef4f14ad5c9a03d4b2e727%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm2/366ce01643ef4f14ad5c9a03d4b2e727/images/large/5.jpg not downloaded yet
2026-03-25 16:31:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj6/711f6153f8b540088cd306cb3f7e4a30/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm2%252F366ce01643ef4f14ad5c9a03d4b2e727%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm2/366ce01643ef4f14ad5c9a03d4b2e727/images/large/6.jpg not downloaded yet
2026-03-25 16:31:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj6/711f6153f8b540088cd306cb3f7e4a30/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk2/320cdccf462b48a8bf6363e34a5a1ac5/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj6/711f6153f8b540088cd306cb3f7e4a30/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk2/320cdccf462b48a8bf6363e34a5a1ac5/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm2%252F366ce01643ef4f14ad5c9a03d4b2e727%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm2/366ce01643ef4f14ad5c9a03d4b2e727/images/large/7.jpg not downloaded yet
2026-03-25 16:31:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj6/711f6153f8b540088cd306cb3f7e4a30/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm2%252F366ce01643ef4f14ad5c9a03d4b2e727%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm2/366ce01643ef4f14ad5c9a03d4b2e727/images/large/8.jpg not downloaded yet
2026-03-25 16:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm2%252F366ce01643ef4f14ad5c9a03d4b2e727%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm2/366ce01643ef4f14ad5c9a03d4b2e727/images/large/9.jpg not downloaded yet
2026-03-25 16:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm2%252F366ce01643ef4f14ad5c9a03d4b2e727%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm2/366ce01643ef4f14ad5c9a03d4b2e727/images/large/10.jpg not downloaded yet
2026-03-25 16:31:10 [ayvens.it] INFO: Found listing with ID: 1983537
2026-03-25 16:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983537%27 HTTP/1.1" 200 None
2026-03-25 16:31:10 [ayvens.it] INFO: Scrape type for 1983537: 1
2026-03-25 16:31:10 [ayvens.it] INFO: Extracting data for car ID: 1983537
2026-03-25 16:31:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 03db467f-43df-5654-99f7-934086cbc3af with identifier: 1983537
2026-03-25 16:31:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 03db467f-43df-5654-99f7-934086cbc3af with scrape type 1
2026-03-25 16:31:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 03db467f-43df-5654-99f7-934086cbc3af
2026-03-25 16:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm1%252Fa5b319b34ed74ba88bbc82ee979ca843%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm1/a5b319b34ed74ba88bbc82ee979ca843/images/large/1.jpg not downloaded yet
2026-03-25 16:31:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh2/fa34f88aad8942da835070feaf318c10/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm1%252Fa5b319b34ed74ba88bbc82ee979ca843%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm1/a5b319b34ed74ba88bbc82ee979ca843/images/large/2.jpg not downloaded yet
2026-03-25 16:31:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc8e1d50>
2026-03-25 16:31:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37d4646d-a37d-5f42-ae38-314944b69880/37d4646d-a37d-5f42-ae38-314944b69880_image_5.jpg HTTP/1.1" 201 0
2026-03-25 16:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj6%252F711f6153f8b540088cd306cb3f7e4a30%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj6/711f6153f8b540088cd306cb3f7e4a30/images/large/6.jpg saved to cache
2026-03-25 16:31:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 37d4646d-a37d-5f42-ae38-314944b69880
2026-03-25 16:31:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc8025d0>
2026-03-25 16:31:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37d4646d-a37d-5f42-ae38-314944b69880/37d4646d-a37d-5f42-ae38-314944b69880_image_3.jpg HTTP/1.1" 201 0
2026-03-25 16:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj6%252F711f6153f8b540088cd306cb3f7e4a30%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj6/711f6153f8b540088cd306cb3f7e4a30/images/large/4.jpg saved to cache
2026-03-25 16:31:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 37d4646d-a37d-5f42-ae38-314944b69880
2026-03-25 16:31:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc9d7610>
2026-03-25 16:31:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9a73218-f66c-5a83-a8ea-fa64869e0144/d9a73218-f66c-5a83-a8ea-fa64869e0144_image_8.jpg HTTP/1.1" 201 0
2026-03-25 16:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk2%252F320cdccf462b48a8bf6363e34a5a1ac5%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk2/320cdccf462b48a8bf6363e34a5a1ac5/images/large/9.jpg saved to cache
2026-03-25 16:31:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d9a73218-f66c-5a83-a8ea-fa64869e0144
2026-03-25 16:31:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcb1e250>
2026-03-25 16:31:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37d4646d-a37d-5f42-ae38-314944b69880/37d4646d-a37d-5f42-ae38-314944b69880_image_6.jpg HTTP/1.1" 201 0
2026-03-25 16:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj6%252F711f6153f8b540088cd306cb3f7e4a30%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj6/711f6153f8b540088cd306cb3f7e4a30/images/large/7.jpg saved to cache
2026-03-25 16:31:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 37d4646d-a37d-5f42-ae38-314944b69880
2026-03-25 16:31:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dca21750>
2026-03-25 16:31:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9a73218-f66c-5a83-a8ea-fa64869e0144/d9a73218-f66c-5a83-a8ea-fa64869e0144_image_9.jpg HTTP/1.1" 201 0
2026-03-25 16:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk2%252F320cdccf462b48a8bf6363e34a5a1ac5%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk2/320cdccf462b48a8bf6363e34a5a1ac5/images/large/10.jpg saved to cache
2026-03-25 16:31:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d9a73218-f66c-5a83-a8ea-fa64869e0144
2026-03-25 16:31:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj6/711f6153f8b540088cd306cb3f7e4a30/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm1%252Fa5b319b34ed74ba88bbc82ee979ca843%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm1/a5b319b34ed74ba88bbc82ee979ca843/images/large/3.jpg not downloaded yet
2026-03-25 16:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm1%252Fa5b319b34ed74ba88bbc82ee979ca843%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm1/a5b319b34ed74ba88bbc82ee979ca843/images/large/4.jpg not downloaded yet
2026-03-25 16:31:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcaab690>
2026-03-25 16:31:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37d4646d-a37d-5f42-ae38-314944b69880/37d4646d-a37d-5f42-ae38-314944b69880_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj6%252F711f6153f8b540088cd306cb3f7e4a30%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj6/711f6153f8b540088cd306cb3f7e4a30/images/large/1.jpg saved to cache
2026-03-25 16:31:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 37d4646d-a37d-5f42-ae38-314944b69880
2026-03-25 16:31:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc7df010>
2026-03-25 16:31:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75bec01e-91fa-50ed-ad7e-b7c43b81a0f6/75bec01e-91fa-50ed-ad7e-b7c43b81a0f6_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh2%252Ffa34f88aad8942da835070feaf318c10%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh2/fa34f88aad8942da835070feaf318c10/images/large/1.jpg saved to cache
2026-03-25 16:31:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 75bec01e-91fa-50ed-ad7e-b7c43b81a0f6
2026-03-25 16:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm1%252Fa5b319b34ed74ba88bbc82ee979ca843%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm1/a5b319b34ed74ba88bbc82ee979ca843/images/large/5.jpg not downloaded yet
2026-03-25 16:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm1%252Fa5b319b34ed74ba88bbc82ee979ca843%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm1/a5b319b34ed74ba88bbc82ee979ca843/images/large/6.jpg not downloaded yet
2026-03-25 16:31:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh2/fa34f88aad8942da835070feaf318c10/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34de16b9d0>
2026-03-25 16:31:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37d4646d-a37d-5f42-ae38-314944b69880/37d4646d-a37d-5f42-ae38-314944b69880_image_4.jpg HTTP/1.1" 201 0
2026-03-25 16:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj6%252F711f6153f8b540088cd306cb3f7e4a30%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj6/711f6153f8b540088cd306cb3f7e4a30/images/large/5.jpg saved to cache
2026-03-25 16:31:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 37d4646d-a37d-5f42-ae38-314944b69880
2026-03-25 16:31:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh2/fa34f88aad8942da835070feaf318c10/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh2/fa34f88aad8942da835070feaf318c10/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm1%252Fa5b319b34ed74ba88bbc82ee979ca843%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm1/a5b319b34ed74ba88bbc82ee979ca843/images/large/7.jpg not downloaded yet
2026-03-25 16:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm1%252Fa5b319b34ed74ba88bbc82ee979ca843%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm1/a5b319b34ed74ba88bbc82ee979ca843/images/large/8.jpg not downloaded yet
2026-03-25 16:31:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh2/fa34f88aad8942da835070feaf318c10/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh2/fa34f88aad8942da835070feaf318c10/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh2/fa34f88aad8942da835070feaf318c10/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm1%252Fa5b319b34ed74ba88bbc82ee979ca843%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm1/a5b319b34ed74ba88bbc82ee979ca843/images/large/9.jpg not downloaded yet
2026-03-25 16:31:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcc1ad50>
2026-03-25 16:31:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75bec01e-91fa-50ed-ad7e-b7c43b81a0f6/75bec01e-91fa-50ed-ad7e-b7c43b81a0f6_image_5.jpg HTTP/1.1" 201 0
2026-03-25 16:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh2%252Ffa34f88aad8942da835070feaf318c10%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh2/fa34f88aad8942da835070feaf318c10/images/large/6.jpg saved to cache
2026-03-25 16:31:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 75bec01e-91fa-50ed-ad7e-b7c43b81a0f6
2026-03-25 16:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm1%252Fa5b319b34ed74ba88bbc82ee979ca843%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm1/a5b319b34ed74ba88bbc82ee979ca843/images/large/10.jpg not downloaded yet
2026-03-25 16:31:11 [ayvens.it] INFO: Found listing with ID: 1983538
2026-03-25 16:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983538%27 HTTP/1.1" 200 None
2026-03-25 16:31:11 [ayvens.it] INFO: Scrape type for 1983538: 1
2026-03-25 16:31:11 [ayvens.it] INFO: Extracting data for car ID: 1983538
2026-03-25 16:31:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c3409c17-3df5-500a-a99e-bb10218ccb97 with identifier: 1983538
2026-03-25 16:31:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c3409c17-3df5-500a-a99e-bb10218ccb97 with scrape type 1
2026-03-25 16:31:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c3409c17-3df5-500a-a99e-bb10218ccb97
2026-03-25 16:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgy2%252F7ff0b580f3cd43689ee0411db457cb51%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gy2/7ff0b580f3cd43689ee0411db457cb51/images/large/1.jpg not downloaded yet
2026-03-25 16:31:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc76f3d0>
2026-03-25 16:31:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75bec01e-91fa-50ed-ad7e-b7c43b81a0f6/75bec01e-91fa-50ed-ad7e-b7c43b81a0f6_image_7.jpg HTTP/1.1" 201 0
2026-03-25 16:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh2%252Ffa34f88aad8942da835070feaf318c10%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh2/fa34f88aad8942da835070feaf318c10/images/large/8.jpg saved to cache
2026-03-25 16:31:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 75bec01e-91fa-50ed-ad7e-b7c43b81a0f6
2026-03-25 16:31:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc551f90>
2026-03-25 16:31:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75bec01e-91fa-50ed-ad7e-b7c43b81a0f6/75bec01e-91fa-50ed-ad7e-b7c43b81a0f6_image_6.jpg HTTP/1.1" 201 0
2026-03-25 16:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh2%252Ffa34f88aad8942da835070feaf318c10%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh2/fa34f88aad8942da835070feaf318c10/images/large/7.jpg saved to cache
2026-03-25 16:31:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 75bec01e-91fa-50ed-ad7e-b7c43b81a0f6
2026-03-25 16:31:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34d6b3c8d0>
2026-03-25 16:31:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75bec01e-91fa-50ed-ad7e-b7c43b81a0f6/75bec01e-91fa-50ed-ad7e-b7c43b81a0f6_image_3.jpg HTTP/1.1" 201 0
2026-03-25 16:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh2%252Ffa34f88aad8942da835070feaf318c10%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh2/fa34f88aad8942da835070feaf318c10/images/large/4.jpg saved to cache
2026-03-25 16:31:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 75bec01e-91fa-50ed-ad7e-b7c43b81a0f6
2026-03-25 16:31:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc9e4390>
2026-03-25 16:31:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75bec01e-91fa-50ed-ad7e-b7c43b81a0f6/75bec01e-91fa-50ed-ad7e-b7c43b81a0f6_image_2.jpg HTTP/1.1" 201 0
2026-03-25 16:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh2%252Ffa34f88aad8942da835070feaf318c10%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh2/fa34f88aad8942da835070feaf318c10/images/large/3.jpg saved to cache
2026-03-25 16:31:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 75bec01e-91fa-50ed-ad7e-b7c43b81a0f6
2026-03-25 16:31:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34d6b3ecd0>
2026-03-25 16:31:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75bec01e-91fa-50ed-ad7e-b7c43b81a0f6/75bec01e-91fa-50ed-ad7e-b7c43b81a0f6_image_1.jpg HTTP/1.1" 201 0
2026-03-25 16:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh2%252Ffa34f88aad8942da835070feaf318c10%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh2/fa34f88aad8942da835070feaf318c10/images/large/2.jpg saved to cache
2026-03-25 16:31:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 75bec01e-91fa-50ed-ad7e-b7c43b81a0f6
2026-03-25 16:31:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh2/fa34f88aad8942da835070feaf318c10/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgy2%252F7ff0b580f3cd43689ee0411db457cb51%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gy2/7ff0b580f3cd43689ee0411db457cb51/images/large/2.jpg not downloaded yet
2026-03-25 16:31:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm2/366ce01643ef4f14ad5c9a03d4b2e727/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgy2%252F7ff0b580f3cd43689ee0411db457cb51%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gy2/7ff0b580f3cd43689ee0411db457cb51/images/large/3.jpg not downloaded yet
2026-03-25 16:31:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm2/366ce01643ef4f14ad5c9a03d4b2e727/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgy2%252F7ff0b580f3cd43689ee0411db457cb51%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gy2/7ff0b580f3cd43689ee0411db457cb51/images/large/4.jpg not downloaded yet
2026-03-25 16:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgy2%252F7ff0b580f3cd43689ee0411db457cb51%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gy2/7ff0b580f3cd43689ee0411db457cb51/images/large/5.jpg not downloaded yet
2026-03-25 16:31:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm2/366ce01643ef4f14ad5c9a03d4b2e727/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgy2%252F7ff0b580f3cd43689ee0411db457cb51%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gy2/7ff0b580f3cd43689ee0411db457cb51/images/large/6.jpg not downloaded yet
2026-03-25 16:31:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm2/366ce01643ef4f14ad5c9a03d4b2e727/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgy2%252F7ff0b580f3cd43689ee0411db457cb51%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gy2/7ff0b580f3cd43689ee0411db457cb51/images/large/7.jpg not downloaded yet
2026-03-25 16:31:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcb17550>
2026-03-25 16:31:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75bec01e-91fa-50ed-ad7e-b7c43b81a0f6/75bec01e-91fa-50ed-ad7e-b7c43b81a0f6_image_4.jpg HTTP/1.1" 201 0
2026-03-25 16:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh2%252Ffa34f88aad8942da835070feaf318c10%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh2/fa34f88aad8942da835070feaf318c10/images/large/5.jpg saved to cache
2026-03-25 16:31:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 75bec01e-91fa-50ed-ad7e-b7c43b81a0f6
2026-03-25 16:31:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm2/366ce01643ef4f14ad5c9a03d4b2e727/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm2/366ce01643ef4f14ad5c9a03d4b2e727/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgy2%252F7ff0b580f3cd43689ee0411db457cb51%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gy2/7ff0b580f3cd43689ee0411db457cb51/images/large/8.jpg not downloaded yet
2026-03-25 16:31:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm2/366ce01643ef4f14ad5c9a03d4b2e727/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc34d210>
2026-03-25 16:31:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fdd0122e-d0e5-564b-894a-8b39d1a44fd3/fdd0122e-d0e5-564b-894a-8b39d1a44fd3_image_2.jpg HTTP/1.1" 201 0
2026-03-25 16:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm2%252F366ce01643ef4f14ad5c9a03d4b2e727%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm2/366ce01643ef4f14ad5c9a03d4b2e727/images/large/3.jpg saved to cache
2026-03-25 16:31:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item fdd0122e-d0e5-564b-894a-8b39d1a44fd3
2026-03-25 16:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgy2%252F7ff0b580f3cd43689ee0411db457cb51%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gy2/7ff0b580f3cd43689ee0411db457cb51/images/large/9.jpg not downloaded yet
2026-03-25 16:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgy2%252F7ff0b580f3cd43689ee0411db457cb51%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gy2/7ff0b580f3cd43689ee0411db457cb51/images/large/10.jpg not downloaded yet
2026-03-25 16:31:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34de161910>
2026-03-25 16:31:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fdd0122e-d0e5-564b-894a-8b39d1a44fd3/fdd0122e-d0e5-564b-894a-8b39d1a44fd3_image_4.jpg HTTP/1.1" 201 0
2026-03-25 16:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm2%252F366ce01643ef4f14ad5c9a03d4b2e727%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm2/366ce01643ef4f14ad5c9a03d4b2e727/images/large/5.jpg saved to cache
2026-03-25 16:31:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item fdd0122e-d0e5-564b-894a-8b39d1a44fd3
2026-03-25 16:31:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34d7d606d0>
2026-03-25 16:31:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fdd0122e-d0e5-564b-894a-8b39d1a44fd3/fdd0122e-d0e5-564b-894a-8b39d1a44fd3_image_1.jpg HTTP/1.1" 201 0
2026-03-25 16:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm2%252F366ce01643ef4f14ad5c9a03d4b2e727%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm2/366ce01643ef4f14ad5c9a03d4b2e727/images/large/2.jpg saved to cache
2026-03-25 16:31:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item fdd0122e-d0e5-564b-894a-8b39d1a44fd3
2026-03-25 16:31:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dca95110>
2026-03-25 16:31:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fdd0122e-d0e5-564b-894a-8b39d1a44fd3/fdd0122e-d0e5-564b-894a-8b39d1a44fd3_image_5.jpg HTTP/1.1" 201 0
2026-03-25 16:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm2%252F366ce01643ef4f14ad5c9a03d4b2e727%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm2/366ce01643ef4f14ad5c9a03d4b2e727/images/large/6.jpg saved to cache
2026-03-25 16:31:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item fdd0122e-d0e5-564b-894a-8b39d1a44fd3
2026-03-25 16:31:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34d6b35d10>
2026-03-25 16:31:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fdd0122e-d0e5-564b-894a-8b39d1a44fd3/fdd0122e-d0e5-564b-894a-8b39d1a44fd3_image_6.jpg HTTP/1.1" 201 0
2026-03-25 16:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm2%252F366ce01643ef4f14ad5c9a03d4b2e727%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm2/366ce01643ef4f14ad5c9a03d4b2e727/images/large/7.jpg saved to cache
2026-03-25 16:31:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item fdd0122e-d0e5-564b-894a-8b39d1a44fd3
2026-03-25 16:31:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc94f3d0>
2026-03-25 16:31:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fdd0122e-d0e5-564b-894a-8b39d1a44fd3/fdd0122e-d0e5-564b-894a-8b39d1a44fd3_image_3.jpg HTTP/1.1" 201 0
2026-03-25 16:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm2%252F366ce01643ef4f14ad5c9a03d4b2e727%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm2/366ce01643ef4f14ad5c9a03d4b2e727/images/large/4.jpg saved to cache
2026-03-25 16:31:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item fdd0122e-d0e5-564b-894a-8b39d1a44fd3
2026-03-25 16:31:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcb14a10>
2026-03-25 16:31:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fdd0122e-d0e5-564b-894a-8b39d1a44fd3/fdd0122e-d0e5-564b-894a-8b39d1a44fd3_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm2%252F366ce01643ef4f14ad5c9a03d4b2e727%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm2/366ce01643ef4f14ad5c9a03d4b2e727/images/large/1.jpg saved to cache
2026-03-25 16:31:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fdd0122e-d0e5-564b-894a-8b39d1a44fd3
2026-03-25 16:31:12 [ayvens.it] INFO: Found listing with ID: 1983539
2026-03-25 16:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983539%27 HTTP/1.1" 200 None
2026-03-25 16:31:12 [ayvens.it] INFO: Scrape type for 1983539: 1
2026-03-25 16:31:12 [ayvens.it] INFO: Extracting data for car ID: 1983539
2026-03-25 16:31:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 483367a7-9424-5972-b06a-1bbfe0906820 with identifier: 1983539
2026-03-25 16:31:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 483367a7-9424-5972-b06a-1bbfe0906820 with scrape type 1
2026-03-25 16:31:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 483367a7-9424-5972-b06a-1bbfe0906820
2026-03-25 16:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj1%252Ff1be48883f6047a2ad216a992130481c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj1/f1be48883f6047a2ad216a992130481c/images/large/1.jpg not downloaded yet
2026-03-25 16:31:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm1/a5b319b34ed74ba88bbc82ee979ca843/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj1%252Ff1be48883f6047a2ad216a992130481c%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj1/f1be48883f6047a2ad216a992130481c/images/large/2.jpg not downloaded yet
2026-03-25 16:31:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm1/a5b319b34ed74ba88bbc82ee979ca843/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm1/a5b319b34ed74ba88bbc82ee979ca843/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm2/366ce01643ef4f14ad5c9a03d4b2e727/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj1%252Ff1be48883f6047a2ad216a992130481c%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj1/f1be48883f6047a2ad216a992130481c/images/large/3.jpg not downloaded yet
2026-03-25 16:31:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm1/a5b319b34ed74ba88bbc82ee979ca843/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm1/a5b319b34ed74ba88bbc82ee979ca843/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj1%252Ff1be48883f6047a2ad216a992130481c%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj1/f1be48883f6047a2ad216a992130481c/images/large/4.jpg not downloaded yet
2026-03-25 16:31:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm1/a5b319b34ed74ba88bbc82ee979ca843/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj1%252Ff1be48883f6047a2ad216a992130481c%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj1/f1be48883f6047a2ad216a992130481c/images/large/5.jpg not downloaded yet
2026-03-25 16:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj1%252Ff1be48883f6047a2ad216a992130481c%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj1/f1be48883f6047a2ad216a992130481c/images/large/6.jpg not downloaded yet
2026-03-25 16:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj1%252Ff1be48883f6047a2ad216a992130481c%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj1/f1be48883f6047a2ad216a992130481c/images/large/7.jpg not downloaded yet
2026-03-25 16:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj1%252Ff1be48883f6047a2ad216a992130481c%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj1/f1be48883f6047a2ad216a992130481c/images/large/8.jpg not downloaded yet
2026-03-25 16:31:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc56fb50>
2026-03-25 16:31:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_03db467f-43df-5654-99f7-934086cbc3af/03db467f-43df-5654-99f7-934086cbc3af_image_5.jpg HTTP/1.1" 201 0
2026-03-25 16:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm1%252Fa5b319b34ed74ba88bbc82ee979ca843%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm1/a5b319b34ed74ba88bbc82ee979ca843/images/large/6.jpg saved to cache
2026-03-25 16:31:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 03db467f-43df-5654-99f7-934086cbc3af
2026-03-25 16:31:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm1/a5b319b34ed74ba88bbc82ee979ca843/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj1%252Ff1be48883f6047a2ad216a992130481c%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj1/f1be48883f6047a2ad216a992130481c/images/large/9.jpg not downloaded yet
2026-03-25 16:31:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcc1a5d0>
2026-03-25 16:31:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_03db467f-43df-5654-99f7-934086cbc3af/03db467f-43df-5654-99f7-934086cbc3af_image_4.jpg HTTP/1.1" 201 0
2026-03-25 16:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm1%252Fa5b319b34ed74ba88bbc82ee979ca843%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm1/a5b319b34ed74ba88bbc82ee979ca843/images/large/5.jpg saved to cache
2026-03-25 16:31:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 03db467f-43df-5654-99f7-934086cbc3af
2026-03-25 16:31:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34de568890>
2026-03-25 16:31:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_03db467f-43df-5654-99f7-934086cbc3af/03db467f-43df-5654-99f7-934086cbc3af_image_2.jpg HTTP/1.1" 201 0
2026-03-25 16:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm1%252Fa5b319b34ed74ba88bbc82ee979ca843%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm1/a5b319b34ed74ba88bbc82ee979ca843/images/large/3.jpg saved to cache
2026-03-25 16:31:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 03db467f-43df-5654-99f7-934086cbc3af
2026-03-25 16:31:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc9f0c10>
2026-03-25 16:31:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fdd0122e-d0e5-564b-894a-8b39d1a44fd3/fdd0122e-d0e5-564b-894a-8b39d1a44fd3_image_9.jpg HTTP/1.1" 201 0
2026-03-25 16:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm2%252F366ce01643ef4f14ad5c9a03d4b2e727%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm2/366ce01643ef4f14ad5c9a03d4b2e727/images/large/10.jpg saved to cache
2026-03-25 16:31:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item fdd0122e-d0e5-564b-894a-8b39d1a44fd3
2026-03-25 16:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj1%252Ff1be48883f6047a2ad216a992130481c%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj1/f1be48883f6047a2ad216a992130481c/images/large/10.jpg not downloaded yet
2026-03-25 16:31:13 [ayvens.it] INFO: Found listing with ID: 1983540
2026-03-25 16:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983540%27 HTTP/1.1" 200 None
2026-03-25 16:31:13 [ayvens.it] INFO: Scrape type for 1983540: 1
2026-03-25 16:31:13 [ayvens.it] INFO: Extracting data for car ID: 1983540
2026-03-25 16:31:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 27d7a78c-5def-545b-b6d3-8c2262a0cd32 with identifier: 1983540
2026-03-25 16:31:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 27d7a78c-5def-545b-b6d3-8c2262a0cd32 with scrape type 1
2026-03-25 16:31:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 27d7a78c-5def-545b-b6d3-8c2262a0cd32
2026-03-25 16:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj9%252F143635fb2f8c4029a7d15e1ce5340fc3%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj9/143635fb2f8c4029a7d15e1ce5340fc3/images/large/1.jpg not downloaded yet
2026-03-25 16:31:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcaf65d0>
2026-03-25 16:31:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_03db467f-43df-5654-99f7-934086cbc3af/03db467f-43df-5654-99f7-934086cbc3af_image_6.jpg HTTP/1.1" 201 0
2026-03-25 16:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm1%252Fa5b319b34ed74ba88bbc82ee979ca843%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm1/a5b319b34ed74ba88bbc82ee979ca843/images/large/7.jpg saved to cache
2026-03-25 16:31:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 03db467f-43df-5654-99f7-934086cbc3af
2026-03-25 16:31:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcaf68d0>
2026-03-25 16:31:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_03db467f-43df-5654-99f7-934086cbc3af/03db467f-43df-5654-99f7-934086cbc3af_image_7.jpg HTTP/1.1" 201 0
2026-03-25 16:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm1%252Fa5b319b34ed74ba88bbc82ee979ca843%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm1/a5b319b34ed74ba88bbc82ee979ca843/images/large/8.jpg saved to cache
2026-03-25 16:31:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 03db467f-43df-5654-99f7-934086cbc3af
2026-03-25 16:31:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dca13710>
2026-03-25 16:31:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_03db467f-43df-5654-99f7-934086cbc3af/03db467f-43df-5654-99f7-934086cbc3af_image_3.jpg HTTP/1.1" 201 0
2026-03-25 16:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm1%252Fa5b319b34ed74ba88bbc82ee979ca843%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm1/a5b319b34ed74ba88bbc82ee979ca843/images/large/4.jpg saved to cache
2026-03-25 16:31:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 03db467f-43df-5654-99f7-934086cbc3af
2026-03-25 16:31:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc63d010>
2026-03-25 16:31:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_03db467f-43df-5654-99f7-934086cbc3af/03db467f-43df-5654-99f7-934086cbc3af_image_1.jpg HTTP/1.1" 201 0
2026-03-25 16:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm1%252Fa5b319b34ed74ba88bbc82ee979ca843%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm1/a5b319b34ed74ba88bbc82ee979ca843/images/large/2.jpg saved to cache
2026-03-25 16:31:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 03db467f-43df-5654-99f7-934086cbc3af
2026-03-25 16:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj9%252F143635fb2f8c4029a7d15e1ce5340fc3%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj9/143635fb2f8c4029a7d15e1ce5340fc3/images/large/2.jpg not downloaded yet
2026-03-25 16:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj9%252F143635fb2f8c4029a7d15e1ce5340fc3%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj9/143635fb2f8c4029a7d15e1ce5340fc3/images/large/3.jpg not downloaded yet
2026-03-25 16:31:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gy2/7ff0b580f3cd43689ee0411db457cb51/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj9%252F143635fb2f8c4029a7d15e1ce5340fc3%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj9/143635fb2f8c4029a7d15e1ce5340fc3/images/large/4.jpg not downloaded yet
2026-03-25 16:31:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gy2/7ff0b580f3cd43689ee0411db457cb51/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gy2/7ff0b580f3cd43689ee0411db457cb51/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gy2/7ff0b580f3cd43689ee0411db457cb51/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gy2/7ff0b580f3cd43689ee0411db457cb51/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj9%252F143635fb2f8c4029a7d15e1ce5340fc3%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj9/143635fb2f8c4029a7d15e1ce5340fc3/images/large/5.jpg not downloaded yet
2026-03-25 16:31:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gy2/7ff0b580f3cd43689ee0411db457cb51/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gy2/7ff0b580f3cd43689ee0411db457cb51/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj9%252F143635fb2f8c4029a7d15e1ce5340fc3%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj9/143635fb2f8c4029a7d15e1ce5340fc3/images/large/6.jpg not downloaded yet
2026-03-25 16:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj9%252F143635fb2f8c4029a7d15e1ce5340fc3%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj9/143635fb2f8c4029a7d15e1ce5340fc3/images/large/7.jpg not downloaded yet
2026-03-25 16:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj9%252F143635fb2f8c4029a7d15e1ce5340fc3%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj9/143635fb2f8c4029a7d15e1ce5340fc3/images/large/8.jpg not downloaded yet
2026-03-25 16:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj9%252F143635fb2f8c4029a7d15e1ce5340fc3%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj9/143635fb2f8c4029a7d15e1ce5340fc3/images/large/9.jpg not downloaded yet
2026-03-25 16:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj9%252F143635fb2f8c4029a7d15e1ce5340fc3%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj9/143635fb2f8c4029a7d15e1ce5340fc3/images/large/10.jpg not downloaded yet
2026-03-25 16:31:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc86b510>
2026-03-25 16:31:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3409c17-3df5-500a-a99e-bb10218ccb97/c3409c17-3df5-500a-a99e-bb10218ccb97_image_6.jpg HTTP/1.1" 201 0
2026-03-25 16:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgy2%252F7ff0b580f3cd43689ee0411db457cb51%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gy2/7ff0b580f3cd43689ee0411db457cb51/images/large/7.jpg saved to cache
2026-03-25 16:31:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c3409c17-3df5-500a-a99e-bb10218ccb97
2026-03-25 16:31:14 [ayvens.it] INFO: Found listing with ID: 1983541
2026-03-25 16:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983541%27 HTTP/1.1" 200 None
2026-03-25 16:31:14 [ayvens.it] INFO: Scrape type for 1983541: 1
2026-03-25 16:31:14 [ayvens.it] INFO: Extracting data for car ID: 1983541
2026-03-25 16:31:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 45ed853b-25a6-5af4-afc2-4c9b6f8210ee with identifier: 1983541
2026-03-25 16:31:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 45ed853b-25a6-5af4-afc2-4c9b6f8210ee with scrape type 1
2026-03-25 16:31:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 45ed853b-25a6-5af4-afc2-4c9b6f8210ee
2026-03-25 16:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj9%252F58500f54b0e64f9c8a573a8cc9ab2e77%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj9/58500f54b0e64f9c8a573a8cc9ab2e77/images/large/1.jpg not downloaded yet
2026-03-25 16:31:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc8689d0>
2026-03-25 16:31:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3409c17-3df5-500a-a99e-bb10218ccb97/c3409c17-3df5-500a-a99e-bb10218ccb97_image_2.jpg HTTP/1.1" 201 0
2026-03-25 16:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgy2%252F7ff0b580f3cd43689ee0411db457cb51%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gy2/7ff0b580f3cd43689ee0411db457cb51/images/large/3.jpg saved to cache
2026-03-25 16:31:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c3409c17-3df5-500a-a99e-bb10218ccb97
2026-03-25 16:31:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dca11610>
2026-03-25 16:31:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3409c17-3df5-500a-a99e-bb10218ccb97/c3409c17-3df5-500a-a99e-bb10218ccb97_image_1.jpg HTTP/1.1" 201 0
2026-03-25 16:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgy2%252F7ff0b580f3cd43689ee0411db457cb51%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gy2/7ff0b580f3cd43689ee0411db457cb51/images/large/2.jpg saved to cache
2026-03-25 16:31:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c3409c17-3df5-500a-a99e-bb10218ccb97
2026-03-25 16:31:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dca20e90>
2026-03-25 16:31:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3409c17-3df5-500a-a99e-bb10218ccb97/c3409c17-3df5-500a-a99e-bb10218ccb97_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgy2%252F7ff0b580f3cd43689ee0411db457cb51%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gy2/7ff0b580f3cd43689ee0411db457cb51/images/large/1.jpg saved to cache
2026-03-25 16:31:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c3409c17-3df5-500a-a99e-bb10218ccb97
2026-03-25 16:31:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc713890>
2026-03-25 16:31:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3409c17-3df5-500a-a99e-bb10218ccb97/c3409c17-3df5-500a-a99e-bb10218ccb97_image_7.jpg HTTP/1.1" 201 0
2026-03-25 16:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgy2%252F7ff0b580f3cd43689ee0411db457cb51%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gy2/7ff0b580f3cd43689ee0411db457cb51/images/large/8.jpg saved to cache
2026-03-25 16:31:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c3409c17-3df5-500a-a99e-bb10218ccb97
2026-03-25 16:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj9%252F58500f54b0e64f9c8a573a8cc9ab2e77%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj9/58500f54b0e64f9c8a573a8cc9ab2e77/images/large/2.jpg not downloaded yet
2026-03-25 16:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj9%252F58500f54b0e64f9c8a573a8cc9ab2e77%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj9/58500f54b0e64f9c8a573a8cc9ab2e77/images/large/3.jpg not downloaded yet
2026-03-25 16:31:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc8e2750>
2026-03-25 16:31:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3409c17-3df5-500a-a99e-bb10218ccb97/c3409c17-3df5-500a-a99e-bb10218ccb97_image_3.jpg HTTP/1.1" 201 0
2026-03-25 16:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgy2%252F7ff0b580f3cd43689ee0411db457cb51%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gy2/7ff0b580f3cd43689ee0411db457cb51/images/large/4.jpg saved to cache
2026-03-25 16:31:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c3409c17-3df5-500a-a99e-bb10218ccb97
2026-03-25 16:31:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc3090d0>
2026-03-25 16:31:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3409c17-3df5-500a-a99e-bb10218ccb97/c3409c17-3df5-500a-a99e-bb10218ccb97_image_4.jpg HTTP/1.1" 201 0
2026-03-25 16:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgy2%252F7ff0b580f3cd43689ee0411db457cb51%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gy2/7ff0b580f3cd43689ee0411db457cb51/images/large/5.jpg saved to cache
2026-03-25 16:31:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c3409c17-3df5-500a-a99e-bb10218ccb97
2026-03-25 16:31:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm1/a5b319b34ed74ba88bbc82ee979ca843/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gy2/7ff0b580f3cd43689ee0411db457cb51/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj9%252F58500f54b0e64f9c8a573a8cc9ab2e77%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj9/58500f54b0e64f9c8a573a8cc9ab2e77/images/large/4.jpg not downloaded yet
2026-03-25 16:31:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gy2/7ff0b580f3cd43689ee0411db457cb51/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gy2/7ff0b580f3cd43689ee0411db457cb51/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj9%252F58500f54b0e64f9c8a573a8cc9ab2e77%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj9/58500f54b0e64f9c8a573a8cc9ab2e77/images/large/5.jpg not downloaded yet
2026-03-25 16:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj9%252F58500f54b0e64f9c8a573a8cc9ab2e77%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj9/58500f54b0e64f9c8a573a8cc9ab2e77/images/large/6.jpg not downloaded yet
2026-03-25 16:31:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj1/f1be48883f6047a2ad216a992130481c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj1/f1be48883f6047a2ad216a992130481c/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj1/f1be48883f6047a2ad216a992130481c/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj9%252F58500f54b0e64f9c8a573a8cc9ab2e77%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj9/58500f54b0e64f9c8a573a8cc9ab2e77/images/large/7.jpg not downloaded yet
2026-03-25 16:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj9%252F58500f54b0e64f9c8a573a8cc9ab2e77%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj9/58500f54b0e64f9c8a573a8cc9ab2e77/images/large/8.jpg not downloaded yet
2026-03-25 16:31:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc590b90>
2026-03-25 16:31:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_03db467f-43df-5654-99f7-934086cbc3af/03db467f-43df-5654-99f7-934086cbc3af_image_9.jpg HTTP/1.1" 201 0
2026-03-25 16:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm1%252Fa5b319b34ed74ba88bbc82ee979ca843%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm1/a5b319b34ed74ba88bbc82ee979ca843/images/large/10.jpg saved to cache
2026-03-25 16:31:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 03db467f-43df-5654-99f7-934086cbc3af
2026-03-25 16:31:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc546f50>
2026-03-25 16:31:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3409c17-3df5-500a-a99e-bb10218ccb97/c3409c17-3df5-500a-a99e-bb10218ccb97_image_5.jpg HTTP/1.1" 201 0
2026-03-25 16:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgy2%252F7ff0b580f3cd43689ee0411db457cb51%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gy2/7ff0b580f3cd43689ee0411db457cb51/images/large/6.jpg saved to cache
2026-03-25 16:31:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c3409c17-3df5-500a-a99e-bb10218ccb97
2026-03-25 16:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj9%252F58500f54b0e64f9c8a573a8cc9ab2e77%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj9/58500f54b0e64f9c8a573a8cc9ab2e77/images/large/9.jpg not downloaded yet
2026-03-25 16:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj9%252F58500f54b0e64f9c8a573a8cc9ab2e77%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj9/58500f54b0e64f9c8a573a8cc9ab2e77/images/large/10.jpg not downloaded yet
2026-03-25 16:31:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34d74cc750>
2026-03-25 16:31:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3409c17-3df5-500a-a99e-bb10218ccb97/c3409c17-3df5-500a-a99e-bb10218ccb97_image_8.jpg HTTP/1.1" 201 0
2026-03-25 16:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgy2%252F7ff0b580f3cd43689ee0411db457cb51%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gy2/7ff0b580f3cd43689ee0411db457cb51/images/large/9.jpg saved to cache
2026-03-25 16:31:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c3409c17-3df5-500a-a99e-bb10218ccb97
2026-03-25 16:31:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc9c9a90>
2026-03-25 16:31:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3409c17-3df5-500a-a99e-bb10218ccb97/c3409c17-3df5-500a-a99e-bb10218ccb97_image_9.jpg HTTP/1.1" 201 0
2026-03-25 16:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgy2%252F7ff0b580f3cd43689ee0411db457cb51%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gy2/7ff0b580f3cd43689ee0411db457cb51/images/large/10.jpg saved to cache
2026-03-25 16:31:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c3409c17-3df5-500a-a99e-bb10218ccb97
2026-03-25 16:31:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c3409c17-3df5-500a-a99e-bb10218ccb97, skipping ID generation
2026-03-25 16:31:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c3409c17-3df5-500a-a99e-bb10218ccb97 with scrape type 1
2026-03-25 16:31:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c3409c17-3df5-500a-a99e-bb10218ccb97 sending to next pipeline
2026-03-25 16:31:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: c3409c17-3df5-500a-a99e-bb10218ccb97, identifier: 1983538
2026-03-25 16:31:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcde3c50>
2026-03-25 16:31:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_483367a7-9424-5972-b06a-1bbfe0906820/483367a7-9424-5972-b06a-1bbfe0906820_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj1%252Ff1be48883f6047a2ad216a992130481c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj1/f1be48883f6047a2ad216a992130481c/images/large/1.jpg saved to cache
2026-03-25 16:31:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 483367a7-9424-5972-b06a-1bbfe0906820
2026-03-25 16:31:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc578c50>
2026-03-25 16:31:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_483367a7-9424-5972-b06a-1bbfe0906820/483367a7-9424-5972-b06a-1bbfe0906820_image_2.jpg HTTP/1.1" 201 0
2026-03-25 16:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj1%252Ff1be48883f6047a2ad216a992130481c%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj1/f1be48883f6047a2ad216a992130481c/images/large/3.jpg saved to cache
2026-03-25 16:31:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 483367a7-9424-5972-b06a-1bbfe0906820
2026-03-25 16:31:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc38d250>
2026-03-25 16:31:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_483367a7-9424-5972-b06a-1bbfe0906820/483367a7-9424-5972-b06a-1bbfe0906820_image_3.jpg HTTP/1.1" 201 0
2026-03-25 16:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj1%252Ff1be48883f6047a2ad216a992130481c%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj1/f1be48883f6047a2ad216a992130481c/images/large/4.jpg saved to cache
2026-03-25 16:31:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 483367a7-9424-5972-b06a-1bbfe0906820
2026-03-25 16:31:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: c3409c17-3df5-500a-a99e-bb10218ccb97 with identifier: 1983538
2026-03-25 16:31:16 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:31:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: c3409c17-3df5-500a-a99e-bb10218ccb97 with identifier: 1983538
2026-03-25 16:31:16 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: c3409c17-3df5-500a-a99e-bb10218ccb97 with identifier: 1983538 to the API
2026-03-25 16:31:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:31:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:31:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gy2/7ff0b580f3cd43689ee0411db457cb51/images/large/10.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'GENERIC COLOR',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-27T09:30:00Z',
'fuel_type': 'hybrid',
'id': 'c3409c17-3df5-500a-a99e-bb10218ccb97',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41025',
'listing': 'auction',
'location': None,
'make': 'BMW',
'model': 'BMW X1 SDRIVE 20I DCT',
'odometer': 25,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3409c17-3df5-500a-a99e-bb10218ccb97/c3409c17-3df5-500a-a99e-bb10218ccb97_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 794439,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gy2/7ff0b580f3cd43689ee0411db457cb51/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3409c17-3df5-500a-a99e-bb10218ccb97/c3409c17-3df5-500a-a99e-bb10218ccb97_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 762411,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gy2/7ff0b580f3cd43689ee0411db457cb51/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3409c17-3df5-500a-a99e-bb10218ccb97/c3409c17-3df5-500a-a99e-bb10218ccb97_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 794439,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gy2/7ff0b580f3cd43689ee0411db457cb51/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3409c17-3df5-500a-a99e-bb10218ccb97/c3409c17-3df5-500a-a99e-bb10218ccb97_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 827053,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gy2/7ff0b580f3cd43689ee0411db457cb51/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3409c17-3df5-500a-a99e-bb10218ccb97/c3409c17-3df5-500a-a99e-bb10218ccb97_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 781058,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gy2/7ff0b580f3cd43689ee0411db457cb51/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3409c17-3df5-500a-a99e-bb10218ccb97/c3409c17-3df5-500a-a99e-bb10218ccb97_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 588222,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gy2/7ff0b580f3cd43689ee0411db457cb51/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3409c17-3df5-500a-a99e-bb10218ccb97/c3409c17-3df5-500a-a99e-bb10218ccb97_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 492373,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gy2/7ff0b580f3cd43689ee0411db457cb51/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3409c17-3df5-500a-a99e-bb10218ccb97/c3409c17-3df5-500a-a99e-bb10218ccb97_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 634069,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gy2/7ff0b580f3cd43689ee0411db457cb51/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3409c17-3df5-500a-a99e-bb10218ccb97/c3409c17-3df5-500a-a99e-bb10218ccb97_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 596546,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gy2/7ff0b580f3cd43689ee0411db457cb51/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3409c17-3df5-500a-a99e-bb10218ccb97/c3409c17-3df5-500a-a99e-bb10218ccb97_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 517159,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gy2/7ff0b580f3cd43689ee0411db457cb51/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2025-02-14',
'seats_number': 5,
'seller_name': None,
'title': 'BMW BMW X1 SDRIVE 20I DCT -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2025}
2026-03-25 16:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983538%27 HTTP/1.1" 200 None
2026-03-25 16:31:16 [ayvens.it] INFO: Saving data for 1983538: {'created_time': 1774456276.726783, 'last_price_update_time': 1774456276.726801, 'auction_closing_time': 1774603800.0}
2026-03-25 16:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1983538') HTTP/1.1" 204 0
2026-03-25 16:31:16 [ayvens.it] INFO: Found listing with ID: 1983542
2026-03-25 16:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983542%27 HTTP/1.1" 200 None
2026-03-25 16:31:16 [ayvens.it] INFO: Scrape type for 1983542: 1
2026-03-25 16:31:16 [ayvens.it] INFO: Extracting data for car ID: 1983542
2026-03-25 16:31:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ebeabe6b-950d-5cfc-a056-e46d82352ba1 with identifier: 1983542
2026-03-25 16:31:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ebeabe6b-950d-5cfc-a056-e46d82352ba1 with scrape type 1
2026-03-25 16:31:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ebeabe6b-950d-5cfc-a056-e46d82352ba1
2026-03-25 16:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk7%252F60ebaa7fe8c540359e0822b23b3a264e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk7/60ebaa7fe8c540359e0822b23b3a264e/images/large/1.jpg not downloaded yet
2026-03-25 16:31:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj1/f1be48883f6047a2ad216a992130481c/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk7%252F60ebaa7fe8c540359e0822b23b3a264e%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk7/60ebaa7fe8c540359e0822b23b3a264e/images/large/2.jpg not downloaded yet
2026-03-25 16:31:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj1/f1be48883f6047a2ad216a992130481c/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk7%252F60ebaa7fe8c540359e0822b23b3a264e%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk7/60ebaa7fe8c540359e0822b23b3a264e/images/large/3.jpg not downloaded yet
2026-03-25 16:31:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj1/f1be48883f6047a2ad216a992130481c/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk7%252F60ebaa7fe8c540359e0822b23b3a264e%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk7/60ebaa7fe8c540359e0822b23b3a264e/images/large/4.jpg not downloaded yet
2026-03-25 16:31:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj9/143635fb2f8c4029a7d15e1ce5340fc3/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj9/143635fb2f8c4029a7d15e1ce5340fc3/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj1/f1be48883f6047a2ad216a992130481c/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk7%252F60ebaa7fe8c540359e0822b23b3a264e%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk7/60ebaa7fe8c540359e0822b23b3a264e/images/large/5.jpg not downloaded yet
2026-03-25 16:31:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj9/143635fb2f8c4029a7d15e1ce5340fc3/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj9/143635fb2f8c4029a7d15e1ce5340fc3/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk7%252F60ebaa7fe8c540359e0822b23b3a264e%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk7/60ebaa7fe8c540359e0822b23b3a264e/images/large/6.jpg not downloaded yet
2026-03-25 16:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk7%252F60ebaa7fe8c540359e0822b23b3a264e%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk7/60ebaa7fe8c540359e0822b23b3a264e/images/large/7.jpg not downloaded yet
2026-03-25 16:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk7%252F60ebaa7fe8c540359e0822b23b3a264e%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk7/60ebaa7fe8c540359e0822b23b3a264e/images/large/8.jpg not downloaded yet
2026-03-25 16:31:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc80dd50>
2026-03-25 16:31:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_483367a7-9424-5972-b06a-1bbfe0906820/483367a7-9424-5972-b06a-1bbfe0906820_image_1.jpg HTTP/1.1" 201 0
2026-03-25 16:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj1%252Ff1be48883f6047a2ad216a992130481c%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj1/f1be48883f6047a2ad216a992130481c/images/large/2.jpg saved to cache
2026-03-25 16:31:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 483367a7-9424-5972-b06a-1bbfe0906820
2026-03-25 16:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk7%252F60ebaa7fe8c540359e0822b23b3a264e%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk7/60ebaa7fe8c540359e0822b23b3a264e/images/large/9.jpg not downloaded yet
2026-03-25 16:31:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc80ea10>
2026-03-25 16:31:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_483367a7-9424-5972-b06a-1bbfe0906820/483367a7-9424-5972-b06a-1bbfe0906820_image_7.jpg HTTP/1.1" 201 0
2026-03-25 16:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj1%252Ff1be48883f6047a2ad216a992130481c%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj1/f1be48883f6047a2ad216a992130481c/images/large/8.jpg saved to cache
2026-03-25 16:31:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 483367a7-9424-5972-b06a-1bbfe0906820
2026-03-25 16:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk7%252F60ebaa7fe8c540359e0822b23b3a264e%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk7/60ebaa7fe8c540359e0822b23b3a264e/images/large/10.jpg not downloaded yet
2026-03-25 16:31:17 [ayvens.it] INFO: Found listing with ID: 1983543
2026-03-25 16:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983543%27 HTTP/1.1" 200 None
2026-03-25 16:31:17 [ayvens.it] INFO: Scrape type for 1983543: 1
2026-03-25 16:31:17 [ayvens.it] INFO: Extracting data for car ID: 1983543
2026-03-25 16:31:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8e19f760-9e22-5009-a59c-17be54bc2a87 with identifier: 1983543
2026-03-25 16:31:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8e19f760-9e22-5009-a59c-17be54bc2a87 with scrape type 1
2026-03-25 16:31:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8e19f760-9e22-5009-a59c-17be54bc2a87
2026-03-25 16:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm2%252Fe029dc1663e944dba28903fe885c6924%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm2/e029dc1663e944dba28903fe885c6924/images/large/1.jpg not downloaded yet
2026-03-25 16:31:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34d6b1ff50>
2026-03-25 16:31:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_483367a7-9424-5972-b06a-1bbfe0906820/483367a7-9424-5972-b06a-1bbfe0906820_image_9.jpg HTTP/1.1" 201 0
2026-03-25 16:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj1%252Ff1be48883f6047a2ad216a992130481c%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj1/f1be48883f6047a2ad216a992130481c/images/large/10.jpg saved to cache
2026-03-25 16:31:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 483367a7-9424-5972-b06a-1bbfe0906820
2026-03-25 16:31:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc326590>
2026-03-25 16:31:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27d7a78c-5def-545b-b6d3-8c2262a0cd32/27d7a78c-5def-545b-b6d3-8c2262a0cd32_image_3.jpg HTTP/1.1" 201 0
2026-03-25 16:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj9%252F143635fb2f8c4029a7d15e1ce5340fc3%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj9/143635fb2f8c4029a7d15e1ce5340fc3/images/large/4.jpg saved to cache
2026-03-25 16:31:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 27d7a78c-5def-545b-b6d3-8c2262a0cd32
2026-03-25 16:31:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc588290>
2026-03-25 16:31:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27d7a78c-5def-545b-b6d3-8c2262a0cd32/27d7a78c-5def-545b-b6d3-8c2262a0cd32_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj9%252F143635fb2f8c4029a7d15e1ce5340fc3%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj9/143635fb2f8c4029a7d15e1ce5340fc3/images/large/1.jpg saved to cache
2026-03-25 16:31:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 27d7a78c-5def-545b-b6d3-8c2262a0cd32
2026-03-25 16:31:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc63d010>
2026-03-25 16:31:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_483367a7-9424-5972-b06a-1bbfe0906820/483367a7-9424-5972-b06a-1bbfe0906820_image_8.jpg HTTP/1.1" 201 0
2026-03-25 16:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj1%252Ff1be48883f6047a2ad216a992130481c%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj1/f1be48883f6047a2ad216a992130481c/images/large/9.jpg saved to cache
2026-03-25 16:31:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 483367a7-9424-5972-b06a-1bbfe0906820
2026-03-25 16:31:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc3825d0>
2026-03-25 16:31:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27d7a78c-5def-545b-b6d3-8c2262a0cd32/27d7a78c-5def-545b-b6d3-8c2262a0cd32_image_2.jpg HTTP/1.1" 201 0
2026-03-25 16:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj9%252F143635fb2f8c4029a7d15e1ce5340fc3%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj9/143635fb2f8c4029a7d15e1ce5340fc3/images/large/3.jpg saved to cache
2026-03-25 16:31:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 27d7a78c-5def-545b-b6d3-8c2262a0cd32
2026-03-25 16:31:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc367fd0>
2026-03-25 16:31:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27d7a78c-5def-545b-b6d3-8c2262a0cd32/27d7a78c-5def-545b-b6d3-8c2262a0cd32_image_1.jpg HTTP/1.1" 201 0
2026-03-25 16:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj9%252F143635fb2f8c4029a7d15e1ce5340fc3%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj9/143635fb2f8c4029a7d15e1ce5340fc3/images/large/2.jpg saved to cache
2026-03-25 16:31:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 27d7a78c-5def-545b-b6d3-8c2262a0cd32
2026-03-25 16:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm2%252Fe029dc1663e944dba28903fe885c6924%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm2/e029dc1663e944dba28903fe885c6924/images/large/2.jpg not downloaded yet
2026-03-25 16:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm2%252Fe029dc1663e944dba28903fe885c6924%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm2/e029dc1663e944dba28903fe885c6924/images/large/3.jpg not downloaded yet
2026-03-25 16:31:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj9/58500f54b0e64f9c8a573a8cc9ab2e77/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj9/58500f54b0e64f9c8a573a8cc9ab2e77/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj9/58500f54b0e64f9c8a573a8cc9ab2e77/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm2%252Fe029dc1663e944dba28903fe885c6924%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm2/e029dc1663e944dba28903fe885c6924/images/large/4.jpg not downloaded yet
2026-03-25 16:31:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj9/58500f54b0e64f9c8a573a8cc9ab2e77/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj9/58500f54b0e64f9c8a573a8cc9ab2e77/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj9/143635fb2f8c4029a7d15e1ce5340fc3/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm2%252Fe029dc1663e944dba28903fe885c6924%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm2/e029dc1663e944dba28903fe885c6924/images/large/5.jpg not downloaded yet
2026-03-25 16:31:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj9/143635fb2f8c4029a7d15e1ce5340fc3/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj9/58500f54b0e64f9c8a573a8cc9ab2e77/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm2%252Fe029dc1663e944dba28903fe885c6924%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm2/e029dc1663e944dba28903fe885c6924/images/large/6.jpg not downloaded yet
2026-03-25 16:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm2%252Fe029dc1663e944dba28903fe885c6924%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm2/e029dc1663e944dba28903fe885c6924/images/large/7.jpg not downloaded yet
2026-03-25 16:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm2%252Fe029dc1663e944dba28903fe885c6924%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm2/e029dc1663e944dba28903fe885c6924/images/large/8.jpg not downloaded yet
2026-03-25 16:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm2%252Fe029dc1663e944dba28903fe885c6924%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm2/e029dc1663e944dba28903fe885c6924/images/large/9.jpg not downloaded yet
2026-03-25 16:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm2%252Fe029dc1663e944dba28903fe885c6924%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm2/e029dc1663e944dba28903fe885c6924/images/large/10.jpg not downloaded yet
2026-03-25 16:31:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc60e9d0>
2026-03-25 16:31:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45ed853b-25a6-5af4-afc2-4c9b6f8210ee/45ed853b-25a6-5af4-afc2-4c9b6f8210ee_image_2.jpg HTTP/1.1" 201 0
2026-03-25 16:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj9%252F58500f54b0e64f9c8a573a8cc9ab2e77%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj9/58500f54b0e64f9c8a573a8cc9ab2e77/images/large/3.jpg saved to cache
2026-03-25 16:31:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 45ed853b-25a6-5af4-afc2-4c9b6f8210ee
2026-03-25 16:31:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc2fd550>
2026-03-25 16:31:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45ed853b-25a6-5af4-afc2-4c9b6f8210ee/45ed853b-25a6-5af4-afc2-4c9b6f8210ee_image_1.jpg HTTP/1.1" 201 0
2026-03-25 16:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj9%252F58500f54b0e64f9c8a573a8cc9ab2e77%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj9/58500f54b0e64f9c8a573a8cc9ab2e77/images/large/2.jpg saved to cache
2026-03-25 16:31:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 45ed853b-25a6-5af4-afc2-4c9b6f8210ee
2026-03-25 16:31:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc586b50>
2026-03-25 16:31:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45ed853b-25a6-5af4-afc2-4c9b6f8210ee/45ed853b-25a6-5af4-afc2-4c9b6f8210ee_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj9%252F58500f54b0e64f9c8a573a8cc9ab2e77%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj9/58500f54b0e64f9c8a573a8cc9ab2e77/images/large/1.jpg saved to cache
2026-03-25 16:31:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 45ed853b-25a6-5af4-afc2-4c9b6f8210ee
2026-03-25 16:31:18 [ayvens.it] INFO: Found listing with ID: 1983544
2026-03-25 16:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983544%27 HTTP/1.1" 200 None
2026-03-25 16:31:18 [ayvens.it] INFO: Scrape type for 1983544: 1
2026-03-25 16:31:18 [ayvens.it] INFO: Extracting data for car ID: 1983544
2026-03-25 16:31:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: edf771e6-c374-5dcf-8d7b-3b45762549ba with identifier: 1983544
2026-03-25 16:31:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item edf771e6-c374-5dcf-8d7b-3b45762549ba with scrape type 1
2026-03-25 16:31:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item edf771e6-c374-5dcf-8d7b-3b45762549ba
2026-03-25 16:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm4%252F9b4b55c1b7ee46d697d2b2fe00705b84%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm4/9b4b55c1b7ee46d697d2b2fe00705b84/images/large/1.jpg not downloaded yet
2026-03-25 16:31:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34de460050>
2026-03-25 16:31:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45ed853b-25a6-5af4-afc2-4c9b6f8210ee/45ed853b-25a6-5af4-afc2-4c9b6f8210ee_image_3.jpg HTTP/1.1" 201 0
2026-03-25 16:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj9%252F58500f54b0e64f9c8a573a8cc9ab2e77%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj9/58500f54b0e64f9c8a573a8cc9ab2e77/images/large/4.jpg saved to cache
2026-03-25 16:31:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 45ed853b-25a6-5af4-afc2-4c9b6f8210ee
2026-03-25 16:31:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dca605d0>
2026-03-25 16:31:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45ed853b-25a6-5af4-afc2-4c9b6f8210ee/45ed853b-25a6-5af4-afc2-4c9b6f8210ee_image_5.jpg HTTP/1.1" 201 0
2026-03-25 16:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj9%252F58500f54b0e64f9c8a573a8cc9ab2e77%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj9/58500f54b0e64f9c8a573a8cc9ab2e77/images/large/6.jpg saved to cache
2026-03-25 16:31:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 45ed853b-25a6-5af4-afc2-4c9b6f8210ee
2026-03-25 16:31:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc356610>
2026-03-25 16:31:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27d7a78c-5def-545b-b6d3-8c2262a0cd32/27d7a78c-5def-545b-b6d3-8c2262a0cd32_image_8.jpg HTTP/1.1" 201 0
2026-03-25 16:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj9%252F143635fb2f8c4029a7d15e1ce5340fc3%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj9/143635fb2f8c4029a7d15e1ce5340fc3/images/large/9.jpg saved to cache
2026-03-25 16:31:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 27d7a78c-5def-545b-b6d3-8c2262a0cd32
2026-03-25 16:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm4%252F9b4b55c1b7ee46d697d2b2fe00705b84%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm4/9b4b55c1b7ee46d697d2b2fe00705b84/images/large/2.jpg not downloaded yet
2026-03-25 16:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm4%252F9b4b55c1b7ee46d697d2b2fe00705b84%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm4/9b4b55c1b7ee46d697d2b2fe00705b84/images/large/3.jpg not downloaded yet
2026-03-25 16:31:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34de655c10>
2026-03-25 16:31:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27d7a78c-5def-545b-b6d3-8c2262a0cd32/27d7a78c-5def-545b-b6d3-8c2262a0cd32_image_9.jpg HTTP/1.1" 201 0
2026-03-25 16:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj9%252F143635fb2f8c4029a7d15e1ce5340fc3%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj9/143635fb2f8c4029a7d15e1ce5340fc3/images/large/10.jpg saved to cache
2026-03-25 16:31:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 27d7a78c-5def-545b-b6d3-8c2262a0cd32
2026-03-25 16:31:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc546850>
2026-03-25 16:31:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45ed853b-25a6-5af4-afc2-4c9b6f8210ee/45ed853b-25a6-5af4-afc2-4c9b6f8210ee_image_4.jpg HTTP/1.1" 201 0
2026-03-25 16:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj9%252F58500f54b0e64f9c8a573a8cc9ab2e77%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj9/58500f54b0e64f9c8a573a8cc9ab2e77/images/large/5.jpg saved to cache
2026-03-25 16:31:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 45ed853b-25a6-5af4-afc2-4c9b6f8210ee
2026-03-25 16:31:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj9/58500f54b0e64f9c8a573a8cc9ab2e77/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm4%252F9b4b55c1b7ee46d697d2b2fe00705b84%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm4/9b4b55c1b7ee46d697d2b2fe00705b84/images/large/4.jpg not downloaded yet
2026-03-25 16:31:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk7/60ebaa7fe8c540359e0822b23b3a264e/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk7/60ebaa7fe8c540359e0822b23b3a264e/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk7/60ebaa7fe8c540359e0822b23b3a264e/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj9/58500f54b0e64f9c8a573a8cc9ab2e77/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk7/60ebaa7fe8c540359e0822b23b3a264e/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm4%252F9b4b55c1b7ee46d697d2b2fe00705b84%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm4/9b4b55c1b7ee46d697d2b2fe00705b84/images/large/5.jpg not downloaded yet
2026-03-25 16:31:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj9/58500f54b0e64f9c8a573a8cc9ab2e77/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk7/60ebaa7fe8c540359e0822b23b3a264e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm4%252F9b4b55c1b7ee46d697d2b2fe00705b84%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm4/9b4b55c1b7ee46d697d2b2fe00705b84/images/large/6.jpg not downloaded yet
2026-03-25 16:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm4%252F9b4b55c1b7ee46d697d2b2fe00705b84%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm4/9b4b55c1b7ee46d697d2b2fe00705b84/images/large/7.jpg not downloaded yet
2026-03-25 16:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm4%252F9b4b55c1b7ee46d697d2b2fe00705b84%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm4/9b4b55c1b7ee46d697d2b2fe00705b84/images/large/8.jpg not downloaded yet
2026-03-25 16:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm4%252F9b4b55c1b7ee46d697d2b2fe00705b84%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm4/9b4b55c1b7ee46d697d2b2fe00705b84/images/large/9.jpg not downloaded yet
2026-03-25 16:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm4%252F9b4b55c1b7ee46d697d2b2fe00705b84%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm4/9b4b55c1b7ee46d697d2b2fe00705b84/images/large/10.jpg not downloaded yet
2026-03-25 16:31:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc9d41d0>
2026-03-25 16:31:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45ed853b-25a6-5af4-afc2-4c9b6f8210ee/45ed853b-25a6-5af4-afc2-4c9b6f8210ee_image_9.jpg HTTP/1.1" 201 0
2026-03-25 16:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj9%252F58500f54b0e64f9c8a573a8cc9ab2e77%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj9/58500f54b0e64f9c8a573a8cc9ab2e77/images/large/10.jpg saved to cache
2026-03-25 16:31:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 45ed853b-25a6-5af4-afc2-4c9b6f8210ee
2026-03-25 16:31:18 [ayvens.it] INFO: Found listing with ID: 1983545
2026-03-25 16:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983545%27 HTTP/1.1" 200 None
2026-03-25 16:31:18 [ayvens.it] INFO: Scrape type for 1983545: 1
2026-03-25 16:31:18 [ayvens.it] INFO: Extracting data for car ID: 1983545
2026-03-25 16:31:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0945dfc6-2df7-5464-9f57-8072d914912d with identifier: 1983545
2026-03-25 16:31:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0945dfc6-2df7-5464-9f57-8072d914912d with scrape type 1
2026-03-25 16:31:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0945dfc6-2df7-5464-9f57-8072d914912d
2026-03-25 16:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm1%252F492184fd70884deea40c7b73c7b31fbf%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm1/492184fd70884deea40c7b73c7b31fbf/images/large/1.jpg not downloaded yet
2026-03-25 16:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm1%252F492184fd70884deea40c7b73c7b31fbf%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm1/492184fd70884deea40c7b73c7b31fbf/images/large/2.jpg not downloaded yet
2026-03-25 16:31:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc5ea1d0>
2026-03-25 16:31:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ebeabe6b-950d-5cfc-a056-e46d82352ba1/ebeabe6b-950d-5cfc-a056-e46d82352ba1_image_9.jpg HTTP/1.1" 201 0
2026-03-25 16:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk7%252F60ebaa7fe8c540359e0822b23b3a264e%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk7/60ebaa7fe8c540359e0822b23b3a264e/images/large/10.jpg saved to cache
2026-03-25 16:31:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ebeabe6b-950d-5cfc-a056-e46d82352ba1
2026-03-25 16:31:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc300fd0>
2026-03-25 16:31:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ebeabe6b-950d-5cfc-a056-e46d82352ba1/ebeabe6b-950d-5cfc-a056-e46d82352ba1_image_1.jpg HTTP/1.1" 201 0
2026-03-25 16:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk7%252F60ebaa7fe8c540359e0822b23b3a264e%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk7/60ebaa7fe8c540359e0822b23b3a264e/images/large/2.jpg saved to cache
2026-03-25 16:31:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ebeabe6b-950d-5cfc-a056-e46d82352ba1
2026-03-25 16:31:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34d6b5bbd0>
2026-03-25 16:31:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ebeabe6b-950d-5cfc-a056-e46d82352ba1/ebeabe6b-950d-5cfc-a056-e46d82352ba1_image_2.jpg HTTP/1.1" 201 0
2026-03-25 16:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk7%252F60ebaa7fe8c540359e0822b23b3a264e%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk7/60ebaa7fe8c540359e0822b23b3a264e/images/large/3.jpg saved to cache
2026-03-25 16:31:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ebeabe6b-950d-5cfc-a056-e46d82352ba1
2026-03-25 16:31:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34d740b7d0>
2026-03-25 16:31:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45ed853b-25a6-5af4-afc2-4c9b6f8210ee/45ed853b-25a6-5af4-afc2-4c9b6f8210ee_image_8.jpg HTTP/1.1" 201 0
2026-03-25 16:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj9%252F58500f54b0e64f9c8a573a8cc9ab2e77%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj9/58500f54b0e64f9c8a573a8cc9ab2e77/images/large/9.jpg saved to cache
2026-03-25 16:31:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 45ed853b-25a6-5af4-afc2-4c9b6f8210ee
2026-03-25 16:31:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dca25110>
2026-03-25 16:31:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ebeabe6b-950d-5cfc-a056-e46d82352ba1/ebeabe6b-950d-5cfc-a056-e46d82352ba1_image_8.jpg HTTP/1.1" 201 0
2026-03-25 16:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk7%252F60ebaa7fe8c540359e0822b23b3a264e%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk7/60ebaa7fe8c540359e0822b23b3a264e/images/large/9.jpg saved to cache
2026-03-25 16:31:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ebeabe6b-950d-5cfc-a056-e46d82352ba1
2026-03-25 16:31:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc87b510>
2026-03-25 16:31:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45ed853b-25a6-5af4-afc2-4c9b6f8210ee/45ed853b-25a6-5af4-afc2-4c9b6f8210ee_image_7.jpg HTTP/1.1" 201 0
2026-03-25 16:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj9%252F58500f54b0e64f9c8a573a8cc9ab2e77%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj9/58500f54b0e64f9c8a573a8cc9ab2e77/images/large/8.jpg saved to cache
2026-03-25 16:31:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 45ed853b-25a6-5af4-afc2-4c9b6f8210ee
2026-03-25 16:31:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc302550>
2026-03-25 16:31:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ebeabe6b-950d-5cfc-a056-e46d82352ba1/ebeabe6b-950d-5cfc-a056-e46d82352ba1_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk7%252F60ebaa7fe8c540359e0822b23b3a264e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk7/60ebaa7fe8c540359e0822b23b3a264e/images/large/1.jpg saved to cache
2026-03-25 16:31:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ebeabe6b-950d-5cfc-a056-e46d82352ba1
2026-03-25 16:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm1%252F492184fd70884deea40c7b73c7b31fbf%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm1/492184fd70884deea40c7b73c7b31fbf/images/large/3.jpg not downloaded yet
2026-03-25 16:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm1%252F492184fd70884deea40c7b73c7b31fbf%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm1/492184fd70884deea40c7b73c7b31fbf/images/large/4.jpg not downloaded yet
2026-03-25 16:31:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk7/60ebaa7fe8c540359e0822b23b3a264e/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm1%252F492184fd70884deea40c7b73c7b31fbf%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm1/492184fd70884deea40c7b73c7b31fbf/images/large/5.jpg not downloaded yet
2026-03-25 16:31:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm2/e029dc1663e944dba28903fe885c6924/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk7/60ebaa7fe8c540359e0822b23b3a264e/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm1%252F492184fd70884deea40c7b73c7b31fbf%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm1/492184fd70884deea40c7b73c7b31fbf/images/large/6.jpg not downloaded yet
2026-03-25 16:31:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm2/e029dc1663e944dba28903fe885c6924/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm2/e029dc1663e944dba28903fe885c6924/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm2/e029dc1663e944dba28903fe885c6924/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm2/e029dc1663e944dba28903fe885c6924/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm1%252F492184fd70884deea40c7b73c7b31fbf%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm1/492184fd70884deea40c7b73c7b31fbf/images/large/7.jpg not downloaded yet
2026-03-25 16:31:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm4/9b4b55c1b7ee46d697d2b2fe00705b84/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm1%252F492184fd70884deea40c7b73c7b31fbf%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm1/492184fd70884deea40c7b73c7b31fbf/images/large/8.jpg not downloaded yet
2026-03-25 16:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm1%252F492184fd70884deea40c7b73c7b31fbf%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm1/492184fd70884deea40c7b73c7b31fbf/images/large/9.jpg not downloaded yet
2026-03-25 16:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm1%252F492184fd70884deea40c7b73c7b31fbf%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm1/492184fd70884deea40c7b73c7b31fbf/images/large/10.jpg not downloaded yet
2026-03-25 16:31:19 [ayvens.it] INFO: Found listing with ID: 1983546
2026-03-25 16:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983546%27 HTTP/1.1" 200 None
2026-03-25 16:31:19 [ayvens.it] INFO: Scrape type for 1983546: 1
2026-03-25 16:31:19 [ayvens.it] INFO: Extracting data for car ID: 1983546
2026-03-25 16:31:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f12ed7e7-f76c-5668-84c9-19e1fefd4177 with identifier: 1983546
2026-03-25 16:31:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f12ed7e7-f76c-5668-84c9-19e1fefd4177 with scrape type 1
2026-03-25 16:31:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f12ed7e7-f76c-5668-84c9-19e1fefd4177
2026-03-25 16:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp0%252Fe3e09c04425f4cd7b932ca3a8a47e10c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp0/e3e09c04425f4cd7b932ca3a8a47e10c/images/large/1.jpg not downloaded yet
2026-03-25 16:31:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc60cbd0>
2026-03-25 16:31:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ebeabe6b-950d-5cfc-a056-e46d82352ba1/ebeabe6b-950d-5cfc-a056-e46d82352ba1_image_6.jpg HTTP/1.1" 201 0
2026-03-25 16:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk7%252F60ebaa7fe8c540359e0822b23b3a264e%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk7/60ebaa7fe8c540359e0822b23b3a264e/images/large/7.jpg saved to cache
2026-03-25 16:31:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ebeabe6b-950d-5cfc-a056-e46d82352ba1
2026-03-25 16:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp0%252Fe3e09c04425f4cd7b932ca3a8a47e10c%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp0/e3e09c04425f4cd7b932ca3a8a47e10c/images/large/2.jpg not downloaded yet
2026-03-25 16:31:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc5b65d0>
2026-03-25 16:31:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e19f760-9e22-5009-a59c-17be54bc2a87/8e19f760-9e22-5009-a59c-17be54bc2a87_image_9.jpg HTTP/1.1" 201 0
2026-03-25 16:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm2%252Fe029dc1663e944dba28903fe885c6924%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm2/e029dc1663e944dba28903fe885c6924/images/large/10.jpg saved to cache
2026-03-25 16:31:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8e19f760-9e22-5009-a59c-17be54bc2a87
2026-03-25 16:31:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc37c2d0>
2026-03-25 16:31:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ebeabe6b-950d-5cfc-a056-e46d82352ba1/ebeabe6b-950d-5cfc-a056-e46d82352ba1_image_7.jpg HTTP/1.1" 201 0
2026-03-25 16:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk7%252F60ebaa7fe8c540359e0822b23b3a264e%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk7/60ebaa7fe8c540359e0822b23b3a264e/images/large/8.jpg saved to cache
2026-03-25 16:31:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ebeabe6b-950d-5cfc-a056-e46d82352ba1
2026-03-25 16:31:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc91d3d0>
2026-03-25 16:31:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e19f760-9e22-5009-a59c-17be54bc2a87/8e19f760-9e22-5009-a59c-17be54bc2a87_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm2%252Fe029dc1663e944dba28903fe885c6924%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm2/e029dc1663e944dba28903fe885c6924/images/large/1.jpg saved to cache
2026-03-25 16:31:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8e19f760-9e22-5009-a59c-17be54bc2a87
2026-03-25 16:31:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc7d1050>
2026-03-25 16:31:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e19f760-9e22-5009-a59c-17be54bc2a87/8e19f760-9e22-5009-a59c-17be54bc2a87_image_2.jpg HTTP/1.1" 201 0
2026-03-25 16:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm2%252Fe029dc1663e944dba28903fe885c6924%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm2/e029dc1663e944dba28903fe885c6924/images/large/3.jpg saved to cache
2026-03-25 16:31:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8e19f760-9e22-5009-a59c-17be54bc2a87
2026-03-25 16:31:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc585890>
2026-03-25 16:31:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e19f760-9e22-5009-a59c-17be54bc2a87/8e19f760-9e22-5009-a59c-17be54bc2a87_image_3.jpg HTTP/1.1" 201 0
2026-03-25 16:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm2%252Fe029dc1663e944dba28903fe885c6924%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm2/e029dc1663e944dba28903fe885c6924/images/large/4.jpg saved to cache
2026-03-25 16:31:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8e19f760-9e22-5009-a59c-17be54bc2a87
2026-03-25 16:31:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcac80d0>
2026-03-25 16:31:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e19f760-9e22-5009-a59c-17be54bc2a87/8e19f760-9e22-5009-a59c-17be54bc2a87_image_1.jpg HTTP/1.1" 201 0
2026-03-25 16:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm2%252Fe029dc1663e944dba28903fe885c6924%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm2/e029dc1663e944dba28903fe885c6924/images/large/2.jpg saved to cache
2026-03-25 16:31:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8e19f760-9e22-5009-a59c-17be54bc2a87
2026-03-25 16:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp0%252Fe3e09c04425f4cd7b932ca3a8a47e10c%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp0/e3e09c04425f4cd7b932ca3a8a47e10c/images/large/3.jpg not downloaded yet
2026-03-25 16:31:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcae8fd0>
2026-03-25 16:31:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_edf771e6-c374-5dcf-8d7b-3b45762549ba/edf771e6-c374-5dcf-8d7b-3b45762549ba_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm4%252F9b4b55c1b7ee46d697d2b2fe00705b84%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm4/9b4b55c1b7ee46d697d2b2fe00705b84/images/large/1.jpg saved to cache
2026-03-25 16:31:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item edf771e6-c374-5dcf-8d7b-3b45762549ba
2026-03-25 16:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp0%252Fe3e09c04425f4cd7b932ca3a8a47e10c%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp0/e3e09c04425f4cd7b932ca3a8a47e10c/images/large/4.jpg not downloaded yet
2026-03-25 16:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp0%252Fe3e09c04425f4cd7b932ca3a8a47e10c%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp0/e3e09c04425f4cd7b932ca3a8a47e10c/images/large/5.jpg not downloaded yet
2026-03-25 16:31:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm2/e029dc1663e944dba28903fe885c6924/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp0%252Fe3e09c04425f4cd7b932ca3a8a47e10c%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp0/e3e09c04425f4cd7b932ca3a8a47e10c/images/large/6.jpg not downloaded yet
2026-03-25 16:31:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm2/e029dc1663e944dba28903fe885c6924/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm2/e029dc1663e944dba28903fe885c6924/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp0%252Fe3e09c04425f4cd7b932ca3a8a47e10c%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp0/e3e09c04425f4cd7b932ca3a8a47e10c/images/large/7.jpg not downloaded yet
2026-03-25 16:31:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm2/e029dc1663e944dba28903fe885c6924/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp0%252Fe3e09c04425f4cd7b932ca3a8a47e10c%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp0/e3e09c04425f4cd7b932ca3a8a47e10c/images/large/8.jpg not downloaded yet
2026-03-25 16:31:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm4/9b4b55c1b7ee46d697d2b2fe00705b84/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm4/9b4b55c1b7ee46d697d2b2fe00705b84/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm4/9b4b55c1b7ee46d697d2b2fe00705b84/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm4/9b4b55c1b7ee46d697d2b2fe00705b84/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp0%252Fe3e09c04425f4cd7b932ca3a8a47e10c%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp0/e3e09c04425f4cd7b932ca3a8a47e10c/images/large/9.jpg not downloaded yet
2026-03-25 16:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp0%252Fe3e09c04425f4cd7b932ca3a8a47e10c%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp0/e3e09c04425f4cd7b932ca3a8a47e10c/images/large/10.jpg not downloaded yet
2026-03-25 16:31:20 [ayvens.it] INFO: Found listing with ID: 1983547
2026-03-25 16:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983547%27 HTTP/1.1" 200 None
2026-03-25 16:31:20 [ayvens.it] INFO: Scrape type for 1983547: 1
2026-03-25 16:31:20 [ayvens.it] INFO: Extracting data for car ID: 1983547
2026-03-25 16:31:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2e0240b9-2b81-5e3a-83e1-95c8245fc12a with identifier: 1983547
2026-03-25 16:31:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2e0240b9-2b81-5e3a-83e1-95c8245fc12a with scrape type 1
2026-03-25 16:31:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2e0240b9-2b81-5e3a-83e1-95c8245fc12a
2026-03-25 16:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn8%252F88fd3b1ede7e4fa8bb1169b65fdc21c5%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn8/88fd3b1ede7e4fa8bb1169b65fdc21c5/images/large/1.jpg not downloaded yet
2026-03-25 16:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn8%252F88fd3b1ede7e4fa8bb1169b65fdc21c5%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn8/88fd3b1ede7e4fa8bb1169b65fdc21c5/images/large/2.jpg not downloaded yet
2026-03-25 16:31:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcaebd90>
2026-03-25 16:31:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e19f760-9e22-5009-a59c-17be54bc2a87/8e19f760-9e22-5009-a59c-17be54bc2a87_image_7.jpg HTTP/1.1" 201 0
2026-03-25 16:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm2%252Fe029dc1663e944dba28903fe885c6924%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm2/e029dc1663e944dba28903fe885c6924/images/large/8.jpg saved to cache
2026-03-25 16:31:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8e19f760-9e22-5009-a59c-17be54bc2a87
2026-03-25 16:31:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc94f990>
2026-03-25 16:31:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e19f760-9e22-5009-a59c-17be54bc2a87/8e19f760-9e22-5009-a59c-17be54bc2a87_image_6.jpg HTTP/1.1" 201 0
2026-03-25 16:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm2%252Fe029dc1663e944dba28903fe885c6924%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm2/e029dc1663e944dba28903fe885c6924/images/large/7.jpg saved to cache
2026-03-25 16:31:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8e19f760-9e22-5009-a59c-17be54bc2a87
2026-03-25 16:31:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc976210>
2026-03-25 16:31:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e19f760-9e22-5009-a59c-17be54bc2a87/8e19f760-9e22-5009-a59c-17be54bc2a87_image_5.jpg HTTP/1.1" 201 0
2026-03-25 16:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm2%252Fe029dc1663e944dba28903fe885c6924%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm2/e029dc1663e944dba28903fe885c6924/images/large/6.jpg saved to cache
2026-03-25 16:31:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8e19f760-9e22-5009-a59c-17be54bc2a87
2026-03-25 16:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn8%252F88fd3b1ede7e4fa8bb1169b65fdc21c5%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn8/88fd3b1ede7e4fa8bb1169b65fdc21c5/images/large/3.jpg not downloaded yet
2026-03-25 16:31:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc802e50>
2026-03-25 16:31:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e19f760-9e22-5009-a59c-17be54bc2a87/8e19f760-9e22-5009-a59c-17be54bc2a87_image_8.jpg HTTP/1.1" 201 0
2026-03-25 16:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm2%252Fe029dc1663e944dba28903fe885c6924%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm2/e029dc1663e944dba28903fe885c6924/images/large/9.jpg saved to cache
2026-03-25 16:31:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8e19f760-9e22-5009-a59c-17be54bc2a87
2026-03-25 16:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn8%252F88fd3b1ede7e4fa8bb1169b65fdc21c5%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn8/88fd3b1ede7e4fa8bb1169b65fdc21c5/images/large/4.jpg not downloaded yet
2026-03-25 16:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn8%252F88fd3b1ede7e4fa8bb1169b65fdc21c5%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn8/88fd3b1ede7e4fa8bb1169b65fdc21c5/images/large/5.jpg not downloaded yet
2026-03-25 16:31:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc7109d0>
2026-03-25 16:31:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_edf771e6-c374-5dcf-8d7b-3b45762549ba/edf771e6-c374-5dcf-8d7b-3b45762549ba_image_1.jpg HTTP/1.1" 201 0
2026-03-25 16:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm4%252F9b4b55c1b7ee46d697d2b2fe00705b84%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm4/9b4b55c1b7ee46d697d2b2fe00705b84/images/large/2.jpg saved to cache
2026-03-25 16:31:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item edf771e6-c374-5dcf-8d7b-3b45762549ba
2026-03-25 16:31:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc35b490>
2026-03-25 16:31:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_edf771e6-c374-5dcf-8d7b-3b45762549ba/edf771e6-c374-5dcf-8d7b-3b45762549ba_image_2.jpg HTTP/1.1" 201 0
2026-03-25 16:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm4%252F9b4b55c1b7ee46d697d2b2fe00705b84%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm4/9b4b55c1b7ee46d697d2b2fe00705b84/images/large/3.jpg saved to cache
2026-03-25 16:31:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item edf771e6-c374-5dcf-8d7b-3b45762549ba
2026-03-25 16:31:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc94fed0>
2026-03-25 16:31:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_edf771e6-c374-5dcf-8d7b-3b45762549ba/edf771e6-c374-5dcf-8d7b-3b45762549ba_image_3.jpg HTTP/1.1" 201 0
2026-03-25 16:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm4%252F9b4b55c1b7ee46d697d2b2fe00705b84%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm4/9b4b55c1b7ee46d697d2b2fe00705b84/images/large/4.jpg saved to cache
2026-03-25 16:31:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item edf771e6-c374-5dcf-8d7b-3b45762549ba
2026-03-25 16:31:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dccfb390>
2026-03-25 16:31:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_edf771e6-c374-5dcf-8d7b-3b45762549ba/edf771e6-c374-5dcf-8d7b-3b45762549ba_image_4.jpg HTTP/1.1" 201 0
2026-03-25 16:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm4%252F9b4b55c1b7ee46d697d2b2fe00705b84%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm4/9b4b55c1b7ee46d697d2b2fe00705b84/images/large/5.jpg saved to cache
2026-03-25 16:31:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item edf771e6-c374-5dcf-8d7b-3b45762549ba
2026-03-25 16:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn8%252F88fd3b1ede7e4fa8bb1169b65fdc21c5%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn8/88fd3b1ede7e4fa8bb1169b65fdc21c5/images/large/6.jpg not downloaded yet
2026-03-25 16:31:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm1/492184fd70884deea40c7b73c7b31fbf/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn8%252F88fd3b1ede7e4fa8bb1169b65fdc21c5%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn8/88fd3b1ede7e4fa8bb1169b65fdc21c5/images/large/7.jpg not downloaded yet
2026-03-25 16:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn8%252F88fd3b1ede7e4fa8bb1169b65fdc21c5%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn8/88fd3b1ede7e4fa8bb1169b65fdc21c5/images/large/8.jpg not downloaded yet
2026-03-25 16:31:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm1/492184fd70884deea40c7b73c7b31fbf/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm1/492184fd70884deea40c7b73c7b31fbf/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm1/492184fd70884deea40c7b73c7b31fbf/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm1/492184fd70884deea40c7b73c7b31fbf/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn8%252F88fd3b1ede7e4fa8bb1169b65fdc21c5%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn8/88fd3b1ede7e4fa8bb1169b65fdc21c5/images/large/9.jpg not downloaded yet
2026-03-25 16:31:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp0/e3e09c04425f4cd7b932ca3a8a47e10c/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp0/e3e09c04425f4cd7b932ca3a8a47e10c/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp0/e3e09c04425f4cd7b932ca3a8a47e10c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn8%252F88fd3b1ede7e4fa8bb1169b65fdc21c5%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn8/88fd3b1ede7e4fa8bb1169b65fdc21c5/images/large/10.jpg not downloaded yet
2026-03-25 16:31:21 [ayvens.it] INFO: Found listing with ID: 1983548
2026-03-25 16:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983548%27 HTTP/1.1" 200 None
2026-03-25 16:31:21 [ayvens.it] INFO: Scrape type for 1983548: 1
2026-03-25 16:31:21 [ayvens.it] INFO: Extracting data for car ID: 1983548
2026-03-25 16:31:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6e915404-e4de-507a-a713-54551d22ce60 with identifier: 1983548
2026-03-25 16:31:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6e915404-e4de-507a-a713-54551d22ce60 with scrape type 1
2026-03-25 16:31:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6e915404-e4de-507a-a713-54551d22ce60
2026-03-25 16:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm4%252F90aca1a734f447d79694e0f72f0a3520%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm4/90aca1a734f447d79694e0f72f0a3520/images/large/1.jpg not downloaded yet
2026-03-25 16:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm4%252F90aca1a734f447d79694e0f72f0a3520%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm4/90aca1a734f447d79694e0f72f0a3520/images/large/2.jpg not downloaded yet
2026-03-25 16:31:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc7fabd0>
2026-03-25 16:31:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0945dfc6-2df7-5464-9f57-8072d914912d/0945dfc6-2df7-5464-9f57-8072d914912d_image_2.jpg HTTP/1.1" 201 0
2026-03-25 16:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm1%252F492184fd70884deea40c7b73c7b31fbf%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm1/492184fd70884deea40c7b73c7b31fbf/images/large/3.jpg saved to cache
2026-03-25 16:31:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0945dfc6-2df7-5464-9f57-8072d914912d
2026-03-25 16:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm4%252F90aca1a734f447d79694e0f72f0a3520%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm4/90aca1a734f447d79694e0f72f0a3520/images/large/3.jpg not downloaded yet
2026-03-25 16:31:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc9b8c90>
2026-03-25 16:31:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0945dfc6-2df7-5464-9f57-8072d914912d/0945dfc6-2df7-5464-9f57-8072d914912d_image_3.jpg HTTP/1.1" 201 0
2026-03-25 16:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm1%252F492184fd70884deea40c7b73c7b31fbf%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm1/492184fd70884deea40c7b73c7b31fbf/images/large/4.jpg saved to cache
2026-03-25 16:31:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0945dfc6-2df7-5464-9f57-8072d914912d
2026-03-25 16:31:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc7fa290>
2026-03-25 16:31:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0945dfc6-2df7-5464-9f57-8072d914912d/0945dfc6-2df7-5464-9f57-8072d914912d_image_9.jpg HTTP/1.1" 201 0
2026-03-25 16:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm1%252F492184fd70884deea40c7b73c7b31fbf%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm1/492184fd70884deea40c7b73c7b31fbf/images/large/10.jpg saved to cache
2026-03-25 16:31:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0945dfc6-2df7-5464-9f57-8072d914912d
2026-03-25 16:31:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc968f10>
2026-03-25 16:31:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0945dfc6-2df7-5464-9f57-8072d914912d/0945dfc6-2df7-5464-9f57-8072d914912d_image_1.jpg HTTP/1.1" 201 0
2026-03-25 16:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm1%252F492184fd70884deea40c7b73c7b31fbf%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm1/492184fd70884deea40c7b73c7b31fbf/images/large/2.jpg saved to cache
2026-03-25 16:31:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0945dfc6-2df7-5464-9f57-8072d914912d
2026-03-25 16:31:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dca619d0>
2026-03-25 16:31:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0945dfc6-2df7-5464-9f57-8072d914912d/0945dfc6-2df7-5464-9f57-8072d914912d_image_8.jpg HTTP/1.1" 201 0
2026-03-25 16:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm1%252F492184fd70884deea40c7b73c7b31fbf%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm1/492184fd70884deea40c7b73c7b31fbf/images/large/9.jpg saved to cache
2026-03-25 16:31:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0945dfc6-2df7-5464-9f57-8072d914912d
2026-03-25 16:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm4%252F90aca1a734f447d79694e0f72f0a3520%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm4/90aca1a734f447d79694e0f72f0a3520/images/large/4.jpg not downloaded yet
2026-03-25 16:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm4%252F90aca1a734f447d79694e0f72f0a3520%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm4/90aca1a734f447d79694e0f72f0a3520/images/large/5.jpg not downloaded yet
2026-03-25 16:31:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc54e7d0>
2026-03-25 16:31:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f12ed7e7-f76c-5668-84c9-19e1fefd4177/f12ed7e7-f76c-5668-84c9-19e1fefd4177_image_1.jpg HTTP/1.1" 201 0
2026-03-25 16:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp0%252Fe3e09c04425f4cd7b932ca3a8a47e10c%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp0/e3e09c04425f4cd7b932ca3a8a47e10c/images/large/2.jpg saved to cache
2026-03-25 16:31:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f12ed7e7-f76c-5668-84c9-19e1fefd4177
2026-03-25 16:31:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc8005d0>
2026-03-25 16:31:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f12ed7e7-f76c-5668-84c9-19e1fefd4177/f12ed7e7-f76c-5668-84c9-19e1fefd4177_image_2.jpg HTTP/1.1" 201 0
2026-03-25 16:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp0%252Fe3e09c04425f4cd7b932ca3a8a47e10c%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp0/e3e09c04425f4cd7b932ca3a8a47e10c/images/large/3.jpg saved to cache
2026-03-25 16:31:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f12ed7e7-f76c-5668-84c9-19e1fefd4177
2026-03-25 16:31:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc5bcd90>
2026-03-25 16:31:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f12ed7e7-f76c-5668-84c9-19e1fefd4177/f12ed7e7-f76c-5668-84c9-19e1fefd4177_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp0%252Fe3e09c04425f4cd7b932ca3a8a47e10c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp0/e3e09c04425f4cd7b932ca3a8a47e10c/images/large/1.jpg saved to cache
2026-03-25 16:31:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f12ed7e7-f76c-5668-84c9-19e1fefd4177
2026-03-25 16:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm4%252F90aca1a734f447d79694e0f72f0a3520%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm4/90aca1a734f447d79694e0f72f0a3520/images/large/6.jpg not downloaded yet
2026-03-25 16:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm4%252F90aca1a734f447d79694e0f72f0a3520%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm4/90aca1a734f447d79694e0f72f0a3520/images/large/7.jpg not downloaded yet
2026-03-25 16:31:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm1/492184fd70884deea40c7b73c7b31fbf/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm4%252F90aca1a734f447d79694e0f72f0a3520%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm4/90aca1a734f447d79694e0f72f0a3520/images/large/8.jpg not downloaded yet
2026-03-25 16:31:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp0/e3e09c04425f4cd7b932ca3a8a47e10c/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn8/88fd3b1ede7e4fa8bb1169b65fdc21c5/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm4%252F90aca1a734f447d79694e0f72f0a3520%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm4/90aca1a734f447d79694e0f72f0a3520/images/large/9.jpg not downloaded yet
2026-03-25 16:31:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp0/e3e09c04425f4cd7b932ca3a8a47e10c/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn8/88fd3b1ede7e4fa8bb1169b65fdc21c5/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp0/e3e09c04425f4cd7b932ca3a8a47e10c/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm4%252F90aca1a734f447d79694e0f72f0a3520%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm4/90aca1a734f447d79694e0f72f0a3520/images/large/10.jpg not downloaded yet
2026-03-25 16:31:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn8/88fd3b1ede7e4fa8bb1169b65fdc21c5/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:22 [ayvens.it] INFO: Found listing with ID: 1983549
2026-03-25 16:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983549%27 HTTP/1.1" 200 None
2026-03-25 16:31:22 [ayvens.it] INFO: Scrape type for 1983549: 1
2026-03-25 16:31:22 [ayvens.it] INFO: Extracting data for car ID: 1983549
2026-03-25 16:31:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9b2ea2df-f838-5481-a106-6d9ac9d2c5e0 with identifier: 1983549
2026-03-25 16:31:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9b2ea2df-f838-5481-a106-6d9ac9d2c5e0 with scrape type 1
2026-03-25 16:31:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9b2ea2df-f838-5481-a106-6d9ac9d2c5e0
2026-03-25 16:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm8%252Fa3aa348e0b7d463b82807353dc557162%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm8/a3aa348e0b7d463b82807353dc557162/images/large/1.jpg not downloaded yet
2026-03-25 16:31:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp0/e3e09c04425f4cd7b932ca3a8a47e10c/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm8%252Fa3aa348e0b7d463b82807353dc557162%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm8/a3aa348e0b7d463b82807353dc557162/images/large/2.jpg not downloaded yet
2026-03-25 16:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm8%252Fa3aa348e0b7d463b82807353dc557162%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm8/a3aa348e0b7d463b82807353dc557162/images/large/3.jpg not downloaded yet
2026-03-25 16:31:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc37e150>
2026-03-25 16:31:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0945dfc6-2df7-5464-9f57-8072d914912d/0945dfc6-2df7-5464-9f57-8072d914912d_image_7.jpg HTTP/1.1" 201 0
2026-03-25 16:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm1%252F492184fd70884deea40c7b73c7b31fbf%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm1/492184fd70884deea40c7b73c7b31fbf/images/large/8.jpg saved to cache
2026-03-25 16:31:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0945dfc6-2df7-5464-9f57-8072d914912d
2026-03-25 16:31:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc94f190>
2026-03-25 16:31:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f12ed7e7-f76c-5668-84c9-19e1fefd4177/f12ed7e7-f76c-5668-84c9-19e1fefd4177_image_3.jpg HTTP/1.1" 201 0
2026-03-25 16:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp0%252Fe3e09c04425f4cd7b932ca3a8a47e10c%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp0/e3e09c04425f4cd7b932ca3a8a47e10c/images/large/4.jpg saved to cache
2026-03-25 16:31:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f12ed7e7-f76c-5668-84c9-19e1fefd4177
2026-03-25 16:31:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dca06c50>
2026-03-25 16:31:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e0240b9-2b81-5e3a-83e1-95c8245fc12a/2e0240b9-2b81-5e3a-83e1-95c8245fc12a_image_1.jpg HTTP/1.1" 201 0
2026-03-25 16:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn8%252F88fd3b1ede7e4fa8bb1169b65fdc21c5%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn8/88fd3b1ede7e4fa8bb1169b65fdc21c5/images/large/2.jpg saved to cache
2026-03-25 16:31:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2e0240b9-2b81-5e3a-83e1-95c8245fc12a
2026-03-25 16:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm8%252Fa3aa348e0b7d463b82807353dc557162%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm8/a3aa348e0b7d463b82807353dc557162/images/large/4.jpg not downloaded yet
2026-03-25 16:31:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc5a0510>
2026-03-25 16:31:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f12ed7e7-f76c-5668-84c9-19e1fefd4177/f12ed7e7-f76c-5668-84c9-19e1fefd4177_image_4.jpg HTTP/1.1" 201 0
2026-03-25 16:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp0%252Fe3e09c04425f4cd7b932ca3a8a47e10c%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp0/e3e09c04425f4cd7b932ca3a8a47e10c/images/large/5.jpg saved to cache
2026-03-25 16:31:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f12ed7e7-f76c-5668-84c9-19e1fefd4177
2026-03-25 16:31:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34d7442490>
2026-03-25 16:31:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e0240b9-2b81-5e3a-83e1-95c8245fc12a/2e0240b9-2b81-5e3a-83e1-95c8245fc12a_image_2.jpg HTTP/1.1" 201 0
2026-03-25 16:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn8%252F88fd3b1ede7e4fa8bb1169b65fdc21c5%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn8/88fd3b1ede7e4fa8bb1169b65fdc21c5/images/large/3.jpg saved to cache
2026-03-25 16:31:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2e0240b9-2b81-5e3a-83e1-95c8245fc12a
2026-03-25 16:31:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc5a2810>
2026-03-25 16:31:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f12ed7e7-f76c-5668-84c9-19e1fefd4177/f12ed7e7-f76c-5668-84c9-19e1fefd4177_image_5.jpg HTTP/1.1" 201 0
2026-03-25 16:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp0%252Fe3e09c04425f4cd7b932ca3a8a47e10c%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp0/e3e09c04425f4cd7b932ca3a8a47e10c/images/large/6.jpg saved to cache
2026-03-25 16:31:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f12ed7e7-f76c-5668-84c9-19e1fefd4177
2026-03-25 16:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm8%252Fa3aa348e0b7d463b82807353dc557162%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm8/a3aa348e0b7d463b82807353dc557162/images/large/5.jpg not downloaded yet
2026-03-25 16:31:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dca18c10>
2026-03-25 16:31:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e0240b9-2b81-5e3a-83e1-95c8245fc12a/2e0240b9-2b81-5e3a-83e1-95c8245fc12a_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn8%252F88fd3b1ede7e4fa8bb1169b65fdc21c5%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn8/88fd3b1ede7e4fa8bb1169b65fdc21c5/images/large/1.jpg saved to cache
2026-03-25 16:31:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2e0240b9-2b81-5e3a-83e1-95c8245fc12a
2026-03-25 16:31:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc548450>
2026-03-25 16:31:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f12ed7e7-f76c-5668-84c9-19e1fefd4177/f12ed7e7-f76c-5668-84c9-19e1fefd4177_image_6.jpg HTTP/1.1" 201 0
2026-03-25 16:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp0%252Fe3e09c04425f4cd7b932ca3a8a47e10c%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp0/e3e09c04425f4cd7b932ca3a8a47e10c/images/large/7.jpg saved to cache
2026-03-25 16:31:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f12ed7e7-f76c-5668-84c9-19e1fefd4177
2026-03-25 16:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm8%252Fa3aa348e0b7d463b82807353dc557162%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm8/a3aa348e0b7d463b82807353dc557162/images/large/6.jpg not downloaded yet
2026-03-25 16:31:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn8/88fd3b1ede7e4fa8bb1169b65fdc21c5/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm4/90aca1a734f447d79694e0f72f0a3520/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm8%252Fa3aa348e0b7d463b82807353dc557162%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm8/a3aa348e0b7d463b82807353dc557162/images/large/7.jpg not downloaded yet
2026-03-25 16:31:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm4/90aca1a734f447d79694e0f72f0a3520/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn8/88fd3b1ede7e4fa8bb1169b65fdc21c5/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn8/88fd3b1ede7e4fa8bb1169b65fdc21c5/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm4/90aca1a734f447d79694e0f72f0a3520/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm4/90aca1a734f447d79694e0f72f0a3520/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm8%252Fa3aa348e0b7d463b82807353dc557162%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm8/a3aa348e0b7d463b82807353dc557162/images/large/8.jpg not downloaded yet
2026-03-25 16:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm8%252Fa3aa348e0b7d463b82807353dc557162%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm8/a3aa348e0b7d463b82807353dc557162/images/large/9.jpg not downloaded yet
2026-03-25 16:31:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn8/88fd3b1ede7e4fa8bb1169b65fdc21c5/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm8%252Fa3aa348e0b7d463b82807353dc557162%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm8/a3aa348e0b7d463b82807353dc557162/images/large/10.jpg not downloaded yet
2026-03-25 16:31:23 [ayvens.it] INFO: Found listing with ID: 1983550
2026-03-25 16:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983550%27 HTTP/1.1" 200 None
2026-03-25 16:31:23 [ayvens.it] INFO: Scrape type for 1983550: 1
2026-03-25 16:31:23 [ayvens.it] INFO: Extracting data for car ID: 1983550
2026-03-25 16:31:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ab9566c9-ba37-51f3-aeee-fcee63a4c9f1 with identifier: 1983550
2026-03-25 16:31:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ab9566c9-ba37-51f3-aeee-fcee63a4c9f1 with scrape type 1
2026-03-25 16:31:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ab9566c9-ba37-51f3-aeee-fcee63a4c9f1
2026-03-25 16:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn6%252F7da59e16a43d4560a3163c12f9ee3b49%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn6/7da59e16a43d4560a3163c12f9ee3b49/images/large/1.jpg not downloaded yet
2026-03-25 16:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn6%252F7da59e16a43d4560a3163c12f9ee3b49%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn6/7da59e16a43d4560a3163c12f9ee3b49/images/large/2.jpg not downloaded yet
2026-03-25 16:31:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcc1a050>
2026-03-25 16:31:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e0240b9-2b81-5e3a-83e1-95c8245fc12a/2e0240b9-2b81-5e3a-83e1-95c8245fc12a_image_6.jpg HTTP/1.1" 201 0
2026-03-25 16:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn8%252F88fd3b1ede7e4fa8bb1169b65fdc21c5%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn8/88fd3b1ede7e4fa8bb1169b65fdc21c5/images/large/7.jpg saved to cache
2026-03-25 16:31:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2e0240b9-2b81-5e3a-83e1-95c8245fc12a
2026-03-25 16:31:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc7df050>
2026-03-25 16:31:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e915404-e4de-507a-a713-54551d22ce60/6e915404-e4de-507a-a713-54551d22ce60_image_3.jpg HTTP/1.1" 201 0
2026-03-25 16:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm4%252F90aca1a734f447d79694e0f72f0a3520%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm4/90aca1a734f447d79694e0f72f0a3520/images/large/4.jpg saved to cache
2026-03-25 16:31:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6e915404-e4de-507a-a713-54551d22ce60
2026-03-25 16:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn6%252F7da59e16a43d4560a3163c12f9ee3b49%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn6/7da59e16a43d4560a3163c12f9ee3b49/images/large/3.jpg not downloaded yet
2026-03-25 16:31:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcb2d3d0>
2026-03-25 16:31:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e915404-e4de-507a-a713-54551d22ce60/6e915404-e4de-507a-a713-54551d22ce60_image_2.jpg HTTP/1.1" 201 0
2026-03-25 16:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm4%252F90aca1a734f447d79694e0f72f0a3520%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm4/90aca1a734f447d79694e0f72f0a3520/images/large/3.jpg saved to cache
2026-03-25 16:31:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6e915404-e4de-507a-a713-54551d22ce60
2026-03-25 16:31:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc549150>
2026-03-25 16:31:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e0240b9-2b81-5e3a-83e1-95c8245fc12a/2e0240b9-2b81-5e3a-83e1-95c8245fc12a_image_5.jpg HTTP/1.1" 201 0
2026-03-25 16:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn8%252F88fd3b1ede7e4fa8bb1169b65fdc21c5%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn8/88fd3b1ede7e4fa8bb1169b65fdc21c5/images/large/6.jpg saved to cache
2026-03-25 16:31:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2e0240b9-2b81-5e3a-83e1-95c8245fc12a
2026-03-25 16:31:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc593750>
2026-03-25 16:31:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e0240b9-2b81-5e3a-83e1-95c8245fc12a/2e0240b9-2b81-5e3a-83e1-95c8245fc12a_image_4.jpg HTTP/1.1" 201 0
2026-03-25 16:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn8%252F88fd3b1ede7e4fa8bb1169b65fdc21c5%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn8/88fd3b1ede7e4fa8bb1169b65fdc21c5/images/large/5.jpg saved to cache
2026-03-25 16:31:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2e0240b9-2b81-5e3a-83e1-95c8245fc12a
2026-03-25 16:31:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc64b3d0>
2026-03-25 16:31:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e915404-e4de-507a-a713-54551d22ce60/6e915404-e4de-507a-a713-54551d22ce60_image_1.jpg HTTP/1.1" 201 0
2026-03-25 16:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm4%252F90aca1a734f447d79694e0f72f0a3520%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm4/90aca1a734f447d79694e0f72f0a3520/images/large/2.jpg saved to cache
2026-03-25 16:31:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6e915404-e4de-507a-a713-54551d22ce60
2026-03-25 16:31:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc301950>
2026-03-25 16:31:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e915404-e4de-507a-a713-54551d22ce60/6e915404-e4de-507a-a713-54551d22ce60_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm4%252F90aca1a734f447d79694e0f72f0a3520%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm4/90aca1a734f447d79694e0f72f0a3520/images/large/1.jpg saved to cache
2026-03-25 16:31:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6e915404-e4de-507a-a713-54551d22ce60
2026-03-25 16:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn6%252F7da59e16a43d4560a3163c12f9ee3b49%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn6/7da59e16a43d4560a3163c12f9ee3b49/images/large/4.jpg not downloaded yet
2026-03-25 16:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn6%252F7da59e16a43d4560a3163c12f9ee3b49%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn6/7da59e16a43d4560a3163c12f9ee3b49/images/large/5.jpg not downloaded yet
2026-03-25 16:31:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc62a610>
2026-03-25 16:31:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e0240b9-2b81-5e3a-83e1-95c8245fc12a/2e0240b9-2b81-5e3a-83e1-95c8245fc12a_image_9.jpg HTTP/1.1" 201 0
2026-03-25 16:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn8%252F88fd3b1ede7e4fa8bb1169b65fdc21c5%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn8/88fd3b1ede7e4fa8bb1169b65fdc21c5/images/large/10.jpg saved to cache
2026-03-25 16:31:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2e0240b9-2b81-5e3a-83e1-95c8245fc12a
2026-03-25 16:31:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm4/90aca1a734f447d79694e0f72f0a3520/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn6%252F7da59e16a43d4560a3163c12f9ee3b49%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn6/7da59e16a43d4560a3163c12f9ee3b49/images/large/6.jpg not downloaded yet
2026-03-25 16:31:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm4/90aca1a734f447d79694e0f72f0a3520/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm4/90aca1a734f447d79694e0f72f0a3520/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm4/90aca1a734f447d79694e0f72f0a3520/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn6%252F7da59e16a43d4560a3163c12f9ee3b49%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn6/7da59e16a43d4560a3163c12f9ee3b49/images/large/7.jpg not downloaded yet
2026-03-25 16:31:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm4/90aca1a734f447d79694e0f72f0a3520/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn8/88fd3b1ede7e4fa8bb1169b65fdc21c5/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn6%252F7da59e16a43d4560a3163c12f9ee3b49%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn6/7da59e16a43d4560a3163c12f9ee3b49/images/large/8.jpg not downloaded yet
2026-03-25 16:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn6%252F7da59e16a43d4560a3163c12f9ee3b49%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn6/7da59e16a43d4560a3163c12f9ee3b49/images/large/9.jpg not downloaded yet
2026-03-25 16:31:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm8/a3aa348e0b7d463b82807353dc557162/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm8/a3aa348e0b7d463b82807353dc557162/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn6%252F7da59e16a43d4560a3163c12f9ee3b49%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn6/7da59e16a43d4560a3163c12f9ee3b49/images/large/10.jpg not downloaded yet
2026-03-25 16:31:24 [ayvens.it] INFO: Found listing with ID: 1983551
2026-03-25 16:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983551%27 HTTP/1.1" 200 None
2026-03-25 16:31:24 [ayvens.it] INFO: Scrape type for 1983551: 1
2026-03-25 16:31:24 [ayvens.it] INFO: Extracting data for car ID: 1983551
2026-03-25 16:31:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 67029932-5c3c-52b8-b2a5-bff35f6f92d7 with identifier: 1983551
2026-03-25 16:31:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 67029932-5c3c-52b8-b2a5-bff35f6f92d7 with scrape type 1
2026-03-25 16:31:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 67029932-5c3c-52b8-b2a5-bff35f6f92d7
2026-03-25 16:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm9%252Ffcb7b77677d0423bb0ec7424f8833a1f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm9/fcb7b77677d0423bb0ec7424f8833a1f/images/large/1.jpg not downloaded yet
2026-03-25 16:31:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc9459d0>
2026-03-25 16:31:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e915404-e4de-507a-a713-54551d22ce60/6e915404-e4de-507a-a713-54551d22ce60_image_5.jpg HTTP/1.1" 201 0
2026-03-25 16:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm4%252F90aca1a734f447d79694e0f72f0a3520%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm4/90aca1a734f447d79694e0f72f0a3520/images/large/6.jpg saved to cache
2026-03-25 16:31:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6e915404-e4de-507a-a713-54551d22ce60
2026-03-25 16:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm9%252Ffcb7b77677d0423bb0ec7424f8833a1f%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm9/fcb7b77677d0423bb0ec7424f8833a1f/images/large/2.jpg not downloaded yet
2026-03-25 16:31:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc38e5d0>
2026-03-25 16:31:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e915404-e4de-507a-a713-54551d22ce60/6e915404-e4de-507a-a713-54551d22ce60_image_4.jpg HTTP/1.1" 201 0
2026-03-25 16:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm4%252F90aca1a734f447d79694e0f72f0a3520%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm4/90aca1a734f447d79694e0f72f0a3520/images/large/5.jpg saved to cache
2026-03-25 16:31:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6e915404-e4de-507a-a713-54551d22ce60
2026-03-25 16:31:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc94ff50>
2026-03-25 16:31:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e915404-e4de-507a-a713-54551d22ce60/6e915404-e4de-507a-a713-54551d22ce60_image_6.jpg HTTP/1.1" 201 0
2026-03-25 16:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm4%252F90aca1a734f447d79694e0f72f0a3520%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm4/90aca1a734f447d79694e0f72f0a3520/images/large/7.jpg saved to cache
2026-03-25 16:31:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6e915404-e4de-507a-a713-54551d22ce60
2026-03-25 16:31:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcbe4250>
2026-03-25 16:31:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e915404-e4de-507a-a713-54551d22ce60/6e915404-e4de-507a-a713-54551d22ce60_image_8.jpg HTTP/1.1" 201 0
2026-03-25 16:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm4%252F90aca1a734f447d79694e0f72f0a3520%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm4/90aca1a734f447d79694e0f72f0a3520/images/large/9.jpg saved to cache
2026-03-25 16:31:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6e915404-e4de-507a-a713-54551d22ce60
2026-03-25 16:31:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc937890>
2026-03-25 16:31:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e915404-e4de-507a-a713-54551d22ce60/6e915404-e4de-507a-a713-54551d22ce60_image_7.jpg HTTP/1.1" 201 0
2026-03-25 16:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm4%252F90aca1a734f447d79694e0f72f0a3520%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm4/90aca1a734f447d79694e0f72f0a3520/images/large/8.jpg saved to cache
2026-03-25 16:31:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6e915404-e4de-507a-a713-54551d22ce60
2026-03-25 16:31:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc7f8e50>
2026-03-25 16:31:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e0240b9-2b81-5e3a-83e1-95c8245fc12a/2e0240b9-2b81-5e3a-83e1-95c8245fc12a_image_8.jpg HTTP/1.1" 201 0
2026-03-25 16:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn8%252F88fd3b1ede7e4fa8bb1169b65fdc21c5%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn8/88fd3b1ede7e4fa8bb1169b65fdc21c5/images/large/9.jpg saved to cache
2026-03-25 16:31:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2e0240b9-2b81-5e3a-83e1-95c8245fc12a
2026-03-25 16:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm9%252Ffcb7b77677d0423bb0ec7424f8833a1f%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm9/fcb7b77677d0423bb0ec7424f8833a1f/images/large/3.jpg not downloaded yet
2026-03-25 16:31:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcaa9210>
2026-03-25 16:31:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b2ea2df-f838-5481-a106-6d9ac9d2c5e0/9b2ea2df-f838-5481-a106-6d9ac9d2c5e0_image_2.jpg HTTP/1.1" 201 0
2026-03-25 16:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm8%252Fa3aa348e0b7d463b82807353dc557162%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm8/a3aa348e0b7d463b82807353dc557162/images/large/3.jpg saved to cache
2026-03-25 16:31:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9b2ea2df-f838-5481-a106-6d9ac9d2c5e0
2026-03-25 16:31:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc7d3550>
2026-03-25 16:31:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b2ea2df-f838-5481-a106-6d9ac9d2c5e0/9b2ea2df-f838-5481-a106-6d9ac9d2c5e0_image_1.jpg HTTP/1.1" 201 0
2026-03-25 16:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm8%252Fa3aa348e0b7d463b82807353dc557162%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm8/a3aa348e0b7d463b82807353dc557162/images/large/2.jpg saved to cache
2026-03-25 16:31:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9b2ea2df-f838-5481-a106-6d9ac9d2c5e0
2026-03-25 16:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm9%252Ffcb7b77677d0423bb0ec7424f8833a1f%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm9/fcb7b77677d0423bb0ec7424f8833a1f/images/large/4.jpg not downloaded yet
2026-03-25 16:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm9%252Ffcb7b77677d0423bb0ec7424f8833a1f%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm9/fcb7b77677d0423bb0ec7424f8833a1f/images/large/5.jpg not downloaded yet
2026-03-25 16:31:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm8/a3aa348e0b7d463b82807353dc557162/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm9%252Ffcb7b77677d0423bb0ec7424f8833a1f%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm9/fcb7b77677d0423bb0ec7424f8833a1f/images/large/6.jpg not downloaded yet
2026-03-25 16:31:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm8/a3aa348e0b7d463b82807353dc557162/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm4/90aca1a734f447d79694e0f72f0a3520/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn8/88fd3b1ede7e4fa8bb1169b65fdc21c5/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm9%252Ffcb7b77677d0423bb0ec7424f8833a1f%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm9/fcb7b77677d0423bb0ec7424f8833a1f/images/large/7.jpg not downloaded yet
2026-03-25 16:31:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm8/a3aa348e0b7d463b82807353dc557162/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm8/a3aa348e0b7d463b82807353dc557162/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm9%252Ffcb7b77677d0423bb0ec7424f8833a1f%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm9/fcb7b77677d0423bb0ec7424f8833a1f/images/large/8.jpg not downloaded yet
2026-03-25 16:31:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm8/a3aa348e0b7d463b82807353dc557162/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm8/a3aa348e0b7d463b82807353dc557162/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm9%252Ffcb7b77677d0423bb0ec7424f8833a1f%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm9/fcb7b77677d0423bb0ec7424f8833a1f/images/large/9.jpg not downloaded yet
2026-03-25 16:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm9%252Ffcb7b77677d0423bb0ec7424f8833a1f%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm9/fcb7b77677d0423bb0ec7424f8833a1f/images/large/10.jpg not downloaded yet
2026-03-25 16:31:25 [ayvens.it] INFO: Found listing with ID: 1983552
2026-03-25 16:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983552%27 HTTP/1.1" 200 None
2026-03-25 16:31:25 [ayvens.it] INFO: Scrape type for 1983552: 1
2026-03-25 16:31:25 [ayvens.it] INFO: Extracting data for car ID: 1983552
2026-03-25 16:31:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0e45ba86-9527-55fd-99cf-b982e9e8ced4 with identifier: 1983552
2026-03-25 16:31:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0e45ba86-9527-55fd-99cf-b982e9e8ced4 with scrape type 1
2026-03-25 16:31:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0e45ba86-9527-55fd-99cf-b982e9e8ced4
2026-03-25 16:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm9%252F1b2c6b582192417c92b4c317c4a517b9%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm9/1b2c6b582192417c92b4c317c4a517b9/images/large/1.jpg not downloaded yet
2026-03-25 16:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm9%252F1b2c6b582192417c92b4c317c4a517b9%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm9/1b2c6b582192417c92b4c317c4a517b9/images/large/2.jpg not downloaded yet
2026-03-25 16:31:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dca13610>
2026-03-25 16:31:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b2ea2df-f838-5481-a106-6d9ac9d2c5e0/9b2ea2df-f838-5481-a106-6d9ac9d2c5e0_image_6.jpg HTTP/1.1" 201 0
2026-03-25 16:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm8%252Fa3aa348e0b7d463b82807353dc557162%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm8/a3aa348e0b7d463b82807353dc557162/images/large/7.jpg saved to cache
2026-03-25 16:31:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9b2ea2df-f838-5481-a106-6d9ac9d2c5e0
2026-03-25 16:31:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc5cfa90>
2026-03-25 16:31:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b2ea2df-f838-5481-a106-6d9ac9d2c5e0/9b2ea2df-f838-5481-a106-6d9ac9d2c5e0_image_5.jpg HTTP/1.1" 201 0
2026-03-25 16:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm8%252Fa3aa348e0b7d463b82807353dc557162%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm8/a3aa348e0b7d463b82807353dc557162/images/large/6.jpg saved to cache
2026-03-25 16:31:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9b2ea2df-f838-5481-a106-6d9ac9d2c5e0
2026-03-25 16:31:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcad9f10>
2026-03-25 16:31:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e915404-e4de-507a-a713-54551d22ce60/6e915404-e4de-507a-a713-54551d22ce60_image_9.jpg HTTP/1.1" 201 0
2026-03-25 16:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm4%252F90aca1a734f447d79694e0f72f0a3520%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm4/90aca1a734f447d79694e0f72f0a3520/images/large/10.jpg saved to cache
2026-03-25 16:31:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6e915404-e4de-507a-a713-54551d22ce60
2026-03-25 16:31:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6e915404-e4de-507a-a713-54551d22ce60, skipping ID generation
2026-03-25 16:31:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6e915404-e4de-507a-a713-54551d22ce60 with scrape type 1
2026-03-25 16:31:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6e915404-e4de-507a-a713-54551d22ce60 sending to next pipeline
2026-03-25 16:31:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 6e915404-e4de-507a-a713-54551d22ce60, identifier: 1983548
2026-03-25 16:31:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc937450>
2026-03-25 16:31:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e0240b9-2b81-5e3a-83e1-95c8245fc12a/2e0240b9-2b81-5e3a-83e1-95c8245fc12a_image_7.jpg HTTP/1.1" 201 0
2026-03-25 16:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn8%252F88fd3b1ede7e4fa8bb1169b65fdc21c5%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn8/88fd3b1ede7e4fa8bb1169b65fdc21c5/images/large/8.jpg saved to cache
2026-03-25 16:31:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2e0240b9-2b81-5e3a-83e1-95c8245fc12a
2026-03-25 16:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm9%252F1b2c6b582192417c92b4c317c4a517b9%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm9/1b2c6b582192417c92b4c317c4a517b9/images/large/3.jpg not downloaded yet
2026-03-25 16:31:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 6e915404-e4de-507a-a713-54551d22ce60 with identifier: 1983548
2026-03-25 16:31:26 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:31:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 6e915404-e4de-507a-a713-54551d22ce60 with identifier: 1983548
2026-03-25 16:31:26 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 6e915404-e4de-507a-a713-54551d22ce60 with identifier: 1983548 to the API
2026-03-25 16:31:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:31:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:31:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gm4/90aca1a734f447d79694e0f72f0a3520/images/large/10.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'BMW INDIVIDUAL FROZEN DEEP GREY METALLIC',
'currency': 'EUR',
'doors_number': 5,
'engine': '3.0L',
'expiration_date': '2026-03-27T09:30:00Z',
'fuel_type': 'diesel',
'id': '6e915404-e4de-507a-a713-54551d22ce60',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41025',
'listing': 'auction',
'location': None,
'make': 'BMW',
'model': 'BMW X3 (PC) XDRIVE M40D MH48V FP',
'odometer': 45579,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 23,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e915404-e4de-507a-a713-54551d22ce60/6e915404-e4de-507a-a713-54551d22ce60_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 558485,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm4/90aca1a734f447d79694e0f72f0a3520/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e915404-e4de-507a-a713-54551d22ce60/6e915404-e4de-507a-a713-54551d22ce60_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 582254,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm4/90aca1a734f447d79694e0f72f0a3520/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e915404-e4de-507a-a713-54551d22ce60/6e915404-e4de-507a-a713-54551d22ce60_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 558485,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm4/90aca1a734f447d79694e0f72f0a3520/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e915404-e4de-507a-a713-54551d22ce60/6e915404-e4de-507a-a713-54551d22ce60_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 557758,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm4/90aca1a734f447d79694e0f72f0a3520/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e915404-e4de-507a-a713-54551d22ce60/6e915404-e4de-507a-a713-54551d22ce60_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 610704,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm4/90aca1a734f447d79694e0f72f0a3520/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e915404-e4de-507a-a713-54551d22ce60/6e915404-e4de-507a-a713-54551d22ce60_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 585592,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm4/90aca1a734f447d79694e0f72f0a3520/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e915404-e4de-507a-a713-54551d22ce60/6e915404-e4de-507a-a713-54551d22ce60_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 583442,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm4/90aca1a734f447d79694e0f72f0a3520/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e915404-e4de-507a-a713-54551d22ce60/6e915404-e4de-507a-a713-54551d22ce60_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 570580,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm4/90aca1a734f447d79694e0f72f0a3520/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e915404-e4de-507a-a713-54551d22ce60/6e915404-e4de-507a-a713-54551d22ce60_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 598665,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm4/90aca1a734f447d79694e0f72f0a3520/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e915404-e4de-507a-a713-54551d22ce60/6e915404-e4de-507a-a713-54551d22ce60_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 607042,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm4/90aca1a734f447d79694e0f72f0a3520/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-11-24',
'seats_number': 5,
'seller_name': None,
'title': 'BMW BMW X3 (PC) XDRIVE M40D MH48V FP -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-25 16:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983548%27 HTTP/1.1" 200 None
2026-03-25 16:31:26 [ayvens.it] INFO: Saving data for 1983548: {'created_time': 1774456286.836186, 'last_price_update_time': 1774456286.836199, 'auction_closing_time': 1774603800.0}
2026-03-25 16:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1983548') HTTP/1.1" 204 0
2026-03-25 16:31:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc80f310>
2026-03-25 16:31:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b2ea2df-f838-5481-a106-6d9ac9d2c5e0/9b2ea2df-f838-5481-a106-6d9ac9d2c5e0_image_3.jpg HTTP/1.1" 201 0
2026-03-25 16:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm8%252Fa3aa348e0b7d463b82807353dc557162%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm8/a3aa348e0b7d463b82807353dc557162/images/large/4.jpg saved to cache
2026-03-25 16:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9b2ea2df-f838-5481-a106-6d9ac9d2c5e0
2026-03-25 16:31:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcb14f10>
2026-03-25 16:31:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b2ea2df-f838-5481-a106-6d9ac9d2c5e0/9b2ea2df-f838-5481-a106-6d9ac9d2c5e0_image_8.jpg HTTP/1.1" 201 0
2026-03-25 16:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm8%252Fa3aa348e0b7d463b82807353dc557162%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm8/a3aa348e0b7d463b82807353dc557162/images/large/9.jpg saved to cache
2026-03-25 16:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9b2ea2df-f838-5481-a106-6d9ac9d2c5e0
2026-03-25 16:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm9%252F1b2c6b582192417c92b4c317c4a517b9%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm9/1b2c6b582192417c92b4c317c4a517b9/images/large/4.jpg not downloaded yet
2026-03-25 16:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm9%252F1b2c6b582192417c92b4c317c4a517b9%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm9/1b2c6b582192417c92b4c317c4a517b9/images/large/5.jpg not downloaded yet
2026-03-25 16:31:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc37d190>
2026-03-25 16:31:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b2ea2df-f838-5481-a106-6d9ac9d2c5e0/9b2ea2df-f838-5481-a106-6d9ac9d2c5e0_image_4.jpg HTTP/1.1" 201 0
2026-03-25 16:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm8%252Fa3aa348e0b7d463b82807353dc557162%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm8/a3aa348e0b7d463b82807353dc557162/images/large/5.jpg saved to cache
2026-03-25 16:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9b2ea2df-f838-5481-a106-6d9ac9d2c5e0
2026-03-25 16:31:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc325850>
2026-03-25 16:31:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b2ea2df-f838-5481-a106-6d9ac9d2c5e0/9b2ea2df-f838-5481-a106-6d9ac9d2c5e0_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm8%252Fa3aa348e0b7d463b82807353dc557162%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm8/a3aa348e0b7d463b82807353dc557162/images/large/1.jpg saved to cache
2026-03-25 16:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9b2ea2df-f838-5481-a106-6d9ac9d2c5e0
2026-03-25 16:31:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm9/fcb7b77677d0423bb0ec7424f8833a1f/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm9%252F1b2c6b582192417c92b4c317c4a517b9%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm9/1b2c6b582192417c92b4c317c4a517b9/images/large/6.jpg not downloaded yet
2026-03-25 16:31:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn6/7da59e16a43d4560a3163c12f9ee3b49/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn6/7da59e16a43d4560a3163c12f9ee3b49/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn6/7da59e16a43d4560a3163c12f9ee3b49/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn6/7da59e16a43d4560a3163c12f9ee3b49/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm9%252F1b2c6b582192417c92b4c317c4a517b9%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm9/1b2c6b582192417c92b4c317c4a517b9/images/large/7.jpg not downloaded yet
2026-03-25 16:31:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn6/7da59e16a43d4560a3163c12f9ee3b49/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn6/7da59e16a43d4560a3163c12f9ee3b49/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn6/7da59e16a43d4560a3163c12f9ee3b49/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm9%252F1b2c6b582192417c92b4c317c4a517b9%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm9/1b2c6b582192417c92b4c317c4a517b9/images/large/8.jpg not downloaded yet
2026-03-25 16:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm9%252F1b2c6b582192417c92b4c317c4a517b9%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm9/1b2c6b582192417c92b4c317c4a517b9/images/large/9.jpg not downloaded yet
2026-03-25 16:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm9%252F1b2c6b582192417c92b4c317c4a517b9%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm9/1b2c6b582192417c92b4c317c4a517b9/images/large/10.jpg not downloaded yet
2026-03-25 16:31:27 [ayvens.it] INFO: Found listing with ID: 1983553
2026-03-25 16:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983553%27 HTTP/1.1" 200 None
2026-03-25 16:31:27 [ayvens.it] INFO: Scrape type for 1983553: 1
2026-03-25 16:31:27 [ayvens.it] INFO: Extracting data for car ID: 1983553
2026-03-25 16:31:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8e484b92-0308-50df-9002-b480df42c181 with identifier: 1983553
2026-03-25 16:31:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8e484b92-0308-50df-9002-b480df42c181 with scrape type 1
2026-03-25 16:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8e484b92-0308-50df-9002-b480df42c181
2026-03-25 16:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp7%252F2c6293d062834ca5946ddac746faf3fa%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp7/2c6293d062834ca5946ddac746faf3fa/images/large/1.jpg not downloaded yet
2026-03-25 16:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp7%252F2c6293d062834ca5946ddac746faf3fa%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp7/2c6293d062834ca5946ddac746faf3fa/images/large/2.jpg not downloaded yet
2026-03-25 16:31:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcb1e410>
2026-03-25 16:31:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67029932-5c3c-52b8-b2a5-bff35f6f92d7/67029932-5c3c-52b8-b2a5-bff35f6f92d7_image_2.jpg HTTP/1.1" 201 0
2026-03-25 16:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm9%252Ffcb7b77677d0423bb0ec7424f8833a1f%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm9/fcb7b77677d0423bb0ec7424f8833a1f/images/large/3.jpg saved to cache
2026-03-25 16:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 67029932-5c3c-52b8-b2a5-bff35f6f92d7
2026-03-25 16:31:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcc4dc10>
2026-03-25 16:31:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab9566c9-ba37-51f3-aeee-fcee63a4c9f1/ab9566c9-ba37-51f3-aeee-fcee63a4c9f1_image_7.jpg HTTP/1.1" 201 0
2026-03-25 16:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn6%252F7da59e16a43d4560a3163c12f9ee3b49%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn6/7da59e16a43d4560a3163c12f9ee3b49/images/large/8.jpg saved to cache
2026-03-25 16:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ab9566c9-ba37-51f3-aeee-fcee63a4c9f1
2026-03-25 16:31:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc3800d0>
2026-03-25 16:31:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab9566c9-ba37-51f3-aeee-fcee63a4c9f1/ab9566c9-ba37-51f3-aeee-fcee63a4c9f1_image_5.jpg HTTP/1.1" 201 0
2026-03-25 16:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn6%252F7da59e16a43d4560a3163c12f9ee3b49%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn6/7da59e16a43d4560a3163c12f9ee3b49/images/large/6.jpg saved to cache
2026-03-25 16:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ab9566c9-ba37-51f3-aeee-fcee63a4c9f1
2026-03-25 16:31:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc380e90>
2026-03-25 16:31:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab9566c9-ba37-51f3-aeee-fcee63a4c9f1/ab9566c9-ba37-51f3-aeee-fcee63a4c9f1_image_4.jpg HTTP/1.1" 201 0
2026-03-25 16:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn6%252F7da59e16a43d4560a3163c12f9ee3b49%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn6/7da59e16a43d4560a3163c12f9ee3b49/images/large/5.jpg saved to cache
2026-03-25 16:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ab9566c9-ba37-51f3-aeee-fcee63a4c9f1
2026-03-25 16:31:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcc4ee50>
2026-03-25 16:31:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab9566c9-ba37-51f3-aeee-fcee63a4c9f1/ab9566c9-ba37-51f3-aeee-fcee63a4c9f1_image_6.jpg HTTP/1.1" 201 0
2026-03-25 16:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn6%252F7da59e16a43d4560a3163c12f9ee3b49%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn6/7da59e16a43d4560a3163c12f9ee3b49/images/large/7.jpg saved to cache
2026-03-25 16:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ab9566c9-ba37-51f3-aeee-fcee63a4c9f1
2026-03-25 16:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp7%252F2c6293d062834ca5946ddac746faf3fa%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp7/2c6293d062834ca5946ddac746faf3fa/images/large/3.jpg not downloaded yet
2026-03-25 16:31:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34d6b1f890>
2026-03-25 16:31:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab9566c9-ba37-51f3-aeee-fcee63a4c9f1/ab9566c9-ba37-51f3-aeee-fcee63a4c9f1_image_3.jpg HTTP/1.1" 201 0
2026-03-25 16:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn6%252F7da59e16a43d4560a3163c12f9ee3b49%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn6/7da59e16a43d4560a3163c12f9ee3b49/images/large/4.jpg saved to cache
2026-03-25 16:31:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ab9566c9-ba37-51f3-aeee-fcee63a4c9f1
2026-03-25 16:31:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dca9c690>
2026-03-25 16:31:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab9566c9-ba37-51f3-aeee-fcee63a4c9f1/ab9566c9-ba37-51f3-aeee-fcee63a4c9f1_image_2.jpg HTTP/1.1" 201 0
2026-03-25 16:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn6%252F7da59e16a43d4560a3163c12f9ee3b49%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn6/7da59e16a43d4560a3163c12f9ee3b49/images/large/3.jpg saved to cache
2026-03-25 16:31:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ab9566c9-ba37-51f3-aeee-fcee63a4c9f1
2026-03-25 16:31:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc9379d0>
2026-03-25 16:31:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab9566c9-ba37-51f3-aeee-fcee63a4c9f1/ab9566c9-ba37-51f3-aeee-fcee63a4c9f1_image_1.jpg HTTP/1.1" 201 0
2026-03-25 16:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn6%252F7da59e16a43d4560a3163c12f9ee3b49%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn6/7da59e16a43d4560a3163c12f9ee3b49/images/large/2.jpg saved to cache
2026-03-25 16:31:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ab9566c9-ba37-51f3-aeee-fcee63a4c9f1
2026-03-25 16:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp7%252F2c6293d062834ca5946ddac746faf3fa%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp7/2c6293d062834ca5946ddac746faf3fa/images/large/4.jpg not downloaded yet
2026-03-25 16:31:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm9/fcb7b77677d0423bb0ec7424f8833a1f/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp7%252F2c6293d062834ca5946ddac746faf3fa%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp7/2c6293d062834ca5946ddac746faf3fa/images/large/5.jpg not downloaded yet
2026-03-25 16:31:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm9/fcb7b77677d0423bb0ec7424f8833a1f/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm9/fcb7b77677d0423bb0ec7424f8833a1f/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm9/1b2c6b582192417c92b4c317c4a517b9/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp7%252F2c6293d062834ca5946ddac746faf3fa%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp7/2c6293d062834ca5946ddac746faf3fa/images/large/6.jpg not downloaded yet
2026-03-25 16:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp7%252F2c6293d062834ca5946ddac746faf3fa%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp7/2c6293d062834ca5946ddac746faf3fa/images/large/7.jpg not downloaded yet
2026-03-25 16:31:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm9/fcb7b77677d0423bb0ec7424f8833a1f/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm9/fcb7b77677d0423bb0ec7424f8833a1f/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm9/1b2c6b582192417c92b4c317c4a517b9/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp7%252F2c6293d062834ca5946ddac746faf3fa%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp7/2c6293d062834ca5946ddac746faf3fa/images/large/8.jpg not downloaded yet
2026-03-25 16:31:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm9/1b2c6b582192417c92b4c317c4a517b9/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp7%252F2c6293d062834ca5946ddac746faf3fa%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp7/2c6293d062834ca5946ddac746faf3fa/images/large/9.jpg not downloaded yet
2026-03-25 16:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp7%252F2c6293d062834ca5946ddac746faf3fa%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp7/2c6293d062834ca5946ddac746faf3fa/images/large/10.jpg not downloaded yet
2026-03-25 16:31:28 [ayvens.it] INFO: Found listing with ID: 1983554
2026-03-25 16:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983554%27 HTTP/1.1" 200 None
2026-03-25 16:31:28 [ayvens.it] INFO: Scrape type for 1983554: 1
2026-03-25 16:31:28 [ayvens.it] INFO: Extracting data for car ID: 1983554
2026-03-25 16:31:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 775a770d-55d8-58c8-827f-efd007bd145e with identifier: 1983554
2026-03-25 16:31:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 775a770d-55d8-58c8-827f-efd007bd145e with scrape type 1
2026-03-25 16:31:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 775a770d-55d8-58c8-827f-efd007bd145e
2026-03-25 16:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs0%252Fa74bff10af6c4226aab63759bffb5058%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs0/a74bff10af6c4226aab63759bffb5058/images/large/1.jpg not downloaded yet
2026-03-25 16:31:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc5d5c50>
2026-03-25 16:31:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67029932-5c3c-52b8-b2a5-bff35f6f92d7/67029932-5c3c-52b8-b2a5-bff35f6f92d7_image_5.jpg HTTP/1.1" 201 0
2026-03-25 16:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm9%252Ffcb7b77677d0423bb0ec7424f8833a1f%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm9/fcb7b77677d0423bb0ec7424f8833a1f/images/large/6.jpg saved to cache
2026-03-25 16:31:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 67029932-5c3c-52b8-b2a5-bff35f6f92d7
2026-03-25 16:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs0%252Fa74bff10af6c4226aab63759bffb5058%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs0/a74bff10af6c4226aab63759bffb5058/images/large/2.jpg not downloaded yet
2026-03-25 16:31:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dce2e590>
2026-03-25 16:31:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67029932-5c3c-52b8-b2a5-bff35f6f92d7/67029932-5c3c-52b8-b2a5-bff35f6f92d7_image_1.jpg HTTP/1.1" 201 0
2026-03-25 16:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm9%252Ffcb7b77677d0423bb0ec7424f8833a1f%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm9/fcb7b77677d0423bb0ec7424f8833a1f/images/large/2.jpg saved to cache
2026-03-25 16:31:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 67029932-5c3c-52b8-b2a5-bff35f6f92d7
2026-03-25 16:31:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc5af290>
2026-03-25 16:31:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67029932-5c3c-52b8-b2a5-bff35f6f92d7/67029932-5c3c-52b8-b2a5-bff35f6f92d7_image_4.jpg HTTP/1.1" 201 0
2026-03-25 16:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm9%252Ffcb7b77677d0423bb0ec7424f8833a1f%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm9/fcb7b77677d0423bb0ec7424f8833a1f/images/large/5.jpg saved to cache
2026-03-25 16:31:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 67029932-5c3c-52b8-b2a5-bff35f6f92d7
2026-03-25 16:31:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34de460290>
2026-03-25 16:31:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e45ba86-9527-55fd-99cf-b982e9e8ced4/0e45ba86-9527-55fd-99cf-b982e9e8ced4_image_1.jpg HTTP/1.1" 201 0
2026-03-25 16:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm9%252F1b2c6b582192417c92b4c317c4a517b9%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm9/1b2c6b582192417c92b4c317c4a517b9/images/large/2.jpg saved to cache
2026-03-25 16:31:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0e45ba86-9527-55fd-99cf-b982e9e8ced4
2026-03-25 16:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs0%252Fa74bff10af6c4226aab63759bffb5058%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs0/a74bff10af6c4226aab63759bffb5058/images/large/3.jpg not downloaded yet
2026-03-25 16:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs0%252Fa74bff10af6c4226aab63759bffb5058%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs0/a74bff10af6c4226aab63759bffb5058/images/large/4.jpg not downloaded yet
2026-03-25 16:31:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc553990>
2026-03-25 16:31:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67029932-5c3c-52b8-b2a5-bff35f6f92d7/67029932-5c3c-52b8-b2a5-bff35f6f92d7_image_3.jpg HTTP/1.1" 201 0
2026-03-25 16:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm9%252Ffcb7b77677d0423bb0ec7424f8833a1f%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm9/fcb7b77677d0423bb0ec7424f8833a1f/images/large/4.jpg saved to cache
2026-03-25 16:31:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 67029932-5c3c-52b8-b2a5-bff35f6f92d7
2026-03-25 16:31:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcaf42d0>
2026-03-25 16:31:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67029932-5c3c-52b8-b2a5-bff35f6f92d7/67029932-5c3c-52b8-b2a5-bff35f6f92d7_image_9.jpg HTTP/1.1" 201 0
2026-03-25 16:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm9%252Ffcb7b77677d0423bb0ec7424f8833a1f%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm9/fcb7b77677d0423bb0ec7424f8833a1f/images/large/10.jpg saved to cache
2026-03-25 16:31:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 67029932-5c3c-52b8-b2a5-bff35f6f92d7
2026-03-25 16:31:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcaf4bd0>
2026-03-25 16:31:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e45ba86-9527-55fd-99cf-b982e9e8ced4/0e45ba86-9527-55fd-99cf-b982e9e8ced4_image_2.jpg HTTP/1.1" 201 0
2026-03-25 16:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm9%252F1b2c6b582192417c92b4c317c4a517b9%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm9/1b2c6b582192417c92b4c317c4a517b9/images/large/3.jpg saved to cache
2026-03-25 16:31:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0e45ba86-9527-55fd-99cf-b982e9e8ced4
2026-03-25 16:31:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc7dd990>
2026-03-25 16:31:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e45ba86-9527-55fd-99cf-b982e9e8ced4/0e45ba86-9527-55fd-99cf-b982e9e8ced4_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm9%252F1b2c6b582192417c92b4c317c4a517b9%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm9/1b2c6b582192417c92b4c317c4a517b9/images/large/1.jpg saved to cache
2026-03-25 16:31:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0e45ba86-9527-55fd-99cf-b982e9e8ced4
2026-03-25 16:31:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm9/fcb7b77677d0423bb0ec7424f8833a1f/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm9/1b2c6b582192417c92b4c317c4a517b9/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm9/fcb7b77677d0423bb0ec7424f8833a1f/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs0%252Fa74bff10af6c4226aab63759bffb5058%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs0/a74bff10af6c4226aab63759bffb5058/images/large/5.jpg not downloaded yet
2026-03-25 16:31:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm9/1b2c6b582192417c92b4c317c4a517b9/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm9/1b2c6b582192417c92b4c317c4a517b9/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm9/1b2c6b582192417c92b4c317c4a517b9/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs0%252Fa74bff10af6c4226aab63759bffb5058%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs0/a74bff10af6c4226aab63759bffb5058/images/large/6.jpg not downloaded yet
2026-03-25 16:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs0%252Fa74bff10af6c4226aab63759bffb5058%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs0/a74bff10af6c4226aab63759bffb5058/images/large/7.jpg not downloaded yet
2026-03-25 16:31:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm9/fcb7b77677d0423bb0ec7424f8833a1f/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs0%252Fa74bff10af6c4226aab63759bffb5058%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs0/a74bff10af6c4226aab63759bffb5058/images/large/8.jpg not downloaded yet
2026-03-25 16:31:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm9/fcb7b77677d0423bb0ec7424f8833a1f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcb2ce90>
2026-03-25 16:31:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67029932-5c3c-52b8-b2a5-bff35f6f92d7/67029932-5c3c-52b8-b2a5-bff35f6f92d7_image_8.jpg HTTP/1.1" 201 0
2026-03-25 16:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm9%252Ffcb7b77677d0423bb0ec7424f8833a1f%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm9/fcb7b77677d0423bb0ec7424f8833a1f/images/large/9.jpg saved to cache
2026-03-25 16:31:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 67029932-5c3c-52b8-b2a5-bff35f6f92d7
2026-03-25 16:31:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc629110>
2026-03-25 16:31:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e45ba86-9527-55fd-99cf-b982e9e8ced4/0e45ba86-9527-55fd-99cf-b982e9e8ced4_image_4.jpg HTTP/1.1" 201 0
2026-03-25 16:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm9%252F1b2c6b582192417c92b4c317c4a517b9%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm9/1b2c6b582192417c92b4c317c4a517b9/images/large/5.jpg saved to cache
2026-03-25 16:31:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0e45ba86-9527-55fd-99cf-b982e9e8ced4
2026-03-25 16:31:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc37f950>
2026-03-25 16:31:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67029932-5c3c-52b8-b2a5-bff35f6f92d7/67029932-5c3c-52b8-b2a5-bff35f6f92d7_image_6.jpg HTTP/1.1" 201 0
2026-03-25 16:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm9%252Ffcb7b77677d0423bb0ec7424f8833a1f%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm9/fcb7b77677d0423bb0ec7424f8833a1f/images/large/7.jpg saved to cache
2026-03-25 16:31:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 67029932-5c3c-52b8-b2a5-bff35f6f92d7
2026-03-25 16:31:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dca1b090>
2026-03-25 16:31:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e45ba86-9527-55fd-99cf-b982e9e8ced4/0e45ba86-9527-55fd-99cf-b982e9e8ced4_image_3.jpg HTTP/1.1" 201 0
2026-03-25 16:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm9%252F1b2c6b582192417c92b4c317c4a517b9%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm9/1b2c6b582192417c92b4c317c4a517b9/images/large/4.jpg saved to cache
2026-03-25 16:31:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0e45ba86-9527-55fd-99cf-b982e9e8ced4
2026-03-25 16:31:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc62bd50>
2026-03-25 16:31:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e45ba86-9527-55fd-99cf-b982e9e8ced4/0e45ba86-9527-55fd-99cf-b982e9e8ced4_image_5.jpg HTTP/1.1" 201 0
2026-03-25 16:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm9%252F1b2c6b582192417c92b4c317c4a517b9%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm9/1b2c6b582192417c92b4c317c4a517b9/images/large/6.jpg saved to cache
2026-03-25 16:31:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0e45ba86-9527-55fd-99cf-b982e9e8ced4
2026-03-25 16:31:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc35b210>
2026-03-25 16:31:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e45ba86-9527-55fd-99cf-b982e9e8ced4/0e45ba86-9527-55fd-99cf-b982e9e8ced4_image_6.jpg HTTP/1.1" 201 0
2026-03-25 16:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm9%252F1b2c6b582192417c92b4c317c4a517b9%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm9/1b2c6b582192417c92b4c317c4a517b9/images/large/7.jpg saved to cache
2026-03-25 16:31:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0e45ba86-9527-55fd-99cf-b982e9e8ced4
2026-03-25 16:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs0%252Fa74bff10af6c4226aab63759bffb5058%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs0/a74bff10af6c4226aab63759bffb5058/images/large/9.jpg not downloaded yet
2026-03-25 16:31:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp7/2c6293d062834ca5946ddac746faf3fa/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs0%252Fa74bff10af6c4226aab63759bffb5058%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs0/a74bff10af6c4226aab63759bffb5058/images/large/10.jpg not downloaded yet
2026-03-25 16:31:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp7/2c6293d062834ca5946ddac746faf3fa/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:30 [ayvens.it] INFO: Found listing with ID: 1983555
2026-03-25 16:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983555%27 HTTP/1.1" 200 None
2026-03-25 16:31:30 [ayvens.it] INFO: Scrape type for 1983555: 1
2026-03-25 16:31:30 [ayvens.it] INFO: Extracting data for car ID: 1983555
2026-03-25 16:31:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dcdb9480-cd9a-5a16-b158-94ab81126f72 with identifier: 1983555
2026-03-25 16:31:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dcdb9480-cd9a-5a16-b158-94ab81126f72 with scrape type 1
2026-03-25 16:31:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item dcdb9480-cd9a-5a16-b158-94ab81126f72
2026-03-25 16:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm6%252F1d4612b3c7d5491fb84aa0e84071aaa9%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm6/1d4612b3c7d5491fb84aa0e84071aaa9/images/large/1.jpg not downloaded yet
2026-03-25 16:31:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc5a3cd0>
2026-03-25 16:31:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67029932-5c3c-52b8-b2a5-bff35f6f92d7/67029932-5c3c-52b8-b2a5-bff35f6f92d7_image_7.jpg HTTP/1.1" 201 0
2026-03-25 16:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm9%252Ffcb7b77677d0423bb0ec7424f8833a1f%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm9/fcb7b77677d0423bb0ec7424f8833a1f/images/large/8.jpg saved to cache
2026-03-25 16:31:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 67029932-5c3c-52b8-b2a5-bff35f6f92d7
2026-03-25 16:31:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcaf6bd0>
2026-03-25 16:31:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67029932-5c3c-52b8-b2a5-bff35f6f92d7/67029932-5c3c-52b8-b2a5-bff35f6f92d7_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm9%252Ffcb7b77677d0423bb0ec7424f8833a1f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm9/fcb7b77677d0423bb0ec7424f8833a1f/images/large/1.jpg saved to cache
2026-03-25 16:31:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 67029932-5c3c-52b8-b2a5-bff35f6f92d7
2026-03-25 16:31:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 67029932-5c3c-52b8-b2a5-bff35f6f92d7, skipping ID generation
2026-03-25 16:31:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 67029932-5c3c-52b8-b2a5-bff35f6f92d7 with scrape type 1
2026-03-25 16:31:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 67029932-5c3c-52b8-b2a5-bff35f6f92d7 sending to next pipeline
2026-03-25 16:31:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 67029932-5c3c-52b8-b2a5-bff35f6f92d7, identifier: 1983551
2026-03-25 16:31:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 67029932-5c3c-52b8-b2a5-bff35f6f92d7 with identifier: 1983551
2026-03-25 16:31:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 67029932-5c3c-52b8-b2a5-bff35f6f92d7 with identifier: 1983551
2026-03-25 16:31:30 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 67029932-5c3c-52b8-b2a5-bff35f6f92d7 with identifier: 1983551 to the API
2026-03-25 16:31:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:31:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:31:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gm9/fcb7b77677d0423bb0ec7424f8833a1f/images/large/1.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'MAGNETIC GREY METALLIZZATO',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-27T09:30:00Z',
'fuel_type': 'hybrid',
'id': '67029932-5c3c-52b8-b2a5-bff35f6f92d7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41025',
'listing': 'auction',
'location': None,
'make': 'FORD',
'model': 'FORD PUMA 1.0 ECOBOOST HYBRID 125CV ST-LINE AUTO FP',
'odometer': 185457,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 51,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67029932-5c3c-52b8-b2a5-bff35f6f92d7/67029932-5c3c-52b8-b2a5-bff35f6f92d7_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 673554,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm9/fcb7b77677d0423bb0ec7424f8833a1f/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67029932-5c3c-52b8-b2a5-bff35f6f92d7/67029932-5c3c-52b8-b2a5-bff35f6f92d7_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 489062,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm9/fcb7b77677d0423bb0ec7424f8833a1f/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67029932-5c3c-52b8-b2a5-bff35f6f92d7/67029932-5c3c-52b8-b2a5-bff35f6f92d7_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 406300,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm9/fcb7b77677d0423bb0ec7424f8833a1f/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67029932-5c3c-52b8-b2a5-bff35f6f92d7/67029932-5c3c-52b8-b2a5-bff35f6f92d7_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 527695,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm9/fcb7b77677d0423bb0ec7424f8833a1f/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67029932-5c3c-52b8-b2a5-bff35f6f92d7/67029932-5c3c-52b8-b2a5-bff35f6f92d7_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 436546,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm9/fcb7b77677d0423bb0ec7424f8833a1f/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67029932-5c3c-52b8-b2a5-bff35f6f92d7/67029932-5c3c-52b8-b2a5-bff35f6f92d7_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 414331,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm9/fcb7b77677d0423bb0ec7424f8833a1f/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67029932-5c3c-52b8-b2a5-bff35f6f92d7/67029932-5c3c-52b8-b2a5-bff35f6f92d7_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 438943,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm9/fcb7b77677d0423bb0ec7424f8833a1f/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67029932-5c3c-52b8-b2a5-bff35f6f92d7/67029932-5c3c-52b8-b2a5-bff35f6f92d7_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 673554,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm9/fcb7b77677d0423bb0ec7424f8833a1f/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67029932-5c3c-52b8-b2a5-bff35f6f92d7/67029932-5c3c-52b8-b2a5-bff35f6f92d7_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 400039,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm9/fcb7b77677d0423bb0ec7424f8833a1f/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67029932-5c3c-52b8-b2a5-bff35f6f92d7/67029932-5c3c-52b8-b2a5-bff35f6f92d7_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 554936,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm9/fcb7b77677d0423bb0ec7424f8833a1f/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-12-23',
'seats_number': 5,
'seller_name': None,
'title': 'FORD FORD PUMA 1.0 ECOBOOST HYBRID 125CV ST-LINE AUTO FP -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-25 16:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983551%27 HTTP/1.1" 200 None
2026-03-25 16:31:30 [ayvens.it] INFO: Saving data for 1983551: {'created_time': 1774456290.985635, 'last_price_update_time': 1774456290.985647, 'auction_closing_time': 1774603800.0}
2026-03-25 16:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1983551') HTTP/1.1" 204 0
2026-03-25 16:31:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp7/2c6293d062834ca5946ddac746faf3fa/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp7/2c6293d062834ca5946ddac746faf3fa/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp7/2c6293d062834ca5946ddac746faf3fa/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm6%252F1d4612b3c7d5491fb84aa0e84071aaa9%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm6/1d4612b3c7d5491fb84aa0e84071aaa9/images/large/2.jpg not downloaded yet
2026-03-25 16:31:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc354ed0>
2026-03-25 16:31:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e484b92-0308-50df-9002-b480df42c181/8e484b92-0308-50df-9002-b480df42c181_image_1.jpg HTTP/1.1" 201 0
2026-03-25 16:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp7%252F2c6293d062834ca5946ddac746faf3fa%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp7/2c6293d062834ca5946ddac746faf3fa/images/large/2.jpg saved to cache
2026-03-25 16:31:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8e484b92-0308-50df-9002-b480df42c181
2026-03-25 16:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm6%252F1d4612b3c7d5491fb84aa0e84071aaa9%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm6/1d4612b3c7d5491fb84aa0e84071aaa9/images/large/3.jpg not downloaded yet
2026-03-25 16:31:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp7/2c6293d062834ca5946ddac746faf3fa/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34d6b1fd10>
2026-03-25 16:31:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e484b92-0308-50df-9002-b480df42c181/8e484b92-0308-50df-9002-b480df42c181_image_3.jpg HTTP/1.1" 201 0
2026-03-25 16:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp7%252F2c6293d062834ca5946ddac746faf3fa%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp7/2c6293d062834ca5946ddac746faf3fa/images/large/4.jpg saved to cache
2026-03-25 16:31:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8e484b92-0308-50df-9002-b480df42c181
2026-03-25 16:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm6%252F1d4612b3c7d5491fb84aa0e84071aaa9%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm6/1d4612b3c7d5491fb84aa0e84071aaa9/images/large/4.jpg not downloaded yet
2026-03-25 16:31:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp7/2c6293d062834ca5946ddac746faf3fa/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:31 [scrapy.core.engine] DEBUG: Crawled (404) <GET https://medias-carmarket.ayvens.com/lots/ald/gs0/a74bff10af6c4226aab63759bffb5058/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm6%252F1d4612b3c7d5491fb84aa0e84071aaa9%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm6/1d4612b3c7d5491fb84aa0e84071aaa9/images/large/5.jpg not downloaded yet
2026-03-25 16:31:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcac9d10>
2026-03-25 16:31:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e484b92-0308-50df-9002-b480df42c181/8e484b92-0308-50df-9002-b480df42c181_image_4.jpg HTTP/1.1" 201 0
2026-03-25 16:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp7%252F2c6293d062834ca5946ddac746faf3fa%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp7/2c6293d062834ca5946ddac746faf3fa/images/large/5.jpg saved to cache
2026-03-25 16:31:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8e484b92-0308-50df-9002-b480df42c181
2026-03-25 16:31:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc94ca90>
2026-03-25 16:31:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e484b92-0308-50df-9002-b480df42c181/8e484b92-0308-50df-9002-b480df42c181_image_2.jpg HTTP/1.1" 201 0
2026-03-25 16:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp7%252F2c6293d062834ca5946ddac746faf3fa%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp7/2c6293d062834ca5946ddac746faf3fa/images/large/3.jpg saved to cache
2026-03-25 16:31:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8e484b92-0308-50df-9002-b480df42c181
2026-03-25 16:31:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dca23690>
2026-03-25 16:31:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e484b92-0308-50df-9002-b480df42c181/8e484b92-0308-50df-9002-b480df42c181_image_5.jpg HTTP/1.1" 201 0
2026-03-25 16:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp7%252F2c6293d062834ca5946ddac746faf3fa%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp7/2c6293d062834ca5946ddac746faf3fa/images/large/6.jpg saved to cache
2026-03-25 16:31:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8e484b92-0308-50df-9002-b480df42c181
2026-03-25 16:31:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp7/2c6293d062834ca5946ddac746faf3fa/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs0/a74bff10af6c4226aab63759bffb5058/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm6%252F1d4612b3c7d5491fb84aa0e84071aaa9%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm6/1d4612b3c7d5491fb84aa0e84071aaa9/images/large/6.jpg not downloaded yet
2026-03-25 16:31:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc58afd0>
2026-03-25 16:31:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e484b92-0308-50df-9002-b480df42c181/8e484b92-0308-50df-9002-b480df42c181_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp7%252F2c6293d062834ca5946ddac746faf3fa%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp7/2c6293d062834ca5946ddac746faf3fa/images/large/1.jpg saved to cache
2026-03-25 16:31:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8e484b92-0308-50df-9002-b480df42c181
2026-03-25 16:31:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs0/a74bff10af6c4226aab63759bffb5058/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:31 [scrapy.core.engine] DEBUG: Crawled (404) <GET https://medias-carmarket.ayvens.com/lots/ald/gs0/a74bff10af6c4226aab63759bffb5058/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm6%252F1d4612b3c7d5491fb84aa0e84071aaa9%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm6/1d4612b3c7d5491fb84aa0e84071aaa9/images/large/7.jpg not downloaded yet
2026-03-25 16:31:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc9df450>
2026-03-25 16:31:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e484b92-0308-50df-9002-b480df42c181/8e484b92-0308-50df-9002-b480df42c181_image_7.jpg HTTP/1.1" 201 0
2026-03-25 16:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp7%252F2c6293d062834ca5946ddac746faf3fa%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp7/2c6293d062834ca5946ddac746faf3fa/images/large/8.jpg saved to cache
2026-03-25 16:31:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8e484b92-0308-50df-9002-b480df42c181
2026-03-25 16:31:31 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 1 for item 775a770d-55d8-58c8-827f-efd007bd145e due to Ignoring non-200 response
2026-03-25 16:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm6%252F1d4612b3c7d5491fb84aa0e84071aaa9%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm6/1d4612b3c7d5491fb84aa0e84071aaa9/images/large/8.jpg not downloaded yet
2026-03-25 16:31:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp7/2c6293d062834ca5946ddac746faf3fa/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:31 [scrapy.core.engine] DEBUG: Crawled (404) <GET https://medias-carmarket.ayvens.com/lots/ald/gs0/a74bff10af6c4226aab63759bffb5058/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs0/a74bff10af6c4226aab63759bffb5058/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm6%252F1d4612b3c7d5491fb84aa0e84071aaa9%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm6/1d4612b3c7d5491fb84aa0e84071aaa9/images/large/9.jpg not downloaded yet
2026-03-25 16:31:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc587a50>
2026-03-25 16:31:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e484b92-0308-50df-9002-b480df42c181/8e484b92-0308-50df-9002-b480df42c181_image_6.jpg HTTP/1.1" 201 0
2026-03-25 16:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp7%252F2c6293d062834ca5946ddac746faf3fa%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp7/2c6293d062834ca5946ddac746faf3fa/images/large/7.jpg saved to cache
2026-03-25 16:31:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8e484b92-0308-50df-9002-b480df42c181
2026-03-25 16:31:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dca96710>
2026-03-25 16:31:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_775a770d-55d8-58c8-827f-efd007bd145e/775a770d-55d8-58c8-827f-efd007bd145e_image_3.jpg HTTP/1.1" 201 0
2026-03-25 16:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs0%252Fa74bff10af6c4226aab63759bffb5058%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs0/a74bff10af6c4226aab63759bffb5058/images/large/4.jpg saved to cache
2026-03-25 16:31:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 775a770d-55d8-58c8-827f-efd007bd145e
2026-03-25 16:31:31 [scrapy.core.engine] DEBUG: Crawled (404) <GET https://medias-carmarket.ayvens.com/lots/ald/gs0/a74bff10af6c4226aab63759bffb5058/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm6%252F1d4612b3c7d5491fb84aa0e84071aaa9%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm6/1d4612b3c7d5491fb84aa0e84071aaa9/images/large/10.jpg not downloaded yet
2026-03-25 16:31:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc355910>
2026-03-25 16:31:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_775a770d-55d8-58c8-827f-efd007bd145e/775a770d-55d8-58c8-827f-efd007bd145e_image_2.jpg HTTP/1.1" 201 0
2026-03-25 16:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs0%252Fa74bff10af6c4226aab63759bffb5058%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs0/a74bff10af6c4226aab63759bffb5058/images/large/3.jpg saved to cache
2026-03-25 16:31:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 775a770d-55d8-58c8-827f-efd007bd145e
2026-03-25 16:31:31 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 5 for item 775a770d-55d8-58c8-827f-efd007bd145e due to Ignoring non-200 response
2026-03-25 16:31:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs0/a74bff10af6c4226aab63759bffb5058/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:31 [ayvens.it] INFO: Found listing with ID: 1983556
2026-03-25 16:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983556%27 HTTP/1.1" 200 None
2026-03-25 16:31:31 [ayvens.it] INFO: Scrape type for 1983556: 1
2026-03-25 16:31:31 [ayvens.it] INFO: Extracting data for car ID: 1983556
2026-03-25 16:31:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b196d70f-4049-5494-acf9-d9ed5517c614 with identifier: 1983556
2026-03-25 16:31:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b196d70f-4049-5494-acf9-d9ed5517c614 with scrape type 1
2026-03-25 16:31:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b196d70f-4049-5494-acf9-d9ed5517c614
2026-03-25 16:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn6%252Fc2490afb8bcc425381e9212a185b8e4e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn6/c2490afb8bcc425381e9212a185b8e4e/images/large/1.jpg not downloaded yet
2026-03-25 16:31:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dea7f090>
2026-03-25 16:31:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e484b92-0308-50df-9002-b480df42c181/8e484b92-0308-50df-9002-b480df42c181_image_9.jpg HTTP/1.1" 201 0
2026-03-25 16:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp7%252F2c6293d062834ca5946ddac746faf3fa%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp7/2c6293d062834ca5946ddac746faf3fa/images/large/10.jpg saved to cache
2026-03-25 16:31:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8e484b92-0308-50df-9002-b480df42c181
2026-03-25 16:31:32 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 9 for item 775a770d-55d8-58c8-827f-efd007bd145e due to Ignoring non-200 response
2026-03-25 16:31:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc87b690>
2026-03-25 16:31:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_775a770d-55d8-58c8-827f-efd007bd145e/775a770d-55d8-58c8-827f-efd007bd145e_image_4.jpg HTTP/1.1" 201 0
2026-03-25 16:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs0%252Fa74bff10af6c4226aab63759bffb5058%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs0/a74bff10af6c4226aab63759bffb5058/images/large/5.jpg saved to cache
2026-03-25 16:31:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 775a770d-55d8-58c8-827f-efd007bd145e
2026-03-25 16:31:32 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 7 for item 775a770d-55d8-58c8-827f-efd007bd145e due to Ignoring non-200 response
2026-03-25 16:31:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs0/a74bff10af6c4226aab63759bffb5058/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn6%252Fc2490afb8bcc425381e9212a185b8e4e%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn6/c2490afb8bcc425381e9212a185b8e4e/images/large/2.jpg not downloaded yet
2026-03-25 16:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn6%252Fc2490afb8bcc425381e9212a185b8e4e%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn6/c2490afb8bcc425381e9212a185b8e4e/images/large/3.jpg not downloaded yet
2026-03-25 16:31:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc96b550>
2026-03-25 16:31:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_775a770d-55d8-58c8-827f-efd007bd145e/775a770d-55d8-58c8-827f-efd007bd145e_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs0%252Fa74bff10af6c4226aab63759bffb5058%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs0/a74bff10af6c4226aab63759bffb5058/images/large/1.jpg saved to cache
2026-03-25 16:31:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 775a770d-55d8-58c8-827f-efd007bd145e
2026-03-25 16:31:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs0/a74bff10af6c4226aab63759bffb5058/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn6%252Fc2490afb8bcc425381e9212a185b8e4e%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn6/c2490afb8bcc425381e9212a185b8e4e/images/large/4.jpg not downloaded yet
2026-03-25 16:31:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp7/2c6293d062834ca5946ddac746faf3fa/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm6/1d4612b3c7d5491fb84aa0e84071aaa9/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm6/1d4612b3c7d5491fb84aa0e84071aaa9/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn6%252Fc2490afb8bcc425381e9212a185b8e4e%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn6/c2490afb8bcc425381e9212a185b8e4e/images/large/5.jpg not downloaded yet
2026-03-25 16:31:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc96a1d0>
2026-03-25 16:31:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_775a770d-55d8-58c8-827f-efd007bd145e/775a770d-55d8-58c8-827f-efd007bd145e_image_6.jpg HTTP/1.1" 201 0
2026-03-25 16:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs0%252Fa74bff10af6c4226aab63759bffb5058%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs0/a74bff10af6c4226aab63759bffb5058/images/large/7.jpg saved to cache
2026-03-25 16:31:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 775a770d-55d8-58c8-827f-efd007bd145e
2026-03-25 16:31:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm6/1d4612b3c7d5491fb84aa0e84071aaa9/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn6%252Fc2490afb8bcc425381e9212a185b8e4e%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn6/c2490afb8bcc425381e9212a185b8e4e/images/large/6.jpg not downloaded yet
2026-03-25 16:31:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm6/1d4612b3c7d5491fb84aa0e84071aaa9/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn6%252Fc2490afb8bcc425381e9212a185b8e4e%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn6/c2490afb8bcc425381e9212a185b8e4e/images/large/7.jpg not downloaded yet
2026-03-25 16:31:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm6/1d4612b3c7d5491fb84aa0e84071aaa9/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn6%252Fc2490afb8bcc425381e9212a185b8e4e%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn6/c2490afb8bcc425381e9212a185b8e4e/images/large/8.jpg not downloaded yet
2026-03-25 16:31:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc34d5d0>
2026-03-25 16:31:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_775a770d-55d8-58c8-827f-efd007bd145e/775a770d-55d8-58c8-827f-efd007bd145e_image_8.jpg HTTP/1.1" 201 0
2026-03-25 16:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs0%252Fa74bff10af6c4226aab63759bffb5058%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs0/a74bff10af6c4226aab63759bffb5058/images/large/9.jpg saved to cache
2026-03-25 16:31:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 775a770d-55d8-58c8-827f-efd007bd145e
2026-03-25 16:31:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 775a770d-55d8-58c8-827f-efd007bd145e, skipping ID generation
2026-03-25 16:31:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 775a770d-55d8-58c8-827f-efd007bd145e with scrape type 1
2026-03-25 16:31:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 775a770d-55d8-58c8-827f-efd007bd145e sending to next pipeline
2026-03-25 16:31:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 775a770d-55d8-58c8-827f-efd007bd145e, identifier: 1983554
2026-03-25 16:31:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc34dd90>
2026-03-25 16:31:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e484b92-0308-50df-9002-b480df42c181/8e484b92-0308-50df-9002-b480df42c181_image_8.jpg HTTP/1.1" 201 0
2026-03-25 16:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp7%252F2c6293d062834ca5946ddac746faf3fa%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp7/2c6293d062834ca5946ddac746faf3fa/images/large/9.jpg saved to cache
2026-03-25 16:31:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8e484b92-0308-50df-9002-b480df42c181
2026-03-25 16:31:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8e484b92-0308-50df-9002-b480df42c181, skipping ID generation
2026-03-25 16:31:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8e484b92-0308-50df-9002-b480df42c181 with scrape type 1
2026-03-25 16:31:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8e484b92-0308-50df-9002-b480df42c181 sending to next pipeline
2026-03-25 16:31:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 8e484b92-0308-50df-9002-b480df42c181, identifier: 1983553
2026-03-25 16:31:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc9c8550>
2026-03-25 16:31:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dcdb9480-cd9a-5a16-b158-94ab81126f72/dcdb9480-cd9a-5a16-b158-94ab81126f72_image_1.jpg HTTP/1.1" 201 0
2026-03-25 16:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm6%252F1d4612b3c7d5491fb84aa0e84071aaa9%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm6/1d4612b3c7d5491fb84aa0e84071aaa9/images/large/2.jpg saved to cache
2026-03-25 16:31:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item dcdb9480-cd9a-5a16-b158-94ab81126f72
2026-03-25 16:31:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc355a90>
2026-03-25 16:31:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dcdb9480-cd9a-5a16-b158-94ab81126f72/dcdb9480-cd9a-5a16-b158-94ab81126f72_image_2.jpg HTTP/1.1" 201 0
2026-03-25 16:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm6%252F1d4612b3c7d5491fb84aa0e84071aaa9%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm6/1d4612b3c7d5491fb84aa0e84071aaa9/images/large/3.jpg saved to cache
2026-03-25 16:31:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item dcdb9480-cd9a-5a16-b158-94ab81126f72
2026-03-25 16:31:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 775a770d-55d8-58c8-827f-efd007bd145e with identifier: 1983554
2026-03-25 16:31:33 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:31:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 775a770d-55d8-58c8-827f-efd007bd145e with identifier: 1983554
2026-03-25 16:31:33 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 775a770d-55d8-58c8-827f-efd007bd145e with identifier: 1983554 to the API
2026-03-25 16:31:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:31:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:31:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gs0/a74bff10af6c4226aab63759bffb5058/images/large/9.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'BIANCO MINERALE PASTELLO',
'currency': 'EUR',
'doors_number': 4,
'engine': '2.3L',
'expiration_date': '2026-03-27T09:30:00Z',
'fuel_type': 'diesel',
'id': '775a770d-55d8-58c8-827f-efd007bd145e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41025',
'listing': 'auction',
'location': None,
'make': 'RENAULT',
'model': 'RENAULT MASTER FG TA L2 H2 T33 DCI 135 START FP',
'odometer': 73066,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 32,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_775a770d-55d8-58c8-827f-efd007bd145e/775a770d-55d8-58c8-827f-efd007bd145e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 583454,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs0/a74bff10af6c4226aab63759bffb5058/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_775a770d-55d8-58c8-827f-efd007bd145e/775a770d-55d8-58c8-827f-efd007bd145e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 604246,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs0/a74bff10af6c4226aab63759bffb5058/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_775a770d-55d8-58c8-827f-efd007bd145e/775a770d-55d8-58c8-827f-efd007bd145e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 480217,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs0/a74bff10af6c4226aab63759bffb5058/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_775a770d-55d8-58c8-827f-efd007bd145e/775a770d-55d8-58c8-827f-efd007bd145e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 437737,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs0/a74bff10af6c4226aab63759bffb5058/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_775a770d-55d8-58c8-827f-efd007bd145e/775a770d-55d8-58c8-827f-efd007bd145e_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 524570,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs0/a74bff10af6c4226aab63759bffb5058/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_775a770d-55d8-58c8-827f-efd007bd145e/775a770d-55d8-58c8-827f-efd007bd145e_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 560963,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs0/a74bff10af6c4226aab63759bffb5058/images/large/9.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-12-07',
'seats_number': 5,
'seller_name': None,
'title': 'RENAULT RENAULT MASTER FG TA L2 H2 T33 DCI 135 START FP -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2023}
2026-03-25 16:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983554%27 HTTP/1.1" 200 None
2026-03-25 16:31:33 [ayvens.it] INFO: Saving data for 1983554: {'created_time': 1774456293.488572, 'last_price_update_time': 1774456293.488584, 'auction_closing_time': 1774603800.0}
2026-03-25 16:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1983554') HTTP/1.1" 204 0
2026-03-25 16:31:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 8e484b92-0308-50df-9002-b480df42c181 with identifier: 1983553
2026-03-25 16:31:33 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:31:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 8e484b92-0308-50df-9002-b480df42c181 with identifier: 1983553
2026-03-25 16:31:33 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 8e484b92-0308-50df-9002-b480df42c181 with identifier: 1983553 to the API
2026-03-25 16:31:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:31:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:31:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gp7/2c6293d062834ca5946ddac746faf3fa/images/large/9.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'NATURAL WHITE PASTELLO',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-27T09:30:00Z',
'fuel_type': 'diesel',
'id': '8e484b92-0308-50df-9002-b480df42c181',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41025',
'listing': 'auction',
'location': None,
'make': 'CITROËN',
'model': 'CITROEN C5 AIRCROSS (PC BLUEHDI 130 S&S C-SERIES EAT8',
'odometer': 48701,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 32,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e484b92-0308-50df-9002-b480df42c181/8e484b92-0308-50df-9002-b480df42c181_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 579768,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp7/2c6293d062834ca5946ddac746faf3fa/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e484b92-0308-50df-9002-b480df42c181/8e484b92-0308-50df-9002-b480df42c181_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 206818,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp7/2c6293d062834ca5946ddac746faf3fa/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e484b92-0308-50df-9002-b480df42c181/8e484b92-0308-50df-9002-b480df42c181_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 473275,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp7/2c6293d062834ca5946ddac746faf3fa/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e484b92-0308-50df-9002-b480df42c181/8e484b92-0308-50df-9002-b480df42c181_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 263092,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp7/2c6293d062834ca5946ddac746faf3fa/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e484b92-0308-50df-9002-b480df42c181/8e484b92-0308-50df-9002-b480df42c181_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 579768,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp7/2c6293d062834ca5946ddac746faf3fa/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e484b92-0308-50df-9002-b480df42c181/8e484b92-0308-50df-9002-b480df42c181_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 429984,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp7/2c6293d062834ca5946ddac746faf3fa/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e484b92-0308-50df-9002-b480df42c181/8e484b92-0308-50df-9002-b480df42c181_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 471922,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp7/2c6293d062834ca5946ddac746faf3fa/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e484b92-0308-50df-9002-b480df42c181/8e484b92-0308-50df-9002-b480df42c181_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 520484,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp7/2c6293d062834ca5946ddac746faf3fa/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e484b92-0308-50df-9002-b480df42c181/8e484b92-0308-50df-9002-b480df42c181_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 489371,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp7/2c6293d062834ca5946ddac746faf3fa/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e484b92-0308-50df-9002-b480df42c181/8e484b92-0308-50df-9002-b480df42c181_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 338439,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp7/2c6293d062834ca5946ddac746faf3fa/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-06-30',
'seats_number': 5,
'seller_name': None,
'title': 'CITROËN CITROEN C5 AIRCROSS (PC BLUEHDI 130 S&S C-SERIES EAT8 -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2023}
2026-03-25 16:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983553%27 HTTP/1.1" 200 None
2026-03-25 16:31:33 [ayvens.it] INFO: Saving data for 1983553: {'created_time': 1774456293.817222, 'last_price_update_time': 1774456293.817236, 'auction_closing_time': 1774603800.0}
2026-03-25 16:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1983553') HTTP/1.1" 204 0
2026-03-25 16:31:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm6/1d4612b3c7d5491fb84aa0e84071aaa9/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn6%252Fc2490afb8bcc425381e9212a185b8e4e%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn6/c2490afb8bcc425381e9212a185b8e4e/images/large/9.jpg not downloaded yet
2026-03-25 16:31:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm9/1b2c6b582192417c92b4c317c4a517b9/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn6%252Fc2490afb8bcc425381e9212a185b8e4e%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn6/c2490afb8bcc425381e9212a185b8e4e/images/large/10.jpg not downloaded yet
2026-03-25 16:31:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm6/1d4612b3c7d5491fb84aa0e84071aaa9/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc993b50>
2026-03-25 16:31:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dcdb9480-cd9a-5a16-b158-94ab81126f72/dcdb9480-cd9a-5a16-b158-94ab81126f72_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm6%252F1d4612b3c7d5491fb84aa0e84071aaa9%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm6/1d4612b3c7d5491fb84aa0e84071aaa9/images/large/1.jpg saved to cache
2026-03-25 16:31:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item dcdb9480-cd9a-5a16-b158-94ab81126f72
2026-03-25 16:31:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc947f10>
2026-03-25 16:31:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dcdb9480-cd9a-5a16-b158-94ab81126f72/dcdb9480-cd9a-5a16-b158-94ab81126f72_image_3.jpg HTTP/1.1" 201 0
2026-03-25 16:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm6%252F1d4612b3c7d5491fb84aa0e84071aaa9%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm6/1d4612b3c7d5491fb84aa0e84071aaa9/images/large/4.jpg saved to cache
2026-03-25 16:31:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item dcdb9480-cd9a-5a16-b158-94ab81126f72
2026-03-25 16:31:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc309890>
2026-03-25 16:31:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dcdb9480-cd9a-5a16-b158-94ab81126f72/dcdb9480-cd9a-5a16-b158-94ab81126f72_image_5.jpg HTTP/1.1" 201 0
2026-03-25 16:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm6%252F1d4612b3c7d5491fb84aa0e84071aaa9%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm6/1d4612b3c7d5491fb84aa0e84071aaa9/images/large/6.jpg saved to cache
2026-03-25 16:31:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item dcdb9480-cd9a-5a16-b158-94ab81126f72
2026-03-25 16:31:34 [ayvens.it] INFO: Found listing with ID: 1983557
2026-03-25 16:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983557%27 HTTP/1.1" 200 None
2026-03-25 16:31:34 [ayvens.it] INFO: Scrape type for 1983557: 1
2026-03-25 16:31:34 [ayvens.it] INFO: Extracting data for car ID: 1983557
2026-03-25 16:31:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 58039fa8-b368-58a0-9660-85afb6cead7d with identifier: 1983557
2026-03-25 16:31:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 58039fa8-b368-58a0-9660-85afb6cead7d with scrape type 1
2026-03-25 16:31:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 58039fa8-b368-58a0-9660-85afb6cead7d
2026-03-25 16:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk2%252Fde30ed1b35af478192b5f02811dbd53c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk2/de30ed1b35af478192b5f02811dbd53c/images/large/1.jpg not downloaded yet
2026-03-25 16:31:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm9/1b2c6b582192417c92b4c317c4a517b9/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm6/1d4612b3c7d5491fb84aa0e84071aaa9/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk2%252Fde30ed1b35af478192b5f02811dbd53c%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk2/de30ed1b35af478192b5f02811dbd53c/images/large/2.jpg not downloaded yet
2026-03-25 16:31:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcbe4050>
2026-03-25 16:31:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dcdb9480-cd9a-5a16-b158-94ab81126f72/dcdb9480-cd9a-5a16-b158-94ab81126f72_image_4.jpg HTTP/1.1" 201 0
2026-03-25 16:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm6%252F1d4612b3c7d5491fb84aa0e84071aaa9%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm6/1d4612b3c7d5491fb84aa0e84071aaa9/images/large/5.jpg saved to cache
2026-03-25 16:31:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item dcdb9480-cd9a-5a16-b158-94ab81126f72
2026-03-25 16:31:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc942f50>
2026-03-25 16:31:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e45ba86-9527-55fd-99cf-b982e9e8ced4/0e45ba86-9527-55fd-99cf-b982e9e8ced4_image_9.jpg HTTP/1.1" 201 0
2026-03-25 16:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm9%252F1b2c6b582192417c92b4c317c4a517b9%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm9/1b2c6b582192417c92b4c317c4a517b9/images/large/10.jpg saved to cache
2026-03-25 16:31:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0e45ba86-9527-55fd-99cf-b982e9e8ced4
2026-03-25 16:31:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcaf4bd0>
2026-03-25 16:31:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dcdb9480-cd9a-5a16-b158-94ab81126f72/dcdb9480-cd9a-5a16-b158-94ab81126f72_image_6.jpg HTTP/1.1" 201 0
2026-03-25 16:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm6%252F1d4612b3c7d5491fb84aa0e84071aaa9%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm6/1d4612b3c7d5491fb84aa0e84071aaa9/images/large/7.jpg saved to cache
2026-03-25 16:31:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item dcdb9480-cd9a-5a16-b158-94ab81126f72
2026-03-25 16:31:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm9/1b2c6b582192417c92b4c317c4a517b9/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm6/1d4612b3c7d5491fb84aa0e84071aaa9/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk2%252Fde30ed1b35af478192b5f02811dbd53c%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk2/de30ed1b35af478192b5f02811dbd53c/images/large/3.jpg not downloaded yet
2026-03-25 16:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk2%252Fde30ed1b35af478192b5f02811dbd53c%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk2/de30ed1b35af478192b5f02811dbd53c/images/large/4.jpg not downloaded yet
2026-03-25 16:31:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn6/7da59e16a43d4560a3163c12f9ee3b49/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc764f90>
2026-03-25 16:31:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e45ba86-9527-55fd-99cf-b982e9e8ced4/0e45ba86-9527-55fd-99cf-b982e9e8ced4_image_8.jpg HTTP/1.1" 201 0
2026-03-25 16:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm9%252F1b2c6b582192417c92b4c317c4a517b9%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm9/1b2c6b582192417c92b4c317c4a517b9/images/large/9.jpg saved to cache
2026-03-25 16:31:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0e45ba86-9527-55fd-99cf-b982e9e8ced4
2026-03-25 16:31:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc357390>
2026-03-25 16:31:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dcdb9480-cd9a-5a16-b158-94ab81126f72/dcdb9480-cd9a-5a16-b158-94ab81126f72_image_7.jpg HTTP/1.1" 201 0
2026-03-25 16:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm6%252F1d4612b3c7d5491fb84aa0e84071aaa9%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm6/1d4612b3c7d5491fb84aa0e84071aaa9/images/large/8.jpg saved to cache
2026-03-25 16:31:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item dcdb9480-cd9a-5a16-b158-94ab81126f72
2026-03-25 16:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk2%252Fde30ed1b35af478192b5f02811dbd53c%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk2/de30ed1b35af478192b5f02811dbd53c/images/large/5.jpg not downloaded yet
2026-03-25 16:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk2%252Fde30ed1b35af478192b5f02811dbd53c%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk2/de30ed1b35af478192b5f02811dbd53c/images/large/6.jpg not downloaded yet
2026-03-25 16:31:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn6/c2490afb8bcc425381e9212a185b8e4e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm6/1d4612b3c7d5491fb84aa0e84071aaa9/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk2%252Fde30ed1b35af478192b5f02811dbd53c%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk2/de30ed1b35af478192b5f02811dbd53c/images/large/7.jpg not downloaded yet
2026-03-25 16:31:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc941ad0>
2026-03-25 16:31:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e45ba86-9527-55fd-99cf-b982e9e8ced4/0e45ba86-9527-55fd-99cf-b982e9e8ced4_image_7.jpg HTTP/1.1" 201 0
2026-03-25 16:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm9%252F1b2c6b582192417c92b4c317c4a517b9%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm9/1b2c6b582192417c92b4c317c4a517b9/images/large/8.jpg saved to cache
2026-03-25 16:31:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0e45ba86-9527-55fd-99cf-b982e9e8ced4
2026-03-25 16:31:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0e45ba86-9527-55fd-99cf-b982e9e8ced4, skipping ID generation
2026-03-25 16:31:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0e45ba86-9527-55fd-99cf-b982e9e8ced4 with scrape type 1
2026-03-25 16:31:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0e45ba86-9527-55fd-99cf-b982e9e8ced4 sending to next pipeline
2026-03-25 16:31:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 0e45ba86-9527-55fd-99cf-b982e9e8ced4, identifier: 1983552
2026-03-25 16:31:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34d7401c10>
2026-03-25 16:31:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dcdb9480-cd9a-5a16-b158-94ab81126f72/dcdb9480-cd9a-5a16-b158-94ab81126f72_image_8.jpg HTTP/1.1" 201 0
2026-03-25 16:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm6%252F1d4612b3c7d5491fb84aa0e84071aaa9%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm6/1d4612b3c7d5491fb84aa0e84071aaa9/images/large/9.jpg saved to cache
2026-03-25 16:31:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item dcdb9480-cd9a-5a16-b158-94ab81126f72
2026-03-25 16:31:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc649550>
2026-03-25 16:31:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab9566c9-ba37-51f3-aeee-fcee63a4c9f1/ab9566c9-ba37-51f3-aeee-fcee63a4c9f1_image_9.jpg HTTP/1.1" 201 0
2026-03-25 16:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn6%252F7da59e16a43d4560a3163c12f9ee3b49%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn6/7da59e16a43d4560a3163c12f9ee3b49/images/large/10.jpg saved to cache
2026-03-25 16:31:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ab9566c9-ba37-51f3-aeee-fcee63a4c9f1
2026-03-25 16:31:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 0e45ba86-9527-55fd-99cf-b982e9e8ced4 with identifier: 1983552
2026-03-25 16:31:34 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:31:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 0e45ba86-9527-55fd-99cf-b982e9e8ced4 with identifier: 1983552
2026-03-25 16:31:34 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 0e45ba86-9527-55fd-99cf-b982e9e8ced4 with identifier: 1983552 to the API
2026-03-25 16:31:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:31:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:31:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gm9/1b2c6b582192417c92b4c317c4a517b9/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'NERO PERLA MTZ',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-27T09:30:00Z',
'fuel_type': 'diesel',
'id': '0e45ba86-9527-55fd-99cf-b982e9e8ced4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41025',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': 'PEUGEOT 5008 (PC) BLUEHDI 130 ALLURE EAT8 S/S AUT. FP',
'odometer': 83421,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 56,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e45ba86-9527-55fd-99cf-b982e9e8ced4/0e45ba86-9527-55fd-99cf-b982e9e8ced4_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 782608,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm9/1b2c6b582192417c92b4c317c4a517b9/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e45ba86-9527-55fd-99cf-b982e9e8ced4/0e45ba86-9527-55fd-99cf-b982e9e8ced4_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 388799,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm9/1b2c6b582192417c92b4c317c4a517b9/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e45ba86-9527-55fd-99cf-b982e9e8ced4/0e45ba86-9527-55fd-99cf-b982e9e8ced4_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 693062,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm9/1b2c6b582192417c92b4c317c4a517b9/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e45ba86-9527-55fd-99cf-b982e9e8ced4/0e45ba86-9527-55fd-99cf-b982e9e8ced4_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 515378,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm9/1b2c6b582192417c92b4c317c4a517b9/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e45ba86-9527-55fd-99cf-b982e9e8ced4/0e45ba86-9527-55fd-99cf-b982e9e8ced4_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 467969,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm9/1b2c6b582192417c92b4c317c4a517b9/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e45ba86-9527-55fd-99cf-b982e9e8ced4/0e45ba86-9527-55fd-99cf-b982e9e8ced4_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 484775,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm9/1b2c6b582192417c92b4c317c4a517b9/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e45ba86-9527-55fd-99cf-b982e9e8ced4/0e45ba86-9527-55fd-99cf-b982e9e8ced4_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 477813,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm9/1b2c6b582192417c92b4c317c4a517b9/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e45ba86-9527-55fd-99cf-b982e9e8ced4/0e45ba86-9527-55fd-99cf-b982e9e8ced4_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 531334,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm9/1b2c6b582192417c92b4c317c4a517b9/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e45ba86-9527-55fd-99cf-b982e9e8ced4/0e45ba86-9527-55fd-99cf-b982e9e8ced4_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 383620,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm9/1b2c6b582192417c92b4c317c4a517b9/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e45ba86-9527-55fd-99cf-b982e9e8ced4/0e45ba86-9527-55fd-99cf-b982e9e8ced4_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 456022,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm9/1b2c6b582192417c92b4c317c4a517b9/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-11-30',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT PEUGEOT 5008 (PC) BLUEHDI 130 ALLURE EAT8 S/S AUT. FP -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-25 16:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983552%27 HTTP/1.1" 200 None
2026-03-25 16:31:35 [ayvens.it] INFO: Saving data for 1983552: {'created_time': 1774456295.107807, 'last_price_update_time': 1774456295.10782, 'auction_closing_time': 1774603800.0}
2026-03-25 16:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1983552') HTTP/1.1" 204 0
2026-03-25 16:31:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn6/c2490afb8bcc425381e9212a185b8e4e/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn6/c2490afb8bcc425381e9212a185b8e4e/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk2%252Fde30ed1b35af478192b5f02811dbd53c%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk2/de30ed1b35af478192b5f02811dbd53c/images/large/8.jpg not downloaded yet
2026-03-25 16:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk2%252Fde30ed1b35af478192b5f02811dbd53c%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk2/de30ed1b35af478192b5f02811dbd53c/images/large/9.jpg not downloaded yet
2026-03-25 16:31:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn6/c2490afb8bcc425381e9212a185b8e4e/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc6340d0>
2026-03-25 16:31:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b196d70f-4049-5494-acf9-d9ed5517c614/b196d70f-4049-5494-acf9-d9ed5517c614_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn6%252Fc2490afb8bcc425381e9212a185b8e4e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn6/c2490afb8bcc425381e9212a185b8e4e/images/large/1.jpg saved to cache
2026-03-25 16:31:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b196d70f-4049-5494-acf9-d9ed5517c614
2026-03-25 16:31:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc5fbe90>
2026-03-25 16:31:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dcdb9480-cd9a-5a16-b158-94ab81126f72/dcdb9480-cd9a-5a16-b158-94ab81126f72_image_9.jpg HTTP/1.1" 201 0
2026-03-25 16:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm6%252F1d4612b3c7d5491fb84aa0e84071aaa9%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm6/1d4612b3c7d5491fb84aa0e84071aaa9/images/large/10.jpg saved to cache
2026-03-25 16:31:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item dcdb9480-cd9a-5a16-b158-94ab81126f72
2026-03-25 16:31:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: dcdb9480-cd9a-5a16-b158-94ab81126f72, skipping ID generation
2026-03-25 16:31:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dcdb9480-cd9a-5a16-b158-94ab81126f72 with scrape type 1
2026-03-25 16:31:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item dcdb9480-cd9a-5a16-b158-94ab81126f72 sending to next pipeline
2026-03-25 16:31:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: dcdb9480-cd9a-5a16-b158-94ab81126f72, identifier: 1983555
2026-03-25 16:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk2%252Fde30ed1b35af478192b5f02811dbd53c%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk2/de30ed1b35af478192b5f02811dbd53c/images/large/10.jpg not downloaded yet
2026-03-25 16:31:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: dcdb9480-cd9a-5a16-b158-94ab81126f72 with identifier: 1983555
2026-03-25 16:31:35 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:31:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: dcdb9480-cd9a-5a16-b158-94ab81126f72 with identifier: 1983555
2026-03-25 16:31:35 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: dcdb9480-cd9a-5a16-b158-94ab81126f72 with identifier: 1983555 to the API
2026-03-25 16:31:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:31:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:31:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gm6/1d4612b3c7d5491fb84aa0e84071aaa9/images/large/10.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'FROZEN WHITE',
'currency': 'EUR',
'doors_number': 4,
'engine': '',
'expiration_date': '2026-03-27T09:30:00Z',
'fuel_type': 'electric',
'id': 'dcdb9480-cd9a-5a16-b158-94ab81126f72',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41025',
'listing': 'auction',
'location': None,
'make': 'FORD',
'model': 'FORD TRANSIT (PC) T/P ELETTRICO 68KWH 184CV 350 L3H2 TREND F FP',
'odometer': 90852,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 84,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dcdb9480-cd9a-5a16-b158-94ab81126f72/dcdb9480-cd9a-5a16-b158-94ab81126f72_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 482248,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm6/1d4612b3c7d5491fb84aa0e84071aaa9/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dcdb9480-cd9a-5a16-b158-94ab81126f72/dcdb9480-cd9a-5a16-b158-94ab81126f72_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 459045,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm6/1d4612b3c7d5491fb84aa0e84071aaa9/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dcdb9480-cd9a-5a16-b158-94ab81126f72/dcdb9480-cd9a-5a16-b158-94ab81126f72_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 337728,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm6/1d4612b3c7d5491fb84aa0e84071aaa9/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dcdb9480-cd9a-5a16-b158-94ab81126f72/dcdb9480-cd9a-5a16-b158-94ab81126f72_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 550847,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm6/1d4612b3c7d5491fb84aa0e84071aaa9/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dcdb9480-cd9a-5a16-b158-94ab81126f72/dcdb9480-cd9a-5a16-b158-94ab81126f72_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 512123,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm6/1d4612b3c7d5491fb84aa0e84071aaa9/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dcdb9480-cd9a-5a16-b158-94ab81126f72/dcdb9480-cd9a-5a16-b158-94ab81126f72_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 160941,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm6/1d4612b3c7d5491fb84aa0e84071aaa9/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dcdb9480-cd9a-5a16-b158-94ab81126f72/dcdb9480-cd9a-5a16-b158-94ab81126f72_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 251104,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm6/1d4612b3c7d5491fb84aa0e84071aaa9/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dcdb9480-cd9a-5a16-b158-94ab81126f72/dcdb9480-cd9a-5a16-b158-94ab81126f72_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 434131,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm6/1d4612b3c7d5491fb84aa0e84071aaa9/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dcdb9480-cd9a-5a16-b158-94ab81126f72/dcdb9480-cd9a-5a16-b158-94ab81126f72_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 532136,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm6/1d4612b3c7d5491fb84aa0e84071aaa9/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dcdb9480-cd9a-5a16-b158-94ab81126f72/dcdb9480-cd9a-5a16-b158-94ab81126f72_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 163351,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm6/1d4612b3c7d5491fb84aa0e84071aaa9/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-01-18',
'seats_number': 5,
'seller_name': None,
'title': 'FORD FORD TRANSIT (PC) T/P ELETTRICO 68KWH 184CV 350 L3H2 TREND F '
'FP -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2023}
2026-03-25 16:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983555%27 HTTP/1.1" 200 None
2026-03-25 16:31:35 [ayvens.it] INFO: Saving data for 1983555: {'created_time': 1774456295.69143, 'last_price_update_time': 1774456295.691442, 'auction_closing_time': 1774603800.0}
2026-03-25 16:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1983555') HTTP/1.1" 204 0
2026-03-25 16:31:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn6/c2490afb8bcc425381e9212a185b8e4e/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn6/7da59e16a43d4560a3163c12f9ee3b49/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:35 [ayvens.it] INFO: Found listing with ID: 1983558
2026-03-25 16:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983558%27 HTTP/1.1" 200 None
2026-03-25 16:31:35 [ayvens.it] INFO: Scrape type for 1983558: 1
2026-03-25 16:31:35 [ayvens.it] INFO: Extracting data for car ID: 1983558
2026-03-25 16:31:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7f7fa5ff-22cc-5974-b5e7-03943d4040b8 with identifier: 1983558
2026-03-25 16:31:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7f7fa5ff-22cc-5974-b5e7-03943d4040b8 with scrape type 1
2026-03-25 16:31:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7f7fa5ff-22cc-5974-b5e7-03943d4040b8
2026-03-25 16:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm1%252Fb992a9d1f2d749609ed519e777aae617%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm1/b992a9d1f2d749609ed519e777aae617/images/large/1.jpg not downloaded yet
2026-03-25 16:31:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc380410>
2026-03-25 16:31:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b196d70f-4049-5494-acf9-d9ed5517c614/b196d70f-4049-5494-acf9-d9ed5517c614_image_3.jpg HTTP/1.1" 201 0
2026-03-25 16:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn6%252Fc2490afb8bcc425381e9212a185b8e4e%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn6/c2490afb8bcc425381e9212a185b8e4e/images/large/4.jpg saved to cache
2026-03-25 16:31:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b196d70f-4049-5494-acf9-d9ed5517c614
2026-03-25 16:31:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc96a010>
2026-03-25 16:31:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b196d70f-4049-5494-acf9-d9ed5517c614/b196d70f-4049-5494-acf9-d9ed5517c614_image_2.jpg HTTP/1.1" 201 0
2026-03-25 16:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn6%252Fc2490afb8bcc425381e9212a185b8e4e%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn6/c2490afb8bcc425381e9212a185b8e4e/images/large/3.jpg saved to cache
2026-03-25 16:31:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b196d70f-4049-5494-acf9-d9ed5517c614
2026-03-25 16:31:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc96b8d0>
2026-03-25 16:31:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b196d70f-4049-5494-acf9-d9ed5517c614/b196d70f-4049-5494-acf9-d9ed5517c614_image_1.jpg HTTP/1.1" 201 0
2026-03-25 16:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn6%252Fc2490afb8bcc425381e9212a185b8e4e%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn6/c2490afb8bcc425381e9212a185b8e4e/images/large/2.jpg saved to cache
2026-03-25 16:31:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b196d70f-4049-5494-acf9-d9ed5517c614
2026-03-25 16:31:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn6/c2490afb8bcc425381e9212a185b8e4e/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm1%252Fb992a9d1f2d749609ed519e777aae617%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm1/b992a9d1f2d749609ed519e777aae617/images/large/2.jpg not downloaded yet
2026-03-25 16:31:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn6/c2490afb8bcc425381e9212a185b8e4e/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm1%252Fb992a9d1f2d749609ed519e777aae617%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm1/b992a9d1f2d749609ed519e777aae617/images/large/3.jpg not downloaded yet
2026-03-25 16:31:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn6/c2490afb8bcc425381e9212a185b8e4e/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc53e8d0>
2026-03-25 16:31:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b196d70f-4049-5494-acf9-d9ed5517c614/b196d70f-4049-5494-acf9-d9ed5517c614_image_4.jpg HTTP/1.1" 201 0
2026-03-25 16:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn6%252Fc2490afb8bcc425381e9212a185b8e4e%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn6/c2490afb8bcc425381e9212a185b8e4e/images/large/5.jpg saved to cache
2026-03-25 16:31:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b196d70f-4049-5494-acf9-d9ed5517c614
2026-03-25 16:31:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc5a0e10>
2026-03-25 16:31:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab9566c9-ba37-51f3-aeee-fcee63a4c9f1/ab9566c9-ba37-51f3-aeee-fcee63a4c9f1_image_8.jpg HTTP/1.1" 201 0
2026-03-25 16:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn6%252F7da59e16a43d4560a3163c12f9ee3b49%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn6/7da59e16a43d4560a3163c12f9ee3b49/images/large/9.jpg saved to cache
2026-03-25 16:31:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ab9566c9-ba37-51f3-aeee-fcee63a4c9f1
2026-03-25 16:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm1%252Fb992a9d1f2d749609ed519e777aae617%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm1/b992a9d1f2d749609ed519e777aae617/images/large/4.jpg not downloaded yet
2026-03-25 16:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm1%252Fb992a9d1f2d749609ed519e777aae617%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm1/b992a9d1f2d749609ed519e777aae617/images/large/5.jpg not downloaded yet
2026-03-25 16:31:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk2/de30ed1b35af478192b5f02811dbd53c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn6/c2490afb8bcc425381e9212a185b8e4e/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn6/c2490afb8bcc425381e9212a185b8e4e/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm1%252Fb992a9d1f2d749609ed519e777aae617%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm1/b992a9d1f2d749609ed519e777aae617/images/large/6.jpg not downloaded yet
2026-03-25 16:31:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcaf4490>
2026-03-25 16:31:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b196d70f-4049-5494-acf9-d9ed5517c614/b196d70f-4049-5494-acf9-d9ed5517c614_image_7.jpg HTTP/1.1" 201 0
2026-03-25 16:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn6%252Fc2490afb8bcc425381e9212a185b8e4e%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn6/c2490afb8bcc425381e9212a185b8e4e/images/large/8.jpg saved to cache
2026-03-25 16:31:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b196d70f-4049-5494-acf9-d9ed5517c614
2026-03-25 16:31:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc364950>
2026-03-25 16:31:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b196d70f-4049-5494-acf9-d9ed5517c614/b196d70f-4049-5494-acf9-d9ed5517c614_image_8.jpg HTTP/1.1" 201 0
2026-03-25 16:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn6%252Fc2490afb8bcc425381e9212a185b8e4e%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn6/c2490afb8bcc425381e9212a185b8e4e/images/large/9.jpg saved to cache
2026-03-25 16:31:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b196d70f-4049-5494-acf9-d9ed5517c614
2026-03-25 16:31:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcab3390>
2026-03-25 16:31:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b196d70f-4049-5494-acf9-d9ed5517c614/b196d70f-4049-5494-acf9-d9ed5517c614_image_6.jpg HTTP/1.1" 201 0
2026-03-25 16:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn6%252Fc2490afb8bcc425381e9212a185b8e4e%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn6/c2490afb8bcc425381e9212a185b8e4e/images/large/7.jpg saved to cache
2026-03-25 16:31:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b196d70f-4049-5494-acf9-d9ed5517c614
2026-03-25 16:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm1%252Fb992a9d1f2d749609ed519e777aae617%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm1/b992a9d1f2d749609ed519e777aae617/images/large/7.jpg not downloaded yet
2026-03-25 16:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm1%252Fb992a9d1f2d749609ed519e777aae617%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm1/b992a9d1f2d749609ed519e777aae617/images/large/8.jpg not downloaded yet
2026-03-25 16:31:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc38f190>
2026-03-25 16:31:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58039fa8-b368-58a0-9660-85afb6cead7d/58039fa8-b368-58a0-9660-85afb6cead7d_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk2%252Fde30ed1b35af478192b5f02811dbd53c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk2/de30ed1b35af478192b5f02811dbd53c/images/large/1.jpg saved to cache
2026-03-25 16:31:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 58039fa8-b368-58a0-9660-85afb6cead7d
2026-03-25 16:31:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc5a16d0>
2026-03-25 16:31:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b196d70f-4049-5494-acf9-d9ed5517c614/b196d70f-4049-5494-acf9-d9ed5517c614_image_5.jpg HTTP/1.1" 201 0
2026-03-25 16:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn6%252Fc2490afb8bcc425381e9212a185b8e4e%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn6/c2490afb8bcc425381e9212a185b8e4e/images/large/6.jpg saved to cache
2026-03-25 16:31:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b196d70f-4049-5494-acf9-d9ed5517c614
2026-03-25 16:31:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcaf6690>
2026-03-25 16:31:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b196d70f-4049-5494-acf9-d9ed5517c614/b196d70f-4049-5494-acf9-d9ed5517c614_image_9.jpg HTTP/1.1" 201 0
2026-03-25 16:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn6%252Fc2490afb8bcc425381e9212a185b8e4e%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn6/c2490afb8bcc425381e9212a185b8e4e/images/large/10.jpg saved to cache
2026-03-25 16:31:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b196d70f-4049-5494-acf9-d9ed5517c614
2026-03-25 16:31:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b196d70f-4049-5494-acf9-d9ed5517c614, skipping ID generation
2026-03-25 16:31:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b196d70f-4049-5494-acf9-d9ed5517c614 with scrape type 1
2026-03-25 16:31:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b196d70f-4049-5494-acf9-d9ed5517c614 sending to next pipeline
2026-03-25 16:31:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: b196d70f-4049-5494-acf9-d9ed5517c614, identifier: 1983556
2026-03-25 16:31:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk2/de30ed1b35af478192b5f02811dbd53c/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm1%252Fb992a9d1f2d749609ed519e777aae617%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm1/b992a9d1f2d749609ed519e777aae617/images/large/9.jpg not downloaded yet
2026-03-25 16:31:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: b196d70f-4049-5494-acf9-d9ed5517c614 with identifier: 1983556
2026-03-25 16:31:37 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:31:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: b196d70f-4049-5494-acf9-d9ed5517c614 with identifier: 1983556
2026-03-25 16:31:37 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: b196d70f-4049-5494-acf9-d9ed5517c614 with identifier: 1983556 to the API
2026-03-25 16:31:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:31:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:31:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gn6/c2490afb8bcc425381e9212a185b8e4e/images/large/10.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'GRIGIO ARTENSE METALLIZZATO',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-27T09:30:00Z',
'fuel_type': 'diesel',
'id': 'b196d70f-4049-5494-acf9-d9ed5517c614',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41025',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': 'PEUGEOT 3008 (PC) BLUEHDI 130 EAT8 S&S ALLURE PACK',
'odometer': 127520,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 22,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b196d70f-4049-5494-acf9-d9ed5517c614/b196d70f-4049-5494-acf9-d9ed5517c614_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 711768,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn6/c2490afb8bcc425381e9212a185b8e4e/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b196d70f-4049-5494-acf9-d9ed5517c614/b196d70f-4049-5494-acf9-d9ed5517c614_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 415380,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn6/c2490afb8bcc425381e9212a185b8e4e/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b196d70f-4049-5494-acf9-d9ed5517c614/b196d70f-4049-5494-acf9-d9ed5517c614_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 711768,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn6/c2490afb8bcc425381e9212a185b8e4e/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b196d70f-4049-5494-acf9-d9ed5517c614/b196d70f-4049-5494-acf9-d9ed5517c614_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 668275,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn6/c2490afb8bcc425381e9212a185b8e4e/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b196d70f-4049-5494-acf9-d9ed5517c614/b196d70f-4049-5494-acf9-d9ed5517c614_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 436220,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn6/c2490afb8bcc425381e9212a185b8e4e/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b196d70f-4049-5494-acf9-d9ed5517c614/b196d70f-4049-5494-acf9-d9ed5517c614_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 739651,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn6/c2490afb8bcc425381e9212a185b8e4e/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b196d70f-4049-5494-acf9-d9ed5517c614/b196d70f-4049-5494-acf9-d9ed5517c614_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 764660,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn6/c2490afb8bcc425381e9212a185b8e4e/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b196d70f-4049-5494-acf9-d9ed5517c614/b196d70f-4049-5494-acf9-d9ed5517c614_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 444134,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn6/c2490afb8bcc425381e9212a185b8e4e/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b196d70f-4049-5494-acf9-d9ed5517c614/b196d70f-4049-5494-acf9-d9ed5517c614_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 540280,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn6/c2490afb8bcc425381e9212a185b8e4e/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b196d70f-4049-5494-acf9-d9ed5517c614/b196d70f-4049-5494-acf9-d9ed5517c614_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 670313,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn6/c2490afb8bcc425381e9212a185b8e4e/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-04-28',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT PEUGEOT 3008 (PC) BLUEHDI 130 EAT8 S&S ALLURE PACK -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2023}
2026-03-25 16:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983556%27 HTTP/1.1" 200 None
2026-03-25 16:31:37 [ayvens.it] INFO: Saving data for 1983556: {'created_time': 1774456297.464827, 'last_price_update_time': 1774456297.464837, 'auction_closing_time': 1774603800.0}
2026-03-25 16:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1983556') HTTP/1.1" 204 0
2026-03-25 16:31:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn6/7da59e16a43d4560a3163c12f9ee3b49/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk2/de30ed1b35af478192b5f02811dbd53c/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm1%252Fb992a9d1f2d749609ed519e777aae617%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm1/b992a9d1f2d749609ed519e777aae617/images/large/10.jpg not downloaded yet
2026-03-25 16:31:37 [ayvens.it] INFO: Found listing with ID: 1983559
2026-03-25 16:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983559%27 HTTP/1.1" 200 None
2026-03-25 16:31:37 [ayvens.it] INFO: Scrape type for 1983559: 1
2026-03-25 16:31:37 [ayvens.it] INFO: Extracting data for car ID: 1983559
2026-03-25 16:31:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 26b1193f-e118-54b6-8b74-27b4a9c6ffe3 with identifier: 1983559
2026-03-25 16:31:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 26b1193f-e118-54b6-8b74-27b4a9c6ffe3 with scrape type 1
2026-03-25 16:31:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 26b1193f-e118-54b6-8b74-27b4a9c6ffe3
2026-03-25 16:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj9%252Fd1d8bfde47a1408d85f60ec645375bff%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj9/d1d8bfde47a1408d85f60ec645375bff/images/large/1.jpg not downloaded yet
2026-03-25 16:31:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc3718d0>
2026-03-25 16:31:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58039fa8-b368-58a0-9660-85afb6cead7d/58039fa8-b368-58a0-9660-85afb6cead7d_image_2.jpg HTTP/1.1" 201 0
2026-03-25 16:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk2%252Fde30ed1b35af478192b5f02811dbd53c%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk2/de30ed1b35af478192b5f02811dbd53c/images/large/3.jpg saved to cache
2026-03-25 16:31:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 58039fa8-b368-58a0-9660-85afb6cead7d
2026-03-25 16:31:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk2/de30ed1b35af478192b5f02811dbd53c/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj9%252Fd1d8bfde47a1408d85f60ec645375bff%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj9/d1d8bfde47a1408d85f60ec645375bff/images/large/2.jpg not downloaded yet
2026-03-25 16:31:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk2/de30ed1b35af478192b5f02811dbd53c/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk2/de30ed1b35af478192b5f02811dbd53c/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj9%252Fd1d8bfde47a1408d85f60ec645375bff%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj9/d1d8bfde47a1408d85f60ec645375bff/images/large/3.jpg not downloaded yet
2026-03-25 16:31:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk2/de30ed1b35af478192b5f02811dbd53c/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc75b410>
2026-03-25 16:31:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab9566c9-ba37-51f3-aeee-fcee63a4c9f1/ab9566c9-ba37-51f3-aeee-fcee63a4c9f1_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn6%252F7da59e16a43d4560a3163c12f9ee3b49%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn6/7da59e16a43d4560a3163c12f9ee3b49/images/large/1.jpg saved to cache
2026-03-25 16:31:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ab9566c9-ba37-51f3-aeee-fcee63a4c9f1
2026-03-25 16:31:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ab9566c9-ba37-51f3-aeee-fcee63a4c9f1, skipping ID generation
2026-03-25 16:31:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ab9566c9-ba37-51f3-aeee-fcee63a4c9f1 with scrape type 1
2026-03-25 16:31:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ab9566c9-ba37-51f3-aeee-fcee63a4c9f1 sending to next pipeline
2026-03-25 16:31:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: ab9566c9-ba37-51f3-aeee-fcee63a4c9f1, identifier: 1983550
2026-03-25 16:31:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc58a350>
2026-03-25 16:31:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58039fa8-b368-58a0-9660-85afb6cead7d/58039fa8-b368-58a0-9660-85afb6cead7d_image_5.jpg HTTP/1.1" 201 0
2026-03-25 16:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk2%252Fde30ed1b35af478192b5f02811dbd53c%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk2/de30ed1b35af478192b5f02811dbd53c/images/large/6.jpg saved to cache
2026-03-25 16:31:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 58039fa8-b368-58a0-9660-85afb6cead7d
2026-03-25 16:31:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk2/de30ed1b35af478192b5f02811dbd53c/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj9%252Fd1d8bfde47a1408d85f60ec645375bff%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj9/d1d8bfde47a1408d85f60ec645375bff/images/large/4.jpg not downloaded yet
2026-03-25 16:31:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: ab9566c9-ba37-51f3-aeee-fcee63a4c9f1 with identifier: 1983550
2026-03-25 16:31:37 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:31:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: ab9566c9-ba37-51f3-aeee-fcee63a4c9f1 with identifier: 1983550
2026-03-25 16:31:38 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: ab9566c9-ba37-51f3-aeee-fcee63a4c9f1 with identifier: 1983550 to the API
2026-03-25 16:31:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:31:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:31:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gn6/7da59e16a43d4560a3163c12f9ee3b49/images/large/1.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'BIANCO GELATO PASTELLO',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-27T09:30:00Z',
'fuel_type': 'hybrid',
'id': 'ab9566c9-ba37-51f3-aeee-fcee63a4c9f1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41025',
'listing': 'auction',
'location': None,
'make': 'FIAT',
'model': 'FIAT PANDA 1.0 Hybrid S&S 70cv E6.4 Van 2 posti Commercial hatch '
'5-door',
'odometer': 58059,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 17,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab9566c9-ba37-51f3-aeee-fcee63a4c9f1/ab9566c9-ba37-51f3-aeee-fcee63a4c9f1_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 584686,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn6/7da59e16a43d4560a3163c12f9ee3b49/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab9566c9-ba37-51f3-aeee-fcee63a4c9f1/ab9566c9-ba37-51f3-aeee-fcee63a4c9f1_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 556762,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn6/7da59e16a43d4560a3163c12f9ee3b49/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab9566c9-ba37-51f3-aeee-fcee63a4c9f1/ab9566c9-ba37-51f3-aeee-fcee63a4c9f1_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 584686,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn6/7da59e16a43d4560a3163c12f9ee3b49/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab9566c9-ba37-51f3-aeee-fcee63a4c9f1/ab9566c9-ba37-51f3-aeee-fcee63a4c9f1_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 584453,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn6/7da59e16a43d4560a3163c12f9ee3b49/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab9566c9-ba37-51f3-aeee-fcee63a4c9f1/ab9566c9-ba37-51f3-aeee-fcee63a4c9f1_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 576005,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn6/7da59e16a43d4560a3163c12f9ee3b49/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab9566c9-ba37-51f3-aeee-fcee63a4c9f1/ab9566c9-ba37-51f3-aeee-fcee63a4c9f1_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 453989,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn6/7da59e16a43d4560a3163c12f9ee3b49/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab9566c9-ba37-51f3-aeee-fcee63a4c9f1/ab9566c9-ba37-51f3-aeee-fcee63a4c9f1_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 544238,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn6/7da59e16a43d4560a3163c12f9ee3b49/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab9566c9-ba37-51f3-aeee-fcee63a4c9f1/ab9566c9-ba37-51f3-aeee-fcee63a4c9f1_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 464386,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn6/7da59e16a43d4560a3163c12f9ee3b49/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab9566c9-ba37-51f3-aeee-fcee63a4c9f1/ab9566c9-ba37-51f3-aeee-fcee63a4c9f1_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 458842,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn6/7da59e16a43d4560a3163c12f9ee3b49/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab9566c9-ba37-51f3-aeee-fcee63a4c9f1/ab9566c9-ba37-51f3-aeee-fcee63a4c9f1_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 667375,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn6/7da59e16a43d4560a3163c12f9ee3b49/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-04-05',
'seats_number': 5,
'seller_name': None,
'title': 'FIAT FIAT PANDA 1.0 Hybrid S&S 70cv E6.4 Van 2 posti Commercial '
'hatch 5-door -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2023}
2026-03-25 16:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983550%27 HTTP/1.1" 200 None
2026-03-25 16:31:38 [ayvens.it] INFO: Saving data for 1983550: {'created_time': 1774456298.477072, 'last_price_update_time': 1774456298.477084, 'auction_closing_time': 1774603800.0}
2026-03-25 16:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1983550') HTTP/1.1" 204 0
2026-03-25 16:31:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk2/de30ed1b35af478192b5f02811dbd53c/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj9%252Fd1d8bfde47a1408d85f60ec645375bff%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj9/d1d8bfde47a1408d85f60ec645375bff/images/large/5.jpg not downloaded yet
2026-03-25 16:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj9%252Fd1d8bfde47a1408d85f60ec645375bff%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj9/d1d8bfde47a1408d85f60ec645375bff/images/large/6.jpg not downloaded yet
2026-03-25 16:31:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc584d50>
2026-03-25 16:31:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58039fa8-b368-58a0-9660-85afb6cead7d/58039fa8-b368-58a0-9660-85afb6cead7d_image_1.jpg HTTP/1.1" 201 0
2026-03-25 16:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk2%252Fde30ed1b35af478192b5f02811dbd53c%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk2/de30ed1b35af478192b5f02811dbd53c/images/large/2.jpg saved to cache
2026-03-25 16:31:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 58039fa8-b368-58a0-9660-85afb6cead7d
2026-03-25 16:31:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dca968d0>
2026-03-25 16:31:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58039fa8-b368-58a0-9660-85afb6cead7d/58039fa8-b368-58a0-9660-85afb6cead7d_image_4.jpg HTTP/1.1" 201 0
2026-03-25 16:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk2%252Fde30ed1b35af478192b5f02811dbd53c%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk2/de30ed1b35af478192b5f02811dbd53c/images/large/5.jpg saved to cache
2026-03-25 16:31:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 58039fa8-b368-58a0-9660-85afb6cead7d
2026-03-25 16:31:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc309190>
2026-03-25 16:31:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58039fa8-b368-58a0-9660-85afb6cead7d/58039fa8-b368-58a0-9660-85afb6cead7d_image_6.jpg HTTP/1.1" 201 0
2026-03-25 16:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk2%252Fde30ed1b35af478192b5f02811dbd53c%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk2/de30ed1b35af478192b5f02811dbd53c/images/large/7.jpg saved to cache
2026-03-25 16:31:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 58039fa8-b368-58a0-9660-85afb6cead7d
2026-03-25 16:31:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc9b2d50>
2026-03-25 16:31:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58039fa8-b368-58a0-9660-85afb6cead7d/58039fa8-b368-58a0-9660-85afb6cead7d_image_7.jpg HTTP/1.1" 201 0
2026-03-25 16:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk2%252Fde30ed1b35af478192b5f02811dbd53c%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk2/de30ed1b35af478192b5f02811dbd53c/images/large/8.jpg saved to cache
2026-03-25 16:31:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 58039fa8-b368-58a0-9660-85afb6cead7d
2026-03-25 16:31:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dca19a10>
2026-03-25 16:31:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58039fa8-b368-58a0-9660-85afb6cead7d/58039fa8-b368-58a0-9660-85afb6cead7d_image_9.jpg HTTP/1.1" 201 0
2026-03-25 16:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk2%252Fde30ed1b35af478192b5f02811dbd53c%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk2/de30ed1b35af478192b5f02811dbd53c/images/large/10.jpg saved to cache
2026-03-25 16:31:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 58039fa8-b368-58a0-9660-85afb6cead7d
2026-03-25 16:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj9%252Fd1d8bfde47a1408d85f60ec645375bff%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj9/d1d8bfde47a1408d85f60ec645375bff/images/large/7.jpg not downloaded yet
2026-03-25 16:31:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm1/b992a9d1f2d749609ed519e777aae617/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk2/de30ed1b35af478192b5f02811dbd53c/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj9%252Fd1d8bfde47a1408d85f60ec645375bff%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj9/d1d8bfde47a1408d85f60ec645375bff/images/large/8.jpg not downloaded yet
2026-03-25 16:31:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm8/a3aa348e0b7d463b82807353dc557162/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm1/b992a9d1f2d749609ed519e777aae617/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dca26010>
2026-03-25 16:31:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58039fa8-b368-58a0-9660-85afb6cead7d/58039fa8-b368-58a0-9660-85afb6cead7d_image_3.jpg HTTP/1.1" 201 0
2026-03-25 16:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk2%252Fde30ed1b35af478192b5f02811dbd53c%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk2/de30ed1b35af478192b5f02811dbd53c/images/large/4.jpg saved to cache
2026-03-25 16:31:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 58039fa8-b368-58a0-9660-85afb6cead7d
2026-03-25 16:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj9%252Fd1d8bfde47a1408d85f60ec645375bff%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj9/d1d8bfde47a1408d85f60ec645375bff/images/large/9.jpg not downloaded yet
2026-03-25 16:31:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm1/b992a9d1f2d749609ed519e777aae617/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm1/b992a9d1f2d749609ed519e777aae617/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm1/b992a9d1f2d749609ed519e777aae617/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm1/b992a9d1f2d749609ed519e777aae617/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj9%252Fd1d8bfde47a1408d85f60ec645375bff%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj9/d1d8bfde47a1408d85f60ec645375bff/images/large/10.jpg not downloaded yet
2026-03-25 16:31:39 [ayvens.it] INFO: Found listing with ID: 1983560
2026-03-25 16:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983560%27 HTTP/1.1" 200 None
2026-03-25 16:31:39 [ayvens.it] INFO: Scrape type for 1983560: 1
2026-03-25 16:31:39 [ayvens.it] INFO: Extracting data for car ID: 1983560
2026-03-25 16:31:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2e1d0474-7c36-520d-9b10-965a59b503c9 with identifier: 1983560
2026-03-25 16:31:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2e1d0474-7c36-520d-9b10-965a59b503c9 with scrape type 1
2026-03-25 16:31:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2e1d0474-7c36-520d-9b10-965a59b503c9
2026-03-25 16:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc4%252Fbbdfd01b13b64024aaab469ceb8f1c6e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc4/bbdfd01b13b64024aaab469ceb8f1c6e/images/large/1.jpg not downloaded yet
2026-03-25 16:31:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc325ed0>
2026-03-25 16:31:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f7fa5ff-22cc-5974-b5e7-03943d4040b8/7f7fa5ff-22cc-5974-b5e7-03943d4040b8_image_1.jpg HTTP/1.1" 201 0
2026-03-25 16:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm1%252Fb992a9d1f2d749609ed519e777aae617%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm1/b992a9d1f2d749609ed519e777aae617/images/large/2.jpg saved to cache
2026-03-25 16:31:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7f7fa5ff-22cc-5974-b5e7-03943d4040b8
2026-03-25 16:31:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc629510>
2026-03-25 16:31:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58039fa8-b368-58a0-9660-85afb6cead7d/58039fa8-b368-58a0-9660-85afb6cead7d_image_8.jpg HTTP/1.1" 201 0
2026-03-25 16:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk2%252Fde30ed1b35af478192b5f02811dbd53c%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk2/de30ed1b35af478192b5f02811dbd53c/images/large/9.jpg saved to cache
2026-03-25 16:31:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 58039fa8-b368-58a0-9660-85afb6cead7d
2026-03-25 16:31:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 58039fa8-b368-58a0-9660-85afb6cead7d, skipping ID generation
2026-03-25 16:31:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 58039fa8-b368-58a0-9660-85afb6cead7d with scrape type 1
2026-03-25 16:31:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 58039fa8-b368-58a0-9660-85afb6cead7d sending to next pipeline
2026-03-25 16:31:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 58039fa8-b368-58a0-9660-85afb6cead7d, identifier: 1983557
2026-03-25 16:31:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 58039fa8-b368-58a0-9660-85afb6cead7d with identifier: 1983557
2026-03-25 16:31:39 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:31:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 58039fa8-b368-58a0-9660-85afb6cead7d with identifier: 1983557
2026-03-25 16:31:39 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 58039fa8-b368-58a0-9660-85afb6cead7d with identifier: 1983557 to the API
2026-03-25 16:31:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:31:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:31:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gk2/de30ed1b35af478192b5f02811dbd53c/images/large/9.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'BIANCO MADREPERLA TINTA SPECIA',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-27T09:30:00Z',
'fuel_type': 'diesel',
'id': '58039fa8-b368-58a0-9660-85afb6cead7d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41025',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': 'PEUGEOT 3008 BlueHDI 130 S&S Active Pack Sport utility vehicle '
'5-door (Euro 6D)',
'odometer': 155573,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 21,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58039fa8-b368-58a0-9660-85afb6cead7d/58039fa8-b368-58a0-9660-85afb6cead7d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 705640,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk2/de30ed1b35af478192b5f02811dbd53c/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58039fa8-b368-58a0-9660-85afb6cead7d/58039fa8-b368-58a0-9660-85afb6cead7d_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 676185,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk2/de30ed1b35af478192b5f02811dbd53c/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58039fa8-b368-58a0-9660-85afb6cead7d/58039fa8-b368-58a0-9660-85afb6cead7d_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 526099,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk2/de30ed1b35af478192b5f02811dbd53c/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58039fa8-b368-58a0-9660-85afb6cead7d/58039fa8-b368-58a0-9660-85afb6cead7d_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 707596,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk2/de30ed1b35af478192b5f02811dbd53c/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58039fa8-b368-58a0-9660-85afb6cead7d/58039fa8-b368-58a0-9660-85afb6cead7d_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 767543,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk2/de30ed1b35af478192b5f02811dbd53c/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58039fa8-b368-58a0-9660-85afb6cead7d/58039fa8-b368-58a0-9660-85afb6cead7d_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 745500,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk2/de30ed1b35af478192b5f02811dbd53c/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58039fa8-b368-58a0-9660-85afb6cead7d/58039fa8-b368-58a0-9660-85afb6cead7d_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 491527,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk2/de30ed1b35af478192b5f02811dbd53c/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58039fa8-b368-58a0-9660-85afb6cead7d/58039fa8-b368-58a0-9660-85afb6cead7d_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 536383,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk2/de30ed1b35af478192b5f02811dbd53c/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58039fa8-b368-58a0-9660-85afb6cead7d/58039fa8-b368-58a0-9660-85afb6cead7d_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 654218,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk2/de30ed1b35af478192b5f02811dbd53c/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58039fa8-b368-58a0-9660-85afb6cead7d/58039fa8-b368-58a0-9660-85afb6cead7d_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 325829,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk2/de30ed1b35af478192b5f02811dbd53c/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-06-10',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT PEUGEOT 3008 BlueHDI 130 S&S Active Pack Sport utility '
'vehicle 5-door (Euro 6D) -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-25 16:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983557%27 HTTP/1.1" 200 None
2026-03-25 16:31:39 [ayvens.it] INFO: Saving data for 1983557: {'created_time': 1774456299.837791, 'last_price_update_time': 1774456299.837801, 'auction_closing_time': 1774603800.0}
2026-03-25 16:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1983557') HTTP/1.1" 204 0
2026-03-25 16:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc4%252Fbbdfd01b13b64024aaab469ceb8f1c6e%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc4/bbdfd01b13b64024aaab469ceb8f1c6e/images/large/2.jpg not downloaded yet
2026-03-25 16:31:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc7f85d0>
2026-03-25 16:31:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b2ea2df-f838-5481-a106-6d9ac9d2c5e0/9b2ea2df-f838-5481-a106-6d9ac9d2c5e0_image_9.jpg HTTP/1.1" 201 0
2026-03-25 16:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm8%252Fa3aa348e0b7d463b82807353dc557162%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm8/a3aa348e0b7d463b82807353dc557162/images/large/10.jpg saved to cache
2026-03-25 16:31:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9b2ea2df-f838-5481-a106-6d9ac9d2c5e0
2026-03-25 16:31:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc9ca550>
2026-03-25 16:31:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f7fa5ff-22cc-5974-b5e7-03943d4040b8/7f7fa5ff-22cc-5974-b5e7-03943d4040b8_image_4.jpg HTTP/1.1" 201 0
2026-03-25 16:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm1%252Fb992a9d1f2d749609ed519e777aae617%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm1/b992a9d1f2d749609ed519e777aae617/images/large/5.jpg saved to cache
2026-03-25 16:31:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7f7fa5ff-22cc-5974-b5e7-03943d4040b8
2026-03-25 16:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc4%252Fbbdfd01b13b64024aaab469ceb8f1c6e%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc4/bbdfd01b13b64024aaab469ceb8f1c6e/images/large/3.jpg not downloaded yet
2026-03-25 16:31:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34d6b1f890>
2026-03-25 16:31:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f7fa5ff-22cc-5974-b5e7-03943d4040b8/7f7fa5ff-22cc-5974-b5e7-03943d4040b8_image_3.jpg HTTP/1.1" 201 0
2026-03-25 16:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm1%252Fb992a9d1f2d749609ed519e777aae617%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm1/b992a9d1f2d749609ed519e777aae617/images/large/4.jpg saved to cache
2026-03-25 16:31:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7f7fa5ff-22cc-5974-b5e7-03943d4040b8
2026-03-25 16:31:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc9f0290>
2026-03-25 16:31:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f7fa5ff-22cc-5974-b5e7-03943d4040b8/7f7fa5ff-22cc-5974-b5e7-03943d4040b8_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm1%252Fb992a9d1f2d749609ed519e777aae617%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm1/b992a9d1f2d749609ed519e777aae617/images/large/1.jpg saved to cache
2026-03-25 16:31:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7f7fa5ff-22cc-5974-b5e7-03943d4040b8
2026-03-25 16:31:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34d74086d0>
2026-03-25 16:31:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f7fa5ff-22cc-5974-b5e7-03943d4040b8/7f7fa5ff-22cc-5974-b5e7-03943d4040b8_image_7.jpg HTTP/1.1" 201 0
2026-03-25 16:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm1%252Fb992a9d1f2d749609ed519e777aae617%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm1/b992a9d1f2d749609ed519e777aae617/images/large/8.jpg saved to cache
2026-03-25 16:31:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7f7fa5ff-22cc-5974-b5e7-03943d4040b8
2026-03-25 16:31:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc9d5510>
2026-03-25 16:31:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f7fa5ff-22cc-5974-b5e7-03943d4040b8/7f7fa5ff-22cc-5974-b5e7-03943d4040b8_image_2.jpg HTTP/1.1" 201 0
2026-03-25 16:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm1%252Fb992a9d1f2d749609ed519e777aae617%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm1/b992a9d1f2d749609ed519e777aae617/images/large/3.jpg saved to cache
2026-03-25 16:31:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7f7fa5ff-22cc-5974-b5e7-03943d4040b8
2026-03-25 16:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc4%252Fbbdfd01b13b64024aaab469ceb8f1c6e%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc4/bbdfd01b13b64024aaab469ceb8f1c6e/images/large/4.jpg not downloaded yet
2026-03-25 16:31:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm1/b992a9d1f2d749609ed519e777aae617/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc4%252Fbbdfd01b13b64024aaab469ceb8f1c6e%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc4/bbdfd01b13b64024aaab469ceb8f1c6e/images/large/5.jpg not downloaded yet
2026-03-25 16:31:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj9/d1d8bfde47a1408d85f60ec645375bff/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj9/d1d8bfde47a1408d85f60ec645375bff/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc4%252Fbbdfd01b13b64024aaab469ceb8f1c6e%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc4/bbdfd01b13b64024aaab469ceb8f1c6e/images/large/6.jpg not downloaded yet
2026-03-25 16:31:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj9/d1d8bfde47a1408d85f60ec645375bff/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc4%252Fbbdfd01b13b64024aaab469ceb8f1c6e%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc4/bbdfd01b13b64024aaab469ceb8f1c6e/images/large/7.jpg not downloaded yet
2026-03-25 16:31:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj9/d1d8bfde47a1408d85f60ec645375bff/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm1/b992a9d1f2d749609ed519e777aae617/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm1/b992a9d1f2d749609ed519e777aae617/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc4%252Fbbdfd01b13b64024aaab469ceb8f1c6e%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc4/bbdfd01b13b64024aaab469ceb8f1c6e/images/large/8.jpg not downloaded yet
2026-03-25 16:31:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm1/b992a9d1f2d749609ed519e777aae617/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc4%252Fbbdfd01b13b64024aaab469ceb8f1c6e%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc4/bbdfd01b13b64024aaab469ceb8f1c6e/images/large/9.jpg not downloaded yet
2026-03-25 16:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc4%252Fbbdfd01b13b64024aaab469ceb8f1c6e%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc4/bbdfd01b13b64024aaab469ceb8f1c6e/images/large/10.jpg not downloaded yet
2026-03-25 16:31:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc5d77d0>
2026-03-25 16:31:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f7fa5ff-22cc-5974-b5e7-03943d4040b8/7f7fa5ff-22cc-5974-b5e7-03943d4040b8_image_6.jpg HTTP/1.1" 201 0
2026-03-25 16:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm1%252Fb992a9d1f2d749609ed519e777aae617%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm1/b992a9d1f2d749609ed519e777aae617/images/large/7.jpg saved to cache
2026-03-25 16:31:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7f7fa5ff-22cc-5974-b5e7-03943d4040b8
2026-03-25 16:31:40 [ayvens.it] INFO: Found listing with ID: 1983561
2026-03-25 16:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983561%27 HTTP/1.1" 200 None
2026-03-25 16:31:40 [ayvens.it] INFO: Scrape type for 1983561: 1
2026-03-25 16:31:40 [ayvens.it] INFO: Extracting data for car ID: 1983561
2026-03-25 16:31:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6b9d88c4-7758-54d7-adaa-0c95f4e9c6be with identifier: 1983561
2026-03-25 16:31:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6b9d88c4-7758-54d7-adaa-0c95f4e9c6be with scrape type 1
2026-03-25 16:31:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6b9d88c4-7758-54d7-adaa-0c95f4e9c6be
2026-03-25 16:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk6%252Ff4c6f16b7581495dbee59dbdf6f2a753%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk6/f4c6f16b7581495dbee59dbdf6f2a753/images/large/1.jpg not downloaded yet
2026-03-25 16:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk6%252Ff4c6f16b7581495dbee59dbdf6f2a753%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk6/f4c6f16b7581495dbee59dbdf6f2a753/images/large/2.jpg not downloaded yet
2026-03-25 16:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk6%252Ff4c6f16b7581495dbee59dbdf6f2a753%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk6/f4c6f16b7581495dbee59dbdf6f2a753/images/large/3.jpg not downloaded yet
2026-03-25 16:31:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34de45a1d0>
2026-03-25 16:31:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26b1193f-e118-54b6-8b74-27b4a9c6ffe3/26b1193f-e118-54b6-8b74-27b4a9c6ffe3_image_3.jpg HTTP/1.1" 201 0
2026-03-25 16:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj9%252Fd1d8bfde47a1408d85f60ec645375bff%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj9/d1d8bfde47a1408d85f60ec645375bff/images/large/4.jpg saved to cache
2026-03-25 16:31:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 26b1193f-e118-54b6-8b74-27b4a9c6ffe3
2026-03-25 16:31:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34d745bfd0>
2026-03-25 16:31:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26b1193f-e118-54b6-8b74-27b4a9c6ffe3/26b1193f-e118-54b6-8b74-27b4a9c6ffe3_image_2.jpg HTTP/1.1" 201 0
2026-03-25 16:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj9%252Fd1d8bfde47a1408d85f60ec645375bff%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj9/d1d8bfde47a1408d85f60ec645375bff/images/large/3.jpg saved to cache
2026-03-25 16:31:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 26b1193f-e118-54b6-8b74-27b4a9c6ffe3
2026-03-25 16:31:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcb1c310>
2026-03-25 16:31:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26b1193f-e118-54b6-8b74-27b4a9c6ffe3/26b1193f-e118-54b6-8b74-27b4a9c6ffe3_image_1.jpg HTTP/1.1" 201 0
2026-03-25 16:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj9%252Fd1d8bfde47a1408d85f60ec645375bff%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj9/d1d8bfde47a1408d85f60ec645375bff/images/large/2.jpg saved to cache
2026-03-25 16:31:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 26b1193f-e118-54b6-8b74-27b4a9c6ffe3
2026-03-25 16:31:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc91f2d0>
2026-03-25 16:31:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26b1193f-e118-54b6-8b74-27b4a9c6ffe3/26b1193f-e118-54b6-8b74-27b4a9c6ffe3_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj9%252Fd1d8bfde47a1408d85f60ec645375bff%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj9/d1d8bfde47a1408d85f60ec645375bff/images/large/1.jpg saved to cache
2026-03-25 16:31:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 26b1193f-e118-54b6-8b74-27b4a9c6ffe3
2026-03-25 16:31:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcb1d390>
2026-03-25 16:31:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f7fa5ff-22cc-5974-b5e7-03943d4040b8/7f7fa5ff-22cc-5974-b5e7-03943d4040b8_image_5.jpg HTTP/1.1" 201 0
2026-03-25 16:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm1%252Fb992a9d1f2d749609ed519e777aae617%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm1/b992a9d1f2d749609ed519e777aae617/images/large/6.jpg saved to cache
2026-03-25 16:31:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7f7fa5ff-22cc-5974-b5e7-03943d4040b8
2026-03-25 16:31:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc80ec10>
2026-03-25 16:31:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f7fa5ff-22cc-5974-b5e7-03943d4040b8/7f7fa5ff-22cc-5974-b5e7-03943d4040b8_image_8.jpg HTTP/1.1" 201 0
2026-03-25 16:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm1%252Fb992a9d1f2d749609ed519e777aae617%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm1/b992a9d1f2d749609ed519e777aae617/images/large/9.jpg saved to cache
2026-03-25 16:31:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7f7fa5ff-22cc-5974-b5e7-03943d4040b8
2026-03-25 16:31:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcb1c2d0>
2026-03-25 16:31:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f7fa5ff-22cc-5974-b5e7-03943d4040b8/7f7fa5ff-22cc-5974-b5e7-03943d4040b8_image_9.jpg HTTP/1.1" 201 0
2026-03-25 16:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm1%252Fb992a9d1f2d749609ed519e777aae617%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm1/b992a9d1f2d749609ed519e777aae617/images/large/10.jpg saved to cache
2026-03-25 16:31:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7f7fa5ff-22cc-5974-b5e7-03943d4040b8
2026-03-25 16:31:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7f7fa5ff-22cc-5974-b5e7-03943d4040b8, skipping ID generation
2026-03-25 16:31:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7f7fa5ff-22cc-5974-b5e7-03943d4040b8 with scrape type 1
2026-03-25 16:31:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7f7fa5ff-22cc-5974-b5e7-03943d4040b8 sending to next pipeline
2026-03-25 16:31:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 7f7fa5ff-22cc-5974-b5e7-03943d4040b8, identifier: 1983558
2026-03-25 16:31:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 7f7fa5ff-22cc-5974-b5e7-03943d4040b8 with identifier: 1983558
2026-03-25 16:31:41 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:31:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 7f7fa5ff-22cc-5974-b5e7-03943d4040b8 with identifier: 1983558
2026-03-25 16:31:41 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 7f7fa5ff-22cc-5974-b5e7-03943d4040b8 with identifier: 1983558 to the API
2026-03-25 16:31:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:31:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:31:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gm1/b992a9d1f2d749609ed519e777aae617/images/large/10.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'NERO PERLA METALLIZZATO',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-27T09:30:00Z',
'fuel_type': 'diesel',
'id': '7f7fa5ff-22cc-5974-b5e7-03943d4040b8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41025',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': 'PEUGEOT 308 SW SW Allure Pack BlueHDi 130 EAT8 S&S SW 5-door',
'odometer': 158964,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 26,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f7fa5ff-22cc-5974-b5e7-03943d4040b8/7f7fa5ff-22cc-5974-b5e7-03943d4040b8_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 843403,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm1/b992a9d1f2d749609ed519e777aae617/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f7fa5ff-22cc-5974-b5e7-03943d4040b8/7f7fa5ff-22cc-5974-b5e7-03943d4040b8_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 419294,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm1/b992a9d1f2d749609ed519e777aae617/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f7fa5ff-22cc-5974-b5e7-03943d4040b8/7f7fa5ff-22cc-5974-b5e7-03943d4040b8_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 444948,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm1/b992a9d1f2d749609ed519e777aae617/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f7fa5ff-22cc-5974-b5e7-03943d4040b8/7f7fa5ff-22cc-5974-b5e7-03943d4040b8_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 651061,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm1/b992a9d1f2d749609ed519e777aae617/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f7fa5ff-22cc-5974-b5e7-03943d4040b8/7f7fa5ff-22cc-5974-b5e7-03943d4040b8_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 494904,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm1/b992a9d1f2d749609ed519e777aae617/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f7fa5ff-22cc-5974-b5e7-03943d4040b8/7f7fa5ff-22cc-5974-b5e7-03943d4040b8_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 845416,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm1/b992a9d1f2d749609ed519e777aae617/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f7fa5ff-22cc-5974-b5e7-03943d4040b8/7f7fa5ff-22cc-5974-b5e7-03943d4040b8_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 366645,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm1/b992a9d1f2d749609ed519e777aae617/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f7fa5ff-22cc-5974-b5e7-03943d4040b8/7f7fa5ff-22cc-5974-b5e7-03943d4040b8_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 412524,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm1/b992a9d1f2d749609ed519e777aae617/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f7fa5ff-22cc-5974-b5e7-03943d4040b8/7f7fa5ff-22cc-5974-b5e7-03943d4040b8_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 832192,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm1/b992a9d1f2d749609ed519e777aae617/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f7fa5ff-22cc-5974-b5e7-03943d4040b8/7f7fa5ff-22cc-5974-b5e7-03943d4040b8_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 866891,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm1/b992a9d1f2d749609ed519e777aae617/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-02-21',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT PEUGEOT 308 SW SW Allure Pack BlueHDi 130 EAT8 S&S SW '
'5-door -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2023}
2026-03-25 16:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983558%27 HTTP/1.1" 200 None
2026-03-25 16:31:41 [ayvens.it] INFO: Saving data for 1983558: {'created_time': 1774456301.961227, 'last_price_update_time': 1774456301.961237, 'auction_closing_time': 1774603800.0}
2026-03-25 16:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1983558') HTTP/1.1" 204 0
2026-03-25 16:31:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj9/d1d8bfde47a1408d85f60ec645375bff/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk6%252Ff4c6f16b7581495dbee59dbdf6f2a753%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk6/f4c6f16b7581495dbee59dbdf6f2a753/images/large/4.jpg not downloaded yet
2026-03-25 16:31:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj9/d1d8bfde47a1408d85f60ec645375bff/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm8/a3aa348e0b7d463b82807353dc557162/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk6%252Ff4c6f16b7581495dbee59dbdf6f2a753%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk6/f4c6f16b7581495dbee59dbdf6f2a753/images/large/5.jpg not downloaded yet
2026-03-25 16:31:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj9/d1d8bfde47a1408d85f60ec645375bff/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk6%252Ff4c6f16b7581495dbee59dbdf6f2a753%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk6/f4c6f16b7581495dbee59dbdf6f2a753/images/large/6.jpg not downloaded yet
2026-03-25 16:31:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj9/d1d8bfde47a1408d85f60ec645375bff/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk6%252Ff4c6f16b7581495dbee59dbdf6f2a753%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk6/f4c6f16b7581495dbee59dbdf6f2a753/images/large/7.jpg not downloaded yet
2026-03-25 16:31:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj9/d1d8bfde47a1408d85f60ec645375bff/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp0/e3e09c04425f4cd7b932ca3a8a47e10c/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn8/88fd3b1ede7e4fa8bb1169b65fdc21c5/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk6%252Ff4c6f16b7581495dbee59dbdf6f2a753%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk6/f4c6f16b7581495dbee59dbdf6f2a753/images/large/8.jpg not downloaded yet
2026-03-25 16:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk6%252Ff4c6f16b7581495dbee59dbdf6f2a753%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk6/f4c6f16b7581495dbee59dbdf6f2a753/images/large/9.jpg not downloaded yet
2026-03-25 16:31:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc766890>
2026-03-25 16:31:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26b1193f-e118-54b6-8b74-27b4a9c6ffe3/26b1193f-e118-54b6-8b74-27b4a9c6ffe3_image_7.jpg HTTP/1.1" 201 0
2026-03-25 16:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj9%252Fd1d8bfde47a1408d85f60ec645375bff%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj9/d1d8bfde47a1408d85f60ec645375bff/images/large/8.jpg saved to cache
2026-03-25 16:31:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 26b1193f-e118-54b6-8b74-27b4a9c6ffe3
2026-03-25 16:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk6%252Ff4c6f16b7581495dbee59dbdf6f2a753%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk6/f4c6f16b7581495dbee59dbdf6f2a753/images/large/10.jpg not downloaded yet
2026-03-25 16:31:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34de460750>
2026-03-25 16:31:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26b1193f-e118-54b6-8b74-27b4a9c6ffe3/26b1193f-e118-54b6-8b74-27b4a9c6ffe3_image_8.jpg HTTP/1.1" 201 0
2026-03-25 16:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj9%252Fd1d8bfde47a1408d85f60ec645375bff%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj9/d1d8bfde47a1408d85f60ec645375bff/images/large/9.jpg saved to cache
2026-03-25 16:31:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 26b1193f-e118-54b6-8b74-27b4a9c6ffe3
2026-03-25 16:31:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc634690>
2026-03-25 16:31:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b2ea2df-f838-5481-a106-6d9ac9d2c5e0/9b2ea2df-f838-5481-a106-6d9ac9d2c5e0_image_7.jpg HTTP/1.1" 201 0
2026-03-25 16:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm8%252Fa3aa348e0b7d463b82807353dc557162%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm8/a3aa348e0b7d463b82807353dc557162/images/large/8.jpg saved to cache
2026-03-25 16:31:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9b2ea2df-f838-5481-a106-6d9ac9d2c5e0
2026-03-25 16:31:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9b2ea2df-f838-5481-a106-6d9ac9d2c5e0, skipping ID generation
2026-03-25 16:31:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9b2ea2df-f838-5481-a106-6d9ac9d2c5e0 with scrape type 1
2026-03-25 16:31:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9b2ea2df-f838-5481-a106-6d9ac9d2c5e0 sending to next pipeline
2026-03-25 16:31:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 9b2ea2df-f838-5481-a106-6d9ac9d2c5e0, identifier: 1983549
2026-03-25 16:31:42 [ayvens.it] INFO: Found listing with ID: 1983562
2026-03-25 16:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983562%27 HTTP/1.1" 200 None
2026-03-25 16:31:42 [ayvens.it] INFO: Scrape type for 1983562: 1
2026-03-25 16:31:42 [ayvens.it] INFO: Extracting data for car ID: 1983562
2026-03-25 16:31:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c70b927e-cb2d-5dfb-847c-0c314bd2fb22 with identifier: 1983562
2026-03-25 16:31:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c70b927e-cb2d-5dfb-847c-0c314bd2fb22 with scrape type 1
2026-03-25 16:31:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c70b927e-cb2d-5dfb-847c-0c314bd2fb22
2026-03-25 16:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj8%252F85df5ee543dd4007afb4aa933b685f10%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj8/85df5ee543dd4007afb4aa933b685f10/images/large/1.jpg not downloaded yet
2026-03-25 16:31:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 9b2ea2df-f838-5481-a106-6d9ac9d2c5e0 with identifier: 1983549
2026-03-25 16:31:42 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:31:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 9b2ea2df-f838-5481-a106-6d9ac9d2c5e0 with identifier: 1983549
2026-03-25 16:31:42 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 9b2ea2df-f838-5481-a106-6d9ac9d2c5e0 with identifier: 1983549 to the API
2026-03-25 16:31:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:31:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:31:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gm8/a3aa348e0b7d463b82807353dc557162/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'BLU ANODIZZATO METALLIZZATO',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.1L',
'expiration_date': '2026-03-27T09:30:00Z',
'fuel_type': 'diesel',
'id': '9b2ea2df-f838-5481-a106-6d9ac9d2c5e0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41025',
'listing': 'auction',
'location': None,
'make': 'ALFA ROMEO',
'model': 'ALFA ROMEO STELVIO 2.2 TD 210 CV TI AT8 Q4 FP',
'odometer': 142116,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 25,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b2ea2df-f838-5481-a106-6d9ac9d2c5e0/9b2ea2df-f838-5481-a106-6d9ac9d2c5e0_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 861334,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm8/a3aa348e0b7d463b82807353dc557162/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b2ea2df-f838-5481-a106-6d9ac9d2c5e0/9b2ea2df-f838-5481-a106-6d9ac9d2c5e0_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 861334,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm8/a3aa348e0b7d463b82807353dc557162/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b2ea2df-f838-5481-a106-6d9ac9d2c5e0/9b2ea2df-f838-5481-a106-6d9ac9d2c5e0_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 845586,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm8/a3aa348e0b7d463b82807353dc557162/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b2ea2df-f838-5481-a106-6d9ac9d2c5e0/9b2ea2df-f838-5481-a106-6d9ac9d2c5e0_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 804663,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm8/a3aa348e0b7d463b82807353dc557162/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b2ea2df-f838-5481-a106-6d9ac9d2c5e0/9b2ea2df-f838-5481-a106-6d9ac9d2c5e0_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 892696,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm8/a3aa348e0b7d463b82807353dc557162/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b2ea2df-f838-5481-a106-6d9ac9d2c5e0/9b2ea2df-f838-5481-a106-6d9ac9d2c5e0_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 625763,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm8/a3aa348e0b7d463b82807353dc557162/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b2ea2df-f838-5481-a106-6d9ac9d2c5e0/9b2ea2df-f838-5481-a106-6d9ac9d2c5e0_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 521666,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm8/a3aa348e0b7d463b82807353dc557162/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b2ea2df-f838-5481-a106-6d9ac9d2c5e0/9b2ea2df-f838-5481-a106-6d9ac9d2c5e0_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 469285,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm8/a3aa348e0b7d463b82807353dc557162/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b2ea2df-f838-5481-a106-6d9ac9d2c5e0/9b2ea2df-f838-5481-a106-6d9ac9d2c5e0_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 631490,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm8/a3aa348e0b7d463b82807353dc557162/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b2ea2df-f838-5481-a106-6d9ac9d2c5e0/9b2ea2df-f838-5481-a106-6d9ac9d2c5e0_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 569789,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm8/a3aa348e0b7d463b82807353dc557162/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-01-26',
'seats_number': 5,
'seller_name': None,
'title': 'ALFA ROMEO ALFA ROMEO STELVIO 2.2 TD 210 CV TI AT8 Q4 FP -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2023}
2026-03-25 16:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983549%27 HTTP/1.1" 200 None
2026-03-25 16:31:42 [ayvens.it] INFO: Saving data for 1983549: {'created_time': 1774456302.969676, 'last_price_update_time': 1774456302.969687, 'auction_closing_time': 1774603800.0}
2026-03-25 16:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1983549') HTTP/1.1" 204 0
2026-03-25 16:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj8%252F85df5ee543dd4007afb4aa933b685f10%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj8/85df5ee543dd4007afb4aa933b685f10/images/large/2.jpg not downloaded yet
2026-03-25 16:31:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcaaa890>
2026-03-25 16:31:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26b1193f-e118-54b6-8b74-27b4a9c6ffe3/26b1193f-e118-54b6-8b74-27b4a9c6ffe3_image_4.jpg HTTP/1.1" 201 0
2026-03-25 16:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj9%252Fd1d8bfde47a1408d85f60ec645375bff%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj9/d1d8bfde47a1408d85f60ec645375bff/images/large/5.jpg saved to cache
2026-03-25 16:31:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 26b1193f-e118-54b6-8b74-27b4a9c6ffe3
2026-03-25 16:31:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dca27750>
2026-03-25 16:31:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26b1193f-e118-54b6-8b74-27b4a9c6ffe3/26b1193f-e118-54b6-8b74-27b4a9c6ffe3_image_5.jpg HTTP/1.1" 201 0
2026-03-25 16:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj9%252Fd1d8bfde47a1408d85f60ec645375bff%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj9/d1d8bfde47a1408d85f60ec645375bff/images/large/6.jpg saved to cache
2026-03-25 16:31:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 26b1193f-e118-54b6-8b74-27b4a9c6ffe3
2026-03-25 16:31:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dca97b50>
2026-03-25 16:31:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26b1193f-e118-54b6-8b74-27b4a9c6ffe3/26b1193f-e118-54b6-8b74-27b4a9c6ffe3_image_6.jpg HTTP/1.1" 201 0
2026-03-25 16:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj9%252Fd1d8bfde47a1408d85f60ec645375bff%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj9/d1d8bfde47a1408d85f60ec645375bff/images/large/7.jpg saved to cache
2026-03-25 16:31:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 26b1193f-e118-54b6-8b74-27b4a9c6ffe3
2026-03-25 16:31:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc6371d0>
2026-03-25 16:31:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f12ed7e7-f76c-5668-84c9-19e1fefd4177/f12ed7e7-f76c-5668-84c9-19e1fefd4177_image_9.jpg HTTP/1.1" 201 0
2026-03-25 16:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp0%252Fe3e09c04425f4cd7b932ca3a8a47e10c%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp0/e3e09c04425f4cd7b932ca3a8a47e10c/images/large/10.jpg saved to cache
2026-03-25 16:31:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f12ed7e7-f76c-5668-84c9-19e1fefd4177
2026-03-25 16:31:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34d6b36250>
2026-03-25 16:31:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e0240b9-2b81-5e3a-83e1-95c8245fc12a/2e0240b9-2b81-5e3a-83e1-95c8245fc12a_image_3.jpg HTTP/1.1" 201 0
2026-03-25 16:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn8%252F88fd3b1ede7e4fa8bb1169b65fdc21c5%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn8/88fd3b1ede7e4fa8bb1169b65fdc21c5/images/large/4.jpg saved to cache
2026-03-25 16:31:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2e0240b9-2b81-5e3a-83e1-95c8245fc12a
2026-03-25 16:31:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2e0240b9-2b81-5e3a-83e1-95c8245fc12a, skipping ID generation
2026-03-25 16:31:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2e0240b9-2b81-5e3a-83e1-95c8245fc12a with scrape type 1
2026-03-25 16:31:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2e0240b9-2b81-5e3a-83e1-95c8245fc12a sending to next pipeline
2026-03-25 16:31:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 2e0240b9-2b81-5e3a-83e1-95c8245fc12a, identifier: 1983547
2026-03-25 16:31:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 2e0240b9-2b81-5e3a-83e1-95c8245fc12a with identifier: 1983547
2026-03-25 16:31:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 2e0240b9-2b81-5e3a-83e1-95c8245fc12a with identifier: 1983547
2026-03-25 16:31:43 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 2e0240b9-2b81-5e3a-83e1-95c8245fc12a with identifier: 1983547 to the API
2026-03-25 16:31:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:31:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:31:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gn8/88fd3b1ede7e4fa8bb1169b65fdc21c5/images/large/4.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'NERO PERLA MTZ',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-27T09:30:00Z',
'fuel_type': 'diesel',
'id': '2e0240b9-2b81-5e3a-83e1-95c8245fc12a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41025',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': 'PEUGEOT 308 SW (PC) SW ALLURE PACK BLUEHDI 130 EAT8 S&S FP',
'odometer': 104285,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 20,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e0240b9-2b81-5e3a-83e1-95c8245fc12a/2e0240b9-2b81-5e3a-83e1-95c8245fc12a_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 809505,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn8/88fd3b1ede7e4fa8bb1169b65fdc21c5/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e0240b9-2b81-5e3a-83e1-95c8245fc12a/2e0240b9-2b81-5e3a-83e1-95c8245fc12a_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 747251,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn8/88fd3b1ede7e4fa8bb1169b65fdc21c5/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e0240b9-2b81-5e3a-83e1-95c8245fc12a/2e0240b9-2b81-5e3a-83e1-95c8245fc12a_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 809505,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn8/88fd3b1ede7e4fa8bb1169b65fdc21c5/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e0240b9-2b81-5e3a-83e1-95c8245fc12a/2e0240b9-2b81-5e3a-83e1-95c8245fc12a_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 750918,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn8/88fd3b1ede7e4fa8bb1169b65fdc21c5/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e0240b9-2b81-5e3a-83e1-95c8245fc12a/2e0240b9-2b81-5e3a-83e1-95c8245fc12a_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 702552,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn8/88fd3b1ede7e4fa8bb1169b65fdc21c5/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e0240b9-2b81-5e3a-83e1-95c8245fc12a/2e0240b9-2b81-5e3a-83e1-95c8245fc12a_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 559792,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn8/88fd3b1ede7e4fa8bb1169b65fdc21c5/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e0240b9-2b81-5e3a-83e1-95c8245fc12a/2e0240b9-2b81-5e3a-83e1-95c8245fc12a_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 398248,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn8/88fd3b1ede7e4fa8bb1169b65fdc21c5/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e0240b9-2b81-5e3a-83e1-95c8245fc12a/2e0240b9-2b81-5e3a-83e1-95c8245fc12a_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 534204,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn8/88fd3b1ede7e4fa8bb1169b65fdc21c5/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e0240b9-2b81-5e3a-83e1-95c8245fc12a/2e0240b9-2b81-5e3a-83e1-95c8245fc12a_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 549175,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn8/88fd3b1ede7e4fa8bb1169b65fdc21c5/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e0240b9-2b81-5e3a-83e1-95c8245fc12a/2e0240b9-2b81-5e3a-83e1-95c8245fc12a_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 515815,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn8/88fd3b1ede7e4fa8bb1169b65fdc21c5/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-04-21',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT PEUGEOT 308 SW (PC) SW ALLURE PACK BLUEHDI 130 EAT8 S&S FP '
'-',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2023}
2026-03-25 16:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983547%27 HTTP/1.1" 200 None
2026-03-25 16:31:43 [ayvens.it] INFO: Saving data for 1983547: {'created_time': 1774456303.828282, 'last_price_update_time': 1774456303.828301, 'auction_closing_time': 1774603800.0}
2026-03-25 16:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1983547') HTTP/1.1" 204 0
2026-03-25 16:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj8%252F85df5ee543dd4007afb4aa933b685f10%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj8/85df5ee543dd4007afb4aa933b685f10/images/large/3.jpg not downloaded yet
2026-03-25 16:31:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc4/bbdfd01b13b64024aaab469ceb8f1c6e/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc4/bbdfd01b13b64024aaab469ceb8f1c6e/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc4/bbdfd01b13b64024aaab469ceb8f1c6e/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk6/f4c6f16b7581495dbee59dbdf6f2a753/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk6/f4c6f16b7581495dbee59dbdf6f2a753/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj8%252F85df5ee543dd4007afb4aa933b685f10%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj8/85df5ee543dd4007afb4aa933b685f10/images/large/4.jpg not downloaded yet
2026-03-25 16:31:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk6/f4c6f16b7581495dbee59dbdf6f2a753/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj8%252F85df5ee543dd4007afb4aa933b685f10%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj8/85df5ee543dd4007afb4aa933b685f10/images/large/5.jpg not downloaded yet
2026-03-25 16:31:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc4/bbdfd01b13b64024aaab469ceb8f1c6e/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc4/bbdfd01b13b64024aaab469ceb8f1c6e/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj8%252F85df5ee543dd4007afb4aa933b685f10%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj8/85df5ee543dd4007afb4aa933b685f10/images/large/6.jpg not downloaded yet
2026-03-25 16:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj8%252F85df5ee543dd4007afb4aa933b685f10%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj8/85df5ee543dd4007afb4aa933b685f10/images/large/7.jpg not downloaded yet
2026-03-25 16:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj8%252F85df5ee543dd4007afb4aa933b685f10%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj8/85df5ee543dd4007afb4aa933b685f10/images/large/8.jpg not downloaded yet
2026-03-25 16:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj8%252F85df5ee543dd4007afb4aa933b685f10%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj8/85df5ee543dd4007afb4aa933b685f10/images/large/9.jpg not downloaded yet
2026-03-25 16:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj8%252F85df5ee543dd4007afb4aa933b685f10%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj8/85df5ee543dd4007afb4aa933b685f10/images/large/10.jpg not downloaded yet
2026-03-25 16:31:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcaaa190>
2026-03-25 16:31:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e1d0474-7c36-520d-9b10-965a59b503c9/2e1d0474-7c36-520d-9b10-965a59b503c9_image_4.jpg HTTP/1.1" 201 0
2026-03-25 16:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc4%252Fbbdfd01b13b64024aaab469ceb8f1c6e%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc4/bbdfd01b13b64024aaab469ceb8f1c6e/images/large/5.jpg saved to cache
2026-03-25 16:31:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2e1d0474-7c36-520d-9b10-965a59b503c9
2026-03-25 16:31:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc593090>
2026-03-25 16:31:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e1d0474-7c36-520d-9b10-965a59b503c9/2e1d0474-7c36-520d-9b10-965a59b503c9_image_5.jpg HTTP/1.1" 201 0
2026-03-25 16:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc4%252Fbbdfd01b13b64024aaab469ceb8f1c6e%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc4/bbdfd01b13b64024aaab469ceb8f1c6e/images/large/6.jpg saved to cache
2026-03-25 16:31:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2e1d0474-7c36-520d-9b10-965a59b503c9
2026-03-25 16:31:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc637e50>
2026-03-25 16:31:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e1d0474-7c36-520d-9b10-965a59b503c9/2e1d0474-7c36-520d-9b10-965a59b503c9_image_3.jpg HTTP/1.1" 201 0
2026-03-25 16:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc4%252Fbbdfd01b13b64024aaab469ceb8f1c6e%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc4/bbdfd01b13b64024aaab469ceb8f1c6e/images/large/4.jpg saved to cache
2026-03-25 16:31:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2e1d0474-7c36-520d-9b10-965a59b503c9
2026-03-25 16:31:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc60dfd0>
2026-03-25 16:31:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b9d88c4-7758-54d7-adaa-0c95f4e9c6be/6b9d88c4-7758-54d7-adaa-0c95f4e9c6be_image_2.jpg HTTP/1.1" 201 0
2026-03-25 16:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk6%252Ff4c6f16b7581495dbee59dbdf6f2a753%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk6/f4c6f16b7581495dbee59dbdf6f2a753/images/large/3.jpg saved to cache
2026-03-25 16:31:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6b9d88c4-7758-54d7-adaa-0c95f4e9c6be
2026-03-25 16:31:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc869a90>
2026-03-25 16:31:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b9d88c4-7758-54d7-adaa-0c95f4e9c6be/6b9d88c4-7758-54d7-adaa-0c95f4e9c6be_image_1.jpg HTTP/1.1" 201 0
2026-03-25 16:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk6%252Ff4c6f16b7581495dbee59dbdf6f2a753%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk6/f4c6f16b7581495dbee59dbdf6f2a753/images/large/2.jpg saved to cache
2026-03-25 16:31:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6b9d88c4-7758-54d7-adaa-0c95f4e9c6be
2026-03-25 16:31:44 [ayvens.it] INFO: Found listing with ID: 1983563
2026-03-25 16:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983563%27 HTTP/1.1" 200 None
2026-03-25 16:31:44 [ayvens.it] INFO: Scrape type for 1983563: 1
2026-03-25 16:31:44 [ayvens.it] INFO: Extracting data for car ID: 1983563
2026-03-25 16:31:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 211dd2cd-f8d1-5e2e-990f-9a303b241aea with identifier: 1983563
2026-03-25 16:31:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 211dd2cd-f8d1-5e2e-990f-9a303b241aea with scrape type 1
2026-03-25 16:31:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 211dd2cd-f8d1-5e2e-990f-9a303b241aea
2026-03-25 16:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn9%252Fe213679c8d49423e81df6cc1bf7c56b6%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn9/e213679c8d49423e81df6cc1bf7c56b6/images/large/1.jpg not downloaded yet
2026-03-25 16:31:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc4/bbdfd01b13b64024aaab469ceb8f1c6e/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcab1190>
2026-03-25 16:31:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b9d88c4-7758-54d7-adaa-0c95f4e9c6be/6b9d88c4-7758-54d7-adaa-0c95f4e9c6be_image_3.jpg HTTP/1.1" 201 0
2026-03-25 16:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk6%252Ff4c6f16b7581495dbee59dbdf6f2a753%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk6/f4c6f16b7581495dbee59dbdf6f2a753/images/large/4.jpg saved to cache
2026-03-25 16:31:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6b9d88c4-7758-54d7-adaa-0c95f4e9c6be
2026-03-25 16:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn9%252Fe213679c8d49423e81df6cc1bf7c56b6%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn9/e213679c8d49423e81df6cc1bf7c56b6/images/large/2.jpg not downloaded yet
2026-03-25 16:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn9%252Fe213679c8d49423e81df6cc1bf7c56b6%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn9/e213679c8d49423e81df6cc1bf7c56b6/images/large/3.jpg not downloaded yet
2026-03-25 16:31:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34d7401110>
2026-03-25 16:31:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e1d0474-7c36-520d-9b10-965a59b503c9/2e1d0474-7c36-520d-9b10-965a59b503c9_image_2.jpg HTTP/1.1" 201 0
2026-03-25 16:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc4%252Fbbdfd01b13b64024aaab469ceb8f1c6e%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc4/bbdfd01b13b64024aaab469ceb8f1c6e/images/large/3.jpg saved to cache
2026-03-25 16:31:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2e1d0474-7c36-520d-9b10-965a59b503c9
2026-03-25 16:31:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dce2cf50>
2026-03-25 16:31:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e1d0474-7c36-520d-9b10-965a59b503c9/2e1d0474-7c36-520d-9b10-965a59b503c9_image_1.jpg HTTP/1.1" 201 0
2026-03-25 16:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc4%252Fbbdfd01b13b64024aaab469ceb8f1c6e%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc4/bbdfd01b13b64024aaab469ceb8f1c6e/images/large/2.jpg saved to cache
2026-03-25 16:31:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2e1d0474-7c36-520d-9b10-965a59b503c9
2026-03-25 16:31:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk6/f4c6f16b7581495dbee59dbdf6f2a753/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn9%252Fe213679c8d49423e81df6cc1bf7c56b6%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn9/e213679c8d49423e81df6cc1bf7c56b6/images/large/4.jpg not downloaded yet
2026-03-25 16:31:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dca12c90>
2026-03-25 16:31:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e1d0474-7c36-520d-9b10-965a59b503c9/2e1d0474-7c36-520d-9b10-965a59b503c9_image_9.jpg HTTP/1.1" 201 0
2026-03-25 16:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc4%252Fbbdfd01b13b64024aaab469ceb8f1c6e%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc4/bbdfd01b13b64024aaab469ceb8f1c6e/images/large/10.jpg saved to cache
2026-03-25 16:31:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2e1d0474-7c36-520d-9b10-965a59b503c9
2026-03-25 16:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn9%252Fe213679c8d49423e81df6cc1bf7c56b6%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn9/e213679c8d49423e81df6cc1bf7c56b6/images/large/5.jpg not downloaded yet
2026-03-25 16:31:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk6/f4c6f16b7581495dbee59dbdf6f2a753/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc4/bbdfd01b13b64024aaab469ceb8f1c6e/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc4/bbdfd01b13b64024aaab469ceb8f1c6e/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk6/f4c6f16b7581495dbee59dbdf6f2a753/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn9%252Fe213679c8d49423e81df6cc1bf7c56b6%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn9/e213679c8d49423e81df6cc1bf7c56b6/images/large/6.jpg not downloaded yet
2026-03-25 16:31:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc4/bbdfd01b13b64024aaab469ceb8f1c6e/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk6/f4c6f16b7581495dbee59dbdf6f2a753/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn9%252Fe213679c8d49423e81df6cc1bf7c56b6%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn9/e213679c8d49423e81df6cc1bf7c56b6/images/large/7.jpg not downloaded yet
2026-03-25 16:31:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc91d9d0>
2026-03-25 16:31:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b9d88c4-7758-54d7-adaa-0c95f4e9c6be/6b9d88c4-7758-54d7-adaa-0c95f4e9c6be_image_4.jpg HTTP/1.1" 201 0
2026-03-25 16:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk6%252Ff4c6f16b7581495dbee59dbdf6f2a753%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk6/f4c6f16b7581495dbee59dbdf6f2a753/images/large/5.jpg saved to cache
2026-03-25 16:31:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6b9d88c4-7758-54d7-adaa-0c95f4e9c6be
2026-03-25 16:31:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj8/85df5ee543dd4007afb4aa933b685f10/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn9%252Fe213679c8d49423e81df6cc1bf7c56b6%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn9/e213679c8d49423e81df6cc1bf7c56b6/images/large/8.jpg not downloaded yet
2026-03-25 16:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn9%252Fe213679c8d49423e81df6cc1bf7c56b6%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn9/e213679c8d49423e81df6cc1bf7c56b6/images/large/9.jpg not downloaded yet
2026-03-25 16:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn9%252Fe213679c8d49423e81df6cc1bf7c56b6%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn9/e213679c8d49423e81df6cc1bf7c56b6/images/large/10.jpg not downloaded yet
2026-03-25 16:31:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc629150>
2026-03-25 16:31:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b9d88c4-7758-54d7-adaa-0c95f4e9c6be/6b9d88c4-7758-54d7-adaa-0c95f4e9c6be_image_9.jpg HTTP/1.1" 201 0
2026-03-25 16:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk6%252Ff4c6f16b7581495dbee59dbdf6f2a753%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk6/f4c6f16b7581495dbee59dbdf6f2a753/images/large/10.jpg saved to cache
2026-03-25 16:31:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6b9d88c4-7758-54d7-adaa-0c95f4e9c6be
2026-03-25 16:31:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc5e9c10>
2026-03-25 16:31:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e1d0474-7c36-520d-9b10-965a59b503c9/2e1d0474-7c36-520d-9b10-965a59b503c9_image_6.jpg HTTP/1.1" 201 0
2026-03-25 16:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc4%252Fbbdfd01b13b64024aaab469ceb8f1c6e%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc4/bbdfd01b13b64024aaab469ceb8f1c6e/images/large/7.jpg saved to cache
2026-03-25 16:31:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2e1d0474-7c36-520d-9b10-965a59b503c9
2026-03-25 16:31:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc37c710>
2026-03-25 16:31:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e1d0474-7c36-520d-9b10-965a59b503c9/2e1d0474-7c36-520d-9b10-965a59b503c9_image_8.jpg HTTP/1.1" 201 0
2026-03-25 16:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc4%252Fbbdfd01b13b64024aaab469ceb8f1c6e%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc4/bbdfd01b13b64024aaab469ceb8f1c6e/images/large/9.jpg saved to cache
2026-03-25 16:31:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2e1d0474-7c36-520d-9b10-965a59b503c9
2026-03-25 16:31:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc30bdd0>
2026-03-25 16:31:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b9d88c4-7758-54d7-adaa-0c95f4e9c6be/6b9d88c4-7758-54d7-adaa-0c95f4e9c6be_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk6%252Ff4c6f16b7581495dbee59dbdf6f2a753%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk6/f4c6f16b7581495dbee59dbdf6f2a753/images/large/1.jpg saved to cache
2026-03-25 16:31:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6b9d88c4-7758-54d7-adaa-0c95f4e9c6be
2026-03-25 16:31:45 [ayvens.it] INFO: Found listing with ID: 1983564
2026-03-25 16:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983564%27 HTTP/1.1" 200 None
2026-03-25 16:31:45 [ayvens.it] INFO: Scrape type for 1983564: 1
2026-03-25 16:31:45 [ayvens.it] INFO: Extracting data for car ID: 1983564
2026-03-25 16:31:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 430c95d6-c62c-5f1c-9503-3e14cf5f2c47 with identifier: 1983564
2026-03-25 16:31:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 430c95d6-c62c-5f1c-9503-3e14cf5f2c47 with scrape type 1
2026-03-25 16:31:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 430c95d6-c62c-5f1c-9503-3e14cf5f2c47
2026-03-25 16:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp0%252F31f231d766034a5298b3adfbf42dda82%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp0/31f231d766034a5298b3adfbf42dda82/images/large/1.jpg not downloaded yet
2026-03-25 16:31:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc5eb5d0>
2026-03-25 16:31:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e1d0474-7c36-520d-9b10-965a59b503c9/2e1d0474-7c36-520d-9b10-965a59b503c9_image_7.jpg HTTP/1.1" 201 0
2026-03-25 16:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc4%252Fbbdfd01b13b64024aaab469ceb8f1c6e%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc4/bbdfd01b13b64024aaab469ceb8f1c6e/images/large/8.jpg saved to cache
2026-03-25 16:31:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2e1d0474-7c36-520d-9b10-965a59b503c9
2026-03-25 16:31:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcac92d0>
2026-03-25 16:31:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b9d88c4-7758-54d7-adaa-0c95f4e9c6be/6b9d88c4-7758-54d7-adaa-0c95f4e9c6be_image_5.jpg HTTP/1.1" 201 0
2026-03-25 16:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk6%252Ff4c6f16b7581495dbee59dbdf6f2a753%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk6/f4c6f16b7581495dbee59dbdf6f2a753/images/large/6.jpg saved to cache
2026-03-25 16:31:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6b9d88c4-7758-54d7-adaa-0c95f4e9c6be
2026-03-25 16:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp0%252F31f231d766034a5298b3adfbf42dda82%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp0/31f231d766034a5298b3adfbf42dda82/images/large/2.jpg not downloaded yet
2026-03-25 16:31:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk6/f4c6f16b7581495dbee59dbdf6f2a753/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc57a590>
2026-03-25 16:31:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c70b927e-cb2d-5dfb-847c-0c314bd2fb22/c70b927e-cb2d-5dfb-847c-0c314bd2fb22_image_1.jpg HTTP/1.1" 201 0
2026-03-25 16:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj8%252F85df5ee543dd4007afb4aa933b685f10%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj8/85df5ee543dd4007afb4aa933b685f10/images/large/2.jpg saved to cache
2026-03-25 16:31:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c70b927e-cb2d-5dfb-847c-0c314bd2fb22
2026-03-25 16:31:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk6/f4c6f16b7581495dbee59dbdf6f2a753/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp0%252F31f231d766034a5298b3adfbf42dda82%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp0/31f231d766034a5298b3adfbf42dda82/images/large/3.jpg not downloaded yet
2026-03-25 16:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp0%252F31f231d766034a5298b3adfbf42dda82%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp0/31f231d766034a5298b3adfbf42dda82/images/large/4.jpg not downloaded yet
2026-03-25 16:31:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk6/f4c6f16b7581495dbee59dbdf6f2a753/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp0%252F31f231d766034a5298b3adfbf42dda82%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp0/31f231d766034a5298b3adfbf42dda82/images/large/5.jpg not downloaded yet
2026-03-25 16:31:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34d7d60f90>
2026-03-25 16:31:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b9d88c4-7758-54d7-adaa-0c95f4e9c6be/6b9d88c4-7758-54d7-adaa-0c95f4e9c6be_image_8.jpg HTTP/1.1" 201 0
2026-03-25 16:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk6%252Ff4c6f16b7581495dbee59dbdf6f2a753%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk6/f4c6f16b7581495dbee59dbdf6f2a753/images/large/9.jpg saved to cache
2026-03-25 16:31:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6b9d88c4-7758-54d7-adaa-0c95f4e9c6be
2026-03-25 16:31:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj8/85df5ee543dd4007afb4aa933b685f10/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp0%252F31f231d766034a5298b3adfbf42dda82%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp0/31f231d766034a5298b3adfbf42dda82/images/large/6.jpg not downloaded yet
2026-03-25 16:31:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj8/85df5ee543dd4007afb4aa933b685f10/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj8/85df5ee543dd4007afb4aa933b685f10/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj8/85df5ee543dd4007afb4aa933b685f10/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp0%252F31f231d766034a5298b3adfbf42dda82%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp0/31f231d766034a5298b3adfbf42dda82/images/large/7.jpg not downloaded yet
2026-03-25 16:31:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn9/e213679c8d49423e81df6cc1bf7c56b6/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp0%252F31f231d766034a5298b3adfbf42dda82%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp0/31f231d766034a5298b3adfbf42dda82/images/large/8.jpg not downloaded yet
2026-03-25 16:31:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc9b8450>
2026-03-25 16:31:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b9d88c4-7758-54d7-adaa-0c95f4e9c6be/6b9d88c4-7758-54d7-adaa-0c95f4e9c6be_image_6.jpg HTTP/1.1" 201 0
2026-03-25 16:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk6%252Ff4c6f16b7581495dbee59dbdf6f2a753%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk6/f4c6f16b7581495dbee59dbdf6f2a753/images/large/7.jpg saved to cache
2026-03-25 16:31:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6b9d88c4-7758-54d7-adaa-0c95f4e9c6be
2026-03-25 16:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp0%252F31f231d766034a5298b3adfbf42dda82%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp0/31f231d766034a5298b3adfbf42dda82/images/large/9.jpg not downloaded yet
2026-03-25 16:31:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc57b9d0>
2026-03-25 16:31:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b9d88c4-7758-54d7-adaa-0c95f4e9c6be/6b9d88c4-7758-54d7-adaa-0c95f4e9c6be_image_7.jpg HTTP/1.1" 201 0
2026-03-25 16:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk6%252Ff4c6f16b7581495dbee59dbdf6f2a753%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk6/f4c6f16b7581495dbee59dbdf6f2a753/images/large/8.jpg saved to cache
2026-03-25 16:31:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6b9d88c4-7758-54d7-adaa-0c95f4e9c6be
2026-03-25 16:31:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6b9d88c4-7758-54d7-adaa-0c95f4e9c6be, skipping ID generation
2026-03-25 16:31:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6b9d88c4-7758-54d7-adaa-0c95f4e9c6be with scrape type 1
2026-03-25 16:31:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6b9d88c4-7758-54d7-adaa-0c95f4e9c6be sending to next pipeline
2026-03-25 16:31:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 6b9d88c4-7758-54d7-adaa-0c95f4e9c6be, identifier: 1983561
2026-03-25 16:31:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 6b9d88c4-7758-54d7-adaa-0c95f4e9c6be with identifier: 1983561
2026-03-25 16:31:46 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:31:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 6b9d88c4-7758-54d7-adaa-0c95f4e9c6be with identifier: 1983561
2026-03-25 16:31:46 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 6b9d88c4-7758-54d7-adaa-0c95f4e9c6be with identifier: 1983561 to the API
2026-03-25 16:31:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:31:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:31:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gk6/f4c6f16b7581495dbee59dbdf6f2a753/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'POLAR WHITE PASTELLO',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-27T09:30:00Z',
'fuel_type': 'diesel',
'id': '6b9d88c4-7758-54d7-adaa-0c95f4e9c6be',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41025',
'listing': 'auction',
'location': None,
'make': 'CITROËN',
'model': 'CITROEN C3 (PC) BLUEHDI 100 S&S FEEL PACK FP',
'odometer': 85813,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 48,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b9d88c4-7758-54d7-adaa-0c95f4e9c6be/6b9d88c4-7758-54d7-adaa-0c95f4e9c6be_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 680500,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk6/f4c6f16b7581495dbee59dbdf6f2a753/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b9d88c4-7758-54d7-adaa-0c95f4e9c6be/6b9d88c4-7758-54d7-adaa-0c95f4e9c6be_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 424315,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk6/f4c6f16b7581495dbee59dbdf6f2a753/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b9d88c4-7758-54d7-adaa-0c95f4e9c6be/6b9d88c4-7758-54d7-adaa-0c95f4e9c6be_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 438008,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk6/f4c6f16b7581495dbee59dbdf6f2a753/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b9d88c4-7758-54d7-adaa-0c95f4e9c6be/6b9d88c4-7758-54d7-adaa-0c95f4e9c6be_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 576760,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk6/f4c6f16b7581495dbee59dbdf6f2a753/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b9d88c4-7758-54d7-adaa-0c95f4e9c6be/6b9d88c4-7758-54d7-adaa-0c95f4e9c6be_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 340309,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk6/f4c6f16b7581495dbee59dbdf6f2a753/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b9d88c4-7758-54d7-adaa-0c95f4e9c6be/6b9d88c4-7758-54d7-adaa-0c95f4e9c6be_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 662317,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk6/f4c6f16b7581495dbee59dbdf6f2a753/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b9d88c4-7758-54d7-adaa-0c95f4e9c6be/6b9d88c4-7758-54d7-adaa-0c95f4e9c6be_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 411865,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk6/f4c6f16b7581495dbee59dbdf6f2a753/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b9d88c4-7758-54d7-adaa-0c95f4e9c6be/6b9d88c4-7758-54d7-adaa-0c95f4e9c6be_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 694912,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk6/f4c6f16b7581495dbee59dbdf6f2a753/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b9d88c4-7758-54d7-adaa-0c95f4e9c6be/6b9d88c4-7758-54d7-adaa-0c95f4e9c6be_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 304117,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk6/f4c6f16b7581495dbee59dbdf6f2a753/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b9d88c4-7758-54d7-adaa-0c95f4e9c6be/6b9d88c4-7758-54d7-adaa-0c95f4e9c6be_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 532208,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk6/f4c6f16b7581495dbee59dbdf6f2a753/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-06-24',
'seats_number': 5,
'seller_name': None,
'title': 'CITROËN CITROEN C3 (PC) BLUEHDI 100 S&S FEEL PACK FP -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-25 16:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983561%27 HTTP/1.1" 200 None
2026-03-25 16:31:46 [ayvens.it] INFO: Saving data for 1983561: {'created_time': 1774456306.773647, 'last_price_update_time': 1774456306.773661, 'auction_closing_time': 1774603800.0}
2026-03-25 16:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1983561') HTTP/1.1" 204 0
2026-03-25 16:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp0%252F31f231d766034a5298b3adfbf42dda82%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp0/31f231d766034a5298b3adfbf42dda82/images/large/10.jpg not downloaded yet
2026-03-25 16:31:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc9ba690>
2026-03-25 16:31:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c70b927e-cb2d-5dfb-847c-0c314bd2fb22/c70b927e-cb2d-5dfb-847c-0c314bd2fb22_image_2.jpg HTTP/1.1" 201 0
2026-03-25 16:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj8%252F85df5ee543dd4007afb4aa933b685f10%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj8/85df5ee543dd4007afb4aa933b685f10/images/large/3.jpg saved to cache
2026-03-25 16:31:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c70b927e-cb2d-5dfb-847c-0c314bd2fb22
2026-03-25 16:31:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc5f8ad0>
2026-03-25 16:31:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c70b927e-cb2d-5dfb-847c-0c314bd2fb22/c70b927e-cb2d-5dfb-847c-0c314bd2fb22_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj8%252F85df5ee543dd4007afb4aa933b685f10%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj8/85df5ee543dd4007afb4aa933b685f10/images/large/1.jpg saved to cache
2026-03-25 16:31:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c70b927e-cb2d-5dfb-847c-0c314bd2fb22
2026-03-25 16:31:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc9dc310>
2026-03-25 16:31:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c70b927e-cb2d-5dfb-847c-0c314bd2fb22/c70b927e-cb2d-5dfb-847c-0c314bd2fb22_image_4.jpg HTTP/1.1" 201 0
2026-03-25 16:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj8%252F85df5ee543dd4007afb4aa933b685f10%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj8/85df5ee543dd4007afb4aa933b685f10/images/large/5.jpg saved to cache
2026-03-25 16:31:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c70b927e-cb2d-5dfb-847c-0c314bd2fb22
2026-03-25 16:31:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc5f9790>
2026-03-25 16:31:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c70b927e-cb2d-5dfb-847c-0c314bd2fb22/c70b927e-cb2d-5dfb-847c-0c314bd2fb22_image_3.jpg HTTP/1.1" 201 0
2026-03-25 16:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj8%252F85df5ee543dd4007afb4aa933b685f10%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj8/85df5ee543dd4007afb4aa933b685f10/images/large/4.jpg saved to cache
2026-03-25 16:31:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c70b927e-cb2d-5dfb-847c-0c314bd2fb22
2026-03-25 16:31:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc64b490>
2026-03-25 16:31:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_211dd2cd-f8d1-5e2e-990f-9a303b241aea/211dd2cd-f8d1-5e2e-990f-9a303b241aea_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn9%252Fe213679c8d49423e81df6cc1bf7c56b6%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn9/e213679c8d49423e81df6cc1bf7c56b6/images/large/1.jpg saved to cache
2026-03-25 16:31:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 211dd2cd-f8d1-5e2e-990f-9a303b241aea
2026-03-25 16:31:47 [ayvens.it] INFO: Found listing with ID: 1983565
2026-03-25 16:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983565%27 HTTP/1.1" 200 None
2026-03-25 16:31:47 [ayvens.it] INFO: Scrape type for 1983565: 1
2026-03-25 16:31:47 [ayvens.it] INFO: Extracting data for car ID: 1983565
2026-03-25 16:31:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 67084afc-39ba-50be-96b1-8609e8ab90d1 with identifier: 1983565
2026-03-25 16:31:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 67084afc-39ba-50be-96b1-8609e8ab90d1 with scrape type 1
2026-03-25 16:31:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 67084afc-39ba-50be-96b1-8609e8ab90d1
2026-03-25 16:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm5%252F6ec2a3f53c36476eb8105378e7aeed27%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm5/6ec2a3f53c36476eb8105378e7aeed27/images/large/1.jpg not downloaded yet
2026-03-25 16:31:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn9/e213679c8d49423e81df6cc1bf7c56b6/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm5%252F6ec2a3f53c36476eb8105378e7aeed27%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm5/6ec2a3f53c36476eb8105378e7aeed27/images/large/2.jpg not downloaded yet
2026-03-25 16:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm5%252F6ec2a3f53c36476eb8105378e7aeed27%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm5/6ec2a3f53c36476eb8105378e7aeed27/images/large/3.jpg not downloaded yet
2026-03-25 16:31:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn9/e213679c8d49423e81df6cc1bf7c56b6/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn9/e213679c8d49423e81df6cc1bf7c56b6/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm5%252F6ec2a3f53c36476eb8105378e7aeed27%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm5/6ec2a3f53c36476eb8105378e7aeed27/images/large/4.jpg not downloaded yet
2026-03-25 16:31:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn9/e213679c8d49423e81df6cc1bf7c56b6/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm5%252F6ec2a3f53c36476eb8105378e7aeed27%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm5/6ec2a3f53c36476eb8105378e7aeed27/images/large/5.jpg not downloaded yet
2026-03-25 16:31:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj8/85df5ee543dd4007afb4aa933b685f10/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj8/85df5ee543dd4007afb4aa933b685f10/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn9/e213679c8d49423e81df6cc1bf7c56b6/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn9/e213679c8d49423e81df6cc1bf7c56b6/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm5%252F6ec2a3f53c36476eb8105378e7aeed27%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm5/6ec2a3f53c36476eb8105378e7aeed27/images/large/6.jpg not downloaded yet
2026-03-25 16:31:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc5ac450>
2026-03-25 16:31:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_211dd2cd-f8d1-5e2e-990f-9a303b241aea/211dd2cd-f8d1-5e2e-990f-9a303b241aea_image_4.jpg HTTP/1.1" 201 0
2026-03-25 16:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn9%252Fe213679c8d49423e81df6cc1bf7c56b6%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn9/e213679c8d49423e81df6cc1bf7c56b6/images/large/5.jpg saved to cache
2026-03-25 16:31:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 211dd2cd-f8d1-5e2e-990f-9a303b241aea
2026-03-25 16:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm5%252F6ec2a3f53c36476eb8105378e7aeed27%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm5/6ec2a3f53c36476eb8105378e7aeed27/images/large/7.jpg not downloaded yet
2026-03-25 16:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm5%252F6ec2a3f53c36476eb8105378e7aeed27%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm5/6ec2a3f53c36476eb8105378e7aeed27/images/large/8.jpg not downloaded yet
2026-03-25 16:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm5%252F6ec2a3f53c36476eb8105378e7aeed27%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm5/6ec2a3f53c36476eb8105378e7aeed27/images/large/9.jpg not downloaded yet
2026-03-25 16:31:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dca97610>
2026-03-25 16:31:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_211dd2cd-f8d1-5e2e-990f-9a303b241aea/211dd2cd-f8d1-5e2e-990f-9a303b241aea_image_2.jpg HTTP/1.1" 201 0
2026-03-25 16:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn9%252Fe213679c8d49423e81df6cc1bf7c56b6%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn9/e213679c8d49423e81df6cc1bf7c56b6/images/large/3.jpg saved to cache
2026-03-25 16:31:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 211dd2cd-f8d1-5e2e-990f-9a303b241aea
2026-03-25 16:31:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dca96750>
2026-03-25 16:31:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_211dd2cd-f8d1-5e2e-990f-9a303b241aea/211dd2cd-f8d1-5e2e-990f-9a303b241aea_image_5.jpg HTTP/1.1" 201 0
2026-03-25 16:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn9%252Fe213679c8d49423e81df6cc1bf7c56b6%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn9/e213679c8d49423e81df6cc1bf7c56b6/images/large/6.jpg saved to cache
2026-03-25 16:31:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 211dd2cd-f8d1-5e2e-990f-9a303b241aea
2026-03-25 16:31:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc9d74d0>
2026-03-25 16:31:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_211dd2cd-f8d1-5e2e-990f-9a303b241aea/211dd2cd-f8d1-5e2e-990f-9a303b241aea_image_3.jpg HTTP/1.1" 201 0
2026-03-25 16:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn9%252Fe213679c8d49423e81df6cc1bf7c56b6%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn9/e213679c8d49423e81df6cc1bf7c56b6/images/large/4.jpg saved to cache
2026-03-25 16:31:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 211dd2cd-f8d1-5e2e-990f-9a303b241aea
2026-03-25 16:31:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc96be50>
2026-03-25 16:31:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c70b927e-cb2d-5dfb-847c-0c314bd2fb22/c70b927e-cb2d-5dfb-847c-0c314bd2fb22_image_8.jpg HTTP/1.1" 201 0
2026-03-25 16:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj8%252F85df5ee543dd4007afb4aa933b685f10%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj8/85df5ee543dd4007afb4aa933b685f10/images/large/9.jpg saved to cache
2026-03-25 16:31:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c70b927e-cb2d-5dfb-847c-0c314bd2fb22
2026-03-25 16:31:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34d745a790>
2026-03-25 16:31:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c70b927e-cb2d-5dfb-847c-0c314bd2fb22/c70b927e-cb2d-5dfb-847c-0c314bd2fb22_image_9.jpg HTTP/1.1" 201 0
2026-03-25 16:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj8%252F85df5ee543dd4007afb4aa933b685f10%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj8/85df5ee543dd4007afb4aa933b685f10/images/large/10.jpg saved to cache
2026-03-25 16:31:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c70b927e-cb2d-5dfb-847c-0c314bd2fb22
2026-03-25 16:31:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc9464d0>
2026-03-25 16:31:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_211dd2cd-f8d1-5e2e-990f-9a303b241aea/211dd2cd-f8d1-5e2e-990f-9a303b241aea_image_1.jpg HTTP/1.1" 201 0
2026-03-25 16:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn9%252Fe213679c8d49423e81df6cc1bf7c56b6%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn9/e213679c8d49423e81df6cc1bf7c56b6/images/large/2.jpg saved to cache
2026-03-25 16:31:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 211dd2cd-f8d1-5e2e-990f-9a303b241aea
2026-03-25 16:31:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc5562d0>
2026-03-25 16:31:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_211dd2cd-f8d1-5e2e-990f-9a303b241aea/211dd2cd-f8d1-5e2e-990f-9a303b241aea_image_7.jpg HTTP/1.1" 201 0
2026-03-25 16:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn9%252Fe213679c8d49423e81df6cc1bf7c56b6%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn9/e213679c8d49423e81df6cc1bf7c56b6/images/large/8.jpg saved to cache
2026-03-25 16:31:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 211dd2cd-f8d1-5e2e-990f-9a303b241aea
2026-03-25 16:31:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp0/31f231d766034a5298b3adfbf42dda82/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm5%252F6ec2a3f53c36476eb8105378e7aeed27%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm5/6ec2a3f53c36476eb8105378e7aeed27/images/large/10.jpg not downloaded yet
2026-03-25 16:31:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp0/31f231d766034a5298b3adfbf42dda82/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:48 [ayvens.it] INFO: Found listing with ID: 1983566
2026-03-25 16:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983566%27 HTTP/1.1" 200 None
2026-03-25 16:31:48 [ayvens.it] INFO: Scrape type for 1983566: 1
2026-03-25 16:31:48 [ayvens.it] INFO: Extracting data for car ID: 1983566
2026-03-25 16:31:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4c7bda55-382f-5d8f-a3a5-5dd4f9ae9376 with identifier: 1983566
2026-03-25 16:31:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4c7bda55-382f-5d8f-a3a5-5dd4f9ae9376 with scrape type 1
2026-03-25 16:31:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4c7bda55-382f-5d8f-a3a5-5dd4f9ae9376
2026-03-25 16:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn8%252F4a449b60ced044df8d1d70a8dffe1524%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn8/4a449b60ced044df8d1d70a8dffe1524/images/large/1.jpg not downloaded yet
2026-03-25 16:31:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp0/31f231d766034a5298b3adfbf42dda82/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp0/31f231d766034a5298b3adfbf42dda82/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn8%252F4a449b60ced044df8d1d70a8dffe1524%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn8/4a449b60ced044df8d1d70a8dffe1524/images/large/2.jpg not downloaded yet
2026-03-25 16:31:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp0/31f231d766034a5298b3adfbf42dda82/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn8%252F4a449b60ced044df8d1d70a8dffe1524%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn8/4a449b60ced044df8d1d70a8dffe1524/images/large/3.jpg not downloaded yet
2026-03-25 16:31:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp0/31f231d766034a5298b3adfbf42dda82/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn8%252F4a449b60ced044df8d1d70a8dffe1524%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn8/4a449b60ced044df8d1d70a8dffe1524/images/large/4.jpg not downloaded yet
2026-03-25 16:31:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn9/e213679c8d49423e81df6cc1bf7c56b6/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc75be50>
2026-03-25 16:31:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_430c95d6-c62c-5f1c-9503-3e14cf5f2c47/430c95d6-c62c-5f1c-9503-3e14cf5f2c47_image_1.jpg HTTP/1.1" 201 0
2026-03-25 16:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp0%252F31f231d766034a5298b3adfbf42dda82%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp0/31f231d766034a5298b3adfbf42dda82/images/large/2.jpg saved to cache
2026-03-25 16:31:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 430c95d6-c62c-5f1c-9503-3e14cf5f2c47
2026-03-25 16:31:48 [scrapy.core.engine] DEBUG: Crawled (404) <GET https://medias-carmarket.ayvens.com/lots/ald/gm5/6ec2a3f53c36476eb8105378e7aeed27/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:48 [scrapy.core.engine] DEBUG: Crawled (404) <GET https://medias-carmarket.ayvens.com/lots/ald/gm5/6ec2a3f53c36476eb8105378e7aeed27/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn8%252F4a449b60ced044df8d1d70a8dffe1524%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn8/4a449b60ced044df8d1d70a8dffe1524/images/large/5.jpg not downloaded yet
2026-03-25 16:31:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn9/e213679c8d49423e81df6cc1bf7c56b6/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn8%252F4a449b60ced044df8d1d70a8dffe1524%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn8/4a449b60ced044df8d1d70a8dffe1524/images/large/6.jpg not downloaded yet
2026-03-25 16:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn8%252F4a449b60ced044df8d1d70a8dffe1524%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn8/4a449b60ced044df8d1d70a8dffe1524/images/large/7.jpg not downloaded yet
2026-03-25 16:31:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc54fdd0>
2026-03-25 16:31:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_430c95d6-c62c-5f1c-9503-3e14cf5f2c47/430c95d6-c62c-5f1c-9503-3e14cf5f2c47_image_2.jpg HTTP/1.1" 201 0
2026-03-25 16:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp0%252F31f231d766034a5298b3adfbf42dda82%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp0/31f231d766034a5298b3adfbf42dda82/images/large/3.jpg saved to cache
2026-03-25 16:31:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 430c95d6-c62c-5f1c-9503-3e14cf5f2c47
2026-03-25 16:31:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc37c2d0>
2026-03-25 16:31:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_430c95d6-c62c-5f1c-9503-3e14cf5f2c47/430c95d6-c62c-5f1c-9503-3e14cf5f2c47_image_4.jpg HTTP/1.1" 201 0
2026-03-25 16:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp0%252F31f231d766034a5298b3adfbf42dda82%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp0/31f231d766034a5298b3adfbf42dda82/images/large/5.jpg saved to cache
2026-03-25 16:31:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 430c95d6-c62c-5f1c-9503-3e14cf5f2c47
2026-03-25 16:31:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc30a1d0>
2026-03-25 16:31:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_430c95d6-c62c-5f1c-9503-3e14cf5f2c47/430c95d6-c62c-5f1c-9503-3e14cf5f2c47_image_7.jpg HTTP/1.1" 201 0
2026-03-25 16:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp0%252F31f231d766034a5298b3adfbf42dda82%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp0/31f231d766034a5298b3adfbf42dda82/images/large/8.jpg saved to cache
2026-03-25 16:31:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 430c95d6-c62c-5f1c-9503-3e14cf5f2c47
2026-03-25 16:31:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc80c510>
2026-03-25 16:31:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_430c95d6-c62c-5f1c-9503-3e14cf5f2c47/430c95d6-c62c-5f1c-9503-3e14cf5f2c47_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp0%252F31f231d766034a5298b3adfbf42dda82%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp0/31f231d766034a5298b3adfbf42dda82/images/large/1.jpg saved to cache
2026-03-25 16:31:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 430c95d6-c62c-5f1c-9503-3e14cf5f2c47
2026-03-25 16:31:48 [scrapy.core.engine] DEBUG: Crawled (404) <GET https://medias-carmarket.ayvens.com/lots/ald/gm5/6ec2a3f53c36476eb8105378e7aeed27/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:48 [scrapy.core.engine] DEBUG: Crawled (404) <GET https://medias-carmarket.ayvens.com/lots/ald/gm5/6ec2a3f53c36476eb8105378e7aeed27/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:48 [scrapy.core.engine] DEBUG: Crawled (404) <GET https://medias-carmarket.ayvens.com/lots/ald/gm5/6ec2a3f53c36476eb8105378e7aeed27/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn8%252F4a449b60ced044df8d1d70a8dffe1524%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn8/4a449b60ced044df8d1d70a8dffe1524/images/large/8.jpg not downloaded yet
2026-03-25 16:31:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc941bd0>
2026-03-25 16:31:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_430c95d6-c62c-5f1c-9503-3e14cf5f2c47/430c95d6-c62c-5f1c-9503-3e14cf5f2c47_image_3.jpg HTTP/1.1" 201 0
2026-03-25 16:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp0%252F31f231d766034a5298b3adfbf42dda82%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp0/31f231d766034a5298b3adfbf42dda82/images/large/4.jpg saved to cache
2026-03-25 16:31:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 430c95d6-c62c-5f1c-9503-3e14cf5f2c47
2026-03-25 16:31:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm5/6ec2a3f53c36476eb8105378e7aeed27/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp0/31f231d766034a5298b3adfbf42dda82/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn8%252F4a449b60ced044df8d1d70a8dffe1524%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn8/4a449b60ced044df8d1d70a8dffe1524/images/large/9.jpg not downloaded yet
2026-03-25 16:31:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc9428d0>
2026-03-25 16:31:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_211dd2cd-f8d1-5e2e-990f-9a303b241aea/211dd2cd-f8d1-5e2e-990f-9a303b241aea_image_8.jpg HTTP/1.1" 201 0
2026-03-25 16:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn9%252Fe213679c8d49423e81df6cc1bf7c56b6%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn9/e213679c8d49423e81df6cc1bf7c56b6/images/large/9.jpg saved to cache
2026-03-25 16:31:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 211dd2cd-f8d1-5e2e-990f-9a303b241aea
2026-03-25 16:31:48 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 1 for item 67084afc-39ba-50be-96b1-8609e8ab90d1 due to Ignoring non-200 response
2026-03-25 16:31:48 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 8 for item 67084afc-39ba-50be-96b1-8609e8ab90d1 due to Ignoring non-200 response
2026-03-25 16:31:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc7f9e50>
2026-03-25 16:31:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_211dd2cd-f8d1-5e2e-990f-9a303b241aea/211dd2cd-f8d1-5e2e-990f-9a303b241aea_image_9.jpg HTTP/1.1" 201 0
2026-03-25 16:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn9%252Fe213679c8d49423e81df6cc1bf7c56b6%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn9/e213679c8d49423e81df6cc1bf7c56b6/images/large/10.jpg saved to cache
2026-03-25 16:31:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 211dd2cd-f8d1-5e2e-990f-9a303b241aea
2026-03-25 16:31:49 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 9 for item 67084afc-39ba-50be-96b1-8609e8ab90d1 due to Ignoring non-200 response
2026-03-25 16:31:49 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 6 for item 67084afc-39ba-50be-96b1-8609e8ab90d1 due to Ignoring non-200 response
2026-03-25 16:31:49 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 4 for item 67084afc-39ba-50be-96b1-8609e8ab90d1 due to Ignoring non-200 response
2026-03-25 16:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn8%252F4a449b60ced044df8d1d70a8dffe1524%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn8/4a449b60ced044df8d1d70a8dffe1524/images/large/10.jpg not downloaded yet
2026-03-25 16:31:49 [scrapy.core.engine] DEBUG: Crawled (404) <GET https://medias-carmarket.ayvens.com/lots/ald/gm5/6ec2a3f53c36476eb8105378e7aeed27/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm5/6ec2a3f53c36476eb8105378e7aeed27/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:49 [ayvens.it] INFO: Found listing with ID: 1983567
2026-03-25 16:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983567%27 HTTP/1.1" 200 None
2026-03-25 16:31:49 [ayvens.it] INFO: Scrape type for 1983567: 1
2026-03-25 16:31:49 [ayvens.it] INFO: Extracting data for car ID: 1983567
2026-03-25 16:31:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ad4830fa-b449-5585-8517-aac6390702f6 with identifier: 1983567
2026-03-25 16:31:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ad4830fa-b449-5585-8517-aac6390702f6 with scrape type 1
2026-03-25 16:31:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ad4830fa-b449-5585-8517-aac6390702f6
2026-03-25 16:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge3%252Fd11aaed2fc824b54825b57cb3783f6d0%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge3/d11aaed2fc824b54825b57cb3783f6d0/images/large/1.jpg not downloaded yet
2026-03-25 16:31:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc7d1850>
2026-03-25 16:31:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67084afc-39ba-50be-96b1-8609e8ab90d1/67084afc-39ba-50be-96b1-8609e8ab90d1_image_2.jpg HTTP/1.1" 201 0
2026-03-25 16:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm5%252F6ec2a3f53c36476eb8105378e7aeed27%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm5/6ec2a3f53c36476eb8105378e7aeed27/images/large/3.jpg saved to cache
2026-03-25 16:31:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 67084afc-39ba-50be-96b1-8609e8ab90d1
2026-03-25 16:31:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc364510>
2026-03-25 16:31:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_430c95d6-c62c-5f1c-9503-3e14cf5f2c47/430c95d6-c62c-5f1c-9503-3e14cf5f2c47_image_9.jpg HTTP/1.1" 201 0
2026-03-25 16:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp0%252F31f231d766034a5298b3adfbf42dda82%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp0/31f231d766034a5298b3adfbf42dda82/images/large/10.jpg saved to cache
2026-03-25 16:31:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 430c95d6-c62c-5f1c-9503-3e14cf5f2c47
2026-03-25 16:31:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp0/31f231d766034a5298b3adfbf42dda82/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge3%252Fd11aaed2fc824b54825b57cb3783f6d0%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge3/d11aaed2fc824b54825b57cb3783f6d0/images/large/2.jpg not downloaded yet
2026-03-25 16:31:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm5/6ec2a3f53c36476eb8105378e7aeed27/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm5/6ec2a3f53c36476eb8105378e7aeed27/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge3%252Fd11aaed2fc824b54825b57cb3783f6d0%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge3/d11aaed2fc824b54825b57cb3783f6d0/images/large/3.jpg not downloaded yet
2026-03-25 16:31:49 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 3 for item 67084afc-39ba-50be-96b1-8609e8ab90d1 due to Ignoring non-200 response
2026-03-25 16:31:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcc4ddd0>
2026-03-25 16:31:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67084afc-39ba-50be-96b1-8609e8ab90d1/67084afc-39ba-50be-96b1-8609e8ab90d1_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm5%252F6ec2a3f53c36476eb8105378e7aeed27%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm5/6ec2a3f53c36476eb8105378e7aeed27/images/large/1.jpg saved to cache
2026-03-25 16:31:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 67084afc-39ba-50be-96b1-8609e8ab90d1
2026-03-25 16:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge3%252Fd11aaed2fc824b54825b57cb3783f6d0%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge3/d11aaed2fc824b54825b57cb3783f6d0/images/large/4.jpg not downloaded yet
2026-03-25 16:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge3%252Fd11aaed2fc824b54825b57cb3783f6d0%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge3/d11aaed2fc824b54825b57cb3783f6d0/images/large/5.jpg not downloaded yet
2026-03-25 16:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge3%252Fd11aaed2fc824b54825b57cb3783f6d0%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge3/d11aaed2fc824b54825b57cb3783f6d0/images/large/6.jpg not downloaded yet
2026-03-25 16:31:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34de656e90>
2026-03-25 16:31:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_430c95d6-c62c-5f1c-9503-3e14cf5f2c47/430c95d6-c62c-5f1c-9503-3e14cf5f2c47_image_8.jpg HTTP/1.1" 201 0
2026-03-25 16:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp0%252F31f231d766034a5298b3adfbf42dda82%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp0/31f231d766034a5298b3adfbf42dda82/images/large/9.jpg saved to cache
2026-03-25 16:31:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 430c95d6-c62c-5f1c-9503-3e14cf5f2c47
2026-03-25 16:31:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34d6b5a550>
2026-03-25 16:31:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67084afc-39ba-50be-96b1-8609e8ab90d1/67084afc-39ba-50be-96b1-8609e8ab90d1_image_7.jpg HTTP/1.1" 201 0
2026-03-25 16:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm5%252F6ec2a3f53c36476eb8105378e7aeed27%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm5/6ec2a3f53c36476eb8105378e7aeed27/images/large/8.jpg saved to cache
2026-03-25 16:31:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 67084afc-39ba-50be-96b1-8609e8ab90d1
2026-03-25 16:31:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc5d5c90>
2026-03-25 16:31:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67084afc-39ba-50be-96b1-8609e8ab90d1/67084afc-39ba-50be-96b1-8609e8ab90d1_image_5.jpg HTTP/1.1" 201 0
2026-03-25 16:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm5%252F6ec2a3f53c36476eb8105378e7aeed27%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm5/6ec2a3f53c36476eb8105378e7aeed27/images/large/6.jpg saved to cache
2026-03-25 16:31:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 67084afc-39ba-50be-96b1-8609e8ab90d1
2026-03-25 16:31:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 67084afc-39ba-50be-96b1-8609e8ab90d1, skipping ID generation
2026-03-25 16:31:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 67084afc-39ba-50be-96b1-8609e8ab90d1 with scrape type 1
2026-03-25 16:31:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 67084afc-39ba-50be-96b1-8609e8ab90d1 sending to next pipeline
2026-03-25 16:31:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 67084afc-39ba-50be-96b1-8609e8ab90d1, identifier: 1983565
2026-03-25 16:31:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 67084afc-39ba-50be-96b1-8609e8ab90d1 with identifier: 1983565
2026-03-25 16:31:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 67084afc-39ba-50be-96b1-8609e8ab90d1 with identifier: 1983565
2026-03-25 16:31:50 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 67084afc-39ba-50be-96b1-8609e8ab90d1 with identifier: 1983565 to the API
2026-03-25 16:31:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:31:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:31:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gm5/6ec2a3f53c36476eb8105378e7aeed27/images/large/6.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Agate Black metallizzato',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-27T09:30:00Z',
'fuel_type': 'diesel',
'id': '67084afc-39ba-50be-96b1-8609e8ab90d1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41025',
'listing': 'auction',
'location': None,
'make': 'FORD',
'model': 'FORD KUGA 2.0 EcoBlue 120CV AWD ST-Line Auto Sport utility vehicle '
'5-door (Euro 6.2)',
'odometer': 204521,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 23,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67084afc-39ba-50be-96b1-8609e8ab90d1/67084afc-39ba-50be-96b1-8609e8ab90d1_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 639868,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm5/6ec2a3f53c36476eb8105378e7aeed27/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67084afc-39ba-50be-96b1-8609e8ab90d1/67084afc-39ba-50be-96b1-8609e8ab90d1_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 424929,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm5/6ec2a3f53c36476eb8105378e7aeed27/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67084afc-39ba-50be-96b1-8609e8ab90d1/67084afc-39ba-50be-96b1-8609e8ab90d1_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 599603,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm5/6ec2a3f53c36476eb8105378e7aeed27/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67084afc-39ba-50be-96b1-8609e8ab90d1/67084afc-39ba-50be-96b1-8609e8ab90d1_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 630626,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm5/6ec2a3f53c36476eb8105378e7aeed27/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-02-24',
'seats_number': 5,
'seller_name': None,
'title': 'FORD FORD KUGA 2.0 EcoBlue 120CV AWD ST-Line Auto Sport utility '
'vehicle 5-door (Euro 6.2) -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2023}
2026-03-25 16:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983565%27 HTTP/1.1" 200 None
2026-03-25 16:31:50 [ayvens.it] INFO: Saving data for 1983565: {'created_time': 1774456310.455352, 'last_price_update_time': 1774456310.455362, 'auction_closing_time': 1774603800.0}
2026-03-25 16:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1983565') HTTP/1.1" 204 0
2026-03-25 16:31:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn8/4a449b60ced044df8d1d70a8dffe1524/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp0/31f231d766034a5298b3adfbf42dda82/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge3%252Fd11aaed2fc824b54825b57cb3783f6d0%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge3/d11aaed2fc824b54825b57cb3783f6d0/images/large/7.jpg not downloaded yet
2026-03-25 16:31:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn8/4a449b60ced044df8d1d70a8dffe1524/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn8/4a449b60ced044df8d1d70a8dffe1524/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge3%252Fd11aaed2fc824b54825b57cb3783f6d0%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge3/d11aaed2fc824b54825b57cb3783f6d0/images/large/8.jpg not downloaded yet
2026-03-25 16:31:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp0/31f231d766034a5298b3adfbf42dda82/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn8/4a449b60ced044df8d1d70a8dffe1524/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge3%252Fd11aaed2fc824b54825b57cb3783f6d0%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge3/d11aaed2fc824b54825b57cb3783f6d0/images/large/9.jpg not downloaded yet
2026-03-25 16:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge3%252Fd11aaed2fc824b54825b57cb3783f6d0%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge3/d11aaed2fc824b54825b57cb3783f6d0/images/large/10.jpg not downloaded yet
2026-03-25 16:31:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn8/4a449b60ced044df8d1d70a8dffe1524/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn8/4a449b60ced044df8d1d70a8dffe1524/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:50 [ayvens.it] INFO: Found listing with ID: 1983568
2026-03-25 16:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983568%27 HTTP/1.1" 200 None
2026-03-25 16:31:50 [ayvens.it] INFO: Scrape type for 1983568: 1
2026-03-25 16:31:50 [ayvens.it] INFO: Extracting data for car ID: 1983568
2026-03-25 16:31:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bf8bec1d-86ad-5e60-a97b-f1847175df2c with identifier: 1983568
2026-03-25 16:31:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bf8bec1d-86ad-5e60-a97b-f1847175df2c with scrape type 1
2026-03-25 16:31:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item bf8bec1d-86ad-5e60-a97b-f1847175df2c
2026-03-25 16:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs9%252F9f795b6663ec44e39f880b25b0ec85d1%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs9/9f795b6663ec44e39f880b25b0ec85d1/images/large/1.jpg not downloaded yet
2026-03-25 16:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs9%252F9f795b6663ec44e39f880b25b0ec85d1%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs9/9f795b6663ec44e39f880b25b0ec85d1/images/large/2.jpg not downloaded yet
2026-03-25 16:31:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcde2b90>
2026-03-25 16:31:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c7bda55-382f-5d8f-a3a5-5dd4f9ae9376/4c7bda55-382f-5d8f-a3a5-5dd4f9ae9376_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn8%252F4a449b60ced044df8d1d70a8dffe1524%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn8/4a449b60ced044df8d1d70a8dffe1524/images/large/1.jpg saved to cache
2026-03-25 16:31:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4c7bda55-382f-5d8f-a3a5-5dd4f9ae9376
2026-03-25 16:31:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc364450>
2026-03-25 16:31:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_430c95d6-c62c-5f1c-9503-3e14cf5f2c47/430c95d6-c62c-5f1c-9503-3e14cf5f2c47_image_6.jpg HTTP/1.1" 201 0
2026-03-25 16:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp0%252F31f231d766034a5298b3adfbf42dda82%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp0/31f231d766034a5298b3adfbf42dda82/images/large/7.jpg saved to cache
2026-03-25 16:31:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 430c95d6-c62c-5f1c-9503-3e14cf5f2c47
2026-03-25 16:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs9%252F9f795b6663ec44e39f880b25b0ec85d1%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs9/9f795b6663ec44e39f880b25b0ec85d1/images/large/3.jpg not downloaded yet
2026-03-25 16:31:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dca89990>
2026-03-25 16:31:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c7bda55-382f-5d8f-a3a5-5dd4f9ae9376/4c7bda55-382f-5d8f-a3a5-5dd4f9ae9376_image_1.jpg HTTP/1.1" 201 0
2026-03-25 16:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn8%252F4a449b60ced044df8d1d70a8dffe1524%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn8/4a449b60ced044df8d1d70a8dffe1524/images/large/2.jpg saved to cache
2026-03-25 16:31:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4c7bda55-382f-5d8f-a3a5-5dd4f9ae9376
2026-03-25 16:31:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcaf4fd0>
2026-03-25 16:31:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c7bda55-382f-5d8f-a3a5-5dd4f9ae9376/4c7bda55-382f-5d8f-a3a5-5dd4f9ae9376_image_2.jpg HTTP/1.1" 201 0
2026-03-25 16:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn8%252F4a449b60ced044df8d1d70a8dffe1524%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn8/4a449b60ced044df8d1d70a8dffe1524/images/large/3.jpg saved to cache
2026-03-25 16:31:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4c7bda55-382f-5d8f-a3a5-5dd4f9ae9376
2026-03-25 16:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs9%252F9f795b6663ec44e39f880b25b0ec85d1%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs9/9f795b6663ec44e39f880b25b0ec85d1/images/large/4.jpg not downloaded yet
2026-03-25 16:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs9%252F9f795b6663ec44e39f880b25b0ec85d1%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs9/9f795b6663ec44e39f880b25b0ec85d1/images/large/5.jpg not downloaded yet
2026-03-25 16:31:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc58b490>
2026-03-25 16:31:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_430c95d6-c62c-5f1c-9503-3e14cf5f2c47/430c95d6-c62c-5f1c-9503-3e14cf5f2c47_image_5.jpg HTTP/1.1" 201 0
2026-03-25 16:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp0%252F31f231d766034a5298b3adfbf42dda82%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp0/31f231d766034a5298b3adfbf42dda82/images/large/6.jpg saved to cache
2026-03-25 16:31:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 430c95d6-c62c-5f1c-9503-3e14cf5f2c47
2026-03-25 16:31:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 430c95d6-c62c-5f1c-9503-3e14cf5f2c47, skipping ID generation
2026-03-25 16:31:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 430c95d6-c62c-5f1c-9503-3e14cf5f2c47 with scrape type 1
2026-03-25 16:31:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 430c95d6-c62c-5f1c-9503-3e14cf5f2c47 sending to next pipeline
2026-03-25 16:31:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 430c95d6-c62c-5f1c-9503-3e14cf5f2c47, identifier: 1983564
2026-03-25 16:31:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34d7ddbf10>
2026-03-25 16:31:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c7bda55-382f-5d8f-a3a5-5dd4f9ae9376/4c7bda55-382f-5d8f-a3a5-5dd4f9ae9376_image_5.jpg HTTP/1.1" 201 0
2026-03-25 16:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn8%252F4a449b60ced044df8d1d70a8dffe1524%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn8/4a449b60ced044df8d1d70a8dffe1524/images/large/6.jpg saved to cache
2026-03-25 16:31:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4c7bda55-382f-5d8f-a3a5-5dd4f9ae9376
2026-03-25 16:31:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dca05850>
2026-03-25 16:31:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c7bda55-382f-5d8f-a3a5-5dd4f9ae9376/4c7bda55-382f-5d8f-a3a5-5dd4f9ae9376_image_3.jpg HTTP/1.1" 201 0
2026-03-25 16:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn8%252F4a449b60ced044df8d1d70a8dffe1524%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn8/4a449b60ced044df8d1d70a8dffe1524/images/large/4.jpg saved to cache
2026-03-25 16:31:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4c7bda55-382f-5d8f-a3a5-5dd4f9ae9376
2026-03-25 16:31:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcb2c0d0>
2026-03-25 16:31:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c7bda55-382f-5d8f-a3a5-5dd4f9ae9376/4c7bda55-382f-5d8f-a3a5-5dd4f9ae9376_image_6.jpg HTTP/1.1" 201 0
2026-03-25 16:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn8%252F4a449b60ced044df8d1d70a8dffe1524%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn8/4a449b60ced044df8d1d70a8dffe1524/images/large/7.jpg saved to cache
2026-03-25 16:31:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4c7bda55-382f-5d8f-a3a5-5dd4f9ae9376
2026-03-25 16:31:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 430c95d6-c62c-5f1c-9503-3e14cf5f2c47 with identifier: 1983564
2026-03-25 16:31:51 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:31:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 430c95d6-c62c-5f1c-9503-3e14cf5f2c47 with identifier: 1983564
2026-03-25 16:31:51 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 430c95d6-c62c-5f1c-9503-3e14cf5f2c47 with identifier: 1983564 to the API
2026-03-25 16:31:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:31:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:31:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gp0/31f231d766034a5298b3adfbf42dda82/images/large/6.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'BIANCO ICY PASTELLO',
'currency': 'EUR',
'doors_number': 2,
'engine': '2.2L',
'expiration_date': '2026-03-27T09:30:00Z',
'fuel_type': 'diesel',
'id': '430c95d6-c62c-5f1c-9503-3e14cf5f2c47',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41025',
'listing': 'auction',
'location': None,
'make': 'OPEL',
'model': 'OPEL MOVANO CAB (PC) AUTOT. EDIT 35 HEAVY L3 BLUEHDI 140 S&S FP',
'odometer': 80130,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 57,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_430c95d6-c62c-5f1c-9503-3e14cf5f2c47/430c95d6-c62c-5f1c-9503-3e14cf5f2c47_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 745466,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp0/31f231d766034a5298b3adfbf42dda82/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_430c95d6-c62c-5f1c-9503-3e14cf5f2c47/430c95d6-c62c-5f1c-9503-3e14cf5f2c47_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 219418,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp0/31f231d766034a5298b3adfbf42dda82/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_430c95d6-c62c-5f1c-9503-3e14cf5f2c47/430c95d6-c62c-5f1c-9503-3e14cf5f2c47_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 408188,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp0/31f231d766034a5298b3adfbf42dda82/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_430c95d6-c62c-5f1c-9503-3e14cf5f2c47/430c95d6-c62c-5f1c-9503-3e14cf5f2c47_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 508045,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp0/31f231d766034a5298b3adfbf42dda82/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_430c95d6-c62c-5f1c-9503-3e14cf5f2c47/430c95d6-c62c-5f1c-9503-3e14cf5f2c47_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 333609,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp0/31f231d766034a5298b3adfbf42dda82/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_430c95d6-c62c-5f1c-9503-3e14cf5f2c47/430c95d6-c62c-5f1c-9503-3e14cf5f2c47_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 343408,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp0/31f231d766034a5298b3adfbf42dda82/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_430c95d6-c62c-5f1c-9503-3e14cf5f2c47/430c95d6-c62c-5f1c-9503-3e14cf5f2c47_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 352722,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp0/31f231d766034a5298b3adfbf42dda82/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_430c95d6-c62c-5f1c-9503-3e14cf5f2c47/430c95d6-c62c-5f1c-9503-3e14cf5f2c47_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 259151,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp0/31f231d766034a5298b3adfbf42dda82/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_430c95d6-c62c-5f1c-9503-3e14cf5f2c47/430c95d6-c62c-5f1c-9503-3e14cf5f2c47_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 231234,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp0/31f231d766034a5298b3adfbf42dda82/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_430c95d6-c62c-5f1c-9503-3e14cf5f2c47/430c95d6-c62c-5f1c-9503-3e14cf5f2c47_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 353006,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp0/31f231d766034a5298b3adfbf42dda82/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-05-16',
'seats_number': 5,
'seller_name': None,
'title': 'OPEL OPEL MOVANO CAB (PC) AUTOT. EDIT 35 HEAVY L3 BLUEHDI 140 S&S '
'FP -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2023}
2026-03-25 16:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983564%27 HTTP/1.1" 200 None
2026-03-25 16:31:51 [ayvens.it] INFO: Saving data for 1983564: {'created_time': 1774456311.834163, 'last_price_update_time': 1774456311.834174, 'auction_closing_time': 1774603800.0}
2026-03-25 16:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1983564') HTTP/1.1" 204 0
2026-03-25 16:31:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn8/4a449b60ced044df8d1d70a8dffe1524/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn8/4a449b60ced044df8d1d70a8dffe1524/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs9%252F9f795b6663ec44e39f880b25b0ec85d1%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs9/9f795b6663ec44e39f880b25b0ec85d1/images/large/6.jpg not downloaded yet
2026-03-25 16:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs9%252F9f795b6663ec44e39f880b25b0ec85d1%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs9/9f795b6663ec44e39f880b25b0ec85d1/images/large/7.jpg not downloaded yet
2026-03-25 16:31:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn9/e213679c8d49423e81df6cc1bf7c56b6/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj8/85df5ee543dd4007afb4aa933b685f10/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs9%252F9f795b6663ec44e39f880b25b0ec85d1%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs9/9f795b6663ec44e39f880b25b0ec85d1/images/large/8.jpg not downloaded yet
2026-03-25 16:31:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn8/4a449b60ced044df8d1d70a8dffe1524/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn8/4a449b60ced044df8d1d70a8dffe1524/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj8/85df5ee543dd4007afb4aa933b685f10/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge3/d11aaed2fc824b54825b57cb3783f6d0/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs9%252F9f795b6663ec44e39f880b25b0ec85d1%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs9/9f795b6663ec44e39f880b25b0ec85d1/images/large/9.jpg not downloaded yet
2026-03-25 16:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs9%252F9f795b6663ec44e39f880b25b0ec85d1%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs9/9f795b6663ec44e39f880b25b0ec85d1/images/large/10.jpg not downloaded yet
2026-03-25 16:31:51 [ayvens.it] INFO: Found listing with ID: 1983569
2026-03-25 16:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983569%27 HTTP/1.1" 200 None
2026-03-25 16:31:51 [ayvens.it] INFO: Scrape type for 1983569: 1
2026-03-25 16:31:51 [ayvens.it] INFO: Extracting data for car ID: 1983569
2026-03-25 16:31:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 98bc6a7b-8683-5ee8-af10-4ff6f5eb34f9 with identifier: 1983569
2026-03-25 16:31:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 98bc6a7b-8683-5ee8-af10-4ff6f5eb34f9 with scrape type 1
2026-03-25 16:31:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 98bc6a7b-8683-5ee8-af10-4ff6f5eb34f9
2026-03-25 16:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffp3%252Ff8f5f0bd09f044839ea959000278651e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fp3/f8f5f0bd09f044839ea959000278651e/images/large/1.jpg not downloaded yet
2026-03-25 16:31:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34d7d5be90>
2026-03-25 16:31:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c7bda55-382f-5d8f-a3a5-5dd4f9ae9376/4c7bda55-382f-5d8f-a3a5-5dd4f9ae9376_image_4.jpg HTTP/1.1" 201 0
2026-03-25 16:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn8%252F4a449b60ced044df8d1d70a8dffe1524%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn8/4a449b60ced044df8d1d70a8dffe1524/images/large/5.jpg saved to cache
2026-03-25 16:31:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4c7bda55-382f-5d8f-a3a5-5dd4f9ae9376
2026-03-25 16:31:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcb2e910>
2026-03-25 16:31:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c7bda55-382f-5d8f-a3a5-5dd4f9ae9376/4c7bda55-382f-5d8f-a3a5-5dd4f9ae9376_image_9.jpg HTTP/1.1" 201 0
2026-03-25 16:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn8%252F4a449b60ced044df8d1d70a8dffe1524%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn8/4a449b60ced044df8d1d70a8dffe1524/images/large/10.jpg saved to cache
2026-03-25 16:31:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4c7bda55-382f-5d8f-a3a5-5dd4f9ae9376
2026-03-25 16:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffp3%252Ff8f5f0bd09f044839ea959000278651e%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fp3/f8f5f0bd09f044839ea959000278651e/images/large/2.jpg not downloaded yet
2026-03-25 16:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffp3%252Ff8f5f0bd09f044839ea959000278651e%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fp3/f8f5f0bd09f044839ea959000278651e/images/large/3.jpg not downloaded yet
2026-03-25 16:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffp3%252Ff8f5f0bd09f044839ea959000278651e%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fp3/f8f5f0bd09f044839ea959000278651e/images/large/4.jpg not downloaded yet
2026-03-25 16:31:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc9d6290>
2026-03-25 16:31:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_211dd2cd-f8d1-5e2e-990f-9a303b241aea/211dd2cd-f8d1-5e2e-990f-9a303b241aea_image_6.jpg HTTP/1.1" 201 0
2026-03-25 16:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn9%252Fe213679c8d49423e81df6cc1bf7c56b6%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn9/e213679c8d49423e81df6cc1bf7c56b6/images/large/7.jpg saved to cache
2026-03-25 16:31:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 211dd2cd-f8d1-5e2e-990f-9a303b241aea
2026-03-25 16:31:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 211dd2cd-f8d1-5e2e-990f-9a303b241aea, skipping ID generation
2026-03-25 16:31:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 211dd2cd-f8d1-5e2e-990f-9a303b241aea with scrape type 1
2026-03-25 16:31:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 211dd2cd-f8d1-5e2e-990f-9a303b241aea sending to next pipeline
2026-03-25 16:31:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 211dd2cd-f8d1-5e2e-990f-9a303b241aea, identifier: 1983563
2026-03-25 16:31:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcbb70d0>
2026-03-25 16:31:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c70b927e-cb2d-5dfb-847c-0c314bd2fb22/c70b927e-cb2d-5dfb-847c-0c314bd2fb22_image_7.jpg HTTP/1.1" 201 0
2026-03-25 16:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj8%252F85df5ee543dd4007afb4aa933b685f10%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj8/85df5ee543dd4007afb4aa933b685f10/images/large/8.jpg saved to cache
2026-03-25 16:31:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c70b927e-cb2d-5dfb-847c-0c314bd2fb22
2026-03-25 16:31:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcbb7110>
2026-03-25 16:31:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c7bda55-382f-5d8f-a3a5-5dd4f9ae9376/4c7bda55-382f-5d8f-a3a5-5dd4f9ae9376_image_7.jpg HTTP/1.1" 201 0
2026-03-25 16:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn8%252F4a449b60ced044df8d1d70a8dffe1524%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn8/4a449b60ced044df8d1d70a8dffe1524/images/large/8.jpg saved to cache
2026-03-25 16:31:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4c7bda55-382f-5d8f-a3a5-5dd4f9ae9376
2026-03-25 16:31:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc82c450>
2026-03-25 16:31:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c7bda55-382f-5d8f-a3a5-5dd4f9ae9376/4c7bda55-382f-5d8f-a3a5-5dd4f9ae9376_image_8.jpg HTTP/1.1" 201 0
2026-03-25 16:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn8%252F4a449b60ced044df8d1d70a8dffe1524%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn8/4a449b60ced044df8d1d70a8dffe1524/images/large/9.jpg saved to cache
2026-03-25 16:31:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4c7bda55-382f-5d8f-a3a5-5dd4f9ae9376
2026-03-25 16:31:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4c7bda55-382f-5d8f-a3a5-5dd4f9ae9376, skipping ID generation
2026-03-25 16:31:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4c7bda55-382f-5d8f-a3a5-5dd4f9ae9376 with scrape type 1
2026-03-25 16:31:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4c7bda55-382f-5d8f-a3a5-5dd4f9ae9376 sending to next pipeline
2026-03-25 16:31:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 4c7bda55-382f-5d8f-a3a5-5dd4f9ae9376, identifier: 1983566
2026-03-25 16:31:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc587310>
2026-03-25 16:31:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c70b927e-cb2d-5dfb-847c-0c314bd2fb22/c70b927e-cb2d-5dfb-847c-0c314bd2fb22_image_6.jpg HTTP/1.1" 201 0
2026-03-25 16:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj8%252F85df5ee543dd4007afb4aa933b685f10%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj8/85df5ee543dd4007afb4aa933b685f10/images/large/7.jpg saved to cache
2026-03-25 16:31:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c70b927e-cb2d-5dfb-847c-0c314bd2fb22
2026-03-25 16:31:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc326c50>
2026-03-25 16:31:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad4830fa-b449-5585-8517-aac6390702f6/ad4830fa-b449-5585-8517-aac6390702f6_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge3%252Fd11aaed2fc824b54825b57cb3783f6d0%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge3/d11aaed2fc824b54825b57cb3783f6d0/images/large/1.jpg saved to cache
2026-03-25 16:31:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ad4830fa-b449-5585-8517-aac6390702f6
2026-03-25 16:31:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 211dd2cd-f8d1-5e2e-990f-9a303b241aea with identifier: 1983563
2026-03-25 16:31:52 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:31:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 211dd2cd-f8d1-5e2e-990f-9a303b241aea with identifier: 1983563
2026-03-25 16:31:52 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 211dd2cd-f8d1-5e2e-990f-9a303b241aea with identifier: 1983563 to the API
2026-03-25 16:31:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:31:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:31:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gn9/e213679c8d49423e81df6cc1bf7c56b6/images/large/7.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Unknown',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-27T09:30:00Z',
'fuel_type': 'hybrid',
'id': '211dd2cd-f8d1-5e2e-990f-9a303b241aea',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41025',
'listing': 'auction',
'location': None,
'make': 'FORD',
'model': 'FORD PUMA 1.0 Ecoboost Hybrid 125CV ST-Line Sport utility vehicle '
'5-door (Euro 6.2)',
'odometer': 48196,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 21,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_211dd2cd-f8d1-5e2e-990f-9a303b241aea/211dd2cd-f8d1-5e2e-990f-9a303b241aea_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 851913,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn9/e213679c8d49423e81df6cc1bf7c56b6/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_211dd2cd-f8d1-5e2e-990f-9a303b241aea/211dd2cd-f8d1-5e2e-990f-9a303b241aea_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 744098,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn9/e213679c8d49423e81df6cc1bf7c56b6/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_211dd2cd-f8d1-5e2e-990f-9a303b241aea/211dd2cd-f8d1-5e2e-990f-9a303b241aea_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 845096,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn9/e213679c8d49423e81df6cc1bf7c56b6/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_211dd2cd-f8d1-5e2e-990f-9a303b241aea/211dd2cd-f8d1-5e2e-990f-9a303b241aea_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 773700,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn9/e213679c8d49423e81df6cc1bf7c56b6/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_211dd2cd-f8d1-5e2e-990f-9a303b241aea/211dd2cd-f8d1-5e2e-990f-9a303b241aea_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 601301,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn9/e213679c8d49423e81df6cc1bf7c56b6/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_211dd2cd-f8d1-5e2e-990f-9a303b241aea/211dd2cd-f8d1-5e2e-990f-9a303b241aea_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 583210,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn9/e213679c8d49423e81df6cc1bf7c56b6/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_211dd2cd-f8d1-5e2e-990f-9a303b241aea/211dd2cd-f8d1-5e2e-990f-9a303b241aea_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 750225,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn9/e213679c8d49423e81df6cc1bf7c56b6/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_211dd2cd-f8d1-5e2e-990f-9a303b241aea/211dd2cd-f8d1-5e2e-990f-9a303b241aea_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 811140,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn9/e213679c8d49423e81df6cc1bf7c56b6/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_211dd2cd-f8d1-5e2e-990f-9a303b241aea/211dd2cd-f8d1-5e2e-990f-9a303b241aea_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 637702,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn9/e213679c8d49423e81df6cc1bf7c56b6/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_211dd2cd-f8d1-5e2e-990f-9a303b241aea/211dd2cd-f8d1-5e2e-990f-9a303b241aea_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 732451,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn9/e213679c8d49423e81df6cc1bf7c56b6/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-03-23',
'seats_number': 5,
'seller_name': None,
'title': 'FORD FORD PUMA 1.0 Ecoboost Hybrid 125CV ST-Line Sport utility '
'vehicle 5-door (Euro 6.2) -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2023}
2026-03-25 16:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983563%27 HTTP/1.1" 200 None
2026-03-25 16:31:53 [ayvens.it] INFO: Saving data for 1983563: {'created_time': 1774456313.520958, 'last_price_update_time': 1774456313.520969, 'auction_closing_time': 1774603800.0}
2026-03-25 16:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1983563') HTTP/1.1" 204 0
2026-03-25 16:31:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 4c7bda55-382f-5d8f-a3a5-5dd4f9ae9376 with identifier: 1983566
2026-03-25 16:31:53 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:31:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 4c7bda55-382f-5d8f-a3a5-5dd4f9ae9376 with identifier: 1983566
2026-03-25 16:31:53 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 4c7bda55-382f-5d8f-a3a5-5dd4f9ae9376 with identifier: 1983566 to the API
2026-03-25 16:31:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:31:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:31:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gn8/4a449b60ced044df8d1d70a8dffe1524/images/large/9.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Unknown',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-27T09:30:00Z',
'fuel_type': 'hybrid',
'id': '4c7bda55-382f-5d8f-a3a5-5dd4f9ae9376',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41025',
'listing': 'auction',
'location': None,
'make': 'FORD',
'model': 'FORD PUMA 1.0 Ecoboost Hybrid 125CV ST-Line Sport utility vehicle '
'5-door (Euro 6.2)',
'odometer': 35207,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 23,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c7bda55-382f-5d8f-a3a5-5dd4f9ae9376/4c7bda55-382f-5d8f-a3a5-5dd4f9ae9376_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 851366,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn8/4a449b60ced044df8d1d70a8dffe1524/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c7bda55-382f-5d8f-a3a5-5dd4f9ae9376/4c7bda55-382f-5d8f-a3a5-5dd4f9ae9376_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 723786,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn8/4a449b60ced044df8d1d70a8dffe1524/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c7bda55-382f-5d8f-a3a5-5dd4f9ae9376/4c7bda55-382f-5d8f-a3a5-5dd4f9ae9376_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 599807,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn8/4a449b60ced044df8d1d70a8dffe1524/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c7bda55-382f-5d8f-a3a5-5dd4f9ae9376/4c7bda55-382f-5d8f-a3a5-5dd4f9ae9376_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 633043,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn8/4a449b60ced044df8d1d70a8dffe1524/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c7bda55-382f-5d8f-a3a5-5dd4f9ae9376/4c7bda55-382f-5d8f-a3a5-5dd4f9ae9376_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 423379,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn8/4a449b60ced044df8d1d70a8dffe1524/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c7bda55-382f-5d8f-a3a5-5dd4f9ae9376/4c7bda55-382f-5d8f-a3a5-5dd4f9ae9376_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 537383,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn8/4a449b60ced044df8d1d70a8dffe1524/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c7bda55-382f-5d8f-a3a5-5dd4f9ae9376/4c7bda55-382f-5d8f-a3a5-5dd4f9ae9376_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 580530,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn8/4a449b60ced044df8d1d70a8dffe1524/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c7bda55-382f-5d8f-a3a5-5dd4f9ae9376/4c7bda55-382f-5d8f-a3a5-5dd4f9ae9376_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 743866,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn8/4a449b60ced044df8d1d70a8dffe1524/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c7bda55-382f-5d8f-a3a5-5dd4f9ae9376/4c7bda55-382f-5d8f-a3a5-5dd4f9ae9376_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 678035,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn8/4a449b60ced044df8d1d70a8dffe1524/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c7bda55-382f-5d8f-a3a5-5dd4f9ae9376/4c7bda55-382f-5d8f-a3a5-5dd4f9ae9376_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 430970,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn8/4a449b60ced044df8d1d70a8dffe1524/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-03-23',
'seats_number': 5,
'seller_name': None,
'title': 'FORD FORD PUMA 1.0 Ecoboost Hybrid 125CV ST-Line Sport utility '
'vehicle 5-door (Euro 6.2) -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2023}
2026-03-25 16:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983566%27 HTTP/1.1" 200 None
2026-03-25 16:31:53 [ayvens.it] INFO: Saving data for 1983566: {'created_time': 1774456313.873088, 'last_price_update_time': 1774456313.873098, 'auction_closing_time': 1774603800.0}
2026-03-25 16:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1983566') HTTP/1.1" 204 0
2026-03-25 16:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffp3%252Ff8f5f0bd09f044839ea959000278651e%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fp3/f8f5f0bd09f044839ea959000278651e/images/large/5.jpg not downloaded yet
2026-03-25 16:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffp3%252Ff8f5f0bd09f044839ea959000278651e%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fp3/f8f5f0bd09f044839ea959000278651e/images/large/6.jpg not downloaded yet
2026-03-25 16:31:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fs9/9f795b6663ec44e39f880b25b0ec85d1/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge3/d11aaed2fc824b54825b57cb3783f6d0/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge3/d11aaed2fc824b54825b57cb3783f6d0/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffp3%252Ff8f5f0bd09f044839ea959000278651e%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fp3/f8f5f0bd09f044839ea959000278651e/images/large/7.jpg not downloaded yet
2026-03-25 16:31:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge3/d11aaed2fc824b54825b57cb3783f6d0/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge3/d11aaed2fc824b54825b57cb3783f6d0/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge3/d11aaed2fc824b54825b57cb3783f6d0/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge3/d11aaed2fc824b54825b57cb3783f6d0/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fs9/9f795b6663ec44e39f880b25b0ec85d1/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffp3%252Ff8f5f0bd09f044839ea959000278651e%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fp3/f8f5f0bd09f044839ea959000278651e/images/large/8.jpg not downloaded yet
2026-03-25 16:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffp3%252Ff8f5f0bd09f044839ea959000278651e%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fp3/f8f5f0bd09f044839ea959000278651e/images/large/9.jpg not downloaded yet
2026-03-25 16:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffp3%252Ff8f5f0bd09f044839ea959000278651e%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fp3/f8f5f0bd09f044839ea959000278651e/images/large/10.jpg not downloaded yet
2026-03-25 16:31:54 [ayvens.it] INFO: Found listing with ID: 1983570
2026-03-25 16:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983570%27 HTTP/1.1" 200 None
2026-03-25 16:31:54 [ayvens.it] INFO: Scrape type for 1983570: 1
2026-03-25 16:31:54 [ayvens.it] INFO: Extracting data for car ID: 1983570
2026-03-25 16:31:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0c8faa7c-fdbc-584f-86a1-1d12a13c64bf with identifier: 1983570
2026-03-25 16:31:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0c8faa7c-fdbc-584f-86a1-1d12a13c64bf with scrape type 1
2026-03-25 16:31:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0c8faa7c-fdbc-584f-86a1-1d12a13c64bf
2026-03-25 16:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz5%252F7e72cb4365644e098575536eb40d16f0%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz5/7e72cb4365644e098575536eb40d16f0/images/large/1.jpg not downloaded yet
2026-03-25 16:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz5%252F7e72cb4365644e098575536eb40d16f0%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz5/7e72cb4365644e098575536eb40d16f0/images/large/2.jpg not downloaded yet
2026-03-25 16:31:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc54d790>
2026-03-25 16:31:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bf8bec1d-86ad-5e60-a97b-f1847175df2c/bf8bec1d-86ad-5e60-a97b-f1847175df2c_image_1.jpg HTTP/1.1" 201 0
2026-03-25 16:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs9%252F9f795b6663ec44e39f880b25b0ec85d1%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs9/9f795b6663ec44e39f880b25b0ec85d1/images/large/2.jpg saved to cache
2026-03-25 16:31:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item bf8bec1d-86ad-5e60-a97b-f1847175df2c
2026-03-25 16:31:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34de162f10>
2026-03-25 16:31:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad4830fa-b449-5585-8517-aac6390702f6/ad4830fa-b449-5585-8517-aac6390702f6_image_2.jpg HTTP/1.1" 201 0
2026-03-25 16:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge3%252Fd11aaed2fc824b54825b57cb3783f6d0%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge3/d11aaed2fc824b54825b57cb3783f6d0/images/large/3.jpg saved to cache
2026-03-25 16:31:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ad4830fa-b449-5585-8517-aac6390702f6
2026-03-25 16:31:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc63e110>
2026-03-25 16:31:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad4830fa-b449-5585-8517-aac6390702f6/ad4830fa-b449-5585-8517-aac6390702f6_image_6.jpg HTTP/1.1" 201 0
2026-03-25 16:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge3%252Fd11aaed2fc824b54825b57cb3783f6d0%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge3/d11aaed2fc824b54825b57cb3783f6d0/images/large/7.jpg saved to cache
2026-03-25 16:31:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ad4830fa-b449-5585-8517-aac6390702f6
2026-03-25 16:31:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc54f1d0>
2026-03-25 16:31:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad4830fa-b449-5585-8517-aac6390702f6/ad4830fa-b449-5585-8517-aac6390702f6_image_3.jpg HTTP/1.1" 201 0
2026-03-25 16:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge3%252Fd11aaed2fc824b54825b57cb3783f6d0%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge3/d11aaed2fc824b54825b57cb3783f6d0/images/large/4.jpg saved to cache
2026-03-25 16:31:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ad4830fa-b449-5585-8517-aac6390702f6
2026-03-25 16:31:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc63d610>
2026-03-25 16:31:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad4830fa-b449-5585-8517-aac6390702f6/ad4830fa-b449-5585-8517-aac6390702f6_image_4.jpg HTTP/1.1" 201 0
2026-03-25 16:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge3%252Fd11aaed2fc824b54825b57cb3783f6d0%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge3/d11aaed2fc824b54825b57cb3783f6d0/images/large/5.jpg saved to cache
2026-03-25 16:31:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ad4830fa-b449-5585-8517-aac6390702f6
2026-03-25 16:31:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc96b650>
2026-03-25 16:31:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad4830fa-b449-5585-8517-aac6390702f6/ad4830fa-b449-5585-8517-aac6390702f6_image_5.jpg HTTP/1.1" 201 0
2026-03-25 16:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge3%252Fd11aaed2fc824b54825b57cb3783f6d0%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge3/d11aaed2fc824b54825b57cb3783f6d0/images/large/6.jpg saved to cache
2026-03-25 16:31:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ad4830fa-b449-5585-8517-aac6390702f6
2026-03-25 16:31:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dca13590>
2026-03-25 16:31:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad4830fa-b449-5585-8517-aac6390702f6/ad4830fa-b449-5585-8517-aac6390702f6_image_7.jpg HTTP/1.1" 201 0
2026-03-25 16:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge3%252Fd11aaed2fc824b54825b57cb3783f6d0%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge3/d11aaed2fc824b54825b57cb3783f6d0/images/large/8.jpg saved to cache
2026-03-25 16:31:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ad4830fa-b449-5585-8517-aac6390702f6
2026-03-25 16:31:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc7f8c50>
2026-03-25 16:31:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bf8bec1d-86ad-5e60-a97b-f1847175df2c/bf8bec1d-86ad-5e60-a97b-f1847175df2c_image_2.jpg HTTP/1.1" 201 0
2026-03-25 16:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs9%252F9f795b6663ec44e39f880b25b0ec85d1%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs9/9f795b6663ec44e39f880b25b0ec85d1/images/large/3.jpg saved to cache
2026-03-25 16:31:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item bf8bec1d-86ad-5e60-a97b-f1847175df2c
2026-03-25 16:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz5%252F7e72cb4365644e098575536eb40d16f0%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz5/7e72cb4365644e098575536eb40d16f0/images/large/3.jpg not downloaded yet
2026-03-25 16:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz5%252F7e72cb4365644e098575536eb40d16f0%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz5/7e72cb4365644e098575536eb40d16f0/images/large/4.jpg not downloaded yet
2026-03-25 16:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz5%252F7e72cb4365644e098575536eb40d16f0%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz5/7e72cb4365644e098575536eb40d16f0/images/large/5.jpg not downloaded yet
2026-03-25 16:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz5%252F7e72cb4365644e098575536eb40d16f0%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz5/7e72cb4365644e098575536eb40d16f0/images/large/6.jpg not downloaded yet
2026-03-25 16:31:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fs9/9f795b6663ec44e39f880b25b0ec85d1/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge3/d11aaed2fc824b54825b57cb3783f6d0/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz5%252F7e72cb4365644e098575536eb40d16f0%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz5/7e72cb4365644e098575536eb40d16f0/images/large/7.jpg not downloaded yet
2026-03-25 16:31:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fs9/9f795b6663ec44e39f880b25b0ec85d1/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fs9/9f795b6663ec44e39f880b25b0ec85d1/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fs9/9f795b6663ec44e39f880b25b0ec85d1/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fp3/f8f5f0bd09f044839ea959000278651e/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fs9/9f795b6663ec44e39f880b25b0ec85d1/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge3/d11aaed2fc824b54825b57cb3783f6d0/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz5%252F7e72cb4365644e098575536eb40d16f0%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz5/7e72cb4365644e098575536eb40d16f0/images/large/8.jpg not downloaded yet
2026-03-25 16:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz5%252F7e72cb4365644e098575536eb40d16f0%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz5/7e72cb4365644e098575536eb40d16f0/images/large/9.jpg not downloaded yet
2026-03-25 16:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz5%252F7e72cb4365644e098575536eb40d16f0%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz5/7e72cb4365644e098575536eb40d16f0/images/large/10.jpg not downloaded yet
2026-03-25 16:31:55 [ayvens.it] INFO: Found listing with ID: 1983571
2026-03-25 16:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983571%27 HTTP/1.1" 200 None
2026-03-25 16:31:55 [ayvens.it] INFO: Scrape type for 1983571: 1
2026-03-25 16:31:55 [ayvens.it] INFO: Extracting data for car ID: 1983571
2026-03-25 16:31:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a93b19a2-927a-558e-ae38-ec141e724405 with identifier: 1983571
2026-03-25 16:31:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a93b19a2-927a-558e-ae38-ec141e724405 with scrape type 1
2026-03-25 16:31:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a93b19a2-927a-558e-ae38-ec141e724405
2026-03-25 16:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk7%252Fe8586465ad154df7bfd871928aa8223e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk7/e8586465ad154df7bfd871928aa8223e/images/large/1.jpg not downloaded yet
2026-03-25 16:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk7%252Fe8586465ad154df7bfd871928aa8223e%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk7/e8586465ad154df7bfd871928aa8223e/images/large/2.jpg not downloaded yet
2026-03-25 16:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk7%252Fe8586465ad154df7bfd871928aa8223e%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk7/e8586465ad154df7bfd871928aa8223e/images/large/3.jpg not downloaded yet
2026-03-25 16:31:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc7fb390>
2026-03-25 16:31:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bf8bec1d-86ad-5e60-a97b-f1847175df2c/bf8bec1d-86ad-5e60-a97b-f1847175df2c_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs9%252F9f795b6663ec44e39f880b25b0ec85d1%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs9/9f795b6663ec44e39f880b25b0ec85d1/images/large/1.jpg saved to cache
2026-03-25 16:31:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bf8bec1d-86ad-5e60-a97b-f1847175df2c
2026-03-25 16:31:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34d7440590>
2026-03-25 16:31:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad4830fa-b449-5585-8517-aac6390702f6/ad4830fa-b449-5585-8517-aac6390702f6_image_8.jpg HTTP/1.1" 201 0
2026-03-25 16:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge3%252Fd11aaed2fc824b54825b57cb3783f6d0%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge3/d11aaed2fc824b54825b57cb3783f6d0/images/large/9.jpg saved to cache
2026-03-25 16:31:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ad4830fa-b449-5585-8517-aac6390702f6
2026-03-25 16:31:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc5b5790>
2026-03-25 16:31:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bf8bec1d-86ad-5e60-a97b-f1847175df2c/bf8bec1d-86ad-5e60-a97b-f1847175df2c_image_6.jpg HTTP/1.1" 201 0
2026-03-25 16:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs9%252F9f795b6663ec44e39f880b25b0ec85d1%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs9/9f795b6663ec44e39f880b25b0ec85d1/images/large/7.jpg saved to cache
2026-03-25 16:31:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item bf8bec1d-86ad-5e60-a97b-f1847175df2c
2026-03-25 16:31:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34d7441b90>
2026-03-25 16:31:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bf8bec1d-86ad-5e60-a97b-f1847175df2c/bf8bec1d-86ad-5e60-a97b-f1847175df2c_image_4.jpg HTTP/1.1" 201 0
2026-03-25 16:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs9%252F9f795b6663ec44e39f880b25b0ec85d1%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs9/9f795b6663ec44e39f880b25b0ec85d1/images/large/5.jpg saved to cache
2026-03-25 16:31:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item bf8bec1d-86ad-5e60-a97b-f1847175df2c
2026-03-25 16:31:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc5bdf90>
2026-03-25 16:31:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bf8bec1d-86ad-5e60-a97b-f1847175df2c/bf8bec1d-86ad-5e60-a97b-f1847175df2c_image_5.jpg HTTP/1.1" 201 0
2026-03-25 16:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs9%252F9f795b6663ec44e39f880b25b0ec85d1%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs9/9f795b6663ec44e39f880b25b0ec85d1/images/large/6.jpg saved to cache
2026-03-25 16:31:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item bf8bec1d-86ad-5e60-a97b-f1847175df2c
2026-03-25 16:31:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dca11190>
2026-03-25 16:31:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98bc6a7b-8683-5ee8-af10-4ff6f5eb34f9/98bc6a7b-8683-5ee8-af10-4ff6f5eb34f9_image_1.jpg HTTP/1.1" 201 0
2026-03-25 16:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffp3%252Ff8f5f0bd09f044839ea959000278651e%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fp3/f8f5f0bd09f044839ea959000278651e/images/large/2.jpg saved to cache
2026-03-25 16:31:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 98bc6a7b-8683-5ee8-af10-4ff6f5eb34f9
2026-03-25 16:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk7%252Fe8586465ad154df7bfd871928aa8223e%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk7/e8586465ad154df7bfd871928aa8223e/images/large/4.jpg not downloaded yet
2026-03-25 16:31:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc5ac350>
2026-03-25 16:31:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bf8bec1d-86ad-5e60-a97b-f1847175df2c/bf8bec1d-86ad-5e60-a97b-f1847175df2c_image_3.jpg HTTP/1.1" 201 0
2026-03-25 16:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs9%252F9f795b6663ec44e39f880b25b0ec85d1%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs9/9f795b6663ec44e39f880b25b0ec85d1/images/large/4.jpg saved to cache
2026-03-25 16:31:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item bf8bec1d-86ad-5e60-a97b-f1847175df2c
2026-03-25 16:31:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc5ac310>
2026-03-25 16:31:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad4830fa-b449-5585-8517-aac6390702f6/ad4830fa-b449-5585-8517-aac6390702f6_image_9.jpg HTTP/1.1" 201 0
2026-03-25 16:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge3%252Fd11aaed2fc824b54825b57cb3783f6d0%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge3/d11aaed2fc824b54825b57cb3783f6d0/images/large/10.jpg saved to cache
2026-03-25 16:31:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ad4830fa-b449-5585-8517-aac6390702f6
2026-03-25 16:31:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fp3/f8f5f0bd09f044839ea959000278651e/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk7%252Fe8586465ad154df7bfd871928aa8223e%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk7/e8586465ad154df7bfd871928aa8223e/images/large/5.jpg not downloaded yet
2026-03-25 16:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk7%252Fe8586465ad154df7bfd871928aa8223e%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk7/e8586465ad154df7bfd871928aa8223e/images/large/6.jpg not downloaded yet
2026-03-25 16:31:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fp3/f8f5f0bd09f044839ea959000278651e/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk7%252Fe8586465ad154df7bfd871928aa8223e%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk7/e8586465ad154df7bfd871928aa8223e/images/large/7.jpg not downloaded yet
2026-03-25 16:31:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fp3/f8f5f0bd09f044839ea959000278651e/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fp3/f8f5f0bd09f044839ea959000278651e/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk7%252Fe8586465ad154df7bfd871928aa8223e%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk7/e8586465ad154df7bfd871928aa8223e/images/large/8.jpg not downloaded yet
2026-03-25 16:31:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fp3/f8f5f0bd09f044839ea959000278651e/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz5/7e72cb4365644e098575536eb40d16f0/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz5/7e72cb4365644e098575536eb40d16f0/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk7%252Fe8586465ad154df7bfd871928aa8223e%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk7/e8586465ad154df7bfd871928aa8223e/images/large/9.jpg not downloaded yet
2026-03-25 16:31:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz5/7e72cb4365644e098575536eb40d16f0/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk7%252Fe8586465ad154df7bfd871928aa8223e%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk7/e8586465ad154df7bfd871928aa8223e/images/large/10.jpg not downloaded yet
2026-03-25 16:31:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc8e0b90>
2026-03-25 16:31:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98bc6a7b-8683-5ee8-af10-4ff6f5eb34f9/98bc6a7b-8683-5ee8-af10-4ff6f5eb34f9_image_4.jpg HTTP/1.1" 201 0
2026-03-25 16:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffp3%252Ff8f5f0bd09f044839ea959000278651e%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fp3/f8f5f0bd09f044839ea959000278651e/images/large/5.jpg saved to cache
2026-03-25 16:31:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 98bc6a7b-8683-5ee8-af10-4ff6f5eb34f9
2026-03-25 16:31:56 [ayvens.it] INFO: Found listing with ID: 1983572
2026-03-25 16:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983572%27 HTTP/1.1" 200 None
2026-03-25 16:31:56 [ayvens.it] INFO: Scrape type for 1983572: 1
2026-03-25 16:31:56 [ayvens.it] INFO: Extracting data for car ID: 1983572
2026-03-25 16:31:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9acdc625-040e-58de-8b6a-cf7077ee2720 with identifier: 1983572
2026-03-25 16:31:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9acdc625-040e-58de-8b6a-cf7077ee2720 with scrape type 1
2026-03-25 16:31:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9acdc625-040e-58de-8b6a-cf7077ee2720
2026-03-25 16:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt2%252F3c1a9c2048584c9189c0ceebca59932d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt2/3c1a9c2048584c9189c0ceebca59932d/images/large/1.jpg not downloaded yet
2026-03-25 16:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt2%252F3c1a9c2048584c9189c0ceebca59932d%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt2/3c1a9c2048584c9189c0ceebca59932d/images/large/2.jpg not downloaded yet
2026-03-25 16:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt2%252F3c1a9c2048584c9189c0ceebca59932d%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt2/3c1a9c2048584c9189c0ceebca59932d/images/large/3.jpg not downloaded yet
2026-03-25 16:31:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34de142f90>
2026-03-25 16:31:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98bc6a7b-8683-5ee8-af10-4ff6f5eb34f9/98bc6a7b-8683-5ee8-af10-4ff6f5eb34f9_image_8.jpg HTTP/1.1" 201 0
2026-03-25 16:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffp3%252Ff8f5f0bd09f044839ea959000278651e%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fp3/f8f5f0bd09f044839ea959000278651e/images/large/9.jpg saved to cache
2026-03-25 16:31:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 98bc6a7b-8683-5ee8-af10-4ff6f5eb34f9
2026-03-25 16:31:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34d7d61690>
2026-03-25 16:31:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98bc6a7b-8683-5ee8-af10-4ff6f5eb34f9/98bc6a7b-8683-5ee8-af10-4ff6f5eb34f9_image_7.jpg HTTP/1.1" 201 0
2026-03-25 16:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffp3%252Ff8f5f0bd09f044839ea959000278651e%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fp3/f8f5f0bd09f044839ea959000278651e/images/large/8.jpg saved to cache
2026-03-25 16:31:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 98bc6a7b-8683-5ee8-af10-4ff6f5eb34f9
2026-03-25 16:31:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc35bad0>
2026-03-25 16:31:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98bc6a7b-8683-5ee8-af10-4ff6f5eb34f9/98bc6a7b-8683-5ee8-af10-4ff6f5eb34f9_image_3.jpg HTTP/1.1" 201 0
2026-03-25 16:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffp3%252Ff8f5f0bd09f044839ea959000278651e%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fp3/f8f5f0bd09f044839ea959000278651e/images/large/4.jpg saved to cache
2026-03-25 16:31:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 98bc6a7b-8683-5ee8-af10-4ff6f5eb34f9
2026-03-25 16:31:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc354090>
2026-03-25 16:31:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98bc6a7b-8683-5ee8-af10-4ff6f5eb34f9/98bc6a7b-8683-5ee8-af10-4ff6f5eb34f9_image_9.jpg HTTP/1.1" 201 0
2026-03-25 16:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffp3%252Ff8f5f0bd09f044839ea959000278651e%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fp3/f8f5f0bd09f044839ea959000278651e/images/large/10.jpg saved to cache
2026-03-25 16:31:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 98bc6a7b-8683-5ee8-af10-4ff6f5eb34f9
2026-03-25 16:31:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc3829d0>
2026-03-25 16:31:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0c8faa7c-fdbc-584f-86a1-1d12a13c64bf/0c8faa7c-fdbc-584f-86a1-1d12a13c64bf_image_1.jpg HTTP/1.1" 201 0
2026-03-25 16:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz5%252F7e72cb4365644e098575536eb40d16f0%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz5/7e72cb4365644e098575536eb40d16f0/images/large/2.jpg saved to cache
2026-03-25 16:31:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0c8faa7c-fdbc-584f-86a1-1d12a13c64bf
2026-03-25 16:31:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34d74cc350>
2026-03-25 16:31:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0c8faa7c-fdbc-584f-86a1-1d12a13c64bf/0c8faa7c-fdbc-584f-86a1-1d12a13c64bf_image_2.jpg HTTP/1.1" 201 0
2026-03-25 16:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz5%252F7e72cb4365644e098575536eb40d16f0%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz5/7e72cb4365644e098575536eb40d16f0/images/large/3.jpg saved to cache
2026-03-25 16:31:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0c8faa7c-fdbc-584f-86a1-1d12a13c64bf
2026-03-25 16:31:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc8e3250>
2026-03-25 16:31:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0c8faa7c-fdbc-584f-86a1-1d12a13c64bf/0c8faa7c-fdbc-584f-86a1-1d12a13c64bf_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz5%252F7e72cb4365644e098575536eb40d16f0%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz5/7e72cb4365644e098575536eb40d16f0/images/large/1.jpg saved to cache
2026-03-25 16:31:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0c8faa7c-fdbc-584f-86a1-1d12a13c64bf
2026-03-25 16:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt2%252F3c1a9c2048584c9189c0ceebca59932d%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt2/3c1a9c2048584c9189c0ceebca59932d/images/large/4.jpg not downloaded yet
2026-03-25 16:31:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fp3/f8f5f0bd09f044839ea959000278651e/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt2%252F3c1a9c2048584c9189c0ceebca59932d%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt2/3c1a9c2048584c9189c0ceebca59932d/images/large/5.jpg not downloaded yet
2026-03-25 16:31:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fp3/f8f5f0bd09f044839ea959000278651e/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt2%252F3c1a9c2048584c9189c0ceebca59932d%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt2/3c1a9c2048584c9189c0ceebca59932d/images/large/6.jpg not downloaded yet
2026-03-25 16:31:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fp3/f8f5f0bd09f044839ea959000278651e/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz5/7e72cb4365644e098575536eb40d16f0/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt2%252F3c1a9c2048584c9189c0ceebca59932d%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt2/3c1a9c2048584c9189c0ceebca59932d/images/large/7.jpg not downloaded yet
2026-03-25 16:31:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz5/7e72cb4365644e098575536eb40d16f0/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz5/7e72cb4365644e098575536eb40d16f0/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt2%252F3c1a9c2048584c9189c0ceebca59932d%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt2/3c1a9c2048584c9189c0ceebca59932d/images/large/8.jpg not downloaded yet
2026-03-25 16:31:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk7/e8586465ad154df7bfd871928aa8223e/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk7/e8586465ad154df7bfd871928aa8223e/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt2%252F3c1a9c2048584c9189c0ceebca59932d%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt2/3c1a9c2048584c9189c0ceebca59932d/images/large/9.jpg not downloaded yet
2026-03-25 16:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt2%252F3c1a9c2048584c9189c0ceebca59932d%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt2/3c1a9c2048584c9189c0ceebca59932d/images/large/10.jpg not downloaded yet
2026-03-25 16:31:57 [ayvens.it] INFO: Found listing with ID: 1983573
2026-03-25 16:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983573%27 HTTP/1.1" 200 None
2026-03-25 16:31:57 [ayvens.it] INFO: Scrape type for 1983573: 1
2026-03-25 16:31:57 [ayvens.it] INFO: Extracting data for car ID: 1983573
2026-03-25 16:31:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8c177fe8-417c-56d6-9b50-32e8a80cea69 with identifier: 1983573
2026-03-25 16:31:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8c177fe8-417c-56d6-9b50-32e8a80cea69 with scrape type 1
2026-03-25 16:31:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8c177fe8-417c-56d6-9b50-32e8a80cea69
2026-03-25 16:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl5%252Ff22afccf1e954bfa9f1b1b2193624fc7%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl5/f22afccf1e954bfa9f1b1b2193624fc7/images/large/1.jpg not downloaded yet
2026-03-25 16:31:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc87b650>
2026-03-25 16:31:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98bc6a7b-8683-5ee8-af10-4ff6f5eb34f9/98bc6a7b-8683-5ee8-af10-4ff6f5eb34f9_image_2.jpg HTTP/1.1" 201 0
2026-03-25 16:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffp3%252Ff8f5f0bd09f044839ea959000278651e%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fp3/f8f5f0bd09f044839ea959000278651e/images/large/3.jpg saved to cache
2026-03-25 16:31:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 98bc6a7b-8683-5ee8-af10-4ff6f5eb34f9
2026-03-25 16:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl5%252Ff22afccf1e954bfa9f1b1b2193624fc7%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl5/f22afccf1e954bfa9f1b1b2193624fc7/images/large/2.jpg not downloaded yet
2026-03-25 16:31:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc8781d0>
2026-03-25 16:31:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98bc6a7b-8683-5ee8-af10-4ff6f5eb34f9/98bc6a7b-8683-5ee8-af10-4ff6f5eb34f9_image_6.jpg HTTP/1.1" 201 0
2026-03-25 16:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffp3%252Ff8f5f0bd09f044839ea959000278651e%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fp3/f8f5f0bd09f044839ea959000278651e/images/large/7.jpg saved to cache
2026-03-25 16:31:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 98bc6a7b-8683-5ee8-af10-4ff6f5eb34f9
2026-03-25 16:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl5%252Ff22afccf1e954bfa9f1b1b2193624fc7%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl5/f22afccf1e954bfa9f1b1b2193624fc7/images/large/3.jpg not downloaded yet
2026-03-25 16:31:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc637650>
2026-03-25 16:31:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98bc6a7b-8683-5ee8-af10-4ff6f5eb34f9/98bc6a7b-8683-5ee8-af10-4ff6f5eb34f9_image_5.jpg HTTP/1.1" 201 0
2026-03-25 16:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffp3%252Ff8f5f0bd09f044839ea959000278651e%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fp3/f8f5f0bd09f044839ea959000278651e/images/large/6.jpg saved to cache
2026-03-25 16:31:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 98bc6a7b-8683-5ee8-af10-4ff6f5eb34f9
2026-03-25 16:31:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcc0a790>
2026-03-25 16:31:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0c8faa7c-fdbc-584f-86a1-1d12a13c64bf/0c8faa7c-fdbc-584f-86a1-1d12a13c64bf_image_3.jpg HTTP/1.1" 201 0
2026-03-25 16:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz5%252F7e72cb4365644e098575536eb40d16f0%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz5/7e72cb4365644e098575536eb40d16f0/images/large/4.jpg saved to cache
2026-03-25 16:31:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0c8faa7c-fdbc-584f-86a1-1d12a13c64bf
2026-03-25 16:31:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc824a10>
2026-03-25 16:31:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0c8faa7c-fdbc-584f-86a1-1d12a13c64bf/0c8faa7c-fdbc-584f-86a1-1d12a13c64bf_image_4.jpg HTTP/1.1" 201 0
2026-03-25 16:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz5%252F7e72cb4365644e098575536eb40d16f0%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz5/7e72cb4365644e098575536eb40d16f0/images/large/5.jpg saved to cache
2026-03-25 16:31:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0c8faa7c-fdbc-584f-86a1-1d12a13c64bf
2026-03-25 16:31:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc826490>
2026-03-25 16:31:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0c8faa7c-fdbc-584f-86a1-1d12a13c64bf/0c8faa7c-fdbc-584f-86a1-1d12a13c64bf_image_5.jpg HTTP/1.1" 201 0
2026-03-25 16:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz5%252F7e72cb4365644e098575536eb40d16f0%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz5/7e72cb4365644e098575536eb40d16f0/images/large/6.jpg saved to cache
2026-03-25 16:31:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0c8faa7c-fdbc-584f-86a1-1d12a13c64bf
2026-03-25 16:31:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc86b190>
2026-03-25 16:31:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a93b19a2-927a-558e-ae38-ec141e724405/a93b19a2-927a-558e-ae38-ec141e724405_image_3.jpg HTTP/1.1" 201 0
2026-03-25 16:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk7%252Fe8586465ad154df7bfd871928aa8223e%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk7/e8586465ad154df7bfd871928aa8223e/images/large/4.jpg saved to cache
2026-03-25 16:31:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a93b19a2-927a-558e-ae38-ec141e724405
2026-03-25 16:31:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc87a550>
2026-03-25 16:31:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a93b19a2-927a-558e-ae38-ec141e724405/a93b19a2-927a-558e-ae38-ec141e724405_image_2.jpg HTTP/1.1" 201 0
2026-03-25 16:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk7%252Fe8586465ad154df7bfd871928aa8223e%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk7/e8586465ad154df7bfd871928aa8223e/images/large/3.jpg saved to cache
2026-03-25 16:31:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a93b19a2-927a-558e-ae38-ec141e724405
2026-03-25 16:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl5%252Ff22afccf1e954bfa9f1b1b2193624fc7%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl5/f22afccf1e954bfa9f1b1b2193624fc7/images/large/4.jpg not downloaded yet
2026-03-25 16:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl5%252Ff22afccf1e954bfa9f1b1b2193624fc7%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl5/f22afccf1e954bfa9f1b1b2193624fc7/images/large/5.jpg not downloaded yet
2026-03-25 16:31:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk7/e8586465ad154df7bfd871928aa8223e/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl5%252Ff22afccf1e954bfa9f1b1b2193624fc7%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl5/f22afccf1e954bfa9f1b1b2193624fc7/images/large/6.jpg not downloaded yet
2026-03-25 16:31:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk7/e8586465ad154df7bfd871928aa8223e/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk7/e8586465ad154df7bfd871928aa8223e/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk7/e8586465ad154df7bfd871928aa8223e/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk7/e8586465ad154df7bfd871928aa8223e/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl5%252Ff22afccf1e954bfa9f1b1b2193624fc7%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl5/f22afccf1e954bfa9f1b1b2193624fc7/images/large/7.jpg not downloaded yet
2026-03-25 16:31:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt2/3c1a9c2048584c9189c0ceebca59932d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk7/e8586465ad154df7bfd871928aa8223e/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl5%252Ff22afccf1e954bfa9f1b1b2193624fc7%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl5/f22afccf1e954bfa9f1b1b2193624fc7/images/large/8.jpg not downloaded yet
2026-03-25 16:31:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk7/e8586465ad154df7bfd871928aa8223e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl5%252Ff22afccf1e954bfa9f1b1b2193624fc7%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl5/f22afccf1e954bfa9f1b1b2193624fc7/images/large/9.jpg not downloaded yet
2026-03-25 16:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl5%252Ff22afccf1e954bfa9f1b1b2193624fc7%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl5/f22afccf1e954bfa9f1b1b2193624fc7/images/large/10.jpg not downloaded yet
2026-03-25 16:31:58 [ayvens.it] INFO: Found listing with ID: 1983574
2026-03-25 16:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983574%27 HTTP/1.1" 200 None
2026-03-25 16:31:58 [ayvens.it] INFO: Scrape type for 1983574: 1
2026-03-25 16:31:58 [ayvens.it] INFO: Extracting data for car ID: 1983574
2026-03-25 16:31:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c4aa3aa1-7708-53ca-8f05-c31e5cbd8416 with identifier: 1983574
2026-03-25 16:31:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c4aa3aa1-7708-53ca-8f05-c31e5cbd8416 with scrape type 1
2026-03-25 16:31:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c4aa3aa1-7708-53ca-8f05-c31e5cbd8416
2026-03-25 16:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk7%252Fc8ff55426fad42a0a0752bf4c5990b5b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk7/c8ff55426fad42a0a0752bf4c5990b5b/images/large/1.jpg not downloaded yet
2026-03-25 16:31:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc37fcd0>
2026-03-25 16:31:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a93b19a2-927a-558e-ae38-ec141e724405/a93b19a2-927a-558e-ae38-ec141e724405_image_6.jpg HTTP/1.1" 201 0
2026-03-25 16:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk7%252Fe8586465ad154df7bfd871928aa8223e%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk7/e8586465ad154df7bfd871928aa8223e/images/large/7.jpg saved to cache
2026-03-25 16:31:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a93b19a2-927a-558e-ae38-ec141e724405
2026-03-25 16:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk7%252Fc8ff55426fad42a0a0752bf4c5990b5b%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk7/c8ff55426fad42a0a0752bf4c5990b5b/images/large/2.jpg not downloaded yet
2026-03-25 16:31:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc586890>
2026-03-25 16:31:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a93b19a2-927a-558e-ae38-ec141e724405/a93b19a2-927a-558e-ae38-ec141e724405_image_1.jpg HTTP/1.1" 201 0
2026-03-25 16:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk7%252Fe8586465ad154df7bfd871928aa8223e%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk7/e8586465ad154df7bfd871928aa8223e/images/large/2.jpg saved to cache
2026-03-25 16:31:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a93b19a2-927a-558e-ae38-ec141e724405
2026-03-25 16:31:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc9e4bd0>
2026-03-25 16:31:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a93b19a2-927a-558e-ae38-ec141e724405/a93b19a2-927a-558e-ae38-ec141e724405_image_9.jpg HTTP/1.1" 201 0
2026-03-25 16:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk7%252Fe8586465ad154df7bfd871928aa8223e%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk7/e8586465ad154df7bfd871928aa8223e/images/large/10.jpg saved to cache
2026-03-25 16:31:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a93b19a2-927a-558e-ae38-ec141e724405
2026-03-25 16:31:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc3712d0>
2026-03-25 16:31:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a93b19a2-927a-558e-ae38-ec141e724405/a93b19a2-927a-558e-ae38-ec141e724405_image_5.jpg HTTP/1.1" 201 0
2026-03-25 16:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk7%252Fe8586465ad154df7bfd871928aa8223e%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk7/e8586465ad154df7bfd871928aa8223e/images/large/6.jpg saved to cache
2026-03-25 16:31:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a93b19a2-927a-558e-ae38-ec141e724405
2026-03-25 16:31:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc300290>
2026-03-25 16:31:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a93b19a2-927a-558e-ae38-ec141e724405/a93b19a2-927a-558e-ae38-ec141e724405_image_8.jpg HTTP/1.1" 201 0
2026-03-25 16:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk7%252Fe8586465ad154df7bfd871928aa8223e%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk7/e8586465ad154df7bfd871928aa8223e/images/large/9.jpg saved to cache
2026-03-25 16:31:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a93b19a2-927a-558e-ae38-ec141e724405
2026-03-25 16:31:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcaabe10>
2026-03-25 16:31:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9acdc625-040e-58de-8b6a-cf7077ee2720/9acdc625-040e-58de-8b6a-cf7077ee2720_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt2%252F3c1a9c2048584c9189c0ceebca59932d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt2/3c1a9c2048584c9189c0ceebca59932d/images/large/1.jpg saved to cache
2026-03-25 16:31:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9acdc625-040e-58de-8b6a-cf7077ee2720
2026-03-25 16:31:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcae9090>
2026-03-25 16:31:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a93b19a2-927a-558e-ae38-ec141e724405/a93b19a2-927a-558e-ae38-ec141e724405_image_4.jpg HTTP/1.1" 201 0
2026-03-25 16:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk7%252Fe8586465ad154df7bfd871928aa8223e%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk7/e8586465ad154df7bfd871928aa8223e/images/large/5.jpg saved to cache
2026-03-25 16:31:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a93b19a2-927a-558e-ae38-ec141e724405
2026-03-25 16:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk7%252Fc8ff55426fad42a0a0752bf4c5990b5b%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk7/c8ff55426fad42a0a0752bf4c5990b5b/images/large/3.jpg not downloaded yet
2026-03-25 16:31:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt2/3c1a9c2048584c9189c0ceebca59932d/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk7%252Fc8ff55426fad42a0a0752bf4c5990b5b%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk7/c8ff55426fad42a0a0752bf4c5990b5b/images/large/4.jpg not downloaded yet
2026-03-25 16:31:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34d74953d0>
2026-03-25 16:31:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a93b19a2-927a-558e-ae38-ec141e724405/a93b19a2-927a-558e-ae38-ec141e724405_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk7%252Fe8586465ad154df7bfd871928aa8223e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk7/e8586465ad154df7bfd871928aa8223e/images/large/1.jpg saved to cache
2026-03-25 16:31:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a93b19a2-927a-558e-ae38-ec141e724405
2026-03-25 16:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk7%252Fc8ff55426fad42a0a0752bf4c5990b5b%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk7/c8ff55426fad42a0a0752bf4c5990b5b/images/large/5.jpg not downloaded yet
2026-03-25 16:31:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt2/3c1a9c2048584c9189c0ceebca59932d/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk7%252Fc8ff55426fad42a0a0752bf4c5990b5b%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk7/c8ff55426fad42a0a0752bf4c5990b5b/images/large/6.jpg not downloaded yet
2026-03-25 16:31:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl5/f22afccf1e954bfa9f1b1b2193624fc7/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl5/f22afccf1e954bfa9f1b1b2193624fc7/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk7%252Fc8ff55426fad42a0a0752bf4c5990b5b%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk7/c8ff55426fad42a0a0752bf4c5990b5b/images/large/7.jpg not downloaded yet
2026-03-25 16:31:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcbdc050>
2026-03-25 16:31:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9acdc625-040e-58de-8b6a-cf7077ee2720/9acdc625-040e-58de-8b6a-cf7077ee2720_image_5.jpg HTTP/1.1" 201 0
2026-03-25 16:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt2%252F3c1a9c2048584c9189c0ceebca59932d%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt2/3c1a9c2048584c9189c0ceebca59932d/images/large/6.jpg saved to cache
2026-03-25 16:31:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9acdc625-040e-58de-8b6a-cf7077ee2720
2026-03-25 16:31:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt2/3c1a9c2048584c9189c0ceebca59932d/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt2/3c1a9c2048584c9189c0ceebca59932d/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk7%252Fc8ff55426fad42a0a0752bf4c5990b5b%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk7/c8ff55426fad42a0a0752bf4c5990b5b/images/large/8.jpg not downloaded yet
2026-03-25 16:31:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt2/3c1a9c2048584c9189c0ceebca59932d/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt2/3c1a9c2048584c9189c0ceebca59932d/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk7%252Fc8ff55426fad42a0a0752bf4c5990b5b%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk7/c8ff55426fad42a0a0752bf4c5990b5b/images/large/9.jpg not downloaded yet
2026-03-25 16:31:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcbe4050>
2026-03-25 16:31:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9acdc625-040e-58de-8b6a-cf7077ee2720/9acdc625-040e-58de-8b6a-cf7077ee2720_image_6.jpg HTTP/1.1" 201 0
2026-03-25 16:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt2%252F3c1a9c2048584c9189c0ceebca59932d%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt2/3c1a9c2048584c9189c0ceebca59932d/images/large/7.jpg saved to cache
2026-03-25 16:31:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9acdc625-040e-58de-8b6a-cf7077ee2720
2026-03-25 16:31:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcbaaa50>
2026-03-25 16:31:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c177fe8-417c-56d6-9b50-32e8a80cea69/8c177fe8-417c-56d6-9b50-32e8a80cea69_image_2.jpg HTTP/1.1" 201 0
2026-03-25 16:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl5%252Ff22afccf1e954bfa9f1b1b2193624fc7%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl5/f22afccf1e954bfa9f1b1b2193624fc7/images/large/3.jpg saved to cache
2026-03-25 16:31:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8c177fe8-417c-56d6-9b50-32e8a80cea69
2026-03-25 16:31:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc60e2d0>
2026-03-25 16:31:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c177fe8-417c-56d6-9b50-32e8a80cea69/8c177fe8-417c-56d6-9b50-32e8a80cea69_image_1.jpg HTTP/1.1" 201 0
2026-03-25 16:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl5%252Ff22afccf1e954bfa9f1b1b2193624fc7%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl5/f22afccf1e954bfa9f1b1b2193624fc7/images/large/2.jpg saved to cache
2026-03-25 16:31:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8c177fe8-417c-56d6-9b50-32e8a80cea69
2026-03-25 16:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk7%252Fc8ff55426fad42a0a0752bf4c5990b5b%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk7/c8ff55426fad42a0a0752bf4c5990b5b/images/large/10.jpg not downloaded yet
2026-03-25 16:31:59 [ayvens.it] INFO: Found listing with ID: 1983575
2026-03-25 16:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983575%27 HTTP/1.1" 200 None
2026-03-25 16:31:59 [ayvens.it] INFO: Scrape type for 1983575: 1
2026-03-25 16:31:59 [ayvens.it] INFO: Extracting data for car ID: 1983575
2026-03-25 16:31:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3c33d0b7-5ce0-5a4c-b751-fa917fddf485 with identifier: 1983575
2026-03-25 16:31:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3c33d0b7-5ce0-5a4c-b751-fa917fddf485 with scrape type 1
2026-03-25 16:31:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3c33d0b7-5ce0-5a4c-b751-fa917fddf485
2026-03-25 16:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl1%252F1b695fc3bff0443eb518f57c80eebb15%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl1/1b695fc3bff0443eb518f57c80eebb15/images/large/1.jpg not downloaded yet
2026-03-25 16:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl1%252F1b695fc3bff0443eb518f57c80eebb15%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl1/1b695fc3bff0443eb518f57c80eebb15/images/large/2.jpg not downloaded yet
2026-03-25 16:31:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcbab9d0>
2026-03-25 16:31:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9acdc625-040e-58de-8b6a-cf7077ee2720/9acdc625-040e-58de-8b6a-cf7077ee2720_image_4.jpg HTTP/1.1" 201 0
2026-03-25 16:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt2%252F3c1a9c2048584c9189c0ceebca59932d%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt2/3c1a9c2048584c9189c0ceebca59932d/images/large/5.jpg saved to cache
2026-03-25 16:31:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9acdc625-040e-58de-8b6a-cf7077ee2720
2026-03-25 16:31:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc54c690>
2026-03-25 16:31:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9acdc625-040e-58de-8b6a-cf7077ee2720/9acdc625-040e-58de-8b6a-cf7077ee2720_image_1.jpg HTTP/1.1" 201 0
2026-03-25 16:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt2%252F3c1a9c2048584c9189c0ceebca59932d%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt2/3c1a9c2048584c9189c0ceebca59932d/images/large/2.jpg saved to cache
2026-03-25 16:31:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9acdc625-040e-58de-8b6a-cf7077ee2720
2026-03-25 16:31:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dca19dd0>
2026-03-25 16:31:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9acdc625-040e-58de-8b6a-cf7077ee2720/9acdc625-040e-58de-8b6a-cf7077ee2720_image_3.jpg HTTP/1.1" 201 0
2026-03-25 16:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt2%252F3c1a9c2048584c9189c0ceebca59932d%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt2/3c1a9c2048584c9189c0ceebca59932d/images/large/4.jpg saved to cache
2026-03-25 16:31:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9acdc625-040e-58de-8b6a-cf7077ee2720
2026-03-25 16:31:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc373650>
2026-03-25 16:31:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9acdc625-040e-58de-8b6a-cf7077ee2720/9acdc625-040e-58de-8b6a-cf7077ee2720_image_2.jpg HTTP/1.1" 201 0
2026-03-25 16:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt2%252F3c1a9c2048584c9189c0ceebca59932d%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 16:31:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt2/3c1a9c2048584c9189c0ceebca59932d/images/large/3.jpg saved to cache
2026-03-25 16:31:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9acdc625-040e-58de-8b6a-cf7077ee2720
2026-03-25 16:31:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl5/f22afccf1e954bfa9f1b1b2193624fc7/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl1%252F1b695fc3bff0443eb518f57c80eebb15%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl1/1b695fc3bff0443eb518f57c80eebb15/images/large/3.jpg not downloaded yet
2026-03-25 16:31:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl5/f22afccf1e954bfa9f1b1b2193624fc7/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl1%252F1b695fc3bff0443eb518f57c80eebb15%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl1/1b695fc3bff0443eb518f57c80eebb15/images/large/4.jpg not downloaded yet
2026-03-25 16:31:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl5/f22afccf1e954bfa9f1b1b2193624fc7/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt2/3c1a9c2048584c9189c0ceebca59932d/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl5/f22afccf1e954bfa9f1b1b2193624fc7/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk7/c8ff55426fad42a0a0752bf4c5990b5b/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt2/3c1a9c2048584c9189c0ceebca59932d/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl1%252F1b695fc3bff0443eb518f57c80eebb15%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl1/1b695fc3bff0443eb518f57c80eebb15/images/large/5.jpg not downloaded yet
2026-03-25 16:31:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk7/c8ff55426fad42a0a0752bf4c5990b5b/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl1%252F1b695fc3bff0443eb518f57c80eebb15%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl1/1b695fc3bff0443eb518f57c80eebb15/images/large/6.jpg not downloaded yet
2026-03-25 16:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl1%252F1b695fc3bff0443eb518f57c80eebb15%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl1/1b695fc3bff0443eb518f57c80eebb15/images/large/7.jpg not downloaded yet
2026-03-25 16:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl1%252F1b695fc3bff0443eb518f57c80eebb15%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:31:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl1/1b695fc3bff0443eb518f57c80eebb15/images/large/8.jpg not downloaded yet
2026-03-25 16:31:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:31:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc553a10>
2026-03-25 16:31:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:31:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:31:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:31:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c177fe8-417c-56d6-9b50-32e8a80cea69/8c177fe8-417c-56d6-9b50-32e8a80cea69_image_4.jpg HTTP/1.1" 201 0
2026-03-25 16:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl5%252Ff22afccf1e954bfa9f1b1b2193624fc7%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl5/f22afccf1e954bfa9f1b1b2193624fc7/images/large/5.jpg saved to cache
2026-03-25 16:32:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8c177fe8-417c-56d6-9b50-32e8a80cea69
2026-03-25 16:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl1%252F1b695fc3bff0443eb518f57c80eebb15%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl1/1b695fc3bff0443eb518f57c80eebb15/images/large/9.jpg not downloaded yet
2026-03-25 16:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl1%252F1b695fc3bff0443eb518f57c80eebb15%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl1/1b695fc3bff0443eb518f57c80eebb15/images/large/10.jpg not downloaded yet
2026-03-25 16:32:00 [ayvens.it] INFO: Found listing with ID: 1983576
2026-03-25 16:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983576%27 HTTP/1.1" 200 None
2026-03-25 16:32:00 [ayvens.it] INFO: Scrape type for 1983576: 1
2026-03-25 16:32:00 [ayvens.it] INFO: Extracting data for car ID: 1983576
2026-03-25 16:32:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 82fe7289-ecaf-5d10-ab83-a98c9b2a2945 with identifier: 1983576
2026-03-25 16:32:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 82fe7289-ecaf-5d10-ab83-a98c9b2a2945 with scrape type 1
2026-03-25 16:32:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 82fe7289-ecaf-5d10-ab83-a98c9b2a2945
2026-03-25 16:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl7%252F21614d75138247928df577f37a5d31c9%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl7/21614d75138247928df577f37a5d31c9/images/large/1.jpg not downloaded yet
2026-03-25 16:32:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc5e9310>
2026-03-25 16:32:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c177fe8-417c-56d6-9b50-32e8a80cea69/8c177fe8-417c-56d6-9b50-32e8a80cea69_image_3.jpg HTTP/1.1" 201 0
2026-03-25 16:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl5%252Ff22afccf1e954bfa9f1b1b2193624fc7%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl5/f22afccf1e954bfa9f1b1b2193624fc7/images/large/4.jpg saved to cache
2026-03-25 16:32:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8c177fe8-417c-56d6-9b50-32e8a80cea69
2026-03-25 16:32:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dca50410>
2026-03-25 16:32:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c177fe8-417c-56d6-9b50-32e8a80cea69/8c177fe8-417c-56d6-9b50-32e8a80cea69_image_5.jpg HTTP/1.1" 201 0
2026-03-25 16:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl5%252Ff22afccf1e954bfa9f1b1b2193624fc7%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl5/f22afccf1e954bfa9f1b1b2193624fc7/images/large/6.jpg saved to cache
2026-03-25 16:32:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8c177fe8-417c-56d6-9b50-32e8a80cea69
2026-03-25 16:32:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc548410>
2026-03-25 16:32:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9acdc625-040e-58de-8b6a-cf7077ee2720/9acdc625-040e-58de-8b6a-cf7077ee2720_image_8.jpg HTTP/1.1" 201 0
2026-03-25 16:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt2%252F3c1a9c2048584c9189c0ceebca59932d%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt2/3c1a9c2048584c9189c0ceebca59932d/images/large/9.jpg saved to cache
2026-03-25 16:32:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9acdc625-040e-58de-8b6a-cf7077ee2720
2026-03-25 16:32:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34de804250>
2026-03-25 16:32:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c177fe8-417c-56d6-9b50-32e8a80cea69/8c177fe8-417c-56d6-9b50-32e8a80cea69_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl5%252Ff22afccf1e954bfa9f1b1b2193624fc7%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl5/f22afccf1e954bfa9f1b1b2193624fc7/images/large/1.jpg saved to cache
2026-03-25 16:32:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8c177fe8-417c-56d6-9b50-32e8a80cea69
2026-03-25 16:32:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dca52050>
2026-03-25 16:32:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c4aa3aa1-7708-53ca-8f05-c31e5cbd8416/c4aa3aa1-7708-53ca-8f05-c31e5cbd8416_image_2.jpg HTTP/1.1" 201 0
2026-03-25 16:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk7%252Fc8ff55426fad42a0a0752bf4c5990b5b%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk7/c8ff55426fad42a0a0752bf4c5990b5b/images/large/3.jpg saved to cache
2026-03-25 16:32:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c4aa3aa1-7708-53ca-8f05-c31e5cbd8416
2026-03-25 16:32:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dca44d10>
2026-03-25 16:32:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9acdc625-040e-58de-8b6a-cf7077ee2720/9acdc625-040e-58de-8b6a-cf7077ee2720_image_9.jpg HTTP/1.1" 201 0
2026-03-25 16:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt2%252F3c1a9c2048584c9189c0ceebca59932d%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt2/3c1a9c2048584c9189c0ceebca59932d/images/large/10.jpg saved to cache
2026-03-25 16:32:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9acdc625-040e-58de-8b6a-cf7077ee2720
2026-03-25 16:32:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc2ff610>
2026-03-25 16:32:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c4aa3aa1-7708-53ca-8f05-c31e5cbd8416/c4aa3aa1-7708-53ca-8f05-c31e5cbd8416_image_1.jpg HTTP/1.1" 201 0
2026-03-25 16:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk7%252Fc8ff55426fad42a0a0752bf4c5990b5b%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk7/c8ff55426fad42a0a0752bf4c5990b5b/images/large/2.jpg saved to cache
2026-03-25 16:32:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c4aa3aa1-7708-53ca-8f05-c31e5cbd8416
2026-03-25 16:32:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk7/c8ff55426fad42a0a0752bf4c5990b5b/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl7%252F21614d75138247928df577f37a5d31c9%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl7/21614d75138247928df577f37a5d31c9/images/large/2.jpg not downloaded yet
2026-03-25 16:32:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk7/c8ff55426fad42a0a0752bf4c5990b5b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk7/c8ff55426fad42a0a0752bf4c5990b5b/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk7/c8ff55426fad42a0a0752bf4c5990b5b/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk7/c8ff55426fad42a0a0752bf4c5990b5b/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk7/c8ff55426fad42a0a0752bf4c5990b5b/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl7%252F21614d75138247928df577f37a5d31c9%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl7/21614d75138247928df577f37a5d31c9/images/large/3.jpg not downloaded yet
2026-03-25 16:32:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk7/c8ff55426fad42a0a0752bf4c5990b5b/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl5/f22afccf1e954bfa9f1b1b2193624fc7/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl7%252F21614d75138247928df577f37a5d31c9%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl7/21614d75138247928df577f37a5d31c9/images/large/4.jpg not downloaded yet
2026-03-25 16:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl7%252F21614d75138247928df577f37a5d31c9%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl7/21614d75138247928df577f37a5d31c9/images/large/5.jpg not downloaded yet
2026-03-25 16:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl7%252F21614d75138247928df577f37a5d31c9%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl7/21614d75138247928df577f37a5d31c9/images/large/6.jpg not downloaded yet
2026-03-25 16:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl7%252F21614d75138247928df577f37a5d31c9%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl7/21614d75138247928df577f37a5d31c9/images/large/7.jpg not downloaded yet
2026-03-25 16:32:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc80e7d0>
2026-03-25 16:32:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c4aa3aa1-7708-53ca-8f05-c31e5cbd8416/c4aa3aa1-7708-53ca-8f05-c31e5cbd8416_image_9.jpg HTTP/1.1" 201 0
2026-03-25 16:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk7%252Fc8ff55426fad42a0a0752bf4c5990b5b%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk7/c8ff55426fad42a0a0752bf4c5990b5b/images/large/10.jpg saved to cache
2026-03-25 16:32:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c4aa3aa1-7708-53ca-8f05-c31e5cbd8416
2026-03-25 16:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl7%252F21614d75138247928df577f37a5d31c9%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl7/21614d75138247928df577f37a5d31c9/images/large/8.jpg not downloaded yet
2026-03-25 16:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl7%252F21614d75138247928df577f37a5d31c9%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl7/21614d75138247928df577f37a5d31c9/images/large/9.jpg not downloaded yet
2026-03-25 16:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl7%252F21614d75138247928df577f37a5d31c9%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl7/21614d75138247928df577f37a5d31c9/images/large/10.jpg not downloaded yet
2026-03-25 16:32:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc802310>
2026-03-25 16:32:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c4aa3aa1-7708-53ca-8f05-c31e5cbd8416/c4aa3aa1-7708-53ca-8f05-c31e5cbd8416_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk7%252Fc8ff55426fad42a0a0752bf4c5990b5b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk7/c8ff55426fad42a0a0752bf4c5990b5b/images/large/1.jpg saved to cache
2026-03-25 16:32:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c4aa3aa1-7708-53ca-8f05-c31e5cbd8416
2026-03-25 16:32:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc9b1690>
2026-03-25 16:32:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c4aa3aa1-7708-53ca-8f05-c31e5cbd8416/c4aa3aa1-7708-53ca-8f05-c31e5cbd8416_image_6.jpg HTTP/1.1" 201 0
2026-03-25 16:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk7%252Fc8ff55426fad42a0a0752bf4c5990b5b%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk7/c8ff55426fad42a0a0752bf4c5990b5b/images/large/7.jpg saved to cache
2026-03-25 16:32:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c4aa3aa1-7708-53ca-8f05-c31e5cbd8416
2026-03-25 16:32:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dca53a50>
2026-03-25 16:32:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c4aa3aa1-7708-53ca-8f05-c31e5cbd8416/c4aa3aa1-7708-53ca-8f05-c31e5cbd8416_image_5.jpg HTTP/1.1" 201 0
2026-03-25 16:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk7%252Fc8ff55426fad42a0a0752bf4c5990b5b%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk7/c8ff55426fad42a0a0752bf4c5990b5b/images/large/6.jpg saved to cache
2026-03-25 16:32:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c4aa3aa1-7708-53ca-8f05-c31e5cbd8416
2026-03-25 16:32:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc592a90>
2026-03-25 16:32:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c4aa3aa1-7708-53ca-8f05-c31e5cbd8416/c4aa3aa1-7708-53ca-8f05-c31e5cbd8416_image_4.jpg HTTP/1.1" 201 0
2026-03-25 16:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk7%252Fc8ff55426fad42a0a0752bf4c5990b5b%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk7/c8ff55426fad42a0a0752bf4c5990b5b/images/large/5.jpg saved to cache
2026-03-25 16:32:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c4aa3aa1-7708-53ca-8f05-c31e5cbd8416
2026-03-25 16:32:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcb84e10>
2026-03-25 16:32:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c4aa3aa1-7708-53ca-8f05-c31e5cbd8416/c4aa3aa1-7708-53ca-8f05-c31e5cbd8416_image_8.jpg HTTP/1.1" 201 0
2026-03-25 16:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk7%252Fc8ff55426fad42a0a0752bf4c5990b5b%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk7/c8ff55426fad42a0a0752bf4c5990b5b/images/large/9.jpg saved to cache
2026-03-25 16:32:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c4aa3aa1-7708-53ca-8f05-c31e5cbd8416
2026-03-25 16:32:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc591410>
2026-03-25 16:32:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c4aa3aa1-7708-53ca-8f05-c31e5cbd8416/c4aa3aa1-7708-53ca-8f05-c31e5cbd8416_image_3.jpg HTTP/1.1" 201 0
2026-03-25 16:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk7%252Fc8ff55426fad42a0a0752bf4c5990b5b%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk7/c8ff55426fad42a0a0752bf4c5990b5b/images/large/4.jpg saved to cache
2026-03-25 16:32:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c4aa3aa1-7708-53ca-8f05-c31e5cbd8416
2026-03-25 16:32:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc591c90>
2026-03-25 16:32:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c177fe8-417c-56d6-9b50-32e8a80cea69/8c177fe8-417c-56d6-9b50-32e8a80cea69_image_9.jpg HTTP/1.1" 201 0
2026-03-25 16:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl5%252Ff22afccf1e954bfa9f1b1b2193624fc7%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl5/f22afccf1e954bfa9f1b1b2193624fc7/images/large/10.jpg saved to cache
2026-03-25 16:32:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8c177fe8-417c-56d6-9b50-32e8a80cea69
2026-03-25 16:32:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk7/c8ff55426fad42a0a0752bf4c5990b5b/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:01 [ayvens.it] INFO: Found listing with ID: 1983577
2026-03-25 16:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983577%27 HTTP/1.1" 200 None
2026-03-25 16:32:01 [ayvens.it] INFO: Scrape type for 1983577: 1
2026-03-25 16:32:01 [ayvens.it] INFO: Extracting data for car ID: 1983577
2026-03-25 16:32:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0eb9b54e-0644-5587-9df4-5f0671e35e3f with identifier: 1983577
2026-03-25 16:32:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0eb9b54e-0644-5587-9df4-5f0671e35e3f with scrape type 1
2026-03-25 16:32:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0eb9b54e-0644-5587-9df4-5f0671e35e3f
2026-03-25 16:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm6%252F41634491d6864274b3ba2a6213c74fdf%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm6/41634491d6864274b3ba2a6213c74fdf/images/large/1.jpg not downloaded yet
2026-03-25 16:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm6%252F41634491d6864274b3ba2a6213c74fdf%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm6/41634491d6864274b3ba2a6213c74fdf/images/large/2.jpg not downloaded yet
2026-03-25 16:32:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl1/1b695fc3bff0443eb518f57c80eebb15/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm6%252F41634491d6864274b3ba2a6213c74fdf%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm6/41634491d6864274b3ba2a6213c74fdf/images/large/3.jpg not downloaded yet
2026-03-25 16:32:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl1/1b695fc3bff0443eb518f57c80eebb15/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl5/f22afccf1e954bfa9f1b1b2193624fc7/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm6%252F41634491d6864274b3ba2a6213c74fdf%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm6/41634491d6864274b3ba2a6213c74fdf/images/large/4.jpg not downloaded yet
2026-03-25 16:32:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl5/f22afccf1e954bfa9f1b1b2193624fc7/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl1/1b695fc3bff0443eb518f57c80eebb15/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm6%252F41634491d6864274b3ba2a6213c74fdf%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm6/41634491d6864274b3ba2a6213c74fdf/images/large/5.jpg not downloaded yet
2026-03-25 16:32:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dfd62e50>
2026-03-25 16:32:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c4aa3aa1-7708-53ca-8f05-c31e5cbd8416/c4aa3aa1-7708-53ca-8f05-c31e5cbd8416_image_7.jpg HTTP/1.1" 201 0
2026-03-25 16:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk7%252Fc8ff55426fad42a0a0752bf4c5990b5b%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk7/c8ff55426fad42a0a0752bf4c5990b5b/images/large/8.jpg saved to cache
2026-03-25 16:32:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c4aa3aa1-7708-53ca-8f05-c31e5cbd8416
2026-03-25 16:32:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c4aa3aa1-7708-53ca-8f05-c31e5cbd8416, skipping ID generation
2026-03-25 16:32:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c4aa3aa1-7708-53ca-8f05-c31e5cbd8416 with scrape type 1
2026-03-25 16:32:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c4aa3aa1-7708-53ca-8f05-c31e5cbd8416 sending to next pipeline
2026-03-25 16:32:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: c4aa3aa1-7708-53ca-8f05-c31e5cbd8416, identifier: 1983574
2026-03-25 16:32:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl1/1b695fc3bff0443eb518f57c80eebb15/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl1/1b695fc3bff0443eb518f57c80eebb15/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm6%252F41634491d6864274b3ba2a6213c74fdf%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm6/41634491d6864274b3ba2a6213c74fdf/images/large/6.jpg not downloaded yet
2026-03-25 16:32:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: c4aa3aa1-7708-53ca-8f05-c31e5cbd8416 with identifier: 1983574
2026-03-25 16:32:02 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:32:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: c4aa3aa1-7708-53ca-8f05-c31e5cbd8416 with identifier: 1983574
2026-03-25 16:32:02 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: c4aa3aa1-7708-53ca-8f05-c31e5cbd8416 with identifier: 1983574 to the API
2026-03-25 16:32:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:32:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:32:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gk7/c8ff55426fad42a0a0752bf4c5990b5b/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Grey Artense metallizzato',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-27T09:30:00Z',
'fuel_type': 'diesel',
'id': 'c4aa3aa1-7708-53ca-8f05-c31e5cbd8416',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41025',
'listing': 'auction',
'location': None,
'make': 'OPEL',
'model': 'OPEL GRANDLAND 1.5 130cv AT8 Business Elegance Sport utility '
'vehicle 5-door (Euro 6D)',
'odometer': 187204,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 42,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c4aa3aa1-7708-53ca-8f05-c31e5cbd8416/c4aa3aa1-7708-53ca-8f05-c31e5cbd8416_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 512772,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk7/c8ff55426fad42a0a0752bf4c5990b5b/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c4aa3aa1-7708-53ca-8f05-c31e5cbd8416/c4aa3aa1-7708-53ca-8f05-c31e5cbd8416_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 671204,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk7/c8ff55426fad42a0a0752bf4c5990b5b/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c4aa3aa1-7708-53ca-8f05-c31e5cbd8416/c4aa3aa1-7708-53ca-8f05-c31e5cbd8416_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 512772,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk7/c8ff55426fad42a0a0752bf4c5990b5b/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c4aa3aa1-7708-53ca-8f05-c31e5cbd8416/c4aa3aa1-7708-53ca-8f05-c31e5cbd8416_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 528871,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk7/c8ff55426fad42a0a0752bf4c5990b5b/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c4aa3aa1-7708-53ca-8f05-c31e5cbd8416/c4aa3aa1-7708-53ca-8f05-c31e5cbd8416_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 512843,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk7/c8ff55426fad42a0a0752bf4c5990b5b/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c4aa3aa1-7708-53ca-8f05-c31e5cbd8416/c4aa3aa1-7708-53ca-8f05-c31e5cbd8416_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 447126,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk7/c8ff55426fad42a0a0752bf4c5990b5b/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c4aa3aa1-7708-53ca-8f05-c31e5cbd8416/c4aa3aa1-7708-53ca-8f05-c31e5cbd8416_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 448115,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk7/c8ff55426fad42a0a0752bf4c5990b5b/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c4aa3aa1-7708-53ca-8f05-c31e5cbd8416/c4aa3aa1-7708-53ca-8f05-c31e5cbd8416_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 373947,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk7/c8ff55426fad42a0a0752bf4c5990b5b/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c4aa3aa1-7708-53ca-8f05-c31e5cbd8416/c4aa3aa1-7708-53ca-8f05-c31e5cbd8416_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 400868,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk7/c8ff55426fad42a0a0752bf4c5990b5b/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c4aa3aa1-7708-53ca-8f05-c31e5cbd8416/c4aa3aa1-7708-53ca-8f05-c31e5cbd8416_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 385513,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk7/c8ff55426fad42a0a0752bf4c5990b5b/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-06-30',
'seats_number': 5,
'seller_name': None,
'title': 'OPEL OPEL GRANDLAND 1.5 130cv AT8 Business Elegance Sport utility '
'vehicle 5-door (Euro 6D) -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-25 16:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983574%27 HTTP/1.1" 200 None
2026-03-25 16:32:02 [ayvens.it] INFO: Saving data for 1983574: {'created_time': 1774456322.577804, 'last_price_update_time': 1774456322.577814, 'auction_closing_time': 1774603800.0}
2026-03-25 16:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1983574') HTTP/1.1" 204 0
2026-03-25 16:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm6%252F41634491d6864274b3ba2a6213c74fdf%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm6/41634491d6864274b3ba2a6213c74fdf/images/large/7.jpg not downloaded yet
2026-03-25 16:32:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcc1a4d0>
2026-03-25 16:32:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c33d0b7-5ce0-5a4c-b751-fa917fddf485/3c33d0b7-5ce0-5a4c-b751-fa917fddf485_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl1%252F1b695fc3bff0443eb518f57c80eebb15%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl1/1b695fc3bff0443eb518f57c80eebb15/images/large/1.jpg saved to cache
2026-03-25 16:32:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3c33d0b7-5ce0-5a4c-b751-fa917fddf485
2026-03-25 16:32:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcc08a50>
2026-03-25 16:32:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c33d0b7-5ce0-5a4c-b751-fa917fddf485/3c33d0b7-5ce0-5a4c-b751-fa917fddf485_image_3.jpg HTTP/1.1" 201 0
2026-03-25 16:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl1%252F1b695fc3bff0443eb518f57c80eebb15%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl1/1b695fc3bff0443eb518f57c80eebb15/images/large/4.jpg saved to cache
2026-03-25 16:32:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3c33d0b7-5ce0-5a4c-b751-fa917fddf485
2026-03-25 16:32:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcb17c50>
2026-03-25 16:32:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c177fe8-417c-56d6-9b50-32e8a80cea69/8c177fe8-417c-56d6-9b50-32e8a80cea69_image_7.jpg HTTP/1.1" 201 0
2026-03-25 16:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl5%252Ff22afccf1e954bfa9f1b1b2193624fc7%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl5/f22afccf1e954bfa9f1b1b2193624fc7/images/large/8.jpg saved to cache
2026-03-25 16:32:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8c177fe8-417c-56d6-9b50-32e8a80cea69
2026-03-25 16:32:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dca88890>
2026-03-25 16:32:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c177fe8-417c-56d6-9b50-32e8a80cea69/8c177fe8-417c-56d6-9b50-32e8a80cea69_image_8.jpg HTTP/1.1" 201 0
2026-03-25 16:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl5%252Ff22afccf1e954bfa9f1b1b2193624fc7%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl5/f22afccf1e954bfa9f1b1b2193624fc7/images/large/9.jpg saved to cache
2026-03-25 16:32:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8c177fe8-417c-56d6-9b50-32e8a80cea69
2026-03-25 16:32:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc7fbd90>
2026-03-25 16:32:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c33d0b7-5ce0-5a4c-b751-fa917fddf485/3c33d0b7-5ce0-5a4c-b751-fa917fddf485_image_2.jpg HTTP/1.1" 201 0
2026-03-25 16:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl1%252F1b695fc3bff0443eb518f57c80eebb15%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl1/1b695fc3bff0443eb518f57c80eebb15/images/large/3.jpg saved to cache
2026-03-25 16:32:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3c33d0b7-5ce0-5a4c-b751-fa917fddf485
2026-03-25 16:32:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dca89610>
2026-03-25 16:32:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c33d0b7-5ce0-5a4c-b751-fa917fddf485/3c33d0b7-5ce0-5a4c-b751-fa917fddf485_image_1.jpg HTTP/1.1" 201 0
2026-03-25 16:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl1%252F1b695fc3bff0443eb518f57c80eebb15%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl1/1b695fc3bff0443eb518f57c80eebb15/images/large/2.jpg saved to cache
2026-03-25 16:32:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3c33d0b7-5ce0-5a4c-b751-fa917fddf485
2026-03-25 16:32:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcb17cd0>
2026-03-25 16:32:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c33d0b7-5ce0-5a4c-b751-fa917fddf485/3c33d0b7-5ce0-5a4c-b751-fa917fddf485_image_8.jpg HTTP/1.1" 201 0
2026-03-25 16:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl1%252F1b695fc3bff0443eb518f57c80eebb15%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl1/1b695fc3bff0443eb518f57c80eebb15/images/large/9.jpg saved to cache
2026-03-25 16:32:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3c33d0b7-5ce0-5a4c-b751-fa917fddf485
2026-03-25 16:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm6%252F41634491d6864274b3ba2a6213c74fdf%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm6/41634491d6864274b3ba2a6213c74fdf/images/large/8.jpg not downloaded yet
2026-03-25 16:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm6%252F41634491d6864274b3ba2a6213c74fdf%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm6/41634491d6864274b3ba2a6213c74fdf/images/large/9.jpg not downloaded yet
2026-03-25 16:32:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl1/1b695fc3bff0443eb518f57c80eebb15/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm6%252F41634491d6864274b3ba2a6213c74fdf%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm6/41634491d6864274b3ba2a6213c74fdf/images/large/10.jpg not downloaded yet
2026-03-25 16:32:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl1/1b695fc3bff0443eb518f57c80eebb15/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:03 [ayvens.it] INFO: Found listing with ID: 1983578
2026-03-25 16:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983578%27 HTTP/1.1" 200 None
2026-03-25 16:32:03 [ayvens.it] INFO: Scrape type for 1983578: 1
2026-03-25 16:32:03 [ayvens.it] INFO: Extracting data for car ID: 1983578
2026-03-25 16:32:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2bac6ebb-51d7-5f21-8fb5-272dcf9f1ec3 with identifier: 1983578
2026-03-25 16:32:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2bac6ebb-51d7-5f21-8fb5-272dcf9f1ec3 with scrape type 1
2026-03-25 16:32:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2bac6ebb-51d7-5f21-8fb5-272dcf9f1ec3
2026-03-25 16:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm6%252Fc4c6df35b1044af4ae346a50d357dbfe%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm6/c4c6df35b1044af4ae346a50d357dbfe/images/large/1.jpg not downloaded yet
2026-03-25 16:32:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl1/1b695fc3bff0443eb518f57c80eebb15/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm6%252Fc4c6df35b1044af4ae346a50d357dbfe%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm6/c4c6df35b1044af4ae346a50d357dbfe/images/large/2.jpg not downloaded yet
2026-03-25 16:32:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl7/21614d75138247928df577f37a5d31c9/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl1/1b695fc3bff0443eb518f57c80eebb15/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl7/21614d75138247928df577f37a5d31c9/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm6%252Fc4c6df35b1044af4ae346a50d357dbfe%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm6/c4c6df35b1044af4ae346a50d357dbfe/images/large/3.jpg not downloaded yet
2026-03-25 16:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm6%252Fc4c6df35b1044af4ae346a50d357dbfe%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm6/c4c6df35b1044af4ae346a50d357dbfe/images/large/4.jpg not downloaded yet
2026-03-25 16:32:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl1/1b695fc3bff0443eb518f57c80eebb15/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl7/21614d75138247928df577f37a5d31c9/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm6%252Fc4c6df35b1044af4ae346a50d357dbfe%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm6/c4c6df35b1044af4ae346a50d357dbfe/images/large/5.jpg not downloaded yet
2026-03-25 16:32:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcde0fd0>
2026-03-25 16:32:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c33d0b7-5ce0-5a4c-b751-fa917fddf485/3c33d0b7-5ce0-5a4c-b751-fa917fddf485_image_6.jpg HTTP/1.1" 201 0
2026-03-25 16:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl1%252F1b695fc3bff0443eb518f57c80eebb15%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl1/1b695fc3bff0443eb518f57c80eebb15/images/large/7.jpg saved to cache
2026-03-25 16:32:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3c33d0b7-5ce0-5a4c-b751-fa917fddf485
2026-03-25 16:32:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc38e950>
2026-03-25 16:32:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c33d0b7-5ce0-5a4c-b751-fa917fddf485/3c33d0b7-5ce0-5a4c-b751-fa917fddf485_image_9.jpg HTTP/1.1" 201 0
2026-03-25 16:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl1%252F1b695fc3bff0443eb518f57c80eebb15%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl1/1b695fc3bff0443eb518f57c80eebb15/images/large/10.jpg saved to cache
2026-03-25 16:32:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3c33d0b7-5ce0-5a4c-b751-fa917fddf485
2026-03-25 16:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm6%252Fc4c6df35b1044af4ae346a50d357dbfe%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm6/c4c6df35b1044af4ae346a50d357dbfe/images/large/6.jpg not downloaded yet
2026-03-25 16:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm6%252Fc4c6df35b1044af4ae346a50d357dbfe%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm6/c4c6df35b1044af4ae346a50d357dbfe/images/large/7.jpg not downloaded yet
2026-03-25 16:32:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dca21510>
2026-03-25 16:32:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c33d0b7-5ce0-5a4c-b751-fa917fddf485/3c33d0b7-5ce0-5a4c-b751-fa917fddf485_image_7.jpg HTTP/1.1" 201 0
2026-03-25 16:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl1%252F1b695fc3bff0443eb518f57c80eebb15%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl1/1b695fc3bff0443eb518f57c80eebb15/images/large/8.jpg saved to cache
2026-03-25 16:32:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3c33d0b7-5ce0-5a4c-b751-fa917fddf485
2026-03-25 16:32:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34de456cd0>
2026-03-25 16:32:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82fe7289-ecaf-5d10-ab83-a98c9b2a2945/82fe7289-ecaf-5d10-ab83-a98c9b2a2945_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl7%252F21614d75138247928df577f37a5d31c9%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl7/21614d75138247928df577f37a5d31c9/images/large/1.jpg saved to cache
2026-03-25 16:32:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 82fe7289-ecaf-5d10-ab83-a98c9b2a2945
2026-03-25 16:32:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcc1a790>
2026-03-25 16:32:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c33d0b7-5ce0-5a4c-b751-fa917fddf485/3c33d0b7-5ce0-5a4c-b751-fa917fddf485_image_5.jpg HTTP/1.1" 201 0
2026-03-25 16:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl1%252F1b695fc3bff0443eb518f57c80eebb15%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl1/1b695fc3bff0443eb518f57c80eebb15/images/large/6.jpg saved to cache
2026-03-25 16:32:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3c33d0b7-5ce0-5a4c-b751-fa917fddf485
2026-03-25 16:32:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc5ad710>
2026-03-25 16:32:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82fe7289-ecaf-5d10-ab83-a98c9b2a2945/82fe7289-ecaf-5d10-ab83-a98c9b2a2945_image_1.jpg HTTP/1.1" 201 0
2026-03-25 16:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl7%252F21614d75138247928df577f37a5d31c9%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl7/21614d75138247928df577f37a5d31c9/images/large/2.jpg saved to cache
2026-03-25 16:32:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 82fe7289-ecaf-5d10-ab83-a98c9b2a2945
2026-03-25 16:32:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc89cf90>
2026-03-25 16:32:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c33d0b7-5ce0-5a4c-b751-fa917fddf485/3c33d0b7-5ce0-5a4c-b751-fa917fddf485_image_4.jpg HTTP/1.1" 201 0
2026-03-25 16:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl1%252F1b695fc3bff0443eb518f57c80eebb15%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl1/1b695fc3bff0443eb518f57c80eebb15/images/large/5.jpg saved to cache
2026-03-25 16:32:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3c33d0b7-5ce0-5a4c-b751-fa917fddf485
2026-03-25 16:32:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3c33d0b7-5ce0-5a4c-b751-fa917fddf485, skipping ID generation
2026-03-25 16:32:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3c33d0b7-5ce0-5a4c-b751-fa917fddf485 with scrape type 1
2026-03-25 16:32:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3c33d0b7-5ce0-5a4c-b751-fa917fddf485 sending to next pipeline
2026-03-25 16:32:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 3c33d0b7-5ce0-5a4c-b751-fa917fddf485, identifier: 1983575
2026-03-25 16:32:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34d7ddbad0>
2026-03-25 16:32:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82fe7289-ecaf-5d10-ab83-a98c9b2a2945/82fe7289-ecaf-5d10-ab83-a98c9b2a2945_image_2.jpg HTTP/1.1" 201 0
2026-03-25 16:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl7%252F21614d75138247928df577f37a5d31c9%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl7/21614d75138247928df577f37a5d31c9/images/large/3.jpg saved to cache
2026-03-25 16:32:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 82fe7289-ecaf-5d10-ab83-a98c9b2a2945
2026-03-25 16:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm6%252Fc4c6df35b1044af4ae346a50d357dbfe%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm6/c4c6df35b1044af4ae346a50d357dbfe/images/large/8.jpg not downloaded yet
2026-03-25 16:32:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 3c33d0b7-5ce0-5a4c-b751-fa917fddf485 with identifier: 1983575
2026-03-25 16:32:04 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:32:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 3c33d0b7-5ce0-5a4c-b751-fa917fddf485 with identifier: 1983575
2026-03-25 16:32:04 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 3c33d0b7-5ce0-5a4c-b751-fa917fddf485 with identifier: 1983575 to the API
2026-03-25 16:32:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:32:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:32:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gl1/1b695fc3bff0443eb518f57c80eebb15/images/large/5.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'GRIGIO NANO METALLIZZATO',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-27T09:30:00Z',
'fuel_type': 'diesel',
'id': '3c33d0b7-5ce0-5a4c-b751-fa917fddf485',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41025',
'listing': 'auction',
'location': None,
'make': 'AUDI',
'model': 'AUDI Q3 SPORTBACK 35 TDI S tronic Business Plus Sport utility '
'vehicle 5-door (Euro 6D)',
'odometer': 212097,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 21,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c33d0b7-5ce0-5a4c-b751-fa917fddf485/3c33d0b7-5ce0-5a4c-b751-fa917fddf485_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 813204,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl1/1b695fc3bff0443eb518f57c80eebb15/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c33d0b7-5ce0-5a4c-b751-fa917fddf485/3c33d0b7-5ce0-5a4c-b751-fa917fddf485_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 834827,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl1/1b695fc3bff0443eb518f57c80eebb15/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c33d0b7-5ce0-5a4c-b751-fa917fddf485/3c33d0b7-5ce0-5a4c-b751-fa917fddf485_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 813204,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl1/1b695fc3bff0443eb518f57c80eebb15/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c33d0b7-5ce0-5a4c-b751-fa917fddf485/3c33d0b7-5ce0-5a4c-b751-fa917fddf485_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 791619,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl1/1b695fc3bff0443eb518f57c80eebb15/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c33d0b7-5ce0-5a4c-b751-fa917fddf485/3c33d0b7-5ce0-5a4c-b751-fa917fddf485_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 828158,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl1/1b695fc3bff0443eb518f57c80eebb15/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c33d0b7-5ce0-5a4c-b751-fa917fddf485/3c33d0b7-5ce0-5a4c-b751-fa917fddf485_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 739601,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl1/1b695fc3bff0443eb518f57c80eebb15/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c33d0b7-5ce0-5a4c-b751-fa917fddf485/3c33d0b7-5ce0-5a4c-b751-fa917fddf485_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 488896,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl1/1b695fc3bff0443eb518f57c80eebb15/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c33d0b7-5ce0-5a4c-b751-fa917fddf485/3c33d0b7-5ce0-5a4c-b751-fa917fddf485_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 674910,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl1/1b695fc3bff0443eb518f57c80eebb15/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c33d0b7-5ce0-5a4c-b751-fa917fddf485/3c33d0b7-5ce0-5a4c-b751-fa917fddf485_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 712498,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl1/1b695fc3bff0443eb518f57c80eebb15/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c33d0b7-5ce0-5a4c-b751-fa917fddf485/3c33d0b7-5ce0-5a4c-b751-fa917fddf485_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 623099,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl1/1b695fc3bff0443eb518f57c80eebb15/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-08-24',
'seats_number': 5,
'seller_name': None,
'title': 'AUDI AUDI Q3 SPORTBACK 35 TDI S tronic Business Plus Sport utility '
'vehicle 5-door (Euro 6D) -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-25 16:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983575%27 HTTP/1.1" 200 None
2026-03-25 16:32:04 [ayvens.it] INFO: Saving data for 1983575: {'created_time': 1774456324.956808, 'last_price_update_time': 1774456324.95682, 'auction_closing_time': 1774603800.0}
2026-03-25 16:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1983575') HTTP/1.1" 204 0
2026-03-25 16:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm6%252Fc4c6df35b1044af4ae346a50d357dbfe%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm6/c4c6df35b1044af4ae346a50d357dbfe/images/large/9.jpg not downloaded yet
2026-03-25 16:32:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl7/21614d75138247928df577f37a5d31c9/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm6/41634491d6864274b3ba2a6213c74fdf/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm6/41634491d6864274b3ba2a6213c74fdf/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm6%252Fc4c6df35b1044af4ae346a50d357dbfe%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm6/c4c6df35b1044af4ae346a50d357dbfe/images/large/10.jpg not downloaded yet
2026-03-25 16:32:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm6/41634491d6864274b3ba2a6213c74fdf/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:05 [ayvens.it] INFO: Found listing with ID: 1983579
2026-03-25 16:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983579%27 HTTP/1.1" 200 None
2026-03-25 16:32:05 [ayvens.it] INFO: Scrape type for 1983579: 1
2026-03-25 16:32:05 [ayvens.it] INFO: Extracting data for car ID: 1983579
2026-03-25 16:32:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 577ed7fb-462d-5f01-a2d2-27ca01a91c58 with identifier: 1983579
2026-03-25 16:32:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 577ed7fb-462d-5f01-a2d2-27ca01a91c58 with scrape type 1
2026-03-25 16:32:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 577ed7fb-462d-5f01-a2d2-27ca01a91c58
2026-03-25 16:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp2%252Fa37e385c06b84afda86393014e741187%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp2/a37e385c06b84afda86393014e741187/images/large/1.jpg not downloaded yet
2026-03-25 16:32:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl7/21614d75138247928df577f37a5d31c9/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm6/41634491d6864274b3ba2a6213c74fdf/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm6/41634491d6864274b3ba2a6213c74fdf/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm6/41634491d6864274b3ba2a6213c74fdf/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp2%252Fa37e385c06b84afda86393014e741187%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp2/a37e385c06b84afda86393014e741187/images/large/2.jpg not downloaded yet
2026-03-25 16:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp2%252Fa37e385c06b84afda86393014e741187%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp2/a37e385c06b84afda86393014e741187/images/large/3.jpg not downloaded yet
2026-03-25 16:32:05 [scrapy.extensions.logstats] INFO: Crawled 20 pages (at 12 pages/min), scraped 28 items (at 20 items/min)
2026-03-25 16:32:05 [scrapy.extensions.memusage] INFO: Peak memory usage is 182MiB
2026-03-25 16:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp2%252Fa37e385c06b84afda86393014e741187%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp2/a37e385c06b84afda86393014e741187/images/large/4.jpg not downloaded yet
2026-03-25 16:32:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34defd2090>
2026-03-25 16:32:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82fe7289-ecaf-5d10-ab83-a98c9b2a2945/82fe7289-ecaf-5d10-ab83-a98c9b2a2945_image_9.jpg HTTP/1.1" 201 0
2026-03-25 16:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl7%252F21614d75138247928df577f37a5d31c9%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl7/21614d75138247928df577f37a5d31c9/images/large/10.jpg saved to cache
2026-03-25 16:32:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 82fe7289-ecaf-5d10-ab83-a98c9b2a2945
2026-03-25 16:32:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc54f3d0>
2026-03-25 16:32:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0eb9b54e-0644-5587-9df4-5f0671e35e3f/0eb9b54e-0644-5587-9df4-5f0671e35e3f_image_2.jpg HTTP/1.1" 201 0
2026-03-25 16:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm6%252F41634491d6864274b3ba2a6213c74fdf%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm6/41634491d6864274b3ba2a6213c74fdf/images/large/3.jpg saved to cache
2026-03-25 16:32:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0eb9b54e-0644-5587-9df4-5f0671e35e3f
2026-03-25 16:32:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34d74359d0>
2026-03-25 16:32:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0eb9b54e-0644-5587-9df4-5f0671e35e3f/0eb9b54e-0644-5587-9df4-5f0671e35e3f_image_1.jpg HTTP/1.1" 201 0
2026-03-25 16:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm6%252F41634491d6864274b3ba2a6213c74fdf%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm6/41634491d6864274b3ba2a6213c74fdf/images/large/2.jpg saved to cache
2026-03-25 16:32:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0eb9b54e-0644-5587-9df4-5f0671e35e3f
2026-03-25 16:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp2%252Fa37e385c06b84afda86393014e741187%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp2/a37e385c06b84afda86393014e741187/images/large/5.jpg not downloaded yet
2026-03-25 16:32:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc60f0d0>
2026-03-25 16:32:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0eb9b54e-0644-5587-9df4-5f0671e35e3f/0eb9b54e-0644-5587-9df4-5f0671e35e3f_image_3.jpg HTTP/1.1" 201 0
2026-03-25 16:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm6%252F41634491d6864274b3ba2a6213c74fdf%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm6/41634491d6864274b3ba2a6213c74fdf/images/large/4.jpg saved to cache
2026-03-25 16:32:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0eb9b54e-0644-5587-9df4-5f0671e35e3f
2026-03-25 16:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp2%252Fa37e385c06b84afda86393014e741187%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp2/a37e385c06b84afda86393014e741187/images/large/6.jpg not downloaded yet
2026-03-25 16:32:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm6/41634491d6864274b3ba2a6213c74fdf/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc60c3d0>
2026-03-25 16:32:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82fe7289-ecaf-5d10-ab83-a98c9b2a2945/82fe7289-ecaf-5d10-ab83-a98c9b2a2945_image_8.jpg HTTP/1.1" 201 0
2026-03-25 16:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl7%252F21614d75138247928df577f37a5d31c9%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl7/21614d75138247928df577f37a5d31c9/images/large/9.jpg saved to cache
2026-03-25 16:32:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 82fe7289-ecaf-5d10-ab83-a98c9b2a2945
2026-03-25 16:32:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc758050>
2026-03-25 16:32:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0eb9b54e-0644-5587-9df4-5f0671e35e3f/0eb9b54e-0644-5587-9df4-5f0671e35e3f_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm6%252F41634491d6864274b3ba2a6213c74fdf%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm6/41634491d6864274b3ba2a6213c74fdf/images/large/1.jpg saved to cache
2026-03-25 16:32:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0eb9b54e-0644-5587-9df4-5f0671e35e3f
2026-03-25 16:32:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dca95750>
2026-03-25 16:32:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0eb9b54e-0644-5587-9df4-5f0671e35e3f/0eb9b54e-0644-5587-9df4-5f0671e35e3f_image_7.jpg HTTP/1.1" 201 0
2026-03-25 16:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm6%252F41634491d6864274b3ba2a6213c74fdf%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm6/41634491d6864274b3ba2a6213c74fdf/images/large/8.jpg saved to cache
2026-03-25 16:32:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0eb9b54e-0644-5587-9df4-5f0671e35e3f
2026-03-25 16:32:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc86a690>
2026-03-25 16:32:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0eb9b54e-0644-5587-9df4-5f0671e35e3f/0eb9b54e-0644-5587-9df4-5f0671e35e3f_image_6.jpg HTTP/1.1" 201 0
2026-03-25 16:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm6%252F41634491d6864274b3ba2a6213c74fdf%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm6/41634491d6864274b3ba2a6213c74fdf/images/large/7.jpg saved to cache
2026-03-25 16:32:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0eb9b54e-0644-5587-9df4-5f0671e35e3f
2026-03-25 16:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp2%252Fa37e385c06b84afda86393014e741187%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp2/a37e385c06b84afda86393014e741187/images/large/7.jpg not downloaded yet
2026-03-25 16:32:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm6/41634491d6864274b3ba2a6213c74fdf/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp2%252Fa37e385c06b84afda86393014e741187%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp2/a37e385c06b84afda86393014e741187/images/large/8.jpg not downloaded yet
2026-03-25 16:32:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc9b9c10>
2026-03-25 16:32:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0eb9b54e-0644-5587-9df4-5f0671e35e3f/0eb9b54e-0644-5587-9df4-5f0671e35e3f_image_9.jpg HTTP/1.1" 201 0
2026-03-25 16:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm6%252F41634491d6864274b3ba2a6213c74fdf%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm6/41634491d6864274b3ba2a6213c74fdf/images/large/10.jpg saved to cache
2026-03-25 16:32:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0eb9b54e-0644-5587-9df4-5f0671e35e3f
2026-03-25 16:32:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm6/41634491d6864274b3ba2a6213c74fdf/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm6/41634491d6864274b3ba2a6213c74fdf/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp2%252Fa37e385c06b84afda86393014e741187%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp2/a37e385c06b84afda86393014e741187/images/large/9.jpg not downloaded yet
2026-03-25 16:32:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm6/c4c6df35b1044af4ae346a50d357dbfe/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm6/c4c6df35b1044af4ae346a50d357dbfe/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp2%252Fa37e385c06b84afda86393014e741187%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp2/a37e385c06b84afda86393014e741187/images/large/10.jpg not downloaded yet
2026-03-25 16:32:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm6/c4c6df35b1044af4ae346a50d357dbfe/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc991750>
2026-03-25 16:32:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0eb9b54e-0644-5587-9df4-5f0671e35e3f/0eb9b54e-0644-5587-9df4-5f0671e35e3f_image_8.jpg HTTP/1.1" 201 0
2026-03-25 16:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm6%252F41634491d6864274b3ba2a6213c74fdf%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm6/41634491d6864274b3ba2a6213c74fdf/images/large/9.jpg saved to cache
2026-03-25 16:32:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0eb9b54e-0644-5587-9df4-5f0671e35e3f
2026-03-25 16:32:06 [ayvens.it] INFO: Found listing with ID: 1983580
2026-03-25 16:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983580%27 HTTP/1.1" 200 None
2026-03-25 16:32:06 [ayvens.it] INFO: Scrape type for 1983580: 1
2026-03-25 16:32:06 [ayvens.it] INFO: Extracting data for car ID: 1983580
2026-03-25 16:32:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8c9dce74-d0fe-5099-a3e8-70e7e71f0b6b with identifier: 1983580
2026-03-25 16:32:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8c9dce74-d0fe-5099-a3e8-70e7e71f0b6b with scrape type 1
2026-03-25 16:32:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8c9dce74-d0fe-5099-a3e8-70e7e71f0b6b
2026-03-25 16:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc0%252Fbaa087d641fd49938ba8f94137c35467%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc0/baa087d641fd49938ba8f94137c35467/images/large/1.jpg not downloaded yet
2026-03-25 16:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc0%252Fbaa087d641fd49938ba8f94137c35467%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc0/baa087d641fd49938ba8f94137c35467/images/large/2.jpg not downloaded yet
2026-03-25 16:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc0%252Fbaa087d641fd49938ba8f94137c35467%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc0/baa087d641fd49938ba8f94137c35467/images/large/3.jpg not downloaded yet
2026-03-25 16:32:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc82f1d0>
2026-03-25 16:32:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0eb9b54e-0644-5587-9df4-5f0671e35e3f/0eb9b54e-0644-5587-9df4-5f0671e35e3f_image_4.jpg HTTP/1.1" 201 0
2026-03-25 16:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm6%252F41634491d6864274b3ba2a6213c74fdf%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm6/41634491d6864274b3ba2a6213c74fdf/images/large/5.jpg saved to cache
2026-03-25 16:32:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0eb9b54e-0644-5587-9df4-5f0671e35e3f
2026-03-25 16:32:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc554250>
2026-03-25 16:32:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0eb9b54e-0644-5587-9df4-5f0671e35e3f/0eb9b54e-0644-5587-9df4-5f0671e35e3f_image_5.jpg HTTP/1.1" 201 0
2026-03-25 16:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm6%252F41634491d6864274b3ba2a6213c74fdf%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm6/41634491d6864274b3ba2a6213c74fdf/images/large/6.jpg saved to cache
2026-03-25 16:32:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0eb9b54e-0644-5587-9df4-5f0671e35e3f
2026-03-25 16:32:06 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0eb9b54e-0644-5587-9df4-5f0671e35e3f, skipping ID generation
2026-03-25 16:32:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0eb9b54e-0644-5587-9df4-5f0671e35e3f with scrape type 1
2026-03-25 16:32:06 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0eb9b54e-0644-5587-9df4-5f0671e35e3f sending to next pipeline
2026-03-25 16:32:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 0eb9b54e-0644-5587-9df4-5f0671e35e3f, identifier: 1983577
2026-03-25 16:32:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcae9910>
2026-03-25 16:32:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2bac6ebb-51d7-5f21-8fb5-272dcf9f1ec3/2bac6ebb-51d7-5f21-8fb5-272dcf9f1ec3_image_6.jpg HTTP/1.1" 201 0
2026-03-25 16:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm6%252Fc4c6df35b1044af4ae346a50d357dbfe%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm6/c4c6df35b1044af4ae346a50d357dbfe/images/large/7.jpg saved to cache
2026-03-25 16:32:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2bac6ebb-51d7-5f21-8fb5-272dcf9f1ec3
2026-03-25 16:32:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcaca810>
2026-03-25 16:32:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2bac6ebb-51d7-5f21-8fb5-272dcf9f1ec3/2bac6ebb-51d7-5f21-8fb5-272dcf9f1ec3_image_7.jpg HTTP/1.1" 201 0
2026-03-25 16:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm6%252Fc4c6df35b1044af4ae346a50d357dbfe%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm6/c4c6df35b1044af4ae346a50d357dbfe/images/large/8.jpg saved to cache
2026-03-25 16:32:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2bac6ebb-51d7-5f21-8fb5-272dcf9f1ec3
2026-03-25 16:32:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc5f9710>
2026-03-25 16:32:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2bac6ebb-51d7-5f21-8fb5-272dcf9f1ec3/2bac6ebb-51d7-5f21-8fb5-272dcf9f1ec3_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm6%252Fc4c6df35b1044af4ae346a50d357dbfe%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm6/c4c6df35b1044af4ae346a50d357dbfe/images/large/1.jpg saved to cache
2026-03-25 16:32:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2bac6ebb-51d7-5f21-8fb5-272dcf9f1ec3
2026-03-25 16:32:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm6/c4c6df35b1044af4ae346a50d357dbfe/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 0eb9b54e-0644-5587-9df4-5f0671e35e3f with identifier: 1983577
2026-03-25 16:32:07 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:32:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 0eb9b54e-0644-5587-9df4-5f0671e35e3f with identifier: 1983577
2026-03-25 16:32:07 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 0eb9b54e-0644-5587-9df4-5f0671e35e3f with identifier: 1983577 to the API
2026-03-25 16:32:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:32:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:32:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gm6/41634491d6864274b3ba2a6213c74fdf/images/large/6.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Unknown',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-27T09:30:00Z',
'fuel_type': 'diesel',
'id': '0eb9b54e-0644-5587-9df4-5f0671e35e3f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41025',
'listing': 'auction',
'location': None,
'make': 'FORD',
'model': 'FORD TOURNEO CUSTOM 320 L1 H1 Act 2.0EcoBlue 170 Cv Auto Combi '
'5-door (Euro 6.2)',
'odometer': 64795,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 37,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0eb9b54e-0644-5587-9df4-5f0671e35e3f/0eb9b54e-0644-5587-9df4-5f0671e35e3f_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 700222,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm6/41634491d6864274b3ba2a6213c74fdf/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0eb9b54e-0644-5587-9df4-5f0671e35e3f/0eb9b54e-0644-5587-9df4-5f0671e35e3f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 712331,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm6/41634491d6864274b3ba2a6213c74fdf/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0eb9b54e-0644-5587-9df4-5f0671e35e3f/0eb9b54e-0644-5587-9df4-5f0671e35e3f_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 700222,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm6/41634491d6864274b3ba2a6213c74fdf/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0eb9b54e-0644-5587-9df4-5f0671e35e3f/0eb9b54e-0644-5587-9df4-5f0671e35e3f_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 590808,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm6/41634491d6864274b3ba2a6213c74fdf/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0eb9b54e-0644-5587-9df4-5f0671e35e3f/0eb9b54e-0644-5587-9df4-5f0671e35e3f_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 567736,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm6/41634491d6864274b3ba2a6213c74fdf/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0eb9b54e-0644-5587-9df4-5f0671e35e3f/0eb9b54e-0644-5587-9df4-5f0671e35e3f_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 554007,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm6/41634491d6864274b3ba2a6213c74fdf/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0eb9b54e-0644-5587-9df4-5f0671e35e3f/0eb9b54e-0644-5587-9df4-5f0671e35e3f_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 419652,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm6/41634491d6864274b3ba2a6213c74fdf/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0eb9b54e-0644-5587-9df4-5f0671e35e3f/0eb9b54e-0644-5587-9df4-5f0671e35e3f_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 438314,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm6/41634491d6864274b3ba2a6213c74fdf/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0eb9b54e-0644-5587-9df4-5f0671e35e3f/0eb9b54e-0644-5587-9df4-5f0671e35e3f_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 538796,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm6/41634491d6864274b3ba2a6213c74fdf/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0eb9b54e-0644-5587-9df4-5f0671e35e3f/0eb9b54e-0644-5587-9df4-5f0671e35e3f_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 525018,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm6/41634491d6864274b3ba2a6213c74fdf/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-02-22',
'seats_number': 5,
'seller_name': None,
'title': 'FORD FORD TOURNEO CUSTOM 320 L1 H1 Act 2.0EcoBlue 170 Cv Auto Combi '
'5-door (Euro 6.2) -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2023}
2026-03-25 16:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983577%27 HTTP/1.1" 200 None
2026-03-25 16:32:07 [ayvens.it] INFO: Saving data for 1983577: {'created_time': 1774456327.749213, 'last_price_update_time': 1774456327.749225, 'auction_closing_time': 1774603800.0}
2026-03-25 16:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1983577') HTTP/1.1" 204 0
2026-03-25 16:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc0%252Fbaa087d641fd49938ba8f94137c35467%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc0/baa087d641fd49938ba8f94137c35467/images/large/4.jpg not downloaded yet
2026-03-25 16:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc0%252Fbaa087d641fd49938ba8f94137c35467%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc0/baa087d641fd49938ba8f94137c35467/images/large/5.jpg not downloaded yet
2026-03-25 16:32:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm6/c4c6df35b1044af4ae346a50d357dbfe/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc86b990>
2026-03-25 16:32:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2bac6ebb-51d7-5f21-8fb5-272dcf9f1ec3/2bac6ebb-51d7-5f21-8fb5-272dcf9f1ec3_image_8.jpg HTTP/1.1" 201 0
2026-03-25 16:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm6%252Fc4c6df35b1044af4ae346a50d357dbfe%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm6/c4c6df35b1044af4ae346a50d357dbfe/images/large/9.jpg saved to cache
2026-03-25 16:32:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2bac6ebb-51d7-5f21-8fb5-272dcf9f1ec3
2026-03-25 16:32:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm6/c4c6df35b1044af4ae346a50d357dbfe/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc0%252Fbaa087d641fd49938ba8f94137c35467%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc0/baa087d641fd49938ba8f94137c35467/images/large/6.jpg not downloaded yet
2026-03-25 16:32:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm6/c4c6df35b1044af4ae346a50d357dbfe/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm6/c4c6df35b1044af4ae346a50d357dbfe/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc0%252Fbaa087d641fd49938ba8f94137c35467%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc0/baa087d641fd49938ba8f94137c35467/images/large/7.jpg not downloaded yet
2026-03-25 16:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc0%252Fbaa087d641fd49938ba8f94137c35467%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc0/baa087d641fd49938ba8f94137c35467/images/large/8.jpg not downloaded yet
2026-03-25 16:32:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcaf4a90>
2026-03-25 16:32:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2bac6ebb-51d7-5f21-8fb5-272dcf9f1ec3/2bac6ebb-51d7-5f21-8fb5-272dcf9f1ec3_image_9.jpg HTTP/1.1" 201 0
2026-03-25 16:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm6%252Fc4c6df35b1044af4ae346a50d357dbfe%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm6/c4c6df35b1044af4ae346a50d357dbfe/images/large/10.jpg saved to cache
2026-03-25 16:32:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2bac6ebb-51d7-5f21-8fb5-272dcf9f1ec3
2026-03-25 16:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc0%252Fbaa087d641fd49938ba8f94137c35467%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc0/baa087d641fd49938ba8f94137c35467/images/large/9.jpg not downloaded yet
2026-03-25 16:32:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp2/a37e385c06b84afda86393014e741187/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp2/a37e385c06b84afda86393014e741187/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc0%252Fbaa087d641fd49938ba8f94137c35467%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc0/baa087d641fd49938ba8f94137c35467/images/large/10.jpg not downloaded yet
2026-03-25 16:32:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp2/a37e385c06b84afda86393014e741187/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:08 [ayvens.it] INFO: Found listing with ID: 1983581
2026-03-25 16:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983581%27 HTTP/1.1" 200 None
2026-03-25 16:32:08 [ayvens.it] INFO: Scrape type for 1983581: 1
2026-03-25 16:32:08 [ayvens.it] INFO: Extracting data for car ID: 1983581
2026-03-25 16:32:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9d2143ed-9432-5b83-a60a-a9f9f2c07100 with identifier: 1983581
2026-03-25 16:32:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9d2143ed-9432-5b83-a60a-a9f9f2c07100 with scrape type 1
2026-03-25 16:32:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9d2143ed-9432-5b83-a60a-a9f9f2c07100
2026-03-25 16:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc6%252F54b02016a093423788c505c366ea2589%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc6/54b02016a093423788c505c366ea2589/images/large/1.jpg not downloaded yet
2026-03-25 16:32:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc869750>
2026-03-25 16:32:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2bac6ebb-51d7-5f21-8fb5-272dcf9f1ec3/2bac6ebb-51d7-5f21-8fb5-272dcf9f1ec3_image_1.jpg HTTP/1.1" 201 0
2026-03-25 16:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm6%252Fc4c6df35b1044af4ae346a50d357dbfe%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm6/c4c6df35b1044af4ae346a50d357dbfe/images/large/2.jpg saved to cache
2026-03-25 16:32:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2bac6ebb-51d7-5f21-8fb5-272dcf9f1ec3
2026-03-25 16:32:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcc1bc90>
2026-03-25 16:32:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2bac6ebb-51d7-5f21-8fb5-272dcf9f1ec3/2bac6ebb-51d7-5f21-8fb5-272dcf9f1ec3_image_4.jpg HTTP/1.1" 201 0
2026-03-25 16:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm6%252Fc4c6df35b1044af4ae346a50d357dbfe%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm6/c4c6df35b1044af4ae346a50d357dbfe/images/large/5.jpg saved to cache
2026-03-25 16:32:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2bac6ebb-51d7-5f21-8fb5-272dcf9f1ec3
2026-03-25 16:32:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc5bf510>
2026-03-25 16:32:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2bac6ebb-51d7-5f21-8fb5-272dcf9f1ec3/2bac6ebb-51d7-5f21-8fb5-272dcf9f1ec3_image_5.jpg HTTP/1.1" 201 0
2026-03-25 16:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm6%252Fc4c6df35b1044af4ae346a50d357dbfe%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm6/c4c6df35b1044af4ae346a50d357dbfe/images/large/6.jpg saved to cache
2026-03-25 16:32:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2bac6ebb-51d7-5f21-8fb5-272dcf9f1ec3
2026-03-25 16:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc6%252F54b02016a093423788c505c366ea2589%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc6/54b02016a093423788c505c366ea2589/images/large/2.jpg not downloaded yet
2026-03-25 16:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc6%252F54b02016a093423788c505c366ea2589%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc6/54b02016a093423788c505c366ea2589/images/large/3.jpg not downloaded yet
2026-03-25 16:32:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dca9fd90>
2026-03-25 16:32:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_577ed7fb-462d-5f01-a2d2-27ca01a91c58/577ed7fb-462d-5f01-a2d2-27ca01a91c58_image_1.jpg HTTP/1.1" 201 0
2026-03-25 16:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp2%252Fa37e385c06b84afda86393014e741187%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp2/a37e385c06b84afda86393014e741187/images/large/2.jpg saved to cache
2026-03-25 16:32:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 577ed7fb-462d-5f01-a2d2-27ca01a91c58
2026-03-25 16:32:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dccfa310>
2026-03-25 16:32:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_577ed7fb-462d-5f01-a2d2-27ca01a91c58/577ed7fb-462d-5f01-a2d2-27ca01a91c58_image_3.jpg HTTP/1.1" 201 0
2026-03-25 16:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp2%252Fa37e385c06b84afda86393014e741187%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp2/a37e385c06b84afda86393014e741187/images/large/4.jpg saved to cache
2026-03-25 16:32:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 577ed7fb-462d-5f01-a2d2-27ca01a91c58
2026-03-25 16:32:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc94dad0>
2026-03-25 16:32:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_577ed7fb-462d-5f01-a2d2-27ca01a91c58/577ed7fb-462d-5f01-a2d2-27ca01a91c58_image_2.jpg HTTP/1.1" 201 0
2026-03-25 16:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp2%252Fa37e385c06b84afda86393014e741187%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp2/a37e385c06b84afda86393014e741187/images/large/3.jpg saved to cache
2026-03-25 16:32:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 577ed7fb-462d-5f01-a2d2-27ca01a91c58
2026-03-25 16:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc6%252F54b02016a093423788c505c366ea2589%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc6/54b02016a093423788c505c366ea2589/images/large/4.jpg not downloaded yet
2026-03-25 16:32:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp2/a37e385c06b84afda86393014e741187/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp2/a37e385c06b84afda86393014e741187/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc6%252F54b02016a093423788c505c366ea2589%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc6/54b02016a093423788c505c366ea2589/images/large/5.jpg not downloaded yet
2026-03-25 16:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc6%252F54b02016a093423788c505c366ea2589%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc6/54b02016a093423788c505c366ea2589/images/large/6.jpg not downloaded yet
2026-03-25 16:32:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp2/a37e385c06b84afda86393014e741187/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc6%252F54b02016a093423788c505c366ea2589%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc6/54b02016a093423788c505c366ea2589/images/large/7.jpg not downloaded yet
2026-03-25 16:32:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm6/c4c6df35b1044af4ae346a50d357dbfe/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc6%252F54b02016a093423788c505c366ea2589%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc6/54b02016a093423788c505c366ea2589/images/large/8.jpg not downloaded yet
2026-03-25 16:32:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp2/a37e385c06b84afda86393014e741187/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc6%252F54b02016a093423788c505c366ea2589%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc6/54b02016a093423788c505c366ea2589/images/large/9.jpg not downloaded yet
2026-03-25 16:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc6%252F54b02016a093423788c505c366ea2589%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc6/54b02016a093423788c505c366ea2589/images/large/10.jpg not downloaded yet
2026-03-25 16:32:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dca246d0>
2026-03-25 16:32:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_577ed7fb-462d-5f01-a2d2-27ca01a91c58/577ed7fb-462d-5f01-a2d2-27ca01a91c58_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp2%252Fa37e385c06b84afda86393014e741187%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp2/a37e385c06b84afda86393014e741187/images/large/1.jpg saved to cache
2026-03-25 16:32:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 577ed7fb-462d-5f01-a2d2-27ca01a91c58
2026-03-25 16:32:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dca26b50>
2026-03-25 16:32:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_577ed7fb-462d-5f01-a2d2-27ca01a91c58/577ed7fb-462d-5f01-a2d2-27ca01a91c58_image_7.jpg HTTP/1.1" 201 0
2026-03-25 16:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp2%252Fa37e385c06b84afda86393014e741187%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp2/a37e385c06b84afda86393014e741187/images/large/8.jpg saved to cache
2026-03-25 16:32:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 577ed7fb-462d-5f01-a2d2-27ca01a91c58
2026-03-25 16:32:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm6/c4c6df35b1044af4ae346a50d357dbfe/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp2/a37e385c06b84afda86393014e741187/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:09 [ayvens.it] INFO: Found listing with ID: 1983582
2026-03-25 16:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983582%27 HTTP/1.1" 200 None
2026-03-25 16:32:09 [ayvens.it] INFO: Scrape type for 1983582: 1
2026-03-25 16:32:09 [ayvens.it] INFO: Extracting data for car ID: 1983582
2026-03-25 16:32:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d994e8df-ffe5-5ca7-aa68-586fb0c0cf50 with identifier: 1983582
2026-03-25 16:32:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d994e8df-ffe5-5ca7-aa68-586fb0c0cf50 with scrape type 1
2026-03-25 16:32:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d994e8df-ffe5-5ca7-aa68-586fb0c0cf50
2026-03-25 16:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge0%252F6b882fcd76664cff8c0289b9cff0668a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge0/6b882fcd76664cff8c0289b9cff0668a/images/large/1.jpg not downloaded yet
2026-03-25 16:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge0%252F6b882fcd76664cff8c0289b9cff0668a%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge0/6b882fcd76664cff8c0289b9cff0668a/images/large/2.jpg not downloaded yet
2026-03-25 16:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge0%252F6b882fcd76664cff8c0289b9cff0668a%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge0/6b882fcd76664cff8c0289b9cff0668a/images/large/3.jpg not downloaded yet
2026-03-25 16:32:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dca9fd50>
2026-03-25 16:32:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_577ed7fb-462d-5f01-a2d2-27ca01a91c58/577ed7fb-462d-5f01-a2d2-27ca01a91c58_image_4.jpg HTTP/1.1" 201 0
2026-03-25 16:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp2%252Fa37e385c06b84afda86393014e741187%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp2/a37e385c06b84afda86393014e741187/images/large/5.jpg saved to cache
2026-03-25 16:32:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 577ed7fb-462d-5f01-a2d2-27ca01a91c58
2026-03-25 16:32:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34d7ddb750>
2026-03-25 16:32:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2bac6ebb-51d7-5f21-8fb5-272dcf9f1ec3/2bac6ebb-51d7-5f21-8fb5-272dcf9f1ec3_image_3.jpg HTTP/1.1" 201 0
2026-03-25 16:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm6%252Fc4c6df35b1044af4ae346a50d357dbfe%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm6/c4c6df35b1044af4ae346a50d357dbfe/images/large/4.jpg saved to cache
2026-03-25 16:32:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2bac6ebb-51d7-5f21-8fb5-272dcf9f1ec3
2026-03-25 16:32:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc904a50>
2026-03-25 16:32:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_577ed7fb-462d-5f01-a2d2-27ca01a91c58/577ed7fb-462d-5f01-a2d2-27ca01a91c58_image_6.jpg HTTP/1.1" 201 0
2026-03-25 16:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp2%252Fa37e385c06b84afda86393014e741187%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp2/a37e385c06b84afda86393014e741187/images/large/7.jpg saved to cache
2026-03-25 16:32:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 577ed7fb-462d-5f01-a2d2-27ca01a91c58
2026-03-25 16:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge0%252F6b882fcd76664cff8c0289b9cff0668a%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge0/6b882fcd76664cff8c0289b9cff0668a/images/large/4.jpg not downloaded yet
2026-03-25 16:32:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp2/a37e385c06b84afda86393014e741187/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc0/baa087d641fd49938ba8f94137c35467/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge0%252F6b882fcd76664cff8c0289b9cff0668a%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge0/6b882fcd76664cff8c0289b9cff0668a/images/large/5.jpg not downloaded yet
2026-03-25 16:32:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34d6b48e90>
2026-03-25 16:32:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2bac6ebb-51d7-5f21-8fb5-272dcf9f1ec3/2bac6ebb-51d7-5f21-8fb5-272dcf9f1ec3_image_2.jpg HTTP/1.1" 201 0
2026-03-25 16:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm6%252Fc4c6df35b1044af4ae346a50d357dbfe%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm6/c4c6df35b1044af4ae346a50d357dbfe/images/large/3.jpg saved to cache
2026-03-25 16:32:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2bac6ebb-51d7-5f21-8fb5-272dcf9f1ec3
2026-03-25 16:32:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2bac6ebb-51d7-5f21-8fb5-272dcf9f1ec3, skipping ID generation
2026-03-25 16:32:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2bac6ebb-51d7-5f21-8fb5-272dcf9f1ec3 with scrape type 1
2026-03-25 16:32:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2bac6ebb-51d7-5f21-8fb5-272dcf9f1ec3 sending to next pipeline
2026-03-25 16:32:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 2bac6ebb-51d7-5f21-8fb5-272dcf9f1ec3, identifier: 1983578
2026-03-25 16:32:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc9b1310>
2026-03-25 16:32:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_577ed7fb-462d-5f01-a2d2-27ca01a91c58/577ed7fb-462d-5f01-a2d2-27ca01a91c58_image_5.jpg HTTP/1.1" 201 0
2026-03-25 16:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp2%252Fa37e385c06b84afda86393014e741187%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp2/a37e385c06b84afda86393014e741187/images/large/6.jpg saved to cache
2026-03-25 16:32:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 577ed7fb-462d-5f01-a2d2-27ca01a91c58
2026-03-25 16:32:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc0/baa087d641fd49938ba8f94137c35467/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc0/baa087d641fd49938ba8f94137c35467/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge0%252F6b882fcd76664cff8c0289b9cff0668a%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge0/6b882fcd76664cff8c0289b9cff0668a/images/large/6.jpg not downloaded yet
2026-03-25 16:32:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 2bac6ebb-51d7-5f21-8fb5-272dcf9f1ec3 with identifier: 1983578
2026-03-25 16:32:09 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:32:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 2bac6ebb-51d7-5f21-8fb5-272dcf9f1ec3 with identifier: 1983578
2026-03-25 16:32:10 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 2bac6ebb-51d7-5f21-8fb5-272dcf9f1ec3 with identifier: 1983578 to the API
2026-03-25 16:32:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:32:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:32:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gm6/c4c6df35b1044af4ae346a50d357dbfe/images/large/3.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'POLAR WHITE PAST',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-27T09:30:00Z',
'fuel_type': 'hybrid',
'id': '2bac6ebb-51d7-5f21-8fb5-272dcf9f1ec3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41025',
'listing': 'auction',
'location': None,
'make': 'HYUNDAI',
'model': 'HYUNDAI TUCSON (PC) 1.6 HEV 2WD 230CV XLINE AUTO FP',
'odometer': 123162,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 14,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2bac6ebb-51d7-5f21-8fb5-272dcf9f1ec3/2bac6ebb-51d7-5f21-8fb5-272dcf9f1ec3_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 763197,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm6/c4c6df35b1044af4ae346a50d357dbfe/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2bac6ebb-51d7-5f21-8fb5-272dcf9f1ec3/2bac6ebb-51d7-5f21-8fb5-272dcf9f1ec3_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 790135,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm6/c4c6df35b1044af4ae346a50d357dbfe/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2bac6ebb-51d7-5f21-8fb5-272dcf9f1ec3/2bac6ebb-51d7-5f21-8fb5-272dcf9f1ec3_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 763197,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm6/c4c6df35b1044af4ae346a50d357dbfe/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2bac6ebb-51d7-5f21-8fb5-272dcf9f1ec3/2bac6ebb-51d7-5f21-8fb5-272dcf9f1ec3_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 758201,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm6/c4c6df35b1044af4ae346a50d357dbfe/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2bac6ebb-51d7-5f21-8fb5-272dcf9f1ec3/2bac6ebb-51d7-5f21-8fb5-272dcf9f1ec3_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 711837,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm6/c4c6df35b1044af4ae346a50d357dbfe/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2bac6ebb-51d7-5f21-8fb5-272dcf9f1ec3/2bac6ebb-51d7-5f21-8fb5-272dcf9f1ec3_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 606476,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm6/c4c6df35b1044af4ae346a50d357dbfe/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2bac6ebb-51d7-5f21-8fb5-272dcf9f1ec3/2bac6ebb-51d7-5f21-8fb5-272dcf9f1ec3_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 662177,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm6/c4c6df35b1044af4ae346a50d357dbfe/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2bac6ebb-51d7-5f21-8fb5-272dcf9f1ec3/2bac6ebb-51d7-5f21-8fb5-272dcf9f1ec3_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 660262,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm6/c4c6df35b1044af4ae346a50d357dbfe/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2bac6ebb-51d7-5f21-8fb5-272dcf9f1ec3/2bac6ebb-51d7-5f21-8fb5-272dcf9f1ec3_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 616322,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm6/c4c6df35b1044af4ae346a50d357dbfe/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2bac6ebb-51d7-5f21-8fb5-272dcf9f1ec3/2bac6ebb-51d7-5f21-8fb5-272dcf9f1ec3_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 541195,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm6/c4c6df35b1044af4ae346a50d357dbfe/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-01-17',
'seats_number': 5,
'seller_name': None,
'title': 'HYUNDAI HYUNDAI TUCSON (PC) 1.6 HEV 2WD 230CV XLINE AUTO FP -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2023}
2026-03-25 16:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983578%27 HTTP/1.1" 200 None
2026-03-25 16:32:10 [ayvens.it] INFO: Saving data for 1983578: {'created_time': 1774456330.472403, 'last_price_update_time': 1774456330.472413, 'auction_closing_time': 1774603800.0}
2026-03-25 16:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1983578') HTTP/1.1" 204 0
2026-03-25 16:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge0%252F6b882fcd76664cff8c0289b9cff0668a%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge0/6b882fcd76664cff8c0289b9cff0668a/images/large/7.jpg not downloaded yet
2026-03-25 16:32:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc0/baa087d641fd49938ba8f94137c35467/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc0/baa087d641fd49938ba8f94137c35467/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge0%252F6b882fcd76664cff8c0289b9cff0668a%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge0/6b882fcd76664cff8c0289b9cff0668a/images/large/8.jpg not downloaded yet
2026-03-25 16:32:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcc1a190>
2026-03-25 16:32:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_577ed7fb-462d-5f01-a2d2-27ca01a91c58/577ed7fb-462d-5f01-a2d2-27ca01a91c58_image_8.jpg HTTP/1.1" 201 0
2026-03-25 16:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp2%252Fa37e385c06b84afda86393014e741187%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp2/a37e385c06b84afda86393014e741187/images/large/9.jpg saved to cache
2026-03-25 16:32:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 577ed7fb-462d-5f01-a2d2-27ca01a91c58
2026-03-25 16:32:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc371790>
2026-03-25 16:32:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c9dce74-d0fe-5099-a3e8-70e7e71f0b6b/8c9dce74-d0fe-5099-a3e8-70e7e71f0b6b_image_3.jpg HTTP/1.1" 201 0
2026-03-25 16:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc0%252Fbaa087d641fd49938ba8f94137c35467%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc0/baa087d641fd49938ba8f94137c35467/images/large/4.jpg saved to cache
2026-03-25 16:32:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8c9dce74-d0fe-5099-a3e8-70e7e71f0b6b
2026-03-25 16:32:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcbe4e50>
2026-03-25 16:32:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c9dce74-d0fe-5099-a3e8-70e7e71f0b6b/8c9dce74-d0fe-5099-a3e8-70e7e71f0b6b_image_4.jpg HTTP/1.1" 201 0
2026-03-25 16:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc0%252Fbaa087d641fd49938ba8f94137c35467%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc0/baa087d641fd49938ba8f94137c35467/images/large/5.jpg saved to cache
2026-03-25 16:32:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8c9dce74-d0fe-5099-a3e8-70e7e71f0b6b
2026-03-25 16:32:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc3718d0>
2026-03-25 16:32:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c9dce74-d0fe-5099-a3e8-70e7e71f0b6b/8c9dce74-d0fe-5099-a3e8-70e7e71f0b6b_image_5.jpg HTTP/1.1" 201 0
2026-03-25 16:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc0%252Fbaa087d641fd49938ba8f94137c35467%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc0/baa087d641fd49938ba8f94137c35467/images/large/6.jpg saved to cache
2026-03-25 16:32:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8c9dce74-d0fe-5099-a3e8-70e7e71f0b6b
2026-03-25 16:32:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc0/baa087d641fd49938ba8f94137c35467/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc0/baa087d641fd49938ba8f94137c35467/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge0%252F6b882fcd76664cff8c0289b9cff0668a%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge0/6b882fcd76664cff8c0289b9cff0668a/images/large/9.jpg not downloaded yet
2026-03-25 16:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge0%252F6b882fcd76664cff8c0289b9cff0668a%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge0/6b882fcd76664cff8c0289b9cff0668a/images/large/10.jpg not downloaded yet
2026-03-25 16:32:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc359550>
2026-03-25 16:32:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c9dce74-d0fe-5099-a3e8-70e7e71f0b6b/8c9dce74-d0fe-5099-a3e8-70e7e71f0b6b_image_2.jpg HTTP/1.1" 201 0
2026-03-25 16:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc0%252Fbaa087d641fd49938ba8f94137c35467%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc0/baa087d641fd49938ba8f94137c35467/images/large/3.jpg saved to cache
2026-03-25 16:32:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8c9dce74-d0fe-5099-a3e8-70e7e71f0b6b
2026-03-25 16:32:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcbb6390>
2026-03-25 16:32:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c9dce74-d0fe-5099-a3e8-70e7e71f0b6b/8c9dce74-d0fe-5099-a3e8-70e7e71f0b6b_image_1.jpg HTTP/1.1" 201 0
2026-03-25 16:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc0%252Fbaa087d641fd49938ba8f94137c35467%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc0/baa087d641fd49938ba8f94137c35467/images/large/2.jpg saved to cache
2026-03-25 16:32:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8c9dce74-d0fe-5099-a3e8-70e7e71f0b6b
2026-03-25 16:32:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc6/54b02016a093423788c505c366ea2589/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:11 [ayvens.it] INFO: Found listing with ID: 1983583
2026-03-25 16:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983583%27 HTTP/1.1" 200 None
2026-03-25 16:32:11 [ayvens.it] INFO: Scrape type for 1983583: 1
2026-03-25 16:32:11 [ayvens.it] INFO: Extracting data for car ID: 1983583
2026-03-25 16:32:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aa6969c7-c5db-5e4b-9e23-509bda400357 with identifier: 1983583
2026-03-25 16:32:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aa6969c7-c5db-5e4b-9e23-509bda400357 with scrape type 1
2026-03-25 16:32:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item aa6969c7-c5db-5e4b-9e23-509bda400357
2026-03-25 16:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc7%252F0a7a0c2bd61f43fca3b045cb165cf1c9%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc7/0a7a0c2bd61f43fca3b045cb165cf1c9/images/large/1.jpg not downloaded yet
2026-03-25 16:32:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc8e1bd0>
2026-03-25 16:32:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c9dce74-d0fe-5099-a3e8-70e7e71f0b6b/8c9dce74-d0fe-5099-a3e8-70e7e71f0b6b_image_7.jpg HTTP/1.1" 201 0
2026-03-25 16:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc0%252Fbaa087d641fd49938ba8f94137c35467%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc0/baa087d641fd49938ba8f94137c35467/images/large/8.jpg saved to cache
2026-03-25 16:32:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8c9dce74-d0fe-5099-a3e8-70e7e71f0b6b
2026-03-25 16:32:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34d745a790>
2026-03-25 16:32:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c9dce74-d0fe-5099-a3e8-70e7e71f0b6b/8c9dce74-d0fe-5099-a3e8-70e7e71f0b6b_image_8.jpg HTTP/1.1" 201 0
2026-03-25 16:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc0%252Fbaa087d641fd49938ba8f94137c35467%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc0/baa087d641fd49938ba8f94137c35467/images/large/9.jpg saved to cache
2026-03-25 16:32:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8c9dce74-d0fe-5099-a3e8-70e7e71f0b6b
2026-03-25 16:32:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc6/54b02016a093423788c505c366ea2589/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc7%252F0a7a0c2bd61f43fca3b045cb165cf1c9%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc7/0a7a0c2bd61f43fca3b045cb165cf1c9/images/large/2.jpg not downloaded yet
2026-03-25 16:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc7%252F0a7a0c2bd61f43fca3b045cb165cf1c9%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc7/0a7a0c2bd61f43fca3b045cb165cf1c9/images/large/3.jpg not downloaded yet
2026-03-25 16:32:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc786d90>
2026-03-25 16:32:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d2143ed-9432-5b83-a60a-a9f9f2c07100/9d2143ed-9432-5b83-a60a-a9f9f2c07100_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc6%252F54b02016a093423788c505c366ea2589%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc6/54b02016a093423788c505c366ea2589/images/large/1.jpg saved to cache
2026-03-25 16:32:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9d2143ed-9432-5b83-a60a-a9f9f2c07100
2026-03-25 16:32:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc6/54b02016a093423788c505c366ea2589/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc6/54b02016a093423788c505c366ea2589/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc7%252F0a7a0c2bd61f43fca3b045cb165cf1c9%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc7/0a7a0c2bd61f43fca3b045cb165cf1c9/images/large/4.jpg not downloaded yet
2026-03-25 16:32:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc944a10>
2026-03-25 16:32:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d2143ed-9432-5b83-a60a-a9f9f2c07100/9d2143ed-9432-5b83-a60a-a9f9f2c07100_image_2.jpg HTTP/1.1" 201 0
2026-03-25 16:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc6%252F54b02016a093423788c505c366ea2589%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc6/54b02016a093423788c505c366ea2589/images/large/3.jpg saved to cache
2026-03-25 16:32:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9d2143ed-9432-5b83-a60a-a9f9f2c07100
2026-03-25 16:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc7%252F0a7a0c2bd61f43fca3b045cb165cf1c9%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc7/0a7a0c2bd61f43fca3b045cb165cf1c9/images/large/5.jpg not downloaded yet
2026-03-25 16:32:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc6/54b02016a093423788c505c366ea2589/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc7%252F0a7a0c2bd61f43fca3b045cb165cf1c9%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc7/0a7a0c2bd61f43fca3b045cb165cf1c9/images/large/6.jpg not downloaded yet
2026-03-25 16:32:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dce2d850>
2026-03-25 16:32:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d2143ed-9432-5b83-a60a-a9f9f2c07100/9d2143ed-9432-5b83-a60a-a9f9f2c07100_image_3.jpg HTTP/1.1" 201 0
2026-03-25 16:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc6%252F54b02016a093423788c505c366ea2589%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc6/54b02016a093423788c505c366ea2589/images/large/4.jpg saved to cache
2026-03-25 16:32:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9d2143ed-9432-5b83-a60a-a9f9f2c07100
2026-03-25 16:32:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc53e190>
2026-03-25 16:32:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d2143ed-9432-5b83-a60a-a9f9f2c07100/9d2143ed-9432-5b83-a60a-a9f9f2c07100_image_4.jpg HTTP/1.1" 201 0
2026-03-25 16:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc6%252F54b02016a093423788c505c366ea2589%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc6/54b02016a093423788c505c366ea2589/images/large/5.jpg saved to cache
2026-03-25 16:32:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9d2143ed-9432-5b83-a60a-a9f9f2c07100
2026-03-25 16:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc7%252F0a7a0c2bd61f43fca3b045cb165cf1c9%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc7/0a7a0c2bd61f43fca3b045cb165cf1c9/images/large/7.jpg not downloaded yet
2026-03-25 16:32:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge0/6b882fcd76664cff8c0289b9cff0668a/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc6/54b02016a093423788c505c366ea2589/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc6/54b02016a093423788c505c366ea2589/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc7%252F0a7a0c2bd61f43fca3b045cb165cf1c9%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc7/0a7a0c2bd61f43fca3b045cb165cf1c9/images/large/8.jpg not downloaded yet
2026-03-25 16:32:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcb15410>
2026-03-25 16:32:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d2143ed-9432-5b83-a60a-a9f9f2c07100/9d2143ed-9432-5b83-a60a-a9f9f2c07100_image_9.jpg HTTP/1.1" 201 0
2026-03-25 16:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc6%252F54b02016a093423788c505c366ea2589%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc6/54b02016a093423788c505c366ea2589/images/large/10.jpg saved to cache
2026-03-25 16:32:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9d2143ed-9432-5b83-a60a-a9f9f2c07100
2026-03-25 16:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc7%252F0a7a0c2bd61f43fca3b045cb165cf1c9%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc7/0a7a0c2bd61f43fca3b045cb165cf1c9/images/large/9.jpg not downloaded yet
2026-03-25 16:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc7%252F0a7a0c2bd61f43fca3b045cb165cf1c9%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc7/0a7a0c2bd61f43fca3b045cb165cf1c9/images/large/10.jpg not downloaded yet
2026-03-25 16:32:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge0/6b882fcd76664cff8c0289b9cff0668a/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:12 [ayvens.it] INFO: Found listing with ID: 1983584
2026-03-25 16:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983584%27 HTTP/1.1" 200 None
2026-03-25 16:32:12 [ayvens.it] INFO: Scrape type for 1983584: 1
2026-03-25 16:32:12 [ayvens.it] INFO: Extracting data for car ID: 1983584
2026-03-25 16:32:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9544ca52-7ed1-5551-9ddf-b4b7d9f9063b with identifier: 1983584
2026-03-25 16:32:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9544ca52-7ed1-5551-9ddf-b4b7d9f9063b with scrape type 1
2026-03-25 16:32:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9544ca52-7ed1-5551-9ddf-b4b7d9f9063b
2026-03-25 16:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd6%252Fce969ec965cb4f30aedaad18a24c7c4e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd6/ce969ec965cb4f30aedaad18a24c7c4e/images/large/1.jpg not downloaded yet
2026-03-25 16:32:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcae9250>
2026-03-25 16:32:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d994e8df-ffe5-5ca7-aa68-586fb0c0cf50/d994e8df-ffe5-5ca7-aa68-586fb0c0cf50_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge0%252F6b882fcd76664cff8c0289b9cff0668a%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge0/6b882fcd76664cff8c0289b9cff0668a/images/large/1.jpg saved to cache
2026-03-25 16:32:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d994e8df-ffe5-5ca7-aa68-586fb0c0cf50
2026-03-25 16:32:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34d7436b90>
2026-03-25 16:32:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d2143ed-9432-5b83-a60a-a9f9f2c07100/9d2143ed-9432-5b83-a60a-a9f9f2c07100_image_5.jpg HTTP/1.1" 201 0
2026-03-25 16:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc6%252F54b02016a093423788c505c366ea2589%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc6/54b02016a093423788c505c366ea2589/images/large/6.jpg saved to cache
2026-03-25 16:32:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9d2143ed-9432-5b83-a60a-a9f9f2c07100
2026-03-25 16:32:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcb2e050>
2026-03-25 16:32:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d2143ed-9432-5b83-a60a-a9f9f2c07100/9d2143ed-9432-5b83-a60a-a9f9f2c07100_image_7.jpg HTTP/1.1" 201 0
2026-03-25 16:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc6%252F54b02016a093423788c505c366ea2589%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc6/54b02016a093423788c505c366ea2589/images/large/8.jpg saved to cache
2026-03-25 16:32:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9d2143ed-9432-5b83-a60a-a9f9f2c07100
2026-03-25 16:32:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge0/6b882fcd76664cff8c0289b9cff0668a/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd6%252Fce969ec965cb4f30aedaad18a24c7c4e%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd6/ce969ec965cb4f30aedaad18a24c7c4e/images/large/2.jpg not downloaded yet
2026-03-25 16:32:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge0/6b882fcd76664cff8c0289b9cff0668a/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd6%252Fce969ec965cb4f30aedaad18a24c7c4e%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd6/ce969ec965cb4f30aedaad18a24c7c4e/images/large/3.jpg not downloaded yet
2026-03-25 16:32:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge0/6b882fcd76664cff8c0289b9cff0668a/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcb2d7d0>
2026-03-25 16:32:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d994e8df-ffe5-5ca7-aa68-586fb0c0cf50/d994e8df-ffe5-5ca7-aa68-586fb0c0cf50_image_3.jpg HTTP/1.1" 201 0
2026-03-25 16:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge0%252F6b882fcd76664cff8c0289b9cff0668a%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge0/6b882fcd76664cff8c0289b9cff0668a/images/large/4.jpg saved to cache
2026-03-25 16:32:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d994e8df-ffe5-5ca7-aa68-586fb0c0cf50
2026-03-25 16:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd6%252Fce969ec965cb4f30aedaad18a24c7c4e%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd6/ce969ec965cb4f30aedaad18a24c7c4e/images/large/4.jpg not downloaded yet
2026-03-25 16:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd6%252Fce969ec965cb4f30aedaad18a24c7c4e%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd6/ce969ec965cb4f30aedaad18a24c7c4e/images/large/5.jpg not downloaded yet
2026-03-25 16:32:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge0/6b882fcd76664cff8c0289b9cff0668a/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge0/6b882fcd76664cff8c0289b9cff0668a/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd6%252Fce969ec965cb4f30aedaad18a24c7c4e%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd6/ce969ec965cb4f30aedaad18a24c7c4e/images/large/6.jpg not downloaded yet
2026-03-25 16:32:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc5f9dd0>
2026-03-25 16:32:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d994e8df-ffe5-5ca7-aa68-586fb0c0cf50/d994e8df-ffe5-5ca7-aa68-586fb0c0cf50_image_2.jpg HTTP/1.1" 201 0
2026-03-25 16:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge0%252F6b882fcd76664cff8c0289b9cff0668a%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge0/6b882fcd76664cff8c0289b9cff0668a/images/large/3.jpg saved to cache
2026-03-25 16:32:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d994e8df-ffe5-5ca7-aa68-586fb0c0cf50
2026-03-25 16:32:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc86a350>
2026-03-25 16:32:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d994e8df-ffe5-5ca7-aa68-586fb0c0cf50/d994e8df-ffe5-5ca7-aa68-586fb0c0cf50_image_1.jpg HTTP/1.1" 201 0
2026-03-25 16:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge0%252F6b882fcd76664cff8c0289b9cff0668a%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge0/6b882fcd76664cff8c0289b9cff0668a/images/large/2.jpg saved to cache
2026-03-25 16:32:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d994e8df-ffe5-5ca7-aa68-586fb0c0cf50
2026-03-25 16:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd6%252Fce969ec965cb4f30aedaad18a24c7c4e%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd6/ce969ec965cb4f30aedaad18a24c7c4e/images/large/7.jpg not downloaded yet
2026-03-25 16:32:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc8e1e50>
2026-03-25 16:32:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d994e8df-ffe5-5ca7-aa68-586fb0c0cf50/d994e8df-ffe5-5ca7-aa68-586fb0c0cf50_image_4.jpg HTTP/1.1" 201 0
2026-03-25 16:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge0%252F6b882fcd76664cff8c0289b9cff0668a%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge0/6b882fcd76664cff8c0289b9cff0668a/images/large/5.jpg saved to cache
2026-03-25 16:32:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d994e8df-ffe5-5ca7-aa68-586fb0c0cf50
2026-03-25 16:32:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge0/6b882fcd76664cff8c0289b9cff0668a/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd6%252Fce969ec965cb4f30aedaad18a24c7c4e%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd6/ce969ec965cb4f30aedaad18a24c7c4e/images/large/8.jpg not downloaded yet
2026-03-25 16:32:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc6/54b02016a093423788c505c366ea2589/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcb15fd0>
2026-03-25 16:32:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d994e8df-ffe5-5ca7-aa68-586fb0c0cf50/d994e8df-ffe5-5ca7-aa68-586fb0c0cf50_image_5.jpg HTTP/1.1" 201 0
2026-03-25 16:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge0%252F6b882fcd76664cff8c0289b9cff0668a%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge0/6b882fcd76664cff8c0289b9cff0668a/images/large/6.jpg saved to cache
2026-03-25 16:32:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d994e8df-ffe5-5ca7-aa68-586fb0c0cf50
2026-03-25 16:32:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc53ef90>
2026-03-25 16:32:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d994e8df-ffe5-5ca7-aa68-586fb0c0cf50/d994e8df-ffe5-5ca7-aa68-586fb0c0cf50_image_6.jpg HTTP/1.1" 201 0
2026-03-25 16:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge0%252F6b882fcd76664cff8c0289b9cff0668a%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge0/6b882fcd76664cff8c0289b9cff0668a/images/large/7.jpg saved to cache
2026-03-25 16:32:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d994e8df-ffe5-5ca7-aa68-586fb0c0cf50
2026-03-25 16:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd6%252Fce969ec965cb4f30aedaad18a24c7c4e%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd6/ce969ec965cb4f30aedaad18a24c7c4e/images/large/9.jpg not downloaded yet
2026-03-25 16:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd6%252Fce969ec965cb4f30aedaad18a24c7c4e%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd6/ce969ec965cb4f30aedaad18a24c7c4e/images/large/10.jpg not downloaded yet
2026-03-25 16:32:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc941390>
2026-03-25 16:32:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d994e8df-ffe5-5ca7-aa68-586fb0c0cf50/d994e8df-ffe5-5ca7-aa68-586fb0c0cf50_image_7.jpg HTTP/1.1" 201 0
2026-03-25 16:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge0%252F6b882fcd76664cff8c0289b9cff0668a%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge0/6b882fcd76664cff8c0289b9cff0668a/images/large/8.jpg saved to cache
2026-03-25 16:32:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d994e8df-ffe5-5ca7-aa68-586fb0c0cf50
2026-03-25 16:32:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc936810>
2026-03-25 16:32:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d2143ed-9432-5b83-a60a-a9f9f2c07100/9d2143ed-9432-5b83-a60a-a9f9f2c07100_image_8.jpg HTTP/1.1" 201 0
2026-03-25 16:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc6%252F54b02016a093423788c505c366ea2589%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc6/54b02016a093423788c505c366ea2589/images/large/9.jpg saved to cache
2026-03-25 16:32:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9d2143ed-9432-5b83-a60a-a9f9f2c07100
2026-03-25 16:32:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc7/0a7a0c2bd61f43fca3b045cb165cf1c9/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge0/6b882fcd76664cff8c0289b9cff0668a/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:13 [ayvens.it] INFO: Found listing with ID: 1983585
2026-03-25 16:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983585%27 HTTP/1.1" 200 None
2026-03-25 16:32:13 [ayvens.it] INFO: Scrape type for 1983585: 1
2026-03-25 16:32:13 [ayvens.it] INFO: Extracting data for car ID: 1983585
2026-03-25 16:32:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 79d46067-3fd5-5265-81d8-941b4602a013 with identifier: 1983585
2026-03-25 16:32:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 79d46067-3fd5-5265-81d8-941b4602a013 with scrape type 1
2026-03-25 16:32:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 79d46067-3fd5-5265-81d8-941b4602a013
2026-03-25 16:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge1%252F0377ba99ae3044bb8da262e094ac056b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge1/0377ba99ae3044bb8da262e094ac056b/images/large/1.jpg not downloaded yet
2026-03-25 16:32:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc7/0a7a0c2bd61f43fca3b045cb165cf1c9/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc7/0a7a0c2bd61f43fca3b045cb165cf1c9/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc7/0a7a0c2bd61f43fca3b045cb165cf1c9/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge1%252F0377ba99ae3044bb8da262e094ac056b%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge1/0377ba99ae3044bb8da262e094ac056b/images/large/2.jpg not downloaded yet
2026-03-25 16:32:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc7/0a7a0c2bd61f43fca3b045cb165cf1c9/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge1%252F0377ba99ae3044bb8da262e094ac056b%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge1/0377ba99ae3044bb8da262e094ac056b/images/large/3.jpg not downloaded yet
2026-03-25 16:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge1%252F0377ba99ae3044bb8da262e094ac056b%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge1/0377ba99ae3044bb8da262e094ac056b/images/large/4.jpg not downloaded yet
2026-03-25 16:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge1%252F0377ba99ae3044bb8da262e094ac056b%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge1/0377ba99ae3044bb8da262e094ac056b/images/large/5.jpg not downloaded yet
2026-03-25 16:32:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc649010>
2026-03-25 16:32:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa6969c7-c5db-5e4b-9e23-509bda400357/aa6969c7-c5db-5e4b-9e23-509bda400357_image_1.jpg HTTP/1.1" 201 0
2026-03-25 16:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc7%252F0a7a0c2bd61f43fca3b045cb165cf1c9%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc7/0a7a0c2bd61f43fca3b045cb165cf1c9/images/large/2.jpg saved to cache
2026-03-25 16:32:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item aa6969c7-c5db-5e4b-9e23-509bda400357
2026-03-25 16:32:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34d7496190>
2026-03-25 16:32:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d994e8df-ffe5-5ca7-aa68-586fb0c0cf50/d994e8df-ffe5-5ca7-aa68-586fb0c0cf50_image_9.jpg HTTP/1.1" 201 0
2026-03-25 16:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge0%252F6b882fcd76664cff8c0289b9cff0668a%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge0/6b882fcd76664cff8c0289b9cff0668a/images/large/10.jpg saved to cache
2026-03-25 16:32:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d994e8df-ffe5-5ca7-aa68-586fb0c0cf50
2026-03-25 16:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge1%252F0377ba99ae3044bb8da262e094ac056b%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge1/0377ba99ae3044bb8da262e094ac056b/images/large/6.jpg not downloaded yet
2026-03-25 16:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge1%252F0377ba99ae3044bb8da262e094ac056b%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge1/0377ba99ae3044bb8da262e094ac056b/images/large/7.jpg not downloaded yet
2026-03-25 16:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge1%252F0377ba99ae3044bb8da262e094ac056b%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge1/0377ba99ae3044bb8da262e094ac056b/images/large/8.jpg not downloaded yet
2026-03-25 16:32:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc80d150>
2026-03-25 16:32:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa6969c7-c5db-5e4b-9e23-509bda400357/aa6969c7-c5db-5e4b-9e23-509bda400357_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc7%252F0a7a0c2bd61f43fca3b045cb165cf1c9%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc7/0a7a0c2bd61f43fca3b045cb165cf1c9/images/large/1.jpg saved to cache
2026-03-25 16:32:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item aa6969c7-c5db-5e4b-9e23-509bda400357
2026-03-25 16:32:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc7fb810>
2026-03-25 16:32:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa6969c7-c5db-5e4b-9e23-509bda400357/aa6969c7-c5db-5e4b-9e23-509bda400357_image_2.jpg HTTP/1.1" 201 0
2026-03-25 16:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc7%252F0a7a0c2bd61f43fca3b045cb165cf1c9%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc7/0a7a0c2bd61f43fca3b045cb165cf1c9/images/large/3.jpg saved to cache
2026-03-25 16:32:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item aa6969c7-c5db-5e4b-9e23-509bda400357
2026-03-25 16:32:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc7d04d0>
2026-03-25 16:32:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa6969c7-c5db-5e4b-9e23-509bda400357/aa6969c7-c5db-5e4b-9e23-509bda400357_image_5.jpg HTTP/1.1" 201 0
2026-03-25 16:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc7%252F0a7a0c2bd61f43fca3b045cb165cf1c9%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc7/0a7a0c2bd61f43fca3b045cb165cf1c9/images/large/6.jpg saved to cache
2026-03-25 16:32:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item aa6969c7-c5db-5e4b-9e23-509bda400357
2026-03-25 16:32:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc7fa110>
2026-03-25 16:32:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa6969c7-c5db-5e4b-9e23-509bda400357/aa6969c7-c5db-5e4b-9e23-509bda400357_image_4.jpg HTTP/1.1" 201 0
2026-03-25 16:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc7%252F0a7a0c2bd61f43fca3b045cb165cf1c9%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc7/0a7a0c2bd61f43fca3b045cb165cf1c9/images/large/5.jpg saved to cache
2026-03-25 16:32:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item aa6969c7-c5db-5e4b-9e23-509bda400357
2026-03-25 16:32:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc7/0a7a0c2bd61f43fca3b045cb165cf1c9/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc7/0a7a0c2bd61f43fca3b045cb165cf1c9/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge1%252F0377ba99ae3044bb8da262e094ac056b%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge1/0377ba99ae3044bb8da262e094ac056b/images/large/9.jpg not downloaded yet
2026-03-25 16:32:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd6/ce969ec965cb4f30aedaad18a24c7c4e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc7/0a7a0c2bd61f43fca3b045cb165cf1c9/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge1%252F0377ba99ae3044bb8da262e094ac056b%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge1/0377ba99ae3044bb8da262e094ac056b/images/large/10.jpg not downloaded yet
2026-03-25 16:32:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd6/ce969ec965cb4f30aedaad18a24c7c4e/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd6/ce969ec965cb4f30aedaad18a24c7c4e/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd6/ce969ec965cb4f30aedaad18a24c7c4e/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge0/6b882fcd76664cff8c0289b9cff0668a/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:14 [ayvens.it] INFO: Found listing with ID: 1983586
2026-03-25 16:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983586%27 HTTP/1.1" 200 None
2026-03-25 16:32:14 [ayvens.it] INFO: Scrape type for 1983586: 1
2026-03-25 16:32:14 [ayvens.it] INFO: Extracting data for car ID: 1983586
2026-03-25 16:32:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a5105208-f25f-5aec-87b2-82099689733f with identifier: 1983586
2026-03-25 16:32:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a5105208-f25f-5aec-87b2-82099689733f with scrape type 1
2026-03-25 16:32:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a5105208-f25f-5aec-87b2-82099689733f
2026-03-25 16:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge8%252Fb0e5fe6eced240648eb4c08016be71a1%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge8/b0e5fe6eced240648eb4c08016be71a1/images/large/1.jpg not downloaded yet
2026-03-25 16:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge8%252Fb0e5fe6eced240648eb4c08016be71a1%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge8/b0e5fe6eced240648eb4c08016be71a1/images/large/2.jpg not downloaded yet
2026-03-25 16:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge8%252Fb0e5fe6eced240648eb4c08016be71a1%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge8/b0e5fe6eced240648eb4c08016be71a1/images/large/3.jpg not downloaded yet
2026-03-25 16:32:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34de16ed90>
2026-03-25 16:32:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa6969c7-c5db-5e4b-9e23-509bda400357/aa6969c7-c5db-5e4b-9e23-509bda400357_image_9.jpg HTTP/1.1" 201 0
2026-03-25 16:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc7%252F0a7a0c2bd61f43fca3b045cb165cf1c9%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc7/0a7a0c2bd61f43fca3b045cb165cf1c9/images/large/10.jpg saved to cache
2026-03-25 16:32:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item aa6969c7-c5db-5e4b-9e23-509bda400357
2026-03-25 16:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge8%252Fb0e5fe6eced240648eb4c08016be71a1%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge8/b0e5fe6eced240648eb4c08016be71a1/images/large/4.jpg not downloaded yet
2026-03-25 16:32:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc936f90>
2026-03-25 16:32:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa6969c7-c5db-5e4b-9e23-509bda400357/aa6969c7-c5db-5e4b-9e23-509bda400357_image_8.jpg HTTP/1.1" 201 0
2026-03-25 16:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc7%252F0a7a0c2bd61f43fca3b045cb165cf1c9%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc7/0a7a0c2bd61f43fca3b045cb165cf1c9/images/large/9.jpg saved to cache
2026-03-25 16:32:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item aa6969c7-c5db-5e4b-9e23-509bda400357
2026-03-25 16:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge8%252Fb0e5fe6eced240648eb4c08016be71a1%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge8/b0e5fe6eced240648eb4c08016be71a1/images/large/5.jpg not downloaded yet
2026-03-25 16:32:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc308890>
2026-03-25 16:32:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9544ca52-7ed1-5551-9ddf-b4b7d9f9063b/9544ca52-7ed1-5551-9ddf-b4b7d9f9063b_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd6%252Fce969ec965cb4f30aedaad18a24c7c4e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd6/ce969ec965cb4f30aedaad18a24c7c4e/images/large/1.jpg saved to cache
2026-03-25 16:32:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9544ca52-7ed1-5551-9ddf-b4b7d9f9063b
2026-03-25 16:32:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc8d6c10>
2026-03-25 16:32:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa6969c7-c5db-5e4b-9e23-509bda400357/aa6969c7-c5db-5e4b-9e23-509bda400357_image_3.jpg HTTP/1.1" 201 0
2026-03-25 16:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc7%252F0a7a0c2bd61f43fca3b045cb165cf1c9%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc7/0a7a0c2bd61f43fca3b045cb165cf1c9/images/large/4.jpg saved to cache
2026-03-25 16:32:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item aa6969c7-c5db-5e4b-9e23-509bda400357
2026-03-25 16:32:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc552790>
2026-03-25 16:32:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9544ca52-7ed1-5551-9ddf-b4b7d9f9063b/9544ca52-7ed1-5551-9ddf-b4b7d9f9063b_image_3.jpg HTTP/1.1" 201 0
2026-03-25 16:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd6%252Fce969ec965cb4f30aedaad18a24c7c4e%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd6/ce969ec965cb4f30aedaad18a24c7c4e/images/large/4.jpg saved to cache
2026-03-25 16:32:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9544ca52-7ed1-5551-9ddf-b4b7d9f9063b
2026-03-25 16:32:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc9d7590>
2026-03-25 16:32:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9544ca52-7ed1-5551-9ddf-b4b7d9f9063b/9544ca52-7ed1-5551-9ddf-b4b7d9f9063b_image_1.jpg HTTP/1.1" 201 0
2026-03-25 16:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd6%252Fce969ec965cb4f30aedaad18a24c7c4e%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd6/ce969ec965cb4f30aedaad18a24c7c4e/images/large/2.jpg saved to cache
2026-03-25 16:32:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9544ca52-7ed1-5551-9ddf-b4b7d9f9063b
2026-03-25 16:32:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc977310>
2026-03-25 16:32:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9544ca52-7ed1-5551-9ddf-b4b7d9f9063b/9544ca52-7ed1-5551-9ddf-b4b7d9f9063b_image_4.jpg HTTP/1.1" 201 0
2026-03-25 16:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd6%252Fce969ec965cb4f30aedaad18a24c7c4e%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd6/ce969ec965cb4f30aedaad18a24c7c4e/images/large/5.jpg saved to cache
2026-03-25 16:32:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9544ca52-7ed1-5551-9ddf-b4b7d9f9063b
2026-03-25 16:32:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc935110>
2026-03-25 16:32:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d994e8df-ffe5-5ca7-aa68-586fb0c0cf50/d994e8df-ffe5-5ca7-aa68-586fb0c0cf50_image_8.jpg HTTP/1.1" 201 0
2026-03-25 16:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge0%252F6b882fcd76664cff8c0289b9cff0668a%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge0/6b882fcd76664cff8c0289b9cff0668a/images/large/9.jpg saved to cache
2026-03-25 16:32:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d994e8df-ffe5-5ca7-aa68-586fb0c0cf50
2026-03-25 16:32:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d994e8df-ffe5-5ca7-aa68-586fb0c0cf50, skipping ID generation
2026-03-25 16:32:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d994e8df-ffe5-5ca7-aa68-586fb0c0cf50 with scrape type 1
2026-03-25 16:32:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d994e8df-ffe5-5ca7-aa68-586fb0c0cf50 sending to next pipeline
2026-03-25 16:32:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: d994e8df-ffe5-5ca7-aa68-586fb0c0cf50, identifier: 1983582
2026-03-25 16:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge8%252Fb0e5fe6eced240648eb4c08016be71a1%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge8/b0e5fe6eced240648eb4c08016be71a1/images/large/6.jpg not downloaded yet
2026-03-25 16:32:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: d994e8df-ffe5-5ca7-aa68-586fb0c0cf50 with identifier: 1983582
2026-03-25 16:32:15 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:32:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: d994e8df-ffe5-5ca7-aa68-586fb0c0cf50 with identifier: 1983582
2026-03-25 16:32:15 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: d994e8df-ffe5-5ca7-aa68-586fb0c0cf50 with identifier: 1983582 to the API
2026-03-25 16:32:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:32:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:32:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/ge0/6b882fcd76664cff8c0289b9cff0668a/images/large/9.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Unknown',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-27T09:30:00Z',
'fuel_type': 'diesel',
'id': 'd994e8df-ffe5-5ca7-aa68-586fb0c0cf50',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41025',
'listing': 'auction',
'location': None,
'make': 'FORD',
'model': 'FORD KUGA 1.5 EcoBlue 120CV 2WD Connect Auto Sport utility vehicle '
'5-door (Euro 6.2)',
'odometer': 112133,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 13,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d994e8df-ffe5-5ca7-aa68-586fb0c0cf50/d994e8df-ffe5-5ca7-aa68-586fb0c0cf50_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 911568,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge0/6b882fcd76664cff8c0289b9cff0668a/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d994e8df-ffe5-5ca7-aa68-586fb0c0cf50/d994e8df-ffe5-5ca7-aa68-586fb0c0cf50_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 808377,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge0/6b882fcd76664cff8c0289b9cff0668a/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d994e8df-ffe5-5ca7-aa68-586fb0c0cf50/d994e8df-ffe5-5ca7-aa68-586fb0c0cf50_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 911568,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge0/6b882fcd76664cff8c0289b9cff0668a/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d994e8df-ffe5-5ca7-aa68-586fb0c0cf50/d994e8df-ffe5-5ca7-aa68-586fb0c0cf50_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 908134,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge0/6b882fcd76664cff8c0289b9cff0668a/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d994e8df-ffe5-5ca7-aa68-586fb0c0cf50/d994e8df-ffe5-5ca7-aa68-586fb0c0cf50_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 871449,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge0/6b882fcd76664cff8c0289b9cff0668a/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d994e8df-ffe5-5ca7-aa68-586fb0c0cf50/d994e8df-ffe5-5ca7-aa68-586fb0c0cf50_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 616550,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge0/6b882fcd76664cff8c0289b9cff0668a/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d994e8df-ffe5-5ca7-aa68-586fb0c0cf50/d994e8df-ffe5-5ca7-aa68-586fb0c0cf50_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 552274,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge0/6b882fcd76664cff8c0289b9cff0668a/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d994e8df-ffe5-5ca7-aa68-586fb0c0cf50/d994e8df-ffe5-5ca7-aa68-586fb0c0cf50_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 504697,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge0/6b882fcd76664cff8c0289b9cff0668a/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d994e8df-ffe5-5ca7-aa68-586fb0c0cf50/d994e8df-ffe5-5ca7-aa68-586fb0c0cf50_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 773362,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge0/6b882fcd76664cff8c0289b9cff0668a/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d994e8df-ffe5-5ca7-aa68-586fb0c0cf50/d994e8df-ffe5-5ca7-aa68-586fb0c0cf50_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 683934,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge0/6b882fcd76664cff8c0289b9cff0668a/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-02-26',
'seats_number': 5,
'seller_name': None,
'title': 'FORD FORD KUGA 1.5 EcoBlue 120CV 2WD Connect Auto Sport utility '
'vehicle 5-door (Euro 6.2) -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2021}
2026-03-25 16:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983582%27 HTTP/1.1" 200 None
2026-03-25 16:32:16 [ayvens.it] INFO: Saving data for 1983582: {'created_time': 1774456336.640092, 'last_price_update_time': 1774456336.640102, 'auction_closing_time': 1774603800.0}
2026-03-25 16:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1983582') HTTP/1.1" 204 0
2026-03-25 16:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge8%252Fb0e5fe6eced240648eb4c08016be71a1%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge8/b0e5fe6eced240648eb4c08016be71a1/images/large/7.jpg not downloaded yet
2026-03-25 16:32:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd6/ce969ec965cb4f30aedaad18a24c7c4e/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd6/ce969ec965cb4f30aedaad18a24c7c4e/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge8%252Fb0e5fe6eced240648eb4c08016be71a1%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge8/b0e5fe6eced240648eb4c08016be71a1/images/large/8.jpg not downloaded yet
2026-03-25 16:32:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge1/0377ba99ae3044bb8da262e094ac056b/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd6/ce969ec965cb4f30aedaad18a24c7c4e/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd6/ce969ec965cb4f30aedaad18a24c7c4e/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge1/0377ba99ae3044bb8da262e094ac056b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd6/ce969ec965cb4f30aedaad18a24c7c4e/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd6/ce969ec965cb4f30aedaad18a24c7c4e/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge8%252Fb0e5fe6eced240648eb4c08016be71a1%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge8/b0e5fe6eced240648eb4c08016be71a1/images/large/9.jpg not downloaded yet
2026-03-25 16:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge8%252Fb0e5fe6eced240648eb4c08016be71a1%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge8/b0e5fe6eced240648eb4c08016be71a1/images/large/10.jpg not downloaded yet
2026-03-25 16:32:16 [ayvens.it] INFO: Found listing with ID: 1983587
2026-03-25 16:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983587%27 HTTP/1.1" 200 None
2026-03-25 16:32:16 [ayvens.it] INFO: Scrape type for 1983587: 1
2026-03-25 16:32:16 [ayvens.it] INFO: Extracting data for car ID: 1983587
2026-03-25 16:32:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 694b6125-b8b4-5b36-922b-807c2e597f64 with identifier: 1983587
2026-03-25 16:32:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 694b6125-b8b4-5b36-922b-807c2e597f64 with scrape type 1
2026-03-25 16:32:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 694b6125-b8b4-5b36-922b-807c2e597f64
2026-03-25 16:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge8%252Febb03bf1d1c64e63b0aad99a8b2048ea%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge8/ebb03bf1d1c64e63b0aad99a8b2048ea/images/large/1.jpg not downloaded yet
2026-03-25 16:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge8%252Febb03bf1d1c64e63b0aad99a8b2048ea%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge8/ebb03bf1d1c64e63b0aad99a8b2048ea/images/large/2.jpg not downloaded yet
2026-03-25 16:32:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34d6b5ad90>
2026-03-25 16:32:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9544ca52-7ed1-5551-9ddf-b4b7d9f9063b/9544ca52-7ed1-5551-9ddf-b4b7d9f9063b_image_9.jpg HTTP/1.1" 201 0
2026-03-25 16:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd6%252Fce969ec965cb4f30aedaad18a24c7c4e%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd6/ce969ec965cb4f30aedaad18a24c7c4e/images/large/10.jpg saved to cache
2026-03-25 16:32:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9544ca52-7ed1-5551-9ddf-b4b7d9f9063b
2026-03-25 16:32:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcb98450>
2026-03-25 16:32:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9544ca52-7ed1-5551-9ddf-b4b7d9f9063b/9544ca52-7ed1-5551-9ddf-b4b7d9f9063b_image_6.jpg HTTP/1.1" 201 0
2026-03-25 16:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd6%252Fce969ec965cb4f30aedaad18a24c7c4e%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd6/ce969ec965cb4f30aedaad18a24c7c4e/images/large/7.jpg saved to cache
2026-03-25 16:32:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9544ca52-7ed1-5551-9ddf-b4b7d9f9063b
2026-03-25 16:32:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc766f50>
2026-03-25 16:32:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79d46067-3fd5-5265-81d8-941b4602a013/79d46067-3fd5-5265-81d8-941b4602a013_image_1.jpg HTTP/1.1" 201 0
2026-03-25 16:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge1%252F0377ba99ae3044bb8da262e094ac056b%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge1/0377ba99ae3044bb8da262e094ac056b/images/large/2.jpg saved to cache
2026-03-25 16:32:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 79d46067-3fd5-5265-81d8-941b4602a013
2026-03-25 16:32:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc766250>
2026-03-25 16:32:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9544ca52-7ed1-5551-9ddf-b4b7d9f9063b/9544ca52-7ed1-5551-9ddf-b4b7d9f9063b_image_5.jpg HTTP/1.1" 201 0
2026-03-25 16:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd6%252Fce969ec965cb4f30aedaad18a24c7c4e%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd6/ce969ec965cb4f30aedaad18a24c7c4e/images/large/6.jpg saved to cache
2026-03-25 16:32:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9544ca52-7ed1-5551-9ddf-b4b7d9f9063b
2026-03-25 16:32:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcb1e010>
2026-03-25 16:32:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9544ca52-7ed1-5551-9ddf-b4b7d9f9063b/9544ca52-7ed1-5551-9ddf-b4b7d9f9063b_image_8.jpg HTTP/1.1" 201 0
2026-03-25 16:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd6%252Fce969ec965cb4f30aedaad18a24c7c4e%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd6/ce969ec965cb4f30aedaad18a24c7c4e/images/large/9.jpg saved to cache
2026-03-25 16:32:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9544ca52-7ed1-5551-9ddf-b4b7d9f9063b
2026-03-25 16:32:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcb1f1d0>
2026-03-25 16:32:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79d46067-3fd5-5265-81d8-941b4602a013/79d46067-3fd5-5265-81d8-941b4602a013_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge1%252F0377ba99ae3044bb8da262e094ac056b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge1/0377ba99ae3044bb8da262e094ac056b/images/large/1.jpg saved to cache
2026-03-25 16:32:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 79d46067-3fd5-5265-81d8-941b4602a013
2026-03-25 16:32:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcb9a590>
2026-03-25 16:32:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9544ca52-7ed1-5551-9ddf-b4b7d9f9063b/9544ca52-7ed1-5551-9ddf-b4b7d9f9063b_image_2.jpg HTTP/1.1" 201 0
2026-03-25 16:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd6%252Fce969ec965cb4f30aedaad18a24c7c4e%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd6/ce969ec965cb4f30aedaad18a24c7c4e/images/large/3.jpg saved to cache
2026-03-25 16:32:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9544ca52-7ed1-5551-9ddf-b4b7d9f9063b
2026-03-25 16:32:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc765e10>
2026-03-25 16:32:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9544ca52-7ed1-5551-9ddf-b4b7d9f9063b/9544ca52-7ed1-5551-9ddf-b4b7d9f9063b_image_7.jpg HTTP/1.1" 201 0
2026-03-25 16:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd6%252Fce969ec965cb4f30aedaad18a24c7c4e%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd6/ce969ec965cb4f30aedaad18a24c7c4e/images/large/8.jpg saved to cache
2026-03-25 16:32:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9544ca52-7ed1-5551-9ddf-b4b7d9f9063b
2026-03-25 16:32:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9544ca52-7ed1-5551-9ddf-b4b7d9f9063b, skipping ID generation
2026-03-25 16:32:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9544ca52-7ed1-5551-9ddf-b4b7d9f9063b with scrape type 1
2026-03-25 16:32:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9544ca52-7ed1-5551-9ddf-b4b7d9f9063b sending to next pipeline
2026-03-25 16:32:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 9544ca52-7ed1-5551-9ddf-b4b7d9f9063b, identifier: 1983584
2026-03-25 16:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge8%252Febb03bf1d1c64e63b0aad99a8b2048ea%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge8/ebb03bf1d1c64e63b0aad99a8b2048ea/images/large/3.jpg not downloaded yet
2026-03-25 16:32:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 9544ca52-7ed1-5551-9ddf-b4b7d9f9063b with identifier: 1983584
2026-03-25 16:32:17 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:32:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 9544ca52-7ed1-5551-9ddf-b4b7d9f9063b with identifier: 1983584
2026-03-25 16:32:17 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 9544ca52-7ed1-5551-9ddf-b4b7d9f9063b with identifier: 1983584 to the API
2026-03-25 16:32:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:32:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:32:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gd6/ce969ec965cb4f30aedaad18a24c7c4e/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'QUARTZ GREY METALLIZZATI',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-27T09:30:00Z',
'fuel_type': 'diesel',
'id': '9544ca52-7ed1-5551-9ddf-b4b7d9f9063b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41025',
'listing': 'auction',
'location': None,
'make': 'OPEL',
'model': 'OPEL GRANDLAND X(PC) 1.5 DIESEL 130CV BUSINESS EDIT. S&S AT8 FP',
'odometer': 62274,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 60,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9544ca52-7ed1-5551-9ddf-b4b7d9f9063b/9544ca52-7ed1-5551-9ddf-b4b7d9f9063b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 570707,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd6/ce969ec965cb4f30aedaad18a24c7c4e/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9544ca52-7ed1-5551-9ddf-b4b7d9f9063b/9544ca52-7ed1-5551-9ddf-b4b7d9f9063b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 604877,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd6/ce969ec965cb4f30aedaad18a24c7c4e/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9544ca52-7ed1-5551-9ddf-b4b7d9f9063b/9544ca52-7ed1-5551-9ddf-b4b7d9f9063b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 570707,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd6/ce969ec965cb4f30aedaad18a24c7c4e/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9544ca52-7ed1-5551-9ddf-b4b7d9f9063b/9544ca52-7ed1-5551-9ddf-b4b7d9f9063b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 562581,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd6/ce969ec965cb4f30aedaad18a24c7c4e/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9544ca52-7ed1-5551-9ddf-b4b7d9f9063b/9544ca52-7ed1-5551-9ddf-b4b7d9f9063b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 608368,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd6/ce969ec965cb4f30aedaad18a24c7c4e/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9544ca52-7ed1-5551-9ddf-b4b7d9f9063b/9544ca52-7ed1-5551-9ddf-b4b7d9f9063b_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 550834,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd6/ce969ec965cb4f30aedaad18a24c7c4e/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9544ca52-7ed1-5551-9ddf-b4b7d9f9063b/9544ca52-7ed1-5551-9ddf-b4b7d9f9063b_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 503211,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd6/ce969ec965cb4f30aedaad18a24c7c4e/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9544ca52-7ed1-5551-9ddf-b4b7d9f9063b/9544ca52-7ed1-5551-9ddf-b4b7d9f9063b_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 434547,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd6/ce969ec965cb4f30aedaad18a24c7c4e/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9544ca52-7ed1-5551-9ddf-b4b7d9f9063b/9544ca52-7ed1-5551-9ddf-b4b7d9f9063b_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 485997,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd6/ce969ec965cb4f30aedaad18a24c7c4e/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9544ca52-7ed1-5551-9ddf-b4b7d9f9063b/9544ca52-7ed1-5551-9ddf-b4b7d9f9063b_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 463739,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd6/ce969ec965cb4f30aedaad18a24c7c4e/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-12-17',
'seats_number': 5,
'seller_name': None,
'title': 'OPEL OPEL GRANDLAND X(PC) 1.5 DIESEL 130CV BUSINESS EDIT. S&S AT8 '
'FP -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2020}
2026-03-25 16:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983584%27 HTTP/1.1" 200 None
2026-03-25 16:32:18 [ayvens.it] INFO: Saving data for 1983584: {'created_time': 1774456338.149448, 'last_price_update_time': 1774456338.14946, 'auction_closing_time': 1774603800.0}
2026-03-25 16:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1983584') HTTP/1.1" 204 0
2026-03-25 16:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge8%252Febb03bf1d1c64e63b0aad99a8b2048ea%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge8/ebb03bf1d1c64e63b0aad99a8b2048ea/images/large/4.jpg not downloaded yet
2026-03-25 16:32:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge1/0377ba99ae3044bb8da262e094ac056b/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge8%252Febb03bf1d1c64e63b0aad99a8b2048ea%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge8/ebb03bf1d1c64e63b0aad99a8b2048ea/images/large/5.jpg not downloaded yet
2026-03-25 16:32:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge1/0377ba99ae3044bb8da262e094ac056b/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge1/0377ba99ae3044bb8da262e094ac056b/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge8%252Febb03bf1d1c64e63b0aad99a8b2048ea%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge8/ebb03bf1d1c64e63b0aad99a8b2048ea/images/large/6.jpg not downloaded yet
2026-03-25 16:32:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge1/0377ba99ae3044bb8da262e094ac056b/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge1/0377ba99ae3044bb8da262e094ac056b/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge8%252Febb03bf1d1c64e63b0aad99a8b2048ea%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge8/ebb03bf1d1c64e63b0aad99a8b2048ea/images/large/7.jpg not downloaded yet
2026-03-25 16:32:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge1/0377ba99ae3044bb8da262e094ac056b/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge1/0377ba99ae3044bb8da262e094ac056b/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge1/0377ba99ae3044bb8da262e094ac056b/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge8%252Febb03bf1d1c64e63b0aad99a8b2048ea%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge8/ebb03bf1d1c64e63b0aad99a8b2048ea/images/large/8.jpg not downloaded yet
2026-03-25 16:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge8%252Febb03bf1d1c64e63b0aad99a8b2048ea%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge8/ebb03bf1d1c64e63b0aad99a8b2048ea/images/large/9.jpg not downloaded yet
2026-03-25 16:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge8%252Febb03bf1d1c64e63b0aad99a8b2048ea%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge8/ebb03bf1d1c64e63b0aad99a8b2048ea/images/large/10.jpg not downloaded yet
2026-03-25 16:32:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcde2dd0>
2026-03-25 16:32:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79d46067-3fd5-5265-81d8-941b4602a013/79d46067-3fd5-5265-81d8-941b4602a013_image_7.jpg HTTP/1.1" 201 0
2026-03-25 16:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge1%252F0377ba99ae3044bb8da262e094ac056b%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge1/0377ba99ae3044bb8da262e094ac056b/images/large/8.jpg saved to cache
2026-03-25 16:32:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 79d46067-3fd5-5265-81d8-941b4602a013
2026-03-25 16:32:18 [ayvens.it] INFO: Found listing with ID: 1983588
2026-03-25 16:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983588%27 HTTP/1.1" 200 None
2026-03-25 16:32:18 [ayvens.it] INFO: Scrape type for 1983588: 1
2026-03-25 16:32:18 [ayvens.it] INFO: Extracting data for car ID: 1983588
2026-03-25 16:32:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b897a862-6b31-5274-b294-b18498275ee3 with identifier: 1983588
2026-03-25 16:32:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b897a862-6b31-5274-b294-b18498275ee3 with scrape type 1
2026-03-25 16:32:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b897a862-6b31-5274-b294-b18498275ee3
2026-03-25 16:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd4%252F9abb9f952ccf4302a733ced9c2a2e21c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd4/9abb9f952ccf4302a733ced9c2a2e21c/images/large/1.jpg not downloaded yet
2026-03-25 16:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd4%252F9abb9f952ccf4302a733ced9c2a2e21c%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd4/9abb9f952ccf4302a733ced9c2a2e21c/images/large/2.jpg not downloaded yet
2026-03-25 16:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd4%252F9abb9f952ccf4302a733ced9c2a2e21c%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd4/9abb9f952ccf4302a733ced9c2a2e21c/images/large/3.jpg not downloaded yet
2026-03-25 16:32:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcbe5890>
2026-03-25 16:32:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79d46067-3fd5-5265-81d8-941b4602a013/79d46067-3fd5-5265-81d8-941b4602a013_image_6.jpg HTTP/1.1" 201 0
2026-03-25 16:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge1%252F0377ba99ae3044bb8da262e094ac056b%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge1/0377ba99ae3044bb8da262e094ac056b/images/large/7.jpg saved to cache
2026-03-25 16:32:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 79d46067-3fd5-5265-81d8-941b4602a013
2026-03-25 16:32:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc9f3490>
2026-03-25 16:32:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79d46067-3fd5-5265-81d8-941b4602a013/79d46067-3fd5-5265-81d8-941b4602a013_image_9.jpg HTTP/1.1" 201 0
2026-03-25 16:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge1%252F0377ba99ae3044bb8da262e094ac056b%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge1/0377ba99ae3044bb8da262e094ac056b/images/large/10.jpg saved to cache
2026-03-25 16:32:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 79d46067-3fd5-5265-81d8-941b4602a013
2026-03-25 16:32:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc9e6c90>
2026-03-25 16:32:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79d46067-3fd5-5265-81d8-941b4602a013/79d46067-3fd5-5265-81d8-941b4602a013_image_5.jpg HTTP/1.1" 201 0
2026-03-25 16:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge1%252F0377ba99ae3044bb8da262e094ac056b%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge1/0377ba99ae3044bb8da262e094ac056b/images/large/6.jpg saved to cache
2026-03-25 16:32:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 79d46067-3fd5-5265-81d8-941b4602a013
2026-03-25 16:32:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc56e450>
2026-03-25 16:32:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79d46067-3fd5-5265-81d8-941b4602a013/79d46067-3fd5-5265-81d8-941b4602a013_image_4.jpg HTTP/1.1" 201 0
2026-03-25 16:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge1%252F0377ba99ae3044bb8da262e094ac056b%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge1/0377ba99ae3044bb8da262e094ac056b/images/large/5.jpg saved to cache
2026-03-25 16:32:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 79d46067-3fd5-5265-81d8-941b4602a013
2026-03-25 16:32:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc637250>
2026-03-25 16:32:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79d46067-3fd5-5265-81d8-941b4602a013/79d46067-3fd5-5265-81d8-941b4602a013_image_8.jpg HTTP/1.1" 201 0
2026-03-25 16:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge1%252F0377ba99ae3044bb8da262e094ac056b%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge1/0377ba99ae3044bb8da262e094ac056b/images/large/9.jpg saved to cache
2026-03-25 16:32:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 79d46067-3fd5-5265-81d8-941b4602a013
2026-03-25 16:32:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc60fad0>
2026-03-25 16:32:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79d46067-3fd5-5265-81d8-941b4602a013/79d46067-3fd5-5265-81d8-941b4602a013_image_3.jpg HTTP/1.1" 201 0
2026-03-25 16:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge1%252F0377ba99ae3044bb8da262e094ac056b%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge1/0377ba99ae3044bb8da262e094ac056b/images/large/4.jpg saved to cache
2026-03-25 16:32:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 79d46067-3fd5-5265-81d8-941b4602a013
2026-03-25 16:32:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dca74710>
2026-03-25 16:32:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79d46067-3fd5-5265-81d8-941b4602a013/79d46067-3fd5-5265-81d8-941b4602a013_image_2.jpg HTTP/1.1" 201 0
2026-03-25 16:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge1%252F0377ba99ae3044bb8da262e094ac056b%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge1/0377ba99ae3044bb8da262e094ac056b/images/large/3.jpg saved to cache
2026-03-25 16:32:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 79d46067-3fd5-5265-81d8-941b4602a013
2026-03-25 16:32:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 79d46067-3fd5-5265-81d8-941b4602a013, skipping ID generation
2026-03-25 16:32:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 79d46067-3fd5-5265-81d8-941b4602a013 with scrape type 1
2026-03-25 16:32:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 79d46067-3fd5-5265-81d8-941b4602a013 sending to next pipeline
2026-03-25 16:32:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 79d46067-3fd5-5265-81d8-941b4602a013, identifier: 1983585
2026-03-25 16:32:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 79d46067-3fd5-5265-81d8-941b4602a013 with identifier: 1983585
2026-03-25 16:32:19 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:32:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 79d46067-3fd5-5265-81d8-941b4602a013 with identifier: 1983585
2026-03-25 16:32:19 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 79d46067-3fd5-5265-81d8-941b4602a013 with identifier: 1983585 to the API
2026-03-25 16:32:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:32:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:32:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/ge1/0377ba99ae3044bb8da262e094ac056b/images/large/3.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Generic Color',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-27T09:30:00Z',
'fuel_type': 'hybrid',
'id': '79d46067-3fd5-5265-81d8-941b4602a013',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41025',
'listing': 'auction',
'location': None,
'make': 'LAND ROVER',
'model': 'LAND ROVER RANGE ROVER EVO 2.0 P300 MHEV R-DYNAMIC SE AWD AUTO FP',
'odometer': 45536,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 17,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79d46067-3fd5-5265-81d8-941b4602a013/79d46067-3fd5-5265-81d8-941b4602a013_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 677135,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge1/0377ba99ae3044bb8da262e094ac056b/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79d46067-3fd5-5265-81d8-941b4602a013/79d46067-3fd5-5265-81d8-941b4602a013_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 618237,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge1/0377ba99ae3044bb8da262e094ac056b/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79d46067-3fd5-5265-81d8-941b4602a013/79d46067-3fd5-5265-81d8-941b4602a013_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 677135,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge1/0377ba99ae3044bb8da262e094ac056b/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79d46067-3fd5-5265-81d8-941b4602a013/79d46067-3fd5-5265-81d8-941b4602a013_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 716805,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge1/0377ba99ae3044bb8da262e094ac056b/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79d46067-3fd5-5265-81d8-941b4602a013/79d46067-3fd5-5265-81d8-941b4602a013_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 675694,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge1/0377ba99ae3044bb8da262e094ac056b/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79d46067-3fd5-5265-81d8-941b4602a013/79d46067-3fd5-5265-81d8-941b4602a013_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 538077,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge1/0377ba99ae3044bb8da262e094ac056b/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79d46067-3fd5-5265-81d8-941b4602a013/79d46067-3fd5-5265-81d8-941b4602a013_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 488516,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge1/0377ba99ae3044bb8da262e094ac056b/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79d46067-3fd5-5265-81d8-941b4602a013/79d46067-3fd5-5265-81d8-941b4602a013_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 423633,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge1/0377ba99ae3044bb8da262e094ac056b/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79d46067-3fd5-5265-81d8-941b4602a013/79d46067-3fd5-5265-81d8-941b4602a013_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 570071,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge1/0377ba99ae3044bb8da262e094ac056b/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79d46067-3fd5-5265-81d8-941b4602a013/79d46067-3fd5-5265-81d8-941b4602a013_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 526351,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge1/0377ba99ae3044bb8da262e094ac056b/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-03-15',
'seats_number': 5,
'seller_name': None,
'title': 'LAND ROVER LAND ROVER RANGE ROVER EVO 2.0 P300 MHEV R-DYNAMIC SE '
'AWD AUTO FP -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2021}
2026-03-25 16:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983585%27 HTTP/1.1" 200 None
2026-03-25 16:32:19 [ayvens.it] INFO: Saving data for 1983585: {'created_time': 1774456339.92995, 'last_price_update_time': 1774456339.929961, 'auction_closing_time': 1774603800.0}
2026-03-25 16:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1983585') HTTP/1.1" 204 0
2026-03-25 16:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd4%252F9abb9f952ccf4302a733ced9c2a2e21c%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd4/9abb9f952ccf4302a733ced9c2a2e21c/images/large/4.jpg not downloaded yet
2026-03-25 16:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd4%252F9abb9f952ccf4302a733ced9c2a2e21c%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd4/9abb9f952ccf4302a733ced9c2a2e21c/images/large/5.jpg not downloaded yet
2026-03-25 16:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd4%252F9abb9f952ccf4302a733ced9c2a2e21c%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd4/9abb9f952ccf4302a733ced9c2a2e21c/images/large/6.jpg not downloaded yet
2026-03-25 16:32:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge8/b0e5fe6eced240648eb4c08016be71a1/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd4%252F9abb9f952ccf4302a733ced9c2a2e21c%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd4/9abb9f952ccf4302a733ced9c2a2e21c/images/large/7.jpg not downloaded yet
2026-03-25 16:32:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge8/b0e5fe6eced240648eb4c08016be71a1/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge8/b0e5fe6eced240648eb4c08016be71a1/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd4%252F9abb9f952ccf4302a733ced9c2a2e21c%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd4/9abb9f952ccf4302a733ced9c2a2e21c/images/large/8.jpg not downloaded yet
2026-03-25 16:32:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge8/b0e5fe6eced240648eb4c08016be71a1/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge8/b0e5fe6eced240648eb4c08016be71a1/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge8/b0e5fe6eced240648eb4c08016be71a1/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd4%252F9abb9f952ccf4302a733ced9c2a2e21c%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd4/9abb9f952ccf4302a733ced9c2a2e21c/images/large/9.jpg not downloaded yet
2026-03-25 16:32:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge8/b0e5fe6eced240648eb4c08016be71a1/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge8/b0e5fe6eced240648eb4c08016be71a1/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd4%252F9abb9f952ccf4302a733ced9c2a2e21c%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd4/9abb9f952ccf4302a733ced9c2a2e21c/images/large/10.jpg not downloaded yet
2026-03-25 16:32:20 [ayvens.it] INFO: Found listing with ID: 1983589
2026-03-25 16:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983589%27 HTTP/1.1" 200 None
2026-03-25 16:32:20 [ayvens.it] INFO: Scrape type for 1983589: 1
2026-03-25 16:32:20 [ayvens.it] INFO: Extracting data for car ID: 1983589
2026-03-25 16:32:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8266c022-3d29-5bf4-b747-4794e2a2c615 with identifier: 1983589
2026-03-25 16:32:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8266c022-3d29-5bf4-b747-4794e2a2c615 with scrape type 1
2026-03-25 16:32:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8266c022-3d29-5bf4-b747-4794e2a2c615
2026-03-25 16:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh3%252Fc5b4eed1b7d64908abba4361c9d51e42%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh3/c5b4eed1b7d64908abba4361c9d51e42/images/large/1.jpg not downloaded yet
2026-03-25 16:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh3%252Fc5b4eed1b7d64908abba4361c9d51e42%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh3/c5b4eed1b7d64908abba4361c9d51e42/images/large/2.jpg not downloaded yet
2026-03-25 16:32:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dca20290>
2026-03-25 16:32:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5105208-f25f-5aec-87b2-82099689733f/a5105208-f25f-5aec-87b2-82099689733f_image_5.jpg HTTP/1.1" 201 0
2026-03-25 16:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge8%252Fb0e5fe6eced240648eb4c08016be71a1%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge8/b0e5fe6eced240648eb4c08016be71a1/images/large/6.jpg saved to cache
2026-03-25 16:32:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a5105208-f25f-5aec-87b2-82099689733f
2026-03-25 16:32:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc91f510>
2026-03-25 16:32:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5105208-f25f-5aec-87b2-82099689733f/a5105208-f25f-5aec-87b2-82099689733f_image_2.jpg HTTP/1.1" 201 0
2026-03-25 16:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge8%252Fb0e5fe6eced240648eb4c08016be71a1%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge8/b0e5fe6eced240648eb4c08016be71a1/images/large/3.jpg saved to cache
2026-03-25 16:32:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a5105208-f25f-5aec-87b2-82099689733f
2026-03-25 16:32:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34d745ae50>
2026-03-25 16:32:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5105208-f25f-5aec-87b2-82099689733f/a5105208-f25f-5aec-87b2-82099689733f_image_7.jpg HTTP/1.1" 201 0
2026-03-25 16:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge8%252Fb0e5fe6eced240648eb4c08016be71a1%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge8/b0e5fe6eced240648eb4c08016be71a1/images/large/8.jpg saved to cache
2026-03-25 16:32:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a5105208-f25f-5aec-87b2-82099689733f
2026-03-25 16:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh3%252Fc5b4eed1b7d64908abba4361c9d51e42%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh3/c5b4eed1b7d64908abba4361c9d51e42/images/large/3.jpg not downloaded yet
2026-03-25 16:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh3%252Fc5b4eed1b7d64908abba4361c9d51e42%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh3/c5b4eed1b7d64908abba4361c9d51e42/images/large/4.jpg not downloaded yet
2026-03-25 16:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh3%252Fc5b4eed1b7d64908abba4361c9d51e42%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh3/c5b4eed1b7d64908abba4361c9d51e42/images/large/5.jpg not downloaded yet
2026-03-25 16:32:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc8e2550>
2026-03-25 16:32:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5105208-f25f-5aec-87b2-82099689733f/a5105208-f25f-5aec-87b2-82099689733f_image_6.jpg HTTP/1.1" 201 0
2026-03-25 16:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge8%252Fb0e5fe6eced240648eb4c08016be71a1%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge8/b0e5fe6eced240648eb4c08016be71a1/images/large/7.jpg saved to cache
2026-03-25 16:32:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a5105208-f25f-5aec-87b2-82099689733f
2026-03-25 16:32:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dca45b10>
2026-03-25 16:32:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5105208-f25f-5aec-87b2-82099689733f/a5105208-f25f-5aec-87b2-82099689733f_image_3.jpg HTTP/1.1" 201 0
2026-03-25 16:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge8%252Fb0e5fe6eced240648eb4c08016be71a1%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge8/b0e5fe6eced240648eb4c08016be71a1/images/large/4.jpg saved to cache
2026-03-25 16:32:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a5105208-f25f-5aec-87b2-82099689733f
2026-03-25 16:32:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc8d6c90>
2026-03-25 16:32:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5105208-f25f-5aec-87b2-82099689733f/a5105208-f25f-5aec-87b2-82099689733f_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge8%252Fb0e5fe6eced240648eb4c08016be71a1%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge8/b0e5fe6eced240648eb4c08016be71a1/images/large/1.jpg saved to cache
2026-03-25 16:32:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a5105208-f25f-5aec-87b2-82099689733f
2026-03-25 16:32:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc7fb810>
2026-03-25 16:32:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5105208-f25f-5aec-87b2-82099689733f/a5105208-f25f-5aec-87b2-82099689733f_image_4.jpg HTTP/1.1" 201 0
2026-03-25 16:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge8%252Fb0e5fe6eced240648eb4c08016be71a1%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge8/b0e5fe6eced240648eb4c08016be71a1/images/large/5.jpg saved to cache
2026-03-25 16:32:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a5105208-f25f-5aec-87b2-82099689733f
2026-03-25 16:32:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcbb4610>
2026-03-25 16:32:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5105208-f25f-5aec-87b2-82099689733f/a5105208-f25f-5aec-87b2-82099689733f_image_1.jpg HTTP/1.1" 201 0
2026-03-25 16:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge8%252Fb0e5fe6eced240648eb4c08016be71a1%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge8/b0e5fe6eced240648eb4c08016be71a1/images/large/2.jpg saved to cache
2026-03-25 16:32:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a5105208-f25f-5aec-87b2-82099689733f
2026-03-25 16:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh3%252Fc5b4eed1b7d64908abba4361c9d51e42%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh3/c5b4eed1b7d64908abba4361c9d51e42/images/large/6.jpg not downloaded yet
2026-03-25 16:32:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge8/ebb03bf1d1c64e63b0aad99a8b2048ea/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge8/ebb03bf1d1c64e63b0aad99a8b2048ea/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge8/ebb03bf1d1c64e63b0aad99a8b2048ea/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge8/ebb03bf1d1c64e63b0aad99a8b2048ea/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge8/ebb03bf1d1c64e63b0aad99a8b2048ea/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh3%252Fc5b4eed1b7d64908abba4361c9d51e42%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh3/c5b4eed1b7d64908abba4361c9d51e42/images/large/7.jpg not downloaded yet
2026-03-25 16:32:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge8/ebb03bf1d1c64e63b0aad99a8b2048ea/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge8/ebb03bf1d1c64e63b0aad99a8b2048ea/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh3%252Fc5b4eed1b7d64908abba4361c9d51e42%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh3/c5b4eed1b7d64908abba4361c9d51e42/images/large/8.jpg not downloaded yet
2026-03-25 16:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh3%252Fc5b4eed1b7d64908abba4361c9d51e42%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh3/c5b4eed1b7d64908abba4361c9d51e42/images/large/9.jpg not downloaded yet
2026-03-25 16:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh3%252Fc5b4eed1b7d64908abba4361c9d51e42%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh3/c5b4eed1b7d64908abba4361c9d51e42/images/large/10.jpg not downloaded yet
2026-03-25 16:32:21 [ayvens.it] INFO: Found listing with ID: 1983590
2026-03-25 16:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983590%27 HTTP/1.1" 200 None
2026-03-25 16:32:21 [ayvens.it] INFO: Scrape type for 1983590: 1
2026-03-25 16:32:21 [ayvens.it] INFO: Extracting data for car ID: 1983590
2026-03-25 16:32:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bb7a89b6-e31f-57d8-bffe-85f86e6d3999 with identifier: 1983590
2026-03-25 16:32:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bb7a89b6-e31f-57d8-bffe-85f86e6d3999 with scrape type 1
2026-03-25 16:32:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item bb7a89b6-e31f-57d8-bffe-85f86e6d3999
2026-03-25 16:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh7%252F0999f7aa078e4a8cbeec7501ad1bda12%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh7/0999f7aa078e4a8cbeec7501ad1bda12/images/large/1.jpg not downloaded yet
2026-03-25 16:32:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd4/9abb9f952ccf4302a733ced9c2a2e21c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh7%252F0999f7aa078e4a8cbeec7501ad1bda12%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh7/0999f7aa078e4a8cbeec7501ad1bda12/images/large/2.jpg not downloaded yet
2026-03-25 16:32:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcc4d450>
2026-03-25 16:32:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_694b6125-b8b4-5b36-922b-807c2e597f64/694b6125-b8b4-5b36-922b-807c2e597f64_image_3.jpg HTTP/1.1" 201 0
2026-03-25 16:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge8%252Febb03bf1d1c64e63b0aad99a8b2048ea%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge8/ebb03bf1d1c64e63b0aad99a8b2048ea/images/large/4.jpg saved to cache
2026-03-25 16:32:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 694b6125-b8b4-5b36-922b-807c2e597f64
2026-03-25 16:32:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc355dd0>
2026-03-25 16:32:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_694b6125-b8b4-5b36-922b-807c2e597f64/694b6125-b8b4-5b36-922b-807c2e597f64_image_4.jpg HTTP/1.1" 201 0
2026-03-25 16:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge8%252Febb03bf1d1c64e63b0aad99a8b2048ea%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge8/ebb03bf1d1c64e63b0aad99a8b2048ea/images/large/5.jpg saved to cache
2026-03-25 16:32:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 694b6125-b8b4-5b36-922b-807c2e597f64
2026-03-25 16:32:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dca51210>
2026-03-25 16:32:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_694b6125-b8b4-5b36-922b-807c2e597f64/694b6125-b8b4-5b36-922b-807c2e597f64_image_5.jpg HTTP/1.1" 201 0
2026-03-25 16:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge8%252Febb03bf1d1c64e63b0aad99a8b2048ea%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge8/ebb03bf1d1c64e63b0aad99a8b2048ea/images/large/6.jpg saved to cache
2026-03-25 16:32:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 694b6125-b8b4-5b36-922b-807c2e597f64
2026-03-25 16:32:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34d6b5a2d0>
2026-03-25 16:32:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_694b6125-b8b4-5b36-922b-807c2e597f64/694b6125-b8b4-5b36-922b-807c2e597f64_image_9.jpg HTTP/1.1" 201 0
2026-03-25 16:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge8%252Febb03bf1d1c64e63b0aad99a8b2048ea%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge8/ebb03bf1d1c64e63b0aad99a8b2048ea/images/large/10.jpg saved to cache
2026-03-25 16:32:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 694b6125-b8b4-5b36-922b-807c2e597f64
2026-03-25 16:32:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcb9b6d0>
2026-03-25 16:32:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_694b6125-b8b4-5b36-922b-807c2e597f64/694b6125-b8b4-5b36-922b-807c2e597f64_image_8.jpg HTTP/1.1" 201 0
2026-03-25 16:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge8%252Febb03bf1d1c64e63b0aad99a8b2048ea%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge8/ebb03bf1d1c64e63b0aad99a8b2048ea/images/large/9.jpg saved to cache
2026-03-25 16:32:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 694b6125-b8b4-5b36-922b-807c2e597f64
2026-03-25 16:32:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc9dc7d0>
2026-03-25 16:32:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_694b6125-b8b4-5b36-922b-807c2e597f64/694b6125-b8b4-5b36-922b-807c2e597f64_image_2.jpg HTTP/1.1" 201 0
2026-03-25 16:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge8%252Febb03bf1d1c64e63b0aad99a8b2048ea%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge8/ebb03bf1d1c64e63b0aad99a8b2048ea/images/large/3.jpg saved to cache
2026-03-25 16:32:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 694b6125-b8b4-5b36-922b-807c2e597f64
2026-03-25 16:32:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc825d90>
2026-03-25 16:32:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_694b6125-b8b4-5b36-922b-807c2e597f64/694b6125-b8b4-5b36-922b-807c2e597f64_image_1.jpg HTTP/1.1" 201 0
2026-03-25 16:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge8%252Febb03bf1d1c64e63b0aad99a8b2048ea%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge8/ebb03bf1d1c64e63b0aad99a8b2048ea/images/large/2.jpg saved to cache
2026-03-25 16:32:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 694b6125-b8b4-5b36-922b-807c2e597f64
2026-03-25 16:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh7%252F0999f7aa078e4a8cbeec7501ad1bda12%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh7/0999f7aa078e4a8cbeec7501ad1bda12/images/large/3.jpg not downloaded yet
2026-03-25 16:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh7%252F0999f7aa078e4a8cbeec7501ad1bda12%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh7/0999f7aa078e4a8cbeec7501ad1bda12/images/large/4.jpg not downloaded yet
2026-03-25 16:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh7%252F0999f7aa078e4a8cbeec7501ad1bda12%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh7/0999f7aa078e4a8cbeec7501ad1bda12/images/large/5.jpg not downloaded yet
2026-03-25 16:32:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc5bf310>
2026-03-25 16:32:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b897a862-6b31-5274-b294-b18498275ee3/b897a862-6b31-5274-b294-b18498275ee3_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd4%252F9abb9f952ccf4302a733ced9c2a2e21c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd4/9abb9f952ccf4302a733ced9c2a2e21c/images/large/1.jpg saved to cache
2026-03-25 16:32:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b897a862-6b31-5274-b294-b18498275ee3
2026-03-25 16:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh7%252F0999f7aa078e4a8cbeec7501ad1bda12%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh7/0999f7aa078e4a8cbeec7501ad1bda12/images/large/6.jpg not downloaded yet
2026-03-25 16:32:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd4/9abb9f952ccf4302a733ced9c2a2e21c/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd4/9abb9f952ccf4302a733ced9c2a2e21c/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh7%252F0999f7aa078e4a8cbeec7501ad1bda12%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh7/0999f7aa078e4a8cbeec7501ad1bda12/images/large/7.jpg not downloaded yet
2026-03-25 16:32:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd4/9abb9f952ccf4302a733ced9c2a2e21c/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh7%252F0999f7aa078e4a8cbeec7501ad1bda12%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh7/0999f7aa078e4a8cbeec7501ad1bda12/images/large/8.jpg not downloaded yet
2026-03-25 16:32:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd4/9abb9f952ccf4302a733ced9c2a2e21c/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd4/9abb9f952ccf4302a733ced9c2a2e21c/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd4/9abb9f952ccf4302a733ced9c2a2e21c/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh7%252F0999f7aa078e4a8cbeec7501ad1bda12%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh7/0999f7aa078e4a8cbeec7501ad1bda12/images/large/9.jpg not downloaded yet
2026-03-25 16:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh7%252F0999f7aa078e4a8cbeec7501ad1bda12%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh7/0999f7aa078e4a8cbeec7501ad1bda12/images/large/10.jpg not downloaded yet
2026-03-25 16:32:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh3/c5b4eed1b7d64908abba4361c9d51e42/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:21 [ayvens.it] INFO: Found listing with ID: 1983591
2026-03-25 16:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983591%27 HTTP/1.1" 200 None
2026-03-25 16:32:21 [ayvens.it] INFO: Scrape type for 1983591: 1
2026-03-25 16:32:21 [ayvens.it] INFO: Extracting data for car ID: 1983591
2026-03-25 16:32:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 409e61fa-395b-59d9-9110-2ad9ea4eadcc with identifier: 1983591
2026-03-25 16:32:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 409e61fa-395b-59d9-9110-2ad9ea4eadcc with scrape type 1
2026-03-25 16:32:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 409e61fa-395b-59d9-9110-2ad9ea4eadcc
2026-03-25 16:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb6%252F6a68286b033a4d41b7a094b5c3c51f56%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb6/6a68286b033a4d41b7a094b5c3c51f56/images/large/1.jpg not downloaded yet
2026-03-25 16:32:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34d7458ed0>
2026-03-25 16:32:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b897a862-6b31-5274-b294-b18498275ee3/b897a862-6b31-5274-b294-b18498275ee3_image_5.jpg HTTP/1.1" 201 0
2026-03-25 16:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd4%252F9abb9f952ccf4302a733ced9c2a2e21c%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd4/9abb9f952ccf4302a733ced9c2a2e21c/images/large/6.jpg saved to cache
2026-03-25 16:32:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b897a862-6b31-5274-b294-b18498275ee3
2026-03-25 16:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb6%252F6a68286b033a4d41b7a094b5c3c51f56%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb6/6a68286b033a4d41b7a094b5c3c51f56/images/large/2.jpg not downloaded yet
2026-03-25 16:32:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34de16e810>
2026-03-25 16:32:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b897a862-6b31-5274-b294-b18498275ee3/b897a862-6b31-5274-b294-b18498275ee3_image_6.jpg HTTP/1.1" 201 0
2026-03-25 16:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd4%252F9abb9f952ccf4302a733ced9c2a2e21c%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd4/9abb9f952ccf4302a733ced9c2a2e21c/images/large/7.jpg saved to cache
2026-03-25 16:32:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b897a862-6b31-5274-b294-b18498275ee3
2026-03-25 16:32:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcb17c10>
2026-03-25 16:32:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b897a862-6b31-5274-b294-b18498275ee3/b897a862-6b31-5274-b294-b18498275ee3_image_7.jpg HTTP/1.1" 201 0
2026-03-25 16:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd4%252F9abb9f952ccf4302a733ced9c2a2e21c%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd4/9abb9f952ccf4302a733ced9c2a2e21c/images/large/8.jpg saved to cache
2026-03-25 16:32:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b897a862-6b31-5274-b294-b18498275ee3
2026-03-25 16:32:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34de459ad0>
2026-03-25 16:32:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b897a862-6b31-5274-b294-b18498275ee3/b897a862-6b31-5274-b294-b18498275ee3_image_4.jpg HTTP/1.1" 201 0
2026-03-25 16:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd4%252F9abb9f952ccf4302a733ced9c2a2e21c%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd4/9abb9f952ccf4302a733ced9c2a2e21c/images/large/5.jpg saved to cache
2026-03-25 16:32:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b897a862-6b31-5274-b294-b18498275ee3
2026-03-25 16:32:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcb15790>
2026-03-25 16:32:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b897a862-6b31-5274-b294-b18498275ee3/b897a862-6b31-5274-b294-b18498275ee3_image_3.jpg HTTP/1.1" 201 0
2026-03-25 16:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd4%252F9abb9f952ccf4302a733ced9c2a2e21c%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd4/9abb9f952ccf4302a733ced9c2a2e21c/images/large/4.jpg saved to cache
2026-03-25 16:32:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b897a862-6b31-5274-b294-b18498275ee3
2026-03-25 16:32:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcb1d8d0>
2026-03-25 16:32:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b897a862-6b31-5274-b294-b18498275ee3/b897a862-6b31-5274-b294-b18498275ee3_image_2.jpg HTTP/1.1" 201 0
2026-03-25 16:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd4%252F9abb9f952ccf4302a733ced9c2a2e21c%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd4/9abb9f952ccf4302a733ced9c2a2e21c/images/large/3.jpg saved to cache
2026-03-25 16:32:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b897a862-6b31-5274-b294-b18498275ee3
2026-03-25 16:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb6%252F6a68286b033a4d41b7a094b5c3c51f56%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb6/6a68286b033a4d41b7a094b5c3c51f56/images/large/3.jpg not downloaded yet
2026-03-25 16:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb6%252F6a68286b033a4d41b7a094b5c3c51f56%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb6/6a68286b033a4d41b7a094b5c3c51f56/images/large/4.jpg not downloaded yet
2026-03-25 16:32:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc8e2390>
2026-03-25 16:32:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8266c022-3d29-5bf4-b747-4794e2a2c615/8266c022-3d29-5bf4-b747-4794e2a2c615_image_2.jpg HTTP/1.1" 201 0
2026-03-25 16:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh3%252Fc5b4eed1b7d64908abba4361c9d51e42%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh3/c5b4eed1b7d64908abba4361c9d51e42/images/large/3.jpg saved to cache
2026-03-25 16:32:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8266c022-3d29-5bf4-b747-4794e2a2c615
2026-03-25 16:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb6%252F6a68286b033a4d41b7a094b5c3c51f56%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb6/6a68286b033a4d41b7a094b5c3c51f56/images/large/5.jpg not downloaded yet
2026-03-25 16:32:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh3/c5b4eed1b7d64908abba4361c9d51e42/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh3/c5b4eed1b7d64908abba4361c9d51e42/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb6%252F6a68286b033a4d41b7a094b5c3c51f56%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb6/6a68286b033a4d41b7a094b5c3c51f56/images/large/6.jpg not downloaded yet
2026-03-25 16:32:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd4/9abb9f952ccf4302a733ced9c2a2e21c/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh3/c5b4eed1b7d64908abba4361c9d51e42/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb6%252F6a68286b033a4d41b7a094b5c3c51f56%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb6/6a68286b033a4d41b7a094b5c3c51f56/images/large/7.jpg not downloaded yet
2026-03-25 16:32:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh3/c5b4eed1b7d64908abba4361c9d51e42/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh3/c5b4eed1b7d64908abba4361c9d51e42/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd4/9abb9f952ccf4302a733ced9c2a2e21c/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh3/c5b4eed1b7d64908abba4361c9d51e42/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb6%252F6a68286b033a4d41b7a094b5c3c51f56%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb6/6a68286b033a4d41b7a094b5c3c51f56/images/large/8.jpg not downloaded yet
2026-03-25 16:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb6%252F6a68286b033a4d41b7a094b5c3c51f56%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb6/6a68286b033a4d41b7a094b5c3c51f56/images/large/9.jpg not downloaded yet
2026-03-25 16:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb6%252F6a68286b033a4d41b7a094b5c3c51f56%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb6/6a68286b033a4d41b7a094b5c3c51f56/images/large/10.jpg not downloaded yet
2026-03-25 16:32:22 [ayvens.it] INFO: Found listing with ID: 1983592
2026-03-25 16:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983592%27 HTTP/1.1" 200 None
2026-03-25 16:32:23 [ayvens.it] INFO: Scrape type for 1983592: 1
2026-03-25 16:32:23 [ayvens.it] INFO: Extracting data for car ID: 1983592
2026-03-25 16:32:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d0ad1e1a-6f31-55a9-b1a9-0b48df6a3009 with identifier: 1983592
2026-03-25 16:32:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d0ad1e1a-6f31-55a9-b1a9-0b48df6a3009 with scrape type 1
2026-03-25 16:32:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d0ad1e1a-6f31-55a9-b1a9-0b48df6a3009
2026-03-25 16:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf9%252F4b262b73892a421f826ddca5a39bb453%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf9/4b262b73892a421f826ddca5a39bb453/images/large/1.jpg not downloaded yet
2026-03-25 16:32:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34de16b590>
2026-03-25 16:32:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8266c022-3d29-5bf4-b747-4794e2a2c615/8266c022-3d29-5bf4-b747-4794e2a2c615_image_1.jpg HTTP/1.1" 201 0
2026-03-25 16:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh3%252Fc5b4eed1b7d64908abba4361c9d51e42%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh3/c5b4eed1b7d64908abba4361c9d51e42/images/large/2.jpg saved to cache
2026-03-25 16:32:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8266c022-3d29-5bf4-b747-4794e2a2c615
2026-03-25 16:32:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc551190>
2026-03-25 16:32:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8266c022-3d29-5bf4-b747-4794e2a2c615/8266c022-3d29-5bf4-b747-4794e2a2c615_image_6.jpg HTTP/1.1" 201 0
2026-03-25 16:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh3%252Fc5b4eed1b7d64908abba4361c9d51e42%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh3/c5b4eed1b7d64908abba4361c9d51e42/images/large/7.jpg saved to cache
2026-03-25 16:32:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8266c022-3d29-5bf4-b747-4794e2a2c615
2026-03-25 16:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf9%252F4b262b73892a421f826ddca5a39bb453%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf9/4b262b73892a421f826ddca5a39bb453/images/large/2.jpg not downloaded yet
2026-03-25 16:32:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc365750>
2026-03-25 16:32:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b897a862-6b31-5274-b294-b18498275ee3/b897a862-6b31-5274-b294-b18498275ee3_image_9.jpg HTTP/1.1" 201 0
2026-03-25 16:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd4%252F9abb9f952ccf4302a733ced9c2a2e21c%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd4/9abb9f952ccf4302a733ced9c2a2e21c/images/large/10.jpg saved to cache
2026-03-25 16:32:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b897a862-6b31-5274-b294-b18498275ee3
2026-03-25 16:32:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc57afd0>
2026-03-25 16:32:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8266c022-3d29-5bf4-b747-4794e2a2c615/8266c022-3d29-5bf4-b747-4794e2a2c615_image_5.jpg HTTP/1.1" 201 0
2026-03-25 16:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh3%252Fc5b4eed1b7d64908abba4361c9d51e42%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh3/c5b4eed1b7d64908abba4361c9d51e42/images/large/6.jpg saved to cache
2026-03-25 16:32:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8266c022-3d29-5bf4-b747-4794e2a2c615
2026-03-25 16:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf9%252F4b262b73892a421f826ddca5a39bb453%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf9/4b262b73892a421f826ddca5a39bb453/images/large/3.jpg not downloaded yet
2026-03-25 16:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf9%252F4b262b73892a421f826ddca5a39bb453%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf9/4b262b73892a421f826ddca5a39bb453/images/large/4.jpg not downloaded yet
2026-03-25 16:32:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc990590>
2026-03-25 16:32:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8266c022-3d29-5bf4-b747-4794e2a2c615/8266c022-3d29-5bf4-b747-4794e2a2c615_image_4.jpg HTTP/1.1" 201 0
2026-03-25 16:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh3%252Fc5b4eed1b7d64908abba4361c9d51e42%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh3/c5b4eed1b7d64908abba4361c9d51e42/images/large/5.jpg saved to cache
2026-03-25 16:32:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8266c022-3d29-5bf4-b747-4794e2a2c615
2026-03-25 16:32:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc86aed0>
2026-03-25 16:32:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8266c022-3d29-5bf4-b747-4794e2a2c615/8266c022-3d29-5bf4-b747-4794e2a2c615_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh3%252Fc5b4eed1b7d64908abba4361c9d51e42%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh3/c5b4eed1b7d64908abba4361c9d51e42/images/large/1.jpg saved to cache
2026-03-25 16:32:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8266c022-3d29-5bf4-b747-4794e2a2c615
2026-03-25 16:32:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcc0bc90>
2026-03-25 16:32:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b897a862-6b31-5274-b294-b18498275ee3/b897a862-6b31-5274-b294-b18498275ee3_image_8.jpg HTTP/1.1" 201 0
2026-03-25 16:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd4%252F9abb9f952ccf4302a733ced9c2a2e21c%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd4/9abb9f952ccf4302a733ced9c2a2e21c/images/large/9.jpg saved to cache
2026-03-25 16:32:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b897a862-6b31-5274-b294-b18498275ee3
2026-03-25 16:32:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc9d5210>
2026-03-25 16:32:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8266c022-3d29-5bf4-b747-4794e2a2c615/8266c022-3d29-5bf4-b747-4794e2a2c615_image_3.jpg HTTP/1.1" 201 0
2026-03-25 16:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh3%252Fc5b4eed1b7d64908abba4361c9d51e42%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh3/c5b4eed1b7d64908abba4361c9d51e42/images/large/4.jpg saved to cache
2026-03-25 16:32:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8266c022-3d29-5bf4-b747-4794e2a2c615
2026-03-25 16:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf9%252F4b262b73892a421f826ddca5a39bb453%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf9/4b262b73892a421f826ddca5a39bb453/images/large/5.jpg not downloaded yet
2026-03-25 16:32:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh7/0999f7aa078e4a8cbeec7501ad1bda12/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh7/0999f7aa078e4a8cbeec7501ad1bda12/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb6/6a68286b033a4d41b7a094b5c3c51f56/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh7/0999f7aa078e4a8cbeec7501ad1bda12/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf9%252F4b262b73892a421f826ddca5a39bb453%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf9/4b262b73892a421f826ddca5a39bb453/images/large/6.jpg not downloaded yet
2026-03-25 16:32:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh7/0999f7aa078e4a8cbeec7501ad1bda12/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh7/0999f7aa078e4a8cbeec7501ad1bda12/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf9%252F4b262b73892a421f826ddca5a39bb453%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf9/4b262b73892a421f826ddca5a39bb453/images/large/7.jpg not downloaded yet
2026-03-25 16:32:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh7/0999f7aa078e4a8cbeec7501ad1bda12/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf9%252F4b262b73892a421f826ddca5a39bb453%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf9/4b262b73892a421f826ddca5a39bb453/images/large/8.jpg not downloaded yet
2026-03-25 16:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf9%252F4b262b73892a421f826ddca5a39bb453%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf9/4b262b73892a421f826ddca5a39bb453/images/large/9.jpg not downloaded yet
2026-03-25 16:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf9%252F4b262b73892a421f826ddca5a39bb453%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf9/4b262b73892a421f826ddca5a39bb453/images/large/10.jpg not downloaded yet
2026-03-25 16:32:23 [ayvens.it] INFO: Found listing with ID: 1983593
2026-03-25 16:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983593%27 HTTP/1.1" 200 None
2026-03-25 16:32:23 [ayvens.it] INFO: Scrape type for 1983593: 1
2026-03-25 16:32:23 [ayvens.it] INFO: Extracting data for car ID: 1983593
2026-03-25 16:32:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ff785b7b-f50c-50ab-a168-5cc0bbc70012 with identifier: 1983593
2026-03-25 16:32:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ff785b7b-f50c-50ab-a168-5cc0bbc70012 with scrape type 1
2026-03-25 16:32:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ff785b7b-f50c-50ab-a168-5cc0bbc70012
2026-03-25 16:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh1%252Ff2683a18a6de4a6dadac7c56020eaa40%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh1/f2683a18a6de4a6dadac7c56020eaa40/images/large/1.jpg not downloaded yet
2026-03-25 16:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh1%252Ff2683a18a6de4a6dadac7c56020eaa40%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh1/f2683a18a6de4a6dadac7c56020eaa40/images/large/2.jpg not downloaded yet
2026-03-25 16:32:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcaab550>
2026-03-25 16:32:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb7a89b6-e31f-57d8-bffe-85f86e6d3999/bb7a89b6-e31f-57d8-bffe-85f86e6d3999_image_6.jpg HTTP/1.1" 201 0
2026-03-25 16:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh7%252F0999f7aa078e4a8cbeec7501ad1bda12%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh7/0999f7aa078e4a8cbeec7501ad1bda12/images/large/7.jpg saved to cache
2026-03-25 16:32:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item bb7a89b6-e31f-57d8-bffe-85f86e6d3999
2026-03-25 16:32:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dce2ec10>
2026-03-25 16:32:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb7a89b6-e31f-57d8-bffe-85f86e6d3999/bb7a89b6-e31f-57d8-bffe-85f86e6d3999_image_4.jpg HTTP/1.1" 201 0
2026-03-25 16:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh7%252F0999f7aa078e4a8cbeec7501ad1bda12%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh7/0999f7aa078e4a8cbeec7501ad1bda12/images/large/5.jpg saved to cache
2026-03-25 16:32:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item bb7a89b6-e31f-57d8-bffe-85f86e6d3999
2026-03-25 16:32:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc637b10>
2026-03-25 16:32:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_409e61fa-395b-59d9-9110-2ad9ea4eadcc/409e61fa-395b-59d9-9110-2ad9ea4eadcc_image_2.jpg HTTP/1.1" 201 0
2026-03-25 16:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb6%252F6a68286b033a4d41b7a094b5c3c51f56%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb6/6a68286b033a4d41b7a094b5c3c51f56/images/large/3.jpg saved to cache
2026-03-25 16:32:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 409e61fa-395b-59d9-9110-2ad9ea4eadcc
2026-03-25 16:32:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc38c5d0>
2026-03-25 16:32:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb7a89b6-e31f-57d8-bffe-85f86e6d3999/bb7a89b6-e31f-57d8-bffe-85f86e6d3999_image_5.jpg HTTP/1.1" 201 0
2026-03-25 16:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh7%252F0999f7aa078e4a8cbeec7501ad1bda12%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh7/0999f7aa078e4a8cbeec7501ad1bda12/images/large/6.jpg saved to cache
2026-03-25 16:32:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item bb7a89b6-e31f-57d8-bffe-85f86e6d3999
2026-03-25 16:32:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc6379d0>
2026-03-25 16:32:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb7a89b6-e31f-57d8-bffe-85f86e6d3999/bb7a89b6-e31f-57d8-bffe-85f86e6d3999_image_7.jpg HTTP/1.1" 201 0
2026-03-25 16:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh7%252F0999f7aa078e4a8cbeec7501ad1bda12%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh7/0999f7aa078e4a8cbeec7501ad1bda12/images/large/8.jpg saved to cache
2026-03-25 16:32:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item bb7a89b6-e31f-57d8-bffe-85f86e6d3999
2026-03-25 16:32:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dce2f8d0>
2026-03-25 16:32:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb7a89b6-e31f-57d8-bffe-85f86e6d3999/bb7a89b6-e31f-57d8-bffe-85f86e6d3999_image_1.jpg HTTP/1.1" 201 0
2026-03-25 16:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh7%252F0999f7aa078e4a8cbeec7501ad1bda12%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh7/0999f7aa078e4a8cbeec7501ad1bda12/images/large/2.jpg saved to cache
2026-03-25 16:32:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item bb7a89b6-e31f-57d8-bffe-85f86e6d3999
2026-03-25 16:32:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc637810>
2026-03-25 16:32:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb7a89b6-e31f-57d8-bffe-85f86e6d3999/bb7a89b6-e31f-57d8-bffe-85f86e6d3999_image_3.jpg HTTP/1.1" 201 0
2026-03-25 16:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh7%252F0999f7aa078e4a8cbeec7501ad1bda12%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh7/0999f7aa078e4a8cbeec7501ad1bda12/images/large/4.jpg saved to cache
2026-03-25 16:32:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item bb7a89b6-e31f-57d8-bffe-85f86e6d3999
2026-03-25 16:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh1%252Ff2683a18a6de4a6dadac7c56020eaa40%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh1/f2683a18a6de4a6dadac7c56020eaa40/images/large/3.jpg not downloaded yet
2026-03-25 16:32:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf9/4b262b73892a421f826ddca5a39bb453/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh7/0999f7aa078e4a8cbeec7501ad1bda12/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh1%252Ff2683a18a6de4a6dadac7c56020eaa40%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh1/f2683a18a6de4a6dadac7c56020eaa40/images/large/4.jpg not downloaded yet
2026-03-25 16:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh1%252Ff2683a18a6de4a6dadac7c56020eaa40%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh1/f2683a18a6de4a6dadac7c56020eaa40/images/large/5.jpg not downloaded yet
2026-03-25 16:32:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf9/4b262b73892a421f826ddca5a39bb453/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh1%252Ff2683a18a6de4a6dadac7c56020eaa40%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh1/f2683a18a6de4a6dadac7c56020eaa40/images/large/6.jpg not downloaded yet
2026-03-25 16:32:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb6/6a68286b033a4d41b7a094b5c3c51f56/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh1%252Ff2683a18a6de4a6dadac7c56020eaa40%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh1/f2683a18a6de4a6dadac7c56020eaa40/images/large/7.jpg not downloaded yet
2026-03-25 16:32:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb6/6a68286b033a4d41b7a094b5c3c51f56/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb6/6a68286b033a4d41b7a094b5c3c51f56/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb6/6a68286b033a4d41b7a094b5c3c51f56/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh1%252Ff2683a18a6de4a6dadac7c56020eaa40%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh1/f2683a18a6de4a6dadac7c56020eaa40/images/large/8.jpg not downloaded yet
2026-03-25 16:32:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb6/6a68286b033a4d41b7a094b5c3c51f56/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh1%252Ff2683a18a6de4a6dadac7c56020eaa40%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh1/f2683a18a6de4a6dadac7c56020eaa40/images/large/9.jpg not downloaded yet
2026-03-25 16:32:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dca76a90>
2026-03-25 16:32:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0ad1e1a-6f31-55a9-b1a9-0b48df6a3009/d0ad1e1a-6f31-55a9-b1a9-0b48df6a3009_image_1.jpg HTTP/1.1" 201 0
2026-03-25 16:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf9%252F4b262b73892a421f826ddca5a39bb453%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf9/4b262b73892a421f826ddca5a39bb453/images/large/2.jpg saved to cache
2026-03-25 16:32:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d0ad1e1a-6f31-55a9-b1a9-0b48df6a3009
2026-03-25 16:32:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc325110>
2026-03-25 16:32:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb7a89b6-e31f-57d8-bffe-85f86e6d3999/bb7a89b6-e31f-57d8-bffe-85f86e6d3999_image_2.jpg HTTP/1.1" 201 0
2026-03-25 16:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh7%252F0999f7aa078e4a8cbeec7501ad1bda12%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh7/0999f7aa078e4a8cbeec7501ad1bda12/images/large/3.jpg saved to cache
2026-03-25 16:32:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item bb7a89b6-e31f-57d8-bffe-85f86e6d3999
2026-03-25 16:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh1%252Ff2683a18a6de4a6dadac7c56020eaa40%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh1/f2683a18a6de4a6dadac7c56020eaa40/images/large/10.jpg not downloaded yet
2026-03-25 16:32:24 [ayvens.it] INFO: Found listing with ID: 1983594
2026-03-25 16:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983594%27 HTTP/1.1" 200 None
2026-03-25 16:32:24 [ayvens.it] INFO: Scrape type for 1983594: 1
2026-03-25 16:32:24 [ayvens.it] INFO: Extracting data for car ID: 1983594
2026-03-25 16:32:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 15452c3d-ec87-5d70-abd9-1543b0ab346e with identifier: 1983594
2026-03-25 16:32:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 15452c3d-ec87-5d70-abd9-1543b0ab346e with scrape type 1
2026-03-25 16:32:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 15452c3d-ec87-5d70-abd9-1543b0ab346e
2026-03-25 16:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge4%252F467712f144064d3ba4f7a25126e58e62%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge4/467712f144064d3ba4f7a25126e58e62/images/large/1.jpg not downloaded yet
2026-03-25 16:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge4%252F467712f144064d3ba4f7a25126e58e62%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge4/467712f144064d3ba4f7a25126e58e62/images/large/2.jpg not downloaded yet
2026-03-25 16:32:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc64b690>
2026-03-25 16:32:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0ad1e1a-6f31-55a9-b1a9-0b48df6a3009/d0ad1e1a-6f31-55a9-b1a9-0b48df6a3009_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf9%252F4b262b73892a421f826ddca5a39bb453%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf9/4b262b73892a421f826ddca5a39bb453/images/large/1.jpg saved to cache
2026-03-25 16:32:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d0ad1e1a-6f31-55a9-b1a9-0b48df6a3009
2026-03-25 16:32:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc5849d0>
2026-03-25 16:32:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_409e61fa-395b-59d9-9110-2ad9ea4eadcc/409e61fa-395b-59d9-9110-2ad9ea4eadcc_image_4.jpg HTTP/1.1" 201 0
2026-03-25 16:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb6%252F6a68286b033a4d41b7a094b5c3c51f56%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb6/6a68286b033a4d41b7a094b5c3c51f56/images/large/5.jpg saved to cache
2026-03-25 16:32:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 409e61fa-395b-59d9-9110-2ad9ea4eadcc
2026-03-25 16:32:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc8e14d0>
2026-03-25 16:32:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_409e61fa-395b-59d9-9110-2ad9ea4eadcc/409e61fa-395b-59d9-9110-2ad9ea4eadcc_image_5.jpg HTTP/1.1" 201 0
2026-03-25 16:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb6%252F6a68286b033a4d41b7a094b5c3c51f56%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb6/6a68286b033a4d41b7a094b5c3c51f56/images/large/6.jpg saved to cache
2026-03-25 16:32:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 409e61fa-395b-59d9-9110-2ad9ea4eadcc
2026-03-25 16:32:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34de458a90>
2026-03-25 16:32:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_409e61fa-395b-59d9-9110-2ad9ea4eadcc/409e61fa-395b-59d9-9110-2ad9ea4eadcc_image_9.jpg HTTP/1.1" 201 0
2026-03-25 16:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb6%252F6a68286b033a4d41b7a094b5c3c51f56%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb6/6a68286b033a4d41b7a094b5c3c51f56/images/large/10.jpg saved to cache
2026-03-25 16:32:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 409e61fa-395b-59d9-9110-2ad9ea4eadcc
2026-03-25 16:32:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc648f50>
2026-03-25 16:32:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_409e61fa-395b-59d9-9110-2ad9ea4eadcc/409e61fa-395b-59d9-9110-2ad9ea4eadcc_image_1.jpg HTTP/1.1" 201 0
2026-03-25 16:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb6%252F6a68286b033a4d41b7a094b5c3c51f56%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb6/6a68286b033a4d41b7a094b5c3c51f56/images/large/2.jpg saved to cache
2026-03-25 16:32:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 409e61fa-395b-59d9-9110-2ad9ea4eadcc
2026-03-25 16:32:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcb2e0d0>
2026-03-25 16:32:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_409e61fa-395b-59d9-9110-2ad9ea4eadcc/409e61fa-395b-59d9-9110-2ad9ea4eadcc_image_3.jpg HTTP/1.1" 201 0
2026-03-25 16:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb6%252F6a68286b033a4d41b7a094b5c3c51f56%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb6/6a68286b033a4d41b7a094b5c3c51f56/images/large/4.jpg saved to cache
2026-03-25 16:32:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 409e61fa-395b-59d9-9110-2ad9ea4eadcc
2026-03-25 16:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge4%252F467712f144064d3ba4f7a25126e58e62%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge4/467712f144064d3ba4f7a25126e58e62/images/large/3.jpg not downloaded yet
2026-03-25 16:32:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf9/4b262b73892a421f826ddca5a39bb453/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf9/4b262b73892a421f826ddca5a39bb453/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge4%252F467712f144064d3ba4f7a25126e58e62%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge4/467712f144064d3ba4f7a25126e58e62/images/large/4.jpg not downloaded yet
2026-03-25 16:32:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb6/6a68286b033a4d41b7a094b5c3c51f56/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf9/4b262b73892a421f826ddca5a39bb453/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf9/4b262b73892a421f826ddca5a39bb453/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb6/6a68286b033a4d41b7a094b5c3c51f56/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge4%252F467712f144064d3ba4f7a25126e58e62%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge4/467712f144064d3ba4f7a25126e58e62/images/large/5.jpg not downloaded yet
2026-03-25 16:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge4%252F467712f144064d3ba4f7a25126e58e62%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge4/467712f144064d3ba4f7a25126e58e62/images/large/6.jpg not downloaded yet
2026-03-25 16:32:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb6/6a68286b033a4d41b7a094b5c3c51f56/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge4%252F467712f144064d3ba4f7a25126e58e62%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge4/467712f144064d3ba4f7a25126e58e62/images/large/7.jpg not downloaded yet
2026-03-25 16:32:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb6/6a68286b033a4d41b7a094b5c3c51f56/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge4%252F467712f144064d3ba4f7a25126e58e62%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge4/467712f144064d3ba4f7a25126e58e62/images/large/8.jpg not downloaded yet
2026-03-25 16:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge4%252F467712f144064d3ba4f7a25126e58e62%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge4/467712f144064d3ba4f7a25126e58e62/images/large/9.jpg not downloaded yet
2026-03-25 16:32:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc8e3010>
2026-03-25 16:32:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0ad1e1a-6f31-55a9-b1a9-0b48df6a3009/d0ad1e1a-6f31-55a9-b1a9-0b48df6a3009_image_3.jpg HTTP/1.1" 201 0
2026-03-25 16:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf9%252F4b262b73892a421f826ddca5a39bb453%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf9/4b262b73892a421f826ddca5a39bb453/images/large/4.jpg saved to cache
2026-03-25 16:32:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d0ad1e1a-6f31-55a9-b1a9-0b48df6a3009
2026-03-25 16:32:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc8d4a10>
2026-03-25 16:32:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0ad1e1a-6f31-55a9-b1a9-0b48df6a3009/d0ad1e1a-6f31-55a9-b1a9-0b48df6a3009_image_5.jpg HTTP/1.1" 201 0
2026-03-25 16:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf9%252F4b262b73892a421f826ddca5a39bb453%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf9/4b262b73892a421f826ddca5a39bb453/images/large/6.jpg saved to cache
2026-03-25 16:32:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d0ad1e1a-6f31-55a9-b1a9-0b48df6a3009
2026-03-25 16:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge4%252F467712f144064d3ba4f7a25126e58e62%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge4/467712f144064d3ba4f7a25126e58e62/images/large/10.jpg not downloaded yet
2026-03-25 16:32:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc5bc910>
2026-03-25 16:32:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_409e61fa-395b-59d9-9110-2ad9ea4eadcc/409e61fa-395b-59d9-9110-2ad9ea4eadcc_image_8.jpg HTTP/1.1" 201 0
2026-03-25 16:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb6%252F6a68286b033a4d41b7a094b5c3c51f56%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb6/6a68286b033a4d41b7a094b5c3c51f56/images/large/9.jpg saved to cache
2026-03-25 16:32:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 409e61fa-395b-59d9-9110-2ad9ea4eadcc
2026-03-25 16:32:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc784510>
2026-03-25 16:32:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0ad1e1a-6f31-55a9-b1a9-0b48df6a3009/d0ad1e1a-6f31-55a9-b1a9-0b48df6a3009_image_2.jpg HTTP/1.1" 201 0
2026-03-25 16:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf9%252F4b262b73892a421f826ddca5a39bb453%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf9/4b262b73892a421f826ddca5a39bb453/images/large/3.jpg saved to cache
2026-03-25 16:32:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d0ad1e1a-6f31-55a9-b1a9-0b48df6a3009
2026-03-25 16:32:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc37c890>
2026-03-25 16:32:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0ad1e1a-6f31-55a9-b1a9-0b48df6a3009/d0ad1e1a-6f31-55a9-b1a9-0b48df6a3009_image_4.jpg HTTP/1.1" 201 0
2026-03-25 16:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf9%252F4b262b73892a421f826ddca5a39bb453%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf9/4b262b73892a421f826ddca5a39bb453/images/large/5.jpg saved to cache
2026-03-25 16:32:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d0ad1e1a-6f31-55a9-b1a9-0b48df6a3009
2026-03-25 16:32:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dca19f10>
2026-03-25 16:32:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_409e61fa-395b-59d9-9110-2ad9ea4eadcc/409e61fa-395b-59d9-9110-2ad9ea4eadcc_image_7.jpg HTTP/1.1" 201 0
2026-03-25 16:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb6%252F6a68286b033a4d41b7a094b5c3c51f56%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb6/6a68286b033a4d41b7a094b5c3c51f56/images/large/8.jpg saved to cache
2026-03-25 16:32:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 409e61fa-395b-59d9-9110-2ad9ea4eadcc
2026-03-25 16:32:26 [ayvens.it] INFO: Found listing with ID: 1983595
2026-03-25 16:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983595%27 HTTP/1.1" 200 None
2026-03-25 16:32:26 [ayvens.it] INFO: Scrape type for 1983595: 1
2026-03-25 16:32:26 [ayvens.it] INFO: Extracting data for car ID: 1983595
2026-03-25 16:32:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 483d98d2-0a14-51c4-8cf4-095412922344 with identifier: 1983595
2026-03-25 16:32:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 483d98d2-0a14-51c4-8cf4-095412922344 with scrape type 1
2026-03-25 16:32:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 483d98d2-0a14-51c4-8cf4-095412922344
2026-03-25 16:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh2%252Fd1e0231afadc4f2592fd6e0e6932e229%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh2/d1e0231afadc4f2592fd6e0e6932e229/images/large/1.jpg not downloaded yet
2026-03-25 16:32:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh1/f2683a18a6de4a6dadac7c56020eaa40/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh2%252Fd1e0231afadc4f2592fd6e0e6932e229%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh2/d1e0231afadc4f2592fd6e0e6932e229/images/large/2.jpg not downloaded yet
2026-03-25 16:32:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc784310>
2026-03-25 16:32:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_409e61fa-395b-59d9-9110-2ad9ea4eadcc/409e61fa-395b-59d9-9110-2ad9ea4eadcc_image_6.jpg HTTP/1.1" 201 0
2026-03-25 16:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb6%252F6a68286b033a4d41b7a094b5c3c51f56%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb6/6a68286b033a4d41b7a094b5c3c51f56/images/large/7.jpg saved to cache
2026-03-25 16:32:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 409e61fa-395b-59d9-9110-2ad9ea4eadcc
2026-03-25 16:32:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcbdd1d0>
2026-03-25 16:32:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_409e61fa-395b-59d9-9110-2ad9ea4eadcc/409e61fa-395b-59d9-9110-2ad9ea4eadcc_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb6%252F6a68286b033a4d41b7a094b5c3c51f56%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb6/6a68286b033a4d41b7a094b5c3c51f56/images/large/1.jpg saved to cache
2026-03-25 16:32:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 409e61fa-395b-59d9-9110-2ad9ea4eadcc
2026-03-25 16:32:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 409e61fa-395b-59d9-9110-2ad9ea4eadcc, skipping ID generation
2026-03-25 16:32:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 409e61fa-395b-59d9-9110-2ad9ea4eadcc with scrape type 1
2026-03-25 16:32:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 409e61fa-395b-59d9-9110-2ad9ea4eadcc sending to next pipeline
2026-03-25 16:32:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 409e61fa-395b-59d9-9110-2ad9ea4eadcc, identifier: 1983591
2026-03-25 16:32:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 409e61fa-395b-59d9-9110-2ad9ea4eadcc with identifier: 1983591
2026-03-25 16:32:26 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:32:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 409e61fa-395b-59d9-9110-2ad9ea4eadcc with identifier: 1983591
2026-03-25 16:32:27 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 409e61fa-395b-59d9-9110-2ad9ea4eadcc with identifier: 1983591 to the API
2026-03-25 16:32:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:32:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:32:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gb6/6a68286b033a4d41b7a094b5c3c51f56/images/large/1.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'BIANCO GELATO PASTELLO',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-27T09:30:00Z',
'fuel_type': 'petrol_lpg',
'id': '409e61fa-395b-59d9-9110-2ad9ea4eadcc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41025',
'listing': 'auction',
'location': None,
'make': 'FIAT',
'model': 'FIAT PANDA CONSIP14 1.2 69 CV EASYPOWER E6D-TEMP EASY FP',
'odometer': 38391,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 22,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_409e61fa-395b-59d9-9110-2ad9ea4eadcc/409e61fa-395b-59d9-9110-2ad9ea4eadcc_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 806701,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb6/6a68286b033a4d41b7a094b5c3c51f56/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_409e61fa-395b-59d9-9110-2ad9ea4eadcc/409e61fa-395b-59d9-9110-2ad9ea4eadcc_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 627507,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb6/6a68286b033a4d41b7a094b5c3c51f56/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_409e61fa-395b-59d9-9110-2ad9ea4eadcc/409e61fa-395b-59d9-9110-2ad9ea4eadcc_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 518140,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb6/6a68286b033a4d41b7a094b5c3c51f56/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_409e61fa-395b-59d9-9110-2ad9ea4eadcc/409e61fa-395b-59d9-9110-2ad9ea4eadcc_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 778525,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb6/6a68286b033a4d41b7a094b5c3c51f56/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_409e61fa-395b-59d9-9110-2ad9ea4eadcc/409e61fa-395b-59d9-9110-2ad9ea4eadcc_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 706102,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb6/6a68286b033a4d41b7a094b5c3c51f56/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_409e61fa-395b-59d9-9110-2ad9ea4eadcc/409e61fa-395b-59d9-9110-2ad9ea4eadcc_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 567639,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb6/6a68286b033a4d41b7a094b5c3c51f56/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_409e61fa-395b-59d9-9110-2ad9ea4eadcc/409e61fa-395b-59d9-9110-2ad9ea4eadcc_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 660764,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb6/6a68286b033a4d41b7a094b5c3c51f56/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_409e61fa-395b-59d9-9110-2ad9ea4eadcc/409e61fa-395b-59d9-9110-2ad9ea4eadcc_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 477720,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb6/6a68286b033a4d41b7a094b5c3c51f56/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_409e61fa-395b-59d9-9110-2ad9ea4eadcc/409e61fa-395b-59d9-9110-2ad9ea4eadcc_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 715096,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb6/6a68286b033a4d41b7a094b5c3c51f56/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_409e61fa-395b-59d9-9110-2ad9ea4eadcc/409e61fa-395b-59d9-9110-2ad9ea4eadcc_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 743840,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb6/6a68286b033a4d41b7a094b5c3c51f56/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-07-08',
'seats_number': 5,
'seller_name': None,
'title': 'FIAT FIAT PANDA CONSIP14 1.2 69 CV EASYPOWER E6D-TEMP EASY FP -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2020}
2026-03-25 16:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983591%27 HTTP/1.1" 200 None
2026-03-25 16:32:27 [ayvens.it] INFO: Saving data for 1983591: {'created_time': 1774456347.449152, 'last_price_update_time': 1774456347.449165, 'auction_closing_time': 1774603800.0}
2026-03-25 16:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1983591') HTTP/1.1" 204 0
2026-03-25 16:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh2%252Fd1e0231afadc4f2592fd6e0e6932e229%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh2/d1e0231afadc4f2592fd6e0e6932e229/images/large/3.jpg not downloaded yet
2026-03-25 16:32:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh1/f2683a18a6de4a6dadac7c56020eaa40/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh1/f2683a18a6de4a6dadac7c56020eaa40/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh1/f2683a18a6de4a6dadac7c56020eaa40/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh2%252Fd1e0231afadc4f2592fd6e0e6932e229%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh2/d1e0231afadc4f2592fd6e0e6932e229/images/large/4.jpg not downloaded yet
2026-03-25 16:32:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh1/f2683a18a6de4a6dadac7c56020eaa40/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc356490>
2026-03-25 16:32:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff785b7b-f50c-50ab-a168-5cc0bbc70012/ff785b7b-f50c-50ab-a168-5cc0bbc70012_image_2.jpg HTTP/1.1" 201 0
2026-03-25 16:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh1%252Ff2683a18a6de4a6dadac7c56020eaa40%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh1/f2683a18a6de4a6dadac7c56020eaa40/images/large/3.jpg saved to cache
2026-03-25 16:32:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ff785b7b-f50c-50ab-a168-5cc0bbc70012
2026-03-25 16:32:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh1/f2683a18a6de4a6dadac7c56020eaa40/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh2%252Fd1e0231afadc4f2592fd6e0e6932e229%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh2/d1e0231afadc4f2592fd6e0e6932e229/images/large/5.jpg not downloaded yet
2026-03-25 16:32:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh1/f2683a18a6de4a6dadac7c56020eaa40/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh1/f2683a18a6de4a6dadac7c56020eaa40/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh2%252Fd1e0231afadc4f2592fd6e0e6932e229%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh2/d1e0231afadc4f2592fd6e0e6932e229/images/large/6.jpg not downloaded yet
2026-03-25 16:32:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge4/467712f144064d3ba4f7a25126e58e62/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh2%252Fd1e0231afadc4f2592fd6e0e6932e229%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh2/d1e0231afadc4f2592fd6e0e6932e229/images/large/7.jpg not downloaded yet
2026-03-25 16:32:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc767ad0>
2026-03-25 16:32:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff785b7b-f50c-50ab-a168-5cc0bbc70012/ff785b7b-f50c-50ab-a168-5cc0bbc70012_image_4.jpg HTTP/1.1" 201 0
2026-03-25 16:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh1%252Ff2683a18a6de4a6dadac7c56020eaa40%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh1/f2683a18a6de4a6dadac7c56020eaa40/images/large/5.jpg saved to cache
2026-03-25 16:32:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ff785b7b-f50c-50ab-a168-5cc0bbc70012
2026-03-25 16:32:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dca9dd10>
2026-03-25 16:32:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff785b7b-f50c-50ab-a168-5cc0bbc70012/ff785b7b-f50c-50ab-a168-5cc0bbc70012_image_8.jpg HTTP/1.1" 201 0
2026-03-25 16:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh1%252Ff2683a18a6de4a6dadac7c56020eaa40%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh1/f2683a18a6de4a6dadac7c56020eaa40/images/large/9.jpg saved to cache
2026-03-25 16:32:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ff785b7b-f50c-50ab-a168-5cc0bbc70012
2026-03-25 16:32:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc712450>
2026-03-25 16:32:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff785b7b-f50c-50ab-a168-5cc0bbc70012/ff785b7b-f50c-50ab-a168-5cc0bbc70012_image_7.jpg HTTP/1.1" 201 0
2026-03-25 16:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh1%252Ff2683a18a6de4a6dadac7c56020eaa40%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh1/f2683a18a6de4a6dadac7c56020eaa40/images/large/8.jpg saved to cache
2026-03-25 16:32:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ff785b7b-f50c-50ab-a168-5cc0bbc70012
2026-03-25 16:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh2%252Fd1e0231afadc4f2592fd6e0e6932e229%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh2/d1e0231afadc4f2592fd6e0e6932e229/images/large/8.jpg not downloaded yet
2026-03-25 16:32:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc991b90>
2026-03-25 16:32:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff785b7b-f50c-50ab-a168-5cc0bbc70012/ff785b7b-f50c-50ab-a168-5cc0bbc70012_image_5.jpg HTTP/1.1" 201 0
2026-03-25 16:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh1%252Ff2683a18a6de4a6dadac7c56020eaa40%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh1/f2683a18a6de4a6dadac7c56020eaa40/images/large/6.jpg saved to cache
2026-03-25 16:32:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ff785b7b-f50c-50ab-a168-5cc0bbc70012
2026-03-25 16:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh2%252Fd1e0231afadc4f2592fd6e0e6932e229%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh2/d1e0231afadc4f2592fd6e0e6932e229/images/large/9.jpg not downloaded yet
2026-03-25 16:32:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge4/467712f144064d3ba4f7a25126e58e62/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc878dd0>
2026-03-25 16:32:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff785b7b-f50c-50ab-a168-5cc0bbc70012/ff785b7b-f50c-50ab-a168-5cc0bbc70012_image_1.jpg HTTP/1.1" 201 0
2026-03-25 16:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh1%252Ff2683a18a6de4a6dadac7c56020eaa40%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh1/f2683a18a6de4a6dadac7c56020eaa40/images/large/2.jpg saved to cache
2026-03-25 16:32:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ff785b7b-f50c-50ab-a168-5cc0bbc70012
2026-03-25 16:32:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc34e1d0>
2026-03-25 16:32:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff785b7b-f50c-50ab-a168-5cc0bbc70012/ff785b7b-f50c-50ab-a168-5cc0bbc70012_image_9.jpg HTTP/1.1" 201 0
2026-03-25 16:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh1%252Ff2683a18a6de4a6dadac7c56020eaa40%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh1/f2683a18a6de4a6dadac7c56020eaa40/images/large/10.jpg saved to cache
2026-03-25 16:32:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ff785b7b-f50c-50ab-a168-5cc0bbc70012
2026-03-25 16:32:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34de16b9d0>
2026-03-25 16:32:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff785b7b-f50c-50ab-a168-5cc0bbc70012/ff785b7b-f50c-50ab-a168-5cc0bbc70012_image_3.jpg HTTP/1.1" 201 0
2026-03-25 16:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh1%252Ff2683a18a6de4a6dadac7c56020eaa40%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh1/f2683a18a6de4a6dadac7c56020eaa40/images/large/4.jpg saved to cache
2026-03-25 16:32:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ff785b7b-f50c-50ab-a168-5cc0bbc70012
2026-03-25 16:32:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc990290>
2026-03-25 16:32:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15452c3d-ec87-5d70-abd9-1543b0ab346e/15452c3d-ec87-5d70-abd9-1543b0ab346e_image_1.jpg HTTP/1.1" 201 0
2026-03-25 16:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge4%252F467712f144064d3ba4f7a25126e58e62%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge4/467712f144064d3ba4f7a25126e58e62/images/large/2.jpg saved to cache
2026-03-25 16:32:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 15452c3d-ec87-5d70-abd9-1543b0ab346e
2026-03-25 16:32:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge4/467712f144064d3ba4f7a25126e58e62/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge4/467712f144064d3ba4f7a25126e58e62/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge4/467712f144064d3ba4f7a25126e58e62/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh2%252Fd1e0231afadc4f2592fd6e0e6932e229%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh2/d1e0231afadc4f2592fd6e0e6932e229/images/large/10.jpg not downloaded yet
2026-03-25 16:32:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge4/467712f144064d3ba4f7a25126e58e62/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:28 [ayvens.it] INFO: Found listing with ID: 1983596
2026-03-25 16:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983596%27 HTTP/1.1" 200 None
2026-03-25 16:32:28 [ayvens.it] INFO: Scrape type for 1983596: 1
2026-03-25 16:32:28 [ayvens.it] INFO: Extracting data for car ID: 1983596
2026-03-25 16:32:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5763bd92-576e-5a92-8caf-cb5fdd50967b with identifier: 1983596
2026-03-25 16:32:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5763bd92-576e-5a92-8caf-cb5fdd50967b with scrape type 1
2026-03-25 16:32:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5763bd92-576e-5a92-8caf-cb5fdd50967b
2026-03-25 16:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj7%252Fac542552ec5d4001b48d635fc947dfd8%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj7/ac542552ec5d4001b48d635fc947dfd8/images/large/1.jpg not downloaded yet
2026-03-25 16:32:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc7df110>
2026-03-25 16:32:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15452c3d-ec87-5d70-abd9-1543b0ab346e/15452c3d-ec87-5d70-abd9-1543b0ab346e_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge4%252F467712f144064d3ba4f7a25126e58e62%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge4/467712f144064d3ba4f7a25126e58e62/images/large/1.jpg saved to cache
2026-03-25 16:32:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 15452c3d-ec87-5d70-abd9-1543b0ab346e
2026-03-25 16:32:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh1/f2683a18a6de4a6dadac7c56020eaa40/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj7%252Fac542552ec5d4001b48d635fc947dfd8%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj7/ac542552ec5d4001b48d635fc947dfd8/images/large/2.jpg not downloaded yet
2026-03-25 16:32:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh1/f2683a18a6de4a6dadac7c56020eaa40/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh2/d1e0231afadc4f2592fd6e0e6932e229/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj7%252Fac542552ec5d4001b48d635fc947dfd8%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj7/ac542552ec5d4001b48d635fc947dfd8/images/large/3.jpg not downloaded yet
2026-03-25 16:32:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcc4d150>
2026-03-25 16:32:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15452c3d-ec87-5d70-abd9-1543b0ab346e/15452c3d-ec87-5d70-abd9-1543b0ab346e_image_2.jpg HTTP/1.1" 201 0
2026-03-25 16:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge4%252F467712f144064d3ba4f7a25126e58e62%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge4/467712f144064d3ba4f7a25126e58e62/images/large/3.jpg saved to cache
2026-03-25 16:32:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 15452c3d-ec87-5d70-abd9-1543b0ab346e
2026-03-25 16:32:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc89de90>
2026-03-25 16:32:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15452c3d-ec87-5d70-abd9-1543b0ab346e/15452c3d-ec87-5d70-abd9-1543b0ab346e_image_3.jpg HTTP/1.1" 201 0
2026-03-25 16:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge4%252F467712f144064d3ba4f7a25126e58e62%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge4/467712f144064d3ba4f7a25126e58e62/images/large/4.jpg saved to cache
2026-03-25 16:32:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 15452c3d-ec87-5d70-abd9-1543b0ab346e
2026-03-25 16:32:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc711a10>
2026-03-25 16:32:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15452c3d-ec87-5d70-abd9-1543b0ab346e/15452c3d-ec87-5d70-abd9-1543b0ab346e_image_5.jpg HTTP/1.1" 201 0
2026-03-25 16:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge4%252F467712f144064d3ba4f7a25126e58e62%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge4/467712f144064d3ba4f7a25126e58e62/images/large/6.jpg saved to cache
2026-03-25 16:32:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 15452c3d-ec87-5d70-abd9-1543b0ab346e
2026-03-25 16:32:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcaf74d0>
2026-03-25 16:32:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15452c3d-ec87-5d70-abd9-1543b0ab346e/15452c3d-ec87-5d70-abd9-1543b0ab346e_image_4.jpg HTTP/1.1" 201 0
2026-03-25 16:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge4%252F467712f144064d3ba4f7a25126e58e62%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge4/467712f144064d3ba4f7a25126e58e62/images/large/5.jpg saved to cache
2026-03-25 16:32:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 15452c3d-ec87-5d70-abd9-1543b0ab346e
2026-03-25 16:32:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge4/467712f144064d3ba4f7a25126e58e62/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge4/467712f144064d3ba4f7a25126e58e62/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj7%252Fac542552ec5d4001b48d635fc947dfd8%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj7/ac542552ec5d4001b48d635fc947dfd8/images/large/4.jpg not downloaded yet
2026-03-25 16:32:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dca60cd0>
2026-03-25 16:32:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff785b7b-f50c-50ab-a168-5cc0bbc70012/ff785b7b-f50c-50ab-a168-5cc0bbc70012_image_6.jpg HTTP/1.1" 201 0
2026-03-25 16:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh1%252Ff2683a18a6de4a6dadac7c56020eaa40%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh1/f2683a18a6de4a6dadac7c56020eaa40/images/large/7.jpg saved to cache
2026-03-25 16:32:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ff785b7b-f50c-50ab-a168-5cc0bbc70012
2026-03-25 16:32:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc86b850>
2026-03-25 16:32:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff785b7b-f50c-50ab-a168-5cc0bbc70012/ff785b7b-f50c-50ab-a168-5cc0bbc70012_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh1%252Ff2683a18a6de4a6dadac7c56020eaa40%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh1/f2683a18a6de4a6dadac7c56020eaa40/images/large/1.jpg saved to cache
2026-03-25 16:32:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ff785b7b-f50c-50ab-a168-5cc0bbc70012
2026-03-25 16:32:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ff785b7b-f50c-50ab-a168-5cc0bbc70012, skipping ID generation
2026-03-25 16:32:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ff785b7b-f50c-50ab-a168-5cc0bbc70012 with scrape type 1
2026-03-25 16:32:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ff785b7b-f50c-50ab-a168-5cc0bbc70012 sending to next pipeline
2026-03-25 16:32:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: ff785b7b-f50c-50ab-a168-5cc0bbc70012, identifier: 1983593
2026-03-25 16:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj7%252Fac542552ec5d4001b48d635fc947dfd8%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj7/ac542552ec5d4001b48d635fc947dfd8/images/large/5.jpg not downloaded yet
2026-03-25 16:32:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: ff785b7b-f50c-50ab-a168-5cc0bbc70012 with identifier: 1983593
2026-03-25 16:32:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: ff785b7b-f50c-50ab-a168-5cc0bbc70012 with identifier: 1983593
2026-03-25 16:32:29 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: ff785b7b-f50c-50ab-a168-5cc0bbc70012 with identifier: 1983593 to the API
2026-03-25 16:32:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:32:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:32:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gh1/f2683a18a6de4a6dadac7c56020eaa40/images/large/1.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Agate Black metallizzato',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-27T09:30:00Z',
'fuel_type': 'hybrid',
'id': 'ff785b7b-f50c-50ab-a168-5cc0bbc70012',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41025',
'listing': 'auction',
'location': None,
'make': 'FORD',
'model': 'FORD PUMA 1.0 Ecoboost Hybrid 125CV Titanium Auto Sport utility '
'vehicle 5-door (Euro 6.2)',
'odometer': 41660,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 33,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff785b7b-f50c-50ab-a168-5cc0bbc70012/ff785b7b-f50c-50ab-a168-5cc0bbc70012_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 594494,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh1/f2683a18a6de4a6dadac7c56020eaa40/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff785b7b-f50c-50ab-a168-5cc0bbc70012/ff785b7b-f50c-50ab-a168-5cc0bbc70012_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 643829,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh1/f2683a18a6de4a6dadac7c56020eaa40/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff785b7b-f50c-50ab-a168-5cc0bbc70012/ff785b7b-f50c-50ab-a168-5cc0bbc70012_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 447806,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh1/f2683a18a6de4a6dadac7c56020eaa40/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff785b7b-f50c-50ab-a168-5cc0bbc70012/ff785b7b-f50c-50ab-a168-5cc0bbc70012_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 617398,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh1/f2683a18a6de4a6dadac7c56020eaa40/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff785b7b-f50c-50ab-a168-5cc0bbc70012/ff785b7b-f50c-50ab-a168-5cc0bbc70012_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 401974,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh1/f2683a18a6de4a6dadac7c56020eaa40/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff785b7b-f50c-50ab-a168-5cc0bbc70012/ff785b7b-f50c-50ab-a168-5cc0bbc70012_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 483724,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh1/f2683a18a6de4a6dadac7c56020eaa40/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff785b7b-f50c-50ab-a168-5cc0bbc70012/ff785b7b-f50c-50ab-a168-5cc0bbc70012_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 457953,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh1/f2683a18a6de4a6dadac7c56020eaa40/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff785b7b-f50c-50ab-a168-5cc0bbc70012/ff785b7b-f50c-50ab-a168-5cc0bbc70012_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 486007,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh1/f2683a18a6de4a6dadac7c56020eaa40/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff785b7b-f50c-50ab-a168-5cc0bbc70012/ff785b7b-f50c-50ab-a168-5cc0bbc70012_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 400053,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh1/f2683a18a6de4a6dadac7c56020eaa40/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff785b7b-f50c-50ab-a168-5cc0bbc70012/ff785b7b-f50c-50ab-a168-5cc0bbc70012_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 669986,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh1/f2683a18a6de4a6dadac7c56020eaa40/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-11-30',
'seats_number': 5,
'seller_name': None,
'title': 'FORD FORD PUMA 1.0 Ecoboost Hybrid 125CV Titanium Auto Sport '
'utility vehicle 5-door (Euro 6.2) -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2021}
2026-03-25 16:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983593%27 HTTP/1.1" 200 None
2026-03-25 16:32:29 [ayvens.it] INFO: Saving data for 1983593: {'created_time': 1774456349.934412, 'last_price_update_time': 1774456349.934427, 'auction_closing_time': 1774603800.0}
2026-03-25 16:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1983593') HTTP/1.1" 204 0
2026-03-25 16:32:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh2/d1e0231afadc4f2592fd6e0e6932e229/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj7%252Fac542552ec5d4001b48d635fc947dfd8%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj7/ac542552ec5d4001b48d635fc947dfd8/images/large/6.jpg not downloaded yet
2026-03-25 16:32:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34d7400610>
2026-03-25 16:32:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_483d98d2-0a14-51c4-8cf4-095412922344/483d98d2-0a14-51c4-8cf4-095412922344_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh2%252Fd1e0231afadc4f2592fd6e0e6932e229%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh2/d1e0231afadc4f2592fd6e0e6932e229/images/large/1.jpg saved to cache
2026-03-25 16:32:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 483d98d2-0a14-51c4-8cf4-095412922344
2026-03-25 16:32:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcc08050>
2026-03-25 16:32:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15452c3d-ec87-5d70-abd9-1543b0ab346e/15452c3d-ec87-5d70-abd9-1543b0ab346e_image_9.jpg HTTP/1.1" 201 0
2026-03-25 16:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge4%252F467712f144064d3ba4f7a25126e58e62%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge4/467712f144064d3ba4f7a25126e58e62/images/large/10.jpg saved to cache
2026-03-25 16:32:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 15452c3d-ec87-5d70-abd9-1543b0ab346e
2026-03-25 16:32:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc712b10>
2026-03-25 16:32:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15452c3d-ec87-5d70-abd9-1543b0ab346e/15452c3d-ec87-5d70-abd9-1543b0ab346e_image_8.jpg HTTP/1.1" 201 0
2026-03-25 16:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge4%252F467712f144064d3ba4f7a25126e58e62%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge4/467712f144064d3ba4f7a25126e58e62/images/large/9.jpg saved to cache
2026-03-25 16:32:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 15452c3d-ec87-5d70-abd9-1543b0ab346e
2026-03-25 16:32:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh2/d1e0231afadc4f2592fd6e0e6932e229/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh2/d1e0231afadc4f2592fd6e0e6932e229/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge4/467712f144064d3ba4f7a25126e58e62/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj7%252Fac542552ec5d4001b48d635fc947dfd8%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj7/ac542552ec5d4001b48d635fc947dfd8/images/large/7.jpg not downloaded yet
2026-03-25 16:32:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh2/d1e0231afadc4f2592fd6e0e6932e229/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj7%252Fac542552ec5d4001b48d635fc947dfd8%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj7/ac542552ec5d4001b48d635fc947dfd8/images/large/8.jpg not downloaded yet
2026-03-25 16:32:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh2/d1e0231afadc4f2592fd6e0e6932e229/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh2/d1e0231afadc4f2592fd6e0e6932e229/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcc088d0>
2026-03-25 16:32:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_483d98d2-0a14-51c4-8cf4-095412922344/483d98d2-0a14-51c4-8cf4-095412922344_image_1.jpg HTTP/1.1" 201 0
2026-03-25 16:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh2%252Fd1e0231afadc4f2592fd6e0e6932e229%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh2/d1e0231afadc4f2592fd6e0e6932e229/images/large/2.jpg saved to cache
2026-03-25 16:32:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 483d98d2-0a14-51c4-8cf4-095412922344
2026-03-25 16:32:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh2/d1e0231afadc4f2592fd6e0e6932e229/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj7%252Fac542552ec5d4001b48d635fc947dfd8%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj7/ac542552ec5d4001b48d635fc947dfd8/images/large/9.jpg not downloaded yet
2026-03-25 16:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj7%252Fac542552ec5d4001b48d635fc947dfd8%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj7/ac542552ec5d4001b48d635fc947dfd8/images/large/10.jpg not downloaded yet
2026-03-25 16:32:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh2/d1e0231afadc4f2592fd6e0e6932e229/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:30 [ayvens.it] INFO: Found listing with ID: 1983597
2026-03-25 16:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983597%27 HTTP/1.1" 200 None
2026-03-25 16:32:30 [ayvens.it] INFO: Scrape type for 1983597: 1
2026-03-25 16:32:30 [ayvens.it] INFO: Extracting data for car ID: 1983597
2026-03-25 16:32:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1db646ef-d42c-5ca3-a556-a3832d5be3f3 with identifier: 1983597
2026-03-25 16:32:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1db646ef-d42c-5ca3-a556-a3832d5be3f3 with scrape type 1
2026-03-25 16:32:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1db646ef-d42c-5ca3-a556-a3832d5be3f3
2026-03-25 16:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk8%252Fe2d3cc3442314b878f7cac74cd31e1b9%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk8/e2d3cc3442314b878f7cac74cd31e1b9/images/large/1.jpg not downloaded yet
2026-03-25 16:32:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc765890>
2026-03-25 16:32:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_483d98d2-0a14-51c4-8cf4-095412922344/483d98d2-0a14-51c4-8cf4-095412922344_image_4.jpg HTTP/1.1" 201 0
2026-03-25 16:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh2%252Fd1e0231afadc4f2592fd6e0e6932e229%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh2/d1e0231afadc4f2592fd6e0e6932e229/images/large/5.jpg saved to cache
2026-03-25 16:32:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 483d98d2-0a14-51c4-8cf4-095412922344
2026-03-25 16:32:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc37fed0>
2026-03-25 16:32:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_483d98d2-0a14-51c4-8cf4-095412922344/483d98d2-0a14-51c4-8cf4-095412922344_image_2.jpg HTTP/1.1" 201 0
2026-03-25 16:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh2%252Fd1e0231afadc4f2592fd6e0e6932e229%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh2/d1e0231afadc4f2592fd6e0e6932e229/images/large/3.jpg saved to cache
2026-03-25 16:32:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 483d98d2-0a14-51c4-8cf4-095412922344
2026-03-25 16:32:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcbb4450>
2026-03-25 16:32:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15452c3d-ec87-5d70-abd9-1543b0ab346e/15452c3d-ec87-5d70-abd9-1543b0ab346e_image_7.jpg HTTP/1.1" 201 0
2026-03-25 16:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge4%252F467712f144064d3ba4f7a25126e58e62%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge4/467712f144064d3ba4f7a25126e58e62/images/large/8.jpg saved to cache
2026-03-25 16:32:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 15452c3d-ec87-5d70-abd9-1543b0ab346e
2026-03-25 16:32:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc8d61d0>
2026-03-25 16:32:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_483d98d2-0a14-51c4-8cf4-095412922344/483d98d2-0a14-51c4-8cf4-095412922344_image_3.jpg HTTP/1.1" 201 0
2026-03-25 16:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh2%252Fd1e0231afadc4f2592fd6e0e6932e229%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh2/d1e0231afadc4f2592fd6e0e6932e229/images/large/4.jpg saved to cache
2026-03-25 16:32:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 483d98d2-0a14-51c4-8cf4-095412922344
2026-03-25 16:32:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc9c2d10>
2026-03-25 16:32:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_483d98d2-0a14-51c4-8cf4-095412922344/483d98d2-0a14-51c4-8cf4-095412922344_image_5.jpg HTTP/1.1" 201 0
2026-03-25 16:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh2%252Fd1e0231afadc4f2592fd6e0e6932e229%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh2/d1e0231afadc4f2592fd6e0e6932e229/images/large/6.jpg saved to cache
2026-03-25 16:32:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 483d98d2-0a14-51c4-8cf4-095412922344
2026-03-25 16:32:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc549290>
2026-03-25 16:32:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_483d98d2-0a14-51c4-8cf4-095412922344/483d98d2-0a14-51c4-8cf4-095412922344_image_8.jpg HTTP/1.1" 201 0
2026-03-25 16:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh2%252Fd1e0231afadc4f2592fd6e0e6932e229%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh2/d1e0231afadc4f2592fd6e0e6932e229/images/large/9.jpg saved to cache
2026-03-25 16:32:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 483d98d2-0a14-51c4-8cf4-095412922344
2026-03-25 16:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk8%252Fe2d3cc3442314b878f7cac74cd31e1b9%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk8/e2d3cc3442314b878f7cac74cd31e1b9/images/large/2.jpg not downloaded yet
2026-03-25 16:32:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge4/467712f144064d3ba4f7a25126e58e62/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk8%252Fe2d3cc3442314b878f7cac74cd31e1b9%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk8/e2d3cc3442314b878f7cac74cd31e1b9/images/large/3.jpg not downloaded yet
2026-03-25 16:32:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc57b750>
2026-03-25 16:32:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_483d98d2-0a14-51c4-8cf4-095412922344/483d98d2-0a14-51c4-8cf4-095412922344_image_7.jpg HTTP/1.1" 201 0
2026-03-25 16:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh2%252Fd1e0231afadc4f2592fd6e0e6932e229%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh2/d1e0231afadc4f2592fd6e0e6932e229/images/large/8.jpg saved to cache
2026-03-25 16:32:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 483d98d2-0a14-51c4-8cf4-095412922344
2026-03-25 16:32:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc710290>
2026-03-25 16:32:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_483d98d2-0a14-51c4-8cf4-095412922344/483d98d2-0a14-51c4-8cf4-095412922344_image_6.jpg HTTP/1.1" 201 0
2026-03-25 16:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh2%252Fd1e0231afadc4f2592fd6e0e6932e229%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh2/d1e0231afadc4f2592fd6e0e6932e229/images/large/7.jpg saved to cache
2026-03-25 16:32:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 483d98d2-0a14-51c4-8cf4-095412922344
2026-03-25 16:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk8%252Fe2d3cc3442314b878f7cac74cd31e1b9%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk8/e2d3cc3442314b878f7cac74cd31e1b9/images/large/4.jpg not downloaded yet
2026-03-25 16:32:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj7/ac542552ec5d4001b48d635fc947dfd8/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf9/4b262b73892a421f826ddca5a39bb453/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj7/ac542552ec5d4001b48d635fc947dfd8/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj7/ac542552ec5d4001b48d635fc947dfd8/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk8%252Fe2d3cc3442314b878f7cac74cd31e1b9%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk8/e2d3cc3442314b878f7cac74cd31e1b9/images/large/5.jpg not downloaded yet
2026-03-25 16:32:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh2/d1e0231afadc4f2592fd6e0e6932e229/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj7/ac542552ec5d4001b48d635fc947dfd8/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf9/4b262b73892a421f826ddca5a39bb453/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk8%252Fe2d3cc3442314b878f7cac74cd31e1b9%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk8/e2d3cc3442314b878f7cac74cd31e1b9/images/large/6.jpg not downloaded yet
2026-03-25 16:32:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc54cb50>
2026-03-25 16:32:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15452c3d-ec87-5d70-abd9-1543b0ab346e/15452c3d-ec87-5d70-abd9-1543b0ab346e_image_6.jpg HTTP/1.1" 201 0
2026-03-25 16:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge4%252F467712f144064d3ba4f7a25126e58e62%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge4/467712f144064d3ba4f7a25126e58e62/images/large/7.jpg saved to cache
2026-03-25 16:32:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 15452c3d-ec87-5d70-abd9-1543b0ab346e
2026-03-25 16:32:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 15452c3d-ec87-5d70-abd9-1543b0ab346e, skipping ID generation
2026-03-25 16:32:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 15452c3d-ec87-5d70-abd9-1543b0ab346e with scrape type 1
2026-03-25 16:32:31 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 15452c3d-ec87-5d70-abd9-1543b0ab346e sending to next pipeline
2026-03-25 16:32:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 15452c3d-ec87-5d70-abd9-1543b0ab346e, identifier: 1983594
2026-03-25 16:32:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 15452c3d-ec87-5d70-abd9-1543b0ab346e with identifier: 1983594
2026-03-25 16:32:31 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:32:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 15452c3d-ec87-5d70-abd9-1543b0ab346e with identifier: 1983594
2026-03-25 16:32:31 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 15452c3d-ec87-5d70-abd9-1543b0ab346e with identifier: 1983594 to the API
2026-03-25 16:32:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:32:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:32:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/ge4/467712f144064d3ba4f7a25126e58e62/images/large/7.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'SEOUL PEARL SILVER METALLIZZATO',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-27T09:30:00Z',
'fuel_type': 'hybrid',
'id': '15452c3d-ec87-5d70-abd9-1543b0ab346e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41025',
'listing': 'auction',
'location': None,
'make': 'LAND ROVER',
'model': 'LAND ROVER RANGE ROVER EVO 1.5 P300E PHEV R-DYNAMIC SE AWD AUTO '
'(PC) FP',
'odometer': 112263,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 36,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15452c3d-ec87-5d70-abd9-1543b0ab346e/15452c3d-ec87-5d70-abd9-1543b0ab346e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 454643,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge4/467712f144064d3ba4f7a25126e58e62/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15452c3d-ec87-5d70-abd9-1543b0ab346e/15452c3d-ec87-5d70-abd9-1543b0ab346e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 425540,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge4/467712f144064d3ba4f7a25126e58e62/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15452c3d-ec87-5d70-abd9-1543b0ab346e/15452c3d-ec87-5d70-abd9-1543b0ab346e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 318179,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge4/467712f144064d3ba4f7a25126e58e62/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15452c3d-ec87-5d70-abd9-1543b0ab346e/15452c3d-ec87-5d70-abd9-1543b0ab346e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 315705,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge4/467712f144064d3ba4f7a25126e58e62/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15452c3d-ec87-5d70-abd9-1543b0ab346e/15452c3d-ec87-5d70-abd9-1543b0ab346e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 436492,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge4/467712f144064d3ba4f7a25126e58e62/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15452c3d-ec87-5d70-abd9-1543b0ab346e/15452c3d-ec87-5d70-abd9-1543b0ab346e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 316262,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge4/467712f144064d3ba4f7a25126e58e62/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15452c3d-ec87-5d70-abd9-1543b0ab346e/15452c3d-ec87-5d70-abd9-1543b0ab346e_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 374621,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge4/467712f144064d3ba4f7a25126e58e62/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15452c3d-ec87-5d70-abd9-1543b0ab346e/15452c3d-ec87-5d70-abd9-1543b0ab346e_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 261233,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge4/467712f144064d3ba4f7a25126e58e62/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15452c3d-ec87-5d70-abd9-1543b0ab346e/15452c3d-ec87-5d70-abd9-1543b0ab346e_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 192011,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge4/467712f144064d3ba4f7a25126e58e62/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15452c3d-ec87-5d70-abd9-1543b0ab346e/15452c3d-ec87-5d70-abd9-1543b0ab346e_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 295374,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge4/467712f144064d3ba4f7a25126e58e62/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-01-12',
'seats_number': 5,
'seller_name': None,
'title': 'LAND ROVER LAND ROVER RANGE ROVER EVO 1.5 P300E PHEV R-DYNAMIC SE '
'AWD AUTO (PC) FP -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2021}
2026-03-25 16:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983594%27 HTTP/1.1" 200 None
2026-03-25 16:32:31 [ayvens.it] INFO: Saving data for 1983594: {'created_time': 1774456351.953408, 'last_price_update_time': 1774456351.95342, 'auction_closing_time': 1774603800.0}
2026-03-25 16:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1983594') HTTP/1.1" 204 0
2026-03-25 16:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk8%252Fe2d3cc3442314b878f7cac74cd31e1b9%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk8/e2d3cc3442314b878f7cac74cd31e1b9/images/large/7.jpg not downloaded yet
2026-03-25 16:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk8%252Fe2d3cc3442314b878f7cac74cd31e1b9%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk8/e2d3cc3442314b878f7cac74cd31e1b9/images/large/8.jpg not downloaded yet
2026-03-25 16:32:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj7/ac542552ec5d4001b48d635fc947dfd8/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj7/ac542552ec5d4001b48d635fc947dfd8/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc62b550>
2026-03-25 16:32:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5763bd92-576e-5a92-8caf-cb5fdd50967b/5763bd92-576e-5a92-8caf-cb5fdd50967b_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj7%252Fac542552ec5d4001b48d635fc947dfd8%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj7/ac542552ec5d4001b48d635fc947dfd8/images/large/1.jpg saved to cache
2026-03-25 16:32:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5763bd92-576e-5a92-8caf-cb5fdd50967b
2026-03-25 16:32:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcb987d0>
2026-03-25 16:32:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0ad1e1a-6f31-55a9-b1a9-0b48df6a3009/d0ad1e1a-6f31-55a9-b1a9-0b48df6a3009_image_9.jpg HTTP/1.1" 201 0
2026-03-25 16:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf9%252F4b262b73892a421f826ddca5a39bb453%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf9/4b262b73892a421f826ddca5a39bb453/images/large/10.jpg saved to cache
2026-03-25 16:32:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d0ad1e1a-6f31-55a9-b1a9-0b48df6a3009
2026-03-25 16:32:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcae8790>
2026-03-25 16:32:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5763bd92-576e-5a92-8caf-cb5fdd50967b/5763bd92-576e-5a92-8caf-cb5fdd50967b_image_1.jpg HTTP/1.1" 201 0
2026-03-25 16:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj7%252Fac542552ec5d4001b48d635fc947dfd8%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj7/ac542552ec5d4001b48d635fc947dfd8/images/large/2.jpg saved to cache
2026-03-25 16:32:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5763bd92-576e-5a92-8caf-cb5fdd50967b
2026-03-25 16:32:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc3649d0>
2026-03-25 16:32:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5763bd92-576e-5a92-8caf-cb5fdd50967b/5763bd92-576e-5a92-8caf-cb5fdd50967b_image_2.jpg HTTP/1.1" 201 0
2026-03-25 16:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj7%252Fac542552ec5d4001b48d635fc947dfd8%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj7/ac542552ec5d4001b48d635fc947dfd8/images/large/3.jpg saved to cache
2026-03-25 16:32:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5763bd92-576e-5a92-8caf-cb5fdd50967b
2026-03-25 16:32:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc325250>
2026-03-25 16:32:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_483d98d2-0a14-51c4-8cf4-095412922344/483d98d2-0a14-51c4-8cf4-095412922344_image_9.jpg HTTP/1.1" 201 0
2026-03-25 16:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh2%252Fd1e0231afadc4f2592fd6e0e6932e229%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh2/d1e0231afadc4f2592fd6e0e6932e229/images/large/10.jpg saved to cache
2026-03-25 16:32:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 483d98d2-0a14-51c4-8cf4-095412922344
2026-03-25 16:32:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 483d98d2-0a14-51c4-8cf4-095412922344, skipping ID generation
2026-03-25 16:32:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 483d98d2-0a14-51c4-8cf4-095412922344 with scrape type 1
2026-03-25 16:32:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 483d98d2-0a14-51c4-8cf4-095412922344 sending to next pipeline
2026-03-25 16:32:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 483d98d2-0a14-51c4-8cf4-095412922344, identifier: 1983595
2026-03-25 16:32:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc802b50>
2026-03-25 16:32:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5763bd92-576e-5a92-8caf-cb5fdd50967b/5763bd92-576e-5a92-8caf-cb5fdd50967b_image_4.jpg HTTP/1.1" 201 0
2026-03-25 16:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj7%252Fac542552ec5d4001b48d635fc947dfd8%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj7/ac542552ec5d4001b48d635fc947dfd8/images/large/5.jpg saved to cache
2026-03-25 16:32:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5763bd92-576e-5a92-8caf-cb5fdd50967b
2026-03-25 16:32:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcae9ad0>
2026-03-25 16:32:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0ad1e1a-6f31-55a9-b1a9-0b48df6a3009/d0ad1e1a-6f31-55a9-b1a9-0b48df6a3009_image_8.jpg HTTP/1.1" 201 0
2026-03-25 16:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf9%252F4b262b73892a421f826ddca5a39bb453%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf9/4b262b73892a421f826ddca5a39bb453/images/large/9.jpg saved to cache
2026-03-25 16:32:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d0ad1e1a-6f31-55a9-b1a9-0b48df6a3009
2026-03-25 16:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk8%252Fe2d3cc3442314b878f7cac74cd31e1b9%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk8/e2d3cc3442314b878f7cac74cd31e1b9/images/large/9.jpg not downloaded yet
2026-03-25 16:32:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 483d98d2-0a14-51c4-8cf4-095412922344 with identifier: 1983595
2026-03-25 16:32:32 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:32:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 483d98d2-0a14-51c4-8cf4-095412922344 with identifier: 1983595
2026-03-25 16:32:32 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 483d98d2-0a14-51c4-8cf4-095412922344 with identifier: 1983595 to the API
2026-03-25 16:32:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:32:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:32:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gh2/d1e0231afadc4f2592fd6e0e6932e229/images/large/10.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'NERO VULCANO METALLIZZATO',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.1L',
'expiration_date': '2026-03-27T09:30:00Z',
'fuel_type': 'diesel',
'id': '483d98d2-0a14-51c4-8cf4-095412922344',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41025',
'listing': 'auction',
'location': None,
'make': 'ALFA ROMEO',
'model': 'ALFA ROMEO STELVIO 2.2 TURBO DIESEL 190CV SPRINT AT8 Q4 FP',
'odometer': 131150,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 37,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_483d98d2-0a14-51c4-8cf4-095412922344/483d98d2-0a14-51c4-8cf4-095412922344_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 572574,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh2/d1e0231afadc4f2592fd6e0e6932e229/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_483d98d2-0a14-51c4-8cf4-095412922344/483d98d2-0a14-51c4-8cf4-095412922344_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 563534,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh2/d1e0231afadc4f2592fd6e0e6932e229/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_483d98d2-0a14-51c4-8cf4-095412922344/483d98d2-0a14-51c4-8cf4-095412922344_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 335967,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh2/d1e0231afadc4f2592fd6e0e6932e229/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_483d98d2-0a14-51c4-8cf4-095412922344/483d98d2-0a14-51c4-8cf4-095412922344_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 407029,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh2/d1e0231afadc4f2592fd6e0e6932e229/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_483d98d2-0a14-51c4-8cf4-095412922344/483d98d2-0a14-51c4-8cf4-095412922344_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 331848,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh2/d1e0231afadc4f2592fd6e0e6932e229/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_483d98d2-0a14-51c4-8cf4-095412922344/483d98d2-0a14-51c4-8cf4-095412922344_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 425440,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh2/d1e0231afadc4f2592fd6e0e6932e229/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_483d98d2-0a14-51c4-8cf4-095412922344/483d98d2-0a14-51c4-8cf4-095412922344_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 230416,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh2/d1e0231afadc4f2592fd6e0e6932e229/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_483d98d2-0a14-51c4-8cf4-095412922344/483d98d2-0a14-51c4-8cf4-095412922344_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 402304,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh2/d1e0231afadc4f2592fd6e0e6932e229/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_483d98d2-0a14-51c4-8cf4-095412922344/483d98d2-0a14-51c4-8cf4-095412922344_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 354275,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh2/d1e0231afadc4f2592fd6e0e6932e229/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_483d98d2-0a14-51c4-8cf4-095412922344/483d98d2-0a14-51c4-8cf4-095412922344_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 494241,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh2/d1e0231afadc4f2592fd6e0e6932e229/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-12-03',
'seats_number': 5,
'seller_name': None,
'title': 'ALFA ROMEO ALFA ROMEO STELVIO 2.2 TURBO DIESEL 190CV SPRINT AT8 Q4 '
'FP -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2021}
2026-03-25 16:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983595%27 HTTP/1.1" 200 None
2026-03-25 16:32:33 [ayvens.it] INFO: Saving data for 1983595: {'created_time': 1774456353.028082, 'last_price_update_time': 1774456353.028092, 'auction_closing_time': 1774603800.0}
2026-03-25 16:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1983595') HTTP/1.1" 204 0
2026-03-25 16:32:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj7/ac542552ec5d4001b48d635fc947dfd8/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf9/4b262b73892a421f826ddca5a39bb453/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf9/4b262b73892a421f826ddca5a39bb453/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk8%252Fe2d3cc3442314b878f7cac74cd31e1b9%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk8/e2d3cc3442314b878f7cac74cd31e1b9/images/large/10.jpg not downloaded yet
2026-03-25 16:32:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc91d490>
2026-03-25 16:32:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5763bd92-576e-5a92-8caf-cb5fdd50967b/5763bd92-576e-5a92-8caf-cb5fdd50967b_image_6.jpg HTTP/1.1" 201 0
2026-03-25 16:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj7%252Fac542552ec5d4001b48d635fc947dfd8%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj7/ac542552ec5d4001b48d635fc947dfd8/images/large/7.jpg saved to cache
2026-03-25 16:32:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5763bd92-576e-5a92-8caf-cb5fdd50967b
2026-03-25 16:32:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc89d410>
2026-03-25 16:32:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5763bd92-576e-5a92-8caf-cb5fdd50967b/5763bd92-576e-5a92-8caf-cb5fdd50967b_image_9.jpg HTTP/1.1" 201 0
2026-03-25 16:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj7%252Fac542552ec5d4001b48d635fc947dfd8%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj7/ac542552ec5d4001b48d635fc947dfd8/images/large/10.jpg saved to cache
2026-03-25 16:32:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5763bd92-576e-5a92-8caf-cb5fdd50967b
2026-03-25 16:32:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj7/ac542552ec5d4001b48d635fc947dfd8/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh7/0999f7aa078e4a8cbeec7501ad1bda12/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:33 [ayvens.it] INFO: Found listing with ID: 1983598
2026-03-25 16:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983598%27 HTTP/1.1" 200 None
2026-03-25 16:32:33 [ayvens.it] INFO: Scrape type for 1983598: 1
2026-03-25 16:32:33 [ayvens.it] INFO: Extracting data for car ID: 1983598
2026-03-25 16:32:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 80be8b73-a037-5b39-9c7c-5e1e71dbbea2 with identifier: 1983598
2026-03-25 16:32:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 80be8b73-a037-5b39-9c7c-5e1e71dbbea2 with scrape type 1
2026-03-25 16:32:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 80be8b73-a037-5b39-9c7c-5e1e71dbbea2
2026-03-25 16:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl8%252Fda0d0ea9b518495c92ff5cba2d3b93b5%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl8/da0d0ea9b518495c92ff5cba2d3b93b5/images/large/1.jpg not downloaded yet
2026-03-25 16:32:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj7/ac542552ec5d4001b48d635fc947dfd8/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk8/e2d3cc3442314b878f7cac74cd31e1b9/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl8%252Fda0d0ea9b518495c92ff5cba2d3b93b5%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl8/da0d0ea9b518495c92ff5cba2d3b93b5/images/large/2.jpg not downloaded yet
2026-03-25 16:32:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk8/e2d3cc3442314b878f7cac74cd31e1b9/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc82d990>
2026-03-25 16:32:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5763bd92-576e-5a92-8caf-cb5fdd50967b/5763bd92-576e-5a92-8caf-cb5fdd50967b_image_3.jpg HTTP/1.1" 201 0
2026-03-25 16:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj7%252Fac542552ec5d4001b48d635fc947dfd8%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj7/ac542552ec5d4001b48d635fc947dfd8/images/large/4.jpg saved to cache
2026-03-25 16:32:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5763bd92-576e-5a92-8caf-cb5fdd50967b
2026-03-25 16:32:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dca74250>
2026-03-25 16:32:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0ad1e1a-6f31-55a9-b1a9-0b48df6a3009/d0ad1e1a-6f31-55a9-b1a9-0b48df6a3009_image_7.jpg HTTP/1.1" 201 0
2026-03-25 16:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf9%252F4b262b73892a421f826ddca5a39bb453%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf9/4b262b73892a421f826ddca5a39bb453/images/large/8.jpg saved to cache
2026-03-25 16:32:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d0ad1e1a-6f31-55a9-b1a9-0b48df6a3009
2026-03-25 16:32:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dca071d0>
2026-03-25 16:32:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0ad1e1a-6f31-55a9-b1a9-0b48df6a3009/d0ad1e1a-6f31-55a9-b1a9-0b48df6a3009_image_6.jpg HTTP/1.1" 201 0
2026-03-25 16:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf9%252F4b262b73892a421f826ddca5a39bb453%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf9/4b262b73892a421f826ddca5a39bb453/images/large/7.jpg saved to cache
2026-03-25 16:32:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d0ad1e1a-6f31-55a9-b1a9-0b48df6a3009
2026-03-25 16:32:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d0ad1e1a-6f31-55a9-b1a9-0b48df6a3009, skipping ID generation
2026-03-25 16:32:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d0ad1e1a-6f31-55a9-b1a9-0b48df6a3009 with scrape type 1
2026-03-25 16:32:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d0ad1e1a-6f31-55a9-b1a9-0b48df6a3009 sending to next pipeline
2026-03-25 16:32:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: d0ad1e1a-6f31-55a9-b1a9-0b48df6a3009, identifier: 1983592
2026-03-25 16:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl8%252Fda0d0ea9b518495c92ff5cba2d3b93b5%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl8/da0d0ea9b518495c92ff5cba2d3b93b5/images/large/3.jpg not downloaded yet
2026-03-25 16:32:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: d0ad1e1a-6f31-55a9-b1a9-0b48df6a3009 with identifier: 1983592
2026-03-25 16:32:33 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:32:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: d0ad1e1a-6f31-55a9-b1a9-0b48df6a3009 with identifier: 1983592
2026-03-25 16:32:33 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: d0ad1e1a-6f31-55a9-b1a9-0b48df6a3009 with identifier: 1983592 to the API
2026-03-25 16:32:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:32:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:32:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gf9/4b262b73892a421f826ddca5a39bb453/images/large/7.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Bianco Madreperla tinta specia',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-27T09:30:00Z',
'fuel_type': 'diesel',
'id': 'd0ad1e1a-6f31-55a9-b1a9-0b48df6a3009',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41025',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': 'PEUGEOT 3008 BlueHDI 130 S&S GT Sport utility vehicle 5-door (Euro '
'6D)',
'odometer': 110171,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 25,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0ad1e1a-6f31-55a9-b1a9-0b48df6a3009/d0ad1e1a-6f31-55a9-b1a9-0b48df6a3009_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 560138,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf9/4b262b73892a421f826ddca5a39bb453/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0ad1e1a-6f31-55a9-b1a9-0b48df6a3009/d0ad1e1a-6f31-55a9-b1a9-0b48df6a3009_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 236552,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf9/4b262b73892a421f826ddca5a39bb453/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0ad1e1a-6f31-55a9-b1a9-0b48df6a3009/d0ad1e1a-6f31-55a9-b1a9-0b48df6a3009_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 589539,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf9/4b262b73892a421f826ddca5a39bb453/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0ad1e1a-6f31-55a9-b1a9-0b48df6a3009/d0ad1e1a-6f31-55a9-b1a9-0b48df6a3009_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 506525,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf9/4b262b73892a421f826ddca5a39bb453/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0ad1e1a-6f31-55a9-b1a9-0b48df6a3009/d0ad1e1a-6f31-55a9-b1a9-0b48df6a3009_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 429926,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf9/4b262b73892a421f826ddca5a39bb453/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0ad1e1a-6f31-55a9-b1a9-0b48df6a3009/d0ad1e1a-6f31-55a9-b1a9-0b48df6a3009_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 247469,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf9/4b262b73892a421f826ddca5a39bb453/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0ad1e1a-6f31-55a9-b1a9-0b48df6a3009/d0ad1e1a-6f31-55a9-b1a9-0b48df6a3009_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 348271,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf9/4b262b73892a421f826ddca5a39bb453/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0ad1e1a-6f31-55a9-b1a9-0b48df6a3009/d0ad1e1a-6f31-55a9-b1a9-0b48df6a3009_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 384794,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf9/4b262b73892a421f826ddca5a39bb453/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0ad1e1a-6f31-55a9-b1a9-0b48df6a3009/d0ad1e1a-6f31-55a9-b1a9-0b48df6a3009_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 548510,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf9/4b262b73892a421f826ddca5a39bb453/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0ad1e1a-6f31-55a9-b1a9-0b48df6a3009/d0ad1e1a-6f31-55a9-b1a9-0b48df6a3009_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 434643,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf9/4b262b73892a421f826ddca5a39bb453/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-05-04',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT PEUGEOT 3008 BlueHDI 130 S&S GT Sport utility vehicle '
'5-door (Euro 6D) -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2021}
2026-03-25 16:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983592%27 HTTP/1.1" 200 None
2026-03-25 16:32:34 [ayvens.it] INFO: Saving data for 1983592: {'created_time': 1774456354.040796, 'last_price_update_time': 1774456354.040808, 'auction_closing_time': 1774603800.0}
2026-03-25 16:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1983592') HTTP/1.1" 204 0
2026-03-25 16:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl8%252Fda0d0ea9b518495c92ff5cba2d3b93b5%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl8/da0d0ea9b518495c92ff5cba2d3b93b5/images/large/4.jpg not downloaded yet
2026-03-25 16:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl8%252Fda0d0ea9b518495c92ff5cba2d3b93b5%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl8/da0d0ea9b518495c92ff5cba2d3b93b5/images/large/5.jpg not downloaded yet
2026-03-25 16:32:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc591810>
2026-03-25 16:32:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5763bd92-576e-5a92-8caf-cb5fdd50967b/5763bd92-576e-5a92-8caf-cb5fdd50967b_image_5.jpg HTTP/1.1" 201 0
2026-03-25 16:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj7%252Fac542552ec5d4001b48d635fc947dfd8%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj7/ac542552ec5d4001b48d635fc947dfd8/images/large/6.jpg saved to cache
2026-03-25 16:32:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5763bd92-576e-5a92-8caf-cb5fdd50967b
2026-03-25 16:32:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcacad10>
2026-03-25 16:32:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb7a89b6-e31f-57d8-bffe-85f86e6d3999/bb7a89b6-e31f-57d8-bffe-85f86e6d3999_image_9.jpg HTTP/1.1" 201 0
2026-03-25 16:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh7%252F0999f7aa078e4a8cbeec7501ad1bda12%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh7/0999f7aa078e4a8cbeec7501ad1bda12/images/large/10.jpg saved to cache
2026-03-25 16:32:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item bb7a89b6-e31f-57d8-bffe-85f86e6d3999
2026-03-25 16:32:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34de16e890>
2026-03-25 16:32:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5763bd92-576e-5a92-8caf-cb5fdd50967b/5763bd92-576e-5a92-8caf-cb5fdd50967b_image_7.jpg HTTP/1.1" 201 0
2026-03-25 16:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj7%252Fac542552ec5d4001b48d635fc947dfd8%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj7/ac542552ec5d4001b48d635fc947dfd8/images/large/8.jpg saved to cache
2026-03-25 16:32:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5763bd92-576e-5a92-8caf-cb5fdd50967b
2026-03-25 16:32:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc8e2390>
2026-03-25 16:32:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1db646ef-d42c-5ca3-a556-a3832d5be3f3/1db646ef-d42c-5ca3-a556-a3832d5be3f3_image_1.jpg HTTP/1.1" 201 0
2026-03-25 16:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk8%252Fe2d3cc3442314b878f7cac74cd31e1b9%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk8/e2d3cc3442314b878f7cac74cd31e1b9/images/large/2.jpg saved to cache
2026-03-25 16:32:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1db646ef-d42c-5ca3-a556-a3832d5be3f3
2026-03-25 16:32:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc53fa10>
2026-03-25 16:32:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1db646ef-d42c-5ca3-a556-a3832d5be3f3/1db646ef-d42c-5ca3-a556-a3832d5be3f3_image_2.jpg HTTP/1.1" 201 0
2026-03-25 16:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk8%252Fe2d3cc3442314b878f7cac74cd31e1b9%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk8/e2d3cc3442314b878f7cac74cd31e1b9/images/large/3.jpg saved to cache
2026-03-25 16:32:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1db646ef-d42c-5ca3-a556-a3832d5be3f3
2026-03-25 16:32:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk8/e2d3cc3442314b878f7cac74cd31e1b9/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk8/e2d3cc3442314b878f7cac74cd31e1b9/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl8%252Fda0d0ea9b518495c92ff5cba2d3b93b5%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl8/da0d0ea9b518495c92ff5cba2d3b93b5/images/large/6.jpg not downloaded yet
2026-03-25 16:32:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj7/ac542552ec5d4001b48d635fc947dfd8/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh7/0999f7aa078e4a8cbeec7501ad1bda12/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl8%252Fda0d0ea9b518495c92ff5cba2d3b93b5%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl8/da0d0ea9b518495c92ff5cba2d3b93b5/images/large/7.jpg not downloaded yet
2026-03-25 16:32:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk8/e2d3cc3442314b878f7cac74cd31e1b9/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk8/e2d3cc3442314b878f7cac74cd31e1b9/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk8/e2d3cc3442314b878f7cac74cd31e1b9/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh7/0999f7aa078e4a8cbeec7501ad1bda12/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl8%252Fda0d0ea9b518495c92ff5cba2d3b93b5%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl8/da0d0ea9b518495c92ff5cba2d3b93b5/images/large/8.jpg not downloaded yet
2026-03-25 16:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl8%252Fda0d0ea9b518495c92ff5cba2d3b93b5%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl8/da0d0ea9b518495c92ff5cba2d3b93b5/images/large/9.jpg not downloaded yet
2026-03-25 16:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl8%252Fda0d0ea9b518495c92ff5cba2d3b93b5%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl8/da0d0ea9b518495c92ff5cba2d3b93b5/images/large/10.jpg not downloaded yet
2026-03-25 16:32:34 [ayvens.it] INFO: Found listing with ID: 1983599
2026-03-25 16:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983599%27 HTTP/1.1" 200 None
2026-03-25 16:32:34 [ayvens.it] INFO: Scrape type for 1983599: 1
2026-03-25 16:32:34 [ayvens.it] INFO: Extracting data for car ID: 1983599
2026-03-25 16:32:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ec12762f-4c8d-5916-9c1e-b6a627d59aed with identifier: 1983599
2026-03-25 16:32:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ec12762f-4c8d-5916-9c1e-b6a627d59aed with scrape type 1
2026-03-25 16:32:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ec12762f-4c8d-5916-9c1e-b6a627d59aed
2026-03-25 16:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr9%252F8f25014f625948a695f32b78b48d15bc%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr9/8f25014f625948a695f32b78b48d15bc/images/large/1.jpg not downloaded yet
2026-03-25 16:32:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcc19b10>
2026-03-25 16:32:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1db646ef-d42c-5ca3-a556-a3832d5be3f3/1db646ef-d42c-5ca3-a556-a3832d5be3f3_image_6.jpg HTTP/1.1" 201 0
2026-03-25 16:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk8%252Fe2d3cc3442314b878f7cac74cd31e1b9%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk8/e2d3cc3442314b878f7cac74cd31e1b9/images/large/7.jpg saved to cache
2026-03-25 16:32:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1db646ef-d42c-5ca3-a556-a3832d5be3f3
2026-03-25 16:32:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc366f50>
2026-03-25 16:32:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1db646ef-d42c-5ca3-a556-a3832d5be3f3/1db646ef-d42c-5ca3-a556-a3832d5be3f3_image_5.jpg HTTP/1.1" 201 0
2026-03-25 16:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk8%252Fe2d3cc3442314b878f7cac74cd31e1b9%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk8/e2d3cc3442314b878f7cac74cd31e1b9/images/large/6.jpg saved to cache
2026-03-25 16:32:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1db646ef-d42c-5ca3-a556-a3832d5be3f3
2026-03-25 16:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr9%252F8f25014f625948a695f32b78b48d15bc%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr9/8f25014f625948a695f32b78b48d15bc/images/large/2.jpg not downloaded yet
2026-03-25 16:32:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcaf5250>
2026-03-25 16:32:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5763bd92-576e-5a92-8caf-cb5fdd50967b/5763bd92-576e-5a92-8caf-cb5fdd50967b_image_8.jpg HTTP/1.1" 201 0
2026-03-25 16:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj7%252Fac542552ec5d4001b48d635fc947dfd8%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj7/ac542552ec5d4001b48d635fc947dfd8/images/large/9.jpg saved to cache
2026-03-25 16:32:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5763bd92-576e-5a92-8caf-cb5fdd50967b
2026-03-25 16:32:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5763bd92-576e-5a92-8caf-cb5fdd50967b, skipping ID generation
2026-03-25 16:32:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5763bd92-576e-5a92-8caf-cb5fdd50967b with scrape type 1
2026-03-25 16:32:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5763bd92-576e-5a92-8caf-cb5fdd50967b sending to next pipeline
2026-03-25 16:32:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 5763bd92-576e-5a92-8caf-cb5fdd50967b, identifier: 1983596
2026-03-25 16:32:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc2fef10>
2026-03-25 16:32:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb7a89b6-e31f-57d8-bffe-85f86e6d3999/bb7a89b6-e31f-57d8-bffe-85f86e6d3999_image_8.jpg HTTP/1.1" 201 0
2026-03-25 16:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh7%252F0999f7aa078e4a8cbeec7501ad1bda12%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh7/0999f7aa078e4a8cbeec7501ad1bda12/images/large/9.jpg saved to cache
2026-03-25 16:32:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item bb7a89b6-e31f-57d8-bffe-85f86e6d3999
2026-03-25 16:32:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34de460290>
2026-03-25 16:32:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1db646ef-d42c-5ca3-a556-a3832d5be3f3/1db646ef-d42c-5ca3-a556-a3832d5be3f3_image_3.jpg HTTP/1.1" 201 0
2026-03-25 16:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk8%252Fe2d3cc3442314b878f7cac74cd31e1b9%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk8/e2d3cc3442314b878f7cac74cd31e1b9/images/large/4.jpg saved to cache
2026-03-25 16:32:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1db646ef-d42c-5ca3-a556-a3832d5be3f3
2026-03-25 16:32:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc5a0c10>
2026-03-25 16:32:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1db646ef-d42c-5ca3-a556-a3832d5be3f3/1db646ef-d42c-5ca3-a556-a3832d5be3f3_image_4.jpg HTTP/1.1" 201 0
2026-03-25 16:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk8%252Fe2d3cc3442314b878f7cac74cd31e1b9%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk8/e2d3cc3442314b878f7cac74cd31e1b9/images/large/5.jpg saved to cache
2026-03-25 16:32:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1db646ef-d42c-5ca3-a556-a3832d5be3f3
2026-03-25 16:32:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcb16290>
2026-03-25 16:32:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1db646ef-d42c-5ca3-a556-a3832d5be3f3/1db646ef-d42c-5ca3-a556-a3832d5be3f3_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk8%252Fe2d3cc3442314b878f7cac74cd31e1b9%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk8/e2d3cc3442314b878f7cac74cd31e1b9/images/large/1.jpg saved to cache
2026-03-25 16:32:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1db646ef-d42c-5ca3-a556-a3832d5be3f3
2026-03-25 16:32:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc324d50>
2026-03-25 16:32:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb7a89b6-e31f-57d8-bffe-85f86e6d3999/bb7a89b6-e31f-57d8-bffe-85f86e6d3999_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh7%252F0999f7aa078e4a8cbeec7501ad1bda12%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh7/0999f7aa078e4a8cbeec7501ad1bda12/images/large/1.jpg saved to cache
2026-03-25 16:32:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bb7a89b6-e31f-57d8-bffe-85f86e6d3999
2026-03-25 16:32:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bb7a89b6-e31f-57d8-bffe-85f86e6d3999, skipping ID generation
2026-03-25 16:32:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bb7a89b6-e31f-57d8-bffe-85f86e6d3999 with scrape type 1
2026-03-25 16:32:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bb7a89b6-e31f-57d8-bffe-85f86e6d3999 sending to next pipeline
2026-03-25 16:32:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: bb7a89b6-e31f-57d8-bffe-85f86e6d3999, identifier: 1983590
2026-03-25 16:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr9%252F8f25014f625948a695f32b78b48d15bc%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr9/8f25014f625948a695f32b78b48d15bc/images/large/3.jpg not downloaded yet
2026-03-25 16:32:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 5763bd92-576e-5a92-8caf-cb5fdd50967b with identifier: 1983596
2026-03-25 16:32:35 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:32:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 5763bd92-576e-5a92-8caf-cb5fdd50967b with identifier: 1983596
2026-03-25 16:32:35 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 5763bd92-576e-5a92-8caf-cb5fdd50967b with identifier: 1983596 to the API
2026-03-25 16:32:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:32:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:32:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gj7/ac542552ec5d4001b48d635fc947dfd8/images/large/9.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'MOONDUST SILVER METALLIZZATO',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-27T09:30:00Z',
'fuel_type': 'diesel',
'id': '5763bd92-576e-5a92-8caf-cb5fdd50967b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41025',
'listing': 'auction',
'location': None,
'make': 'FORD',
'model': 'FORD FOCUS SW (PC) 1.5 ECOBLUE 120CV BUSINESS SW FP',
'odometer': 111958,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 29,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5763bd92-576e-5a92-8caf-cb5fdd50967b/5763bd92-576e-5a92-8caf-cb5fdd50967b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 502890,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj7/ac542552ec5d4001b48d635fc947dfd8/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5763bd92-576e-5a92-8caf-cb5fdd50967b/5763bd92-576e-5a92-8caf-cb5fdd50967b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 396739,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj7/ac542552ec5d4001b48d635fc947dfd8/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5763bd92-576e-5a92-8caf-cb5fdd50967b/5763bd92-576e-5a92-8caf-cb5fdd50967b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 417001,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj7/ac542552ec5d4001b48d635fc947dfd8/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5763bd92-576e-5a92-8caf-cb5fdd50967b/5763bd92-576e-5a92-8caf-cb5fdd50967b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 388795,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj7/ac542552ec5d4001b48d635fc947dfd8/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5763bd92-576e-5a92-8caf-cb5fdd50967b/5763bd92-576e-5a92-8caf-cb5fdd50967b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 207843,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj7/ac542552ec5d4001b48d635fc947dfd8/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5763bd92-576e-5a92-8caf-cb5fdd50967b/5763bd92-576e-5a92-8caf-cb5fdd50967b_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 476094,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj7/ac542552ec5d4001b48d635fc947dfd8/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5763bd92-576e-5a92-8caf-cb5fdd50967b/5763bd92-576e-5a92-8caf-cb5fdd50967b_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 218783,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj7/ac542552ec5d4001b48d635fc947dfd8/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5763bd92-576e-5a92-8caf-cb5fdd50967b/5763bd92-576e-5a92-8caf-cb5fdd50967b_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 549635,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj7/ac542552ec5d4001b48d635fc947dfd8/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5763bd92-576e-5a92-8caf-cb5fdd50967b/5763bd92-576e-5a92-8caf-cb5fdd50967b_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 441012,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj7/ac542552ec5d4001b48d635fc947dfd8/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5763bd92-576e-5a92-8caf-cb5fdd50967b/5763bd92-576e-5a92-8caf-cb5fdd50967b_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 173514,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj7/ac542552ec5d4001b48d635fc947dfd8/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-02-11',
'seats_number': 5,
'seller_name': None,
'title': 'FORD FORD FOCUS SW (PC) 1.5 ECOBLUE 120CV BUSINESS SW FP -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-25 16:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983596%27 HTTP/1.1" 200 None
2026-03-25 16:32:36 [ayvens.it] INFO: Saving data for 1983596: {'created_time': 1774456356.011768, 'last_price_update_time': 1774456356.011779, 'auction_closing_time': 1774603800.0}
2026-03-25 16:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1983596') HTTP/1.1" 204 0
2026-03-25 16:32:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: bb7a89b6-e31f-57d8-bffe-85f86e6d3999 with identifier: 1983590
2026-03-25 16:32:36 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:32:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: bb7a89b6-e31f-57d8-bffe-85f86e6d3999 with identifier: 1983590
2026-03-25 16:32:36 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: bb7a89b6-e31f-57d8-bffe-85f86e6d3999 with identifier: 1983590 to the API
2026-03-25 16:32:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:32:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:32:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gh7/0999f7aa078e4a8cbeec7501ad1bda12/images/large/1.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'BIANCO PERLA METALLIZZATO',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-27T09:30:00Z',
'fuel_type': 'hybrid',
'id': 'bb7a89b6-e31f-57d8-bffe-85f86e6d3999',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41025',
'listing': 'auction',
'location': None,
'make': 'LEXUS',
'model': 'LEXUS UX (PC) HYBRID BUSINESS 2WD MY22 FP',
'odometer': 72627,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 24,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb7a89b6-e31f-57d8-bffe-85f86e6d3999/bb7a89b6-e31f-57d8-bffe-85f86e6d3999_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 576291,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh7/0999f7aa078e4a8cbeec7501ad1bda12/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb7a89b6-e31f-57d8-bffe-85f86e6d3999/bb7a89b6-e31f-57d8-bffe-85f86e6d3999_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 593500,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh7/0999f7aa078e4a8cbeec7501ad1bda12/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb7a89b6-e31f-57d8-bffe-85f86e6d3999/bb7a89b6-e31f-57d8-bffe-85f86e6d3999_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 576291,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh7/0999f7aa078e4a8cbeec7501ad1bda12/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb7a89b6-e31f-57d8-bffe-85f86e6d3999/bb7a89b6-e31f-57d8-bffe-85f86e6d3999_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 667028,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh7/0999f7aa078e4a8cbeec7501ad1bda12/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb7a89b6-e31f-57d8-bffe-85f86e6d3999/bb7a89b6-e31f-57d8-bffe-85f86e6d3999_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 583639,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh7/0999f7aa078e4a8cbeec7501ad1bda12/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb7a89b6-e31f-57d8-bffe-85f86e6d3999/bb7a89b6-e31f-57d8-bffe-85f86e6d3999_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 519452,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh7/0999f7aa078e4a8cbeec7501ad1bda12/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb7a89b6-e31f-57d8-bffe-85f86e6d3999/bb7a89b6-e31f-57d8-bffe-85f86e6d3999_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 557683,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh7/0999f7aa078e4a8cbeec7501ad1bda12/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb7a89b6-e31f-57d8-bffe-85f86e6d3999/bb7a89b6-e31f-57d8-bffe-85f86e6d3999_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 613266,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh7/0999f7aa078e4a8cbeec7501ad1bda12/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb7a89b6-e31f-57d8-bffe-85f86e6d3999/bb7a89b6-e31f-57d8-bffe-85f86e6d3999_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 501944,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh7/0999f7aa078e4a8cbeec7501ad1bda12/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb7a89b6-e31f-57d8-bffe-85f86e6d3999/bb7a89b6-e31f-57d8-bffe-85f86e6d3999_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 462211,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh7/0999f7aa078e4a8cbeec7501ad1bda12/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-01-14',
'seats_number': 5,
'seller_name': None,
'title': 'LEXUS LEXUS UX (PC) HYBRID BUSINESS 2WD MY22 FP -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-25 16:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983590%27 HTTP/1.1" 200 None
2026-03-25 16:32:36 [ayvens.it] INFO: Saving data for 1983590: {'created_time': 1774456356.517801, 'last_price_update_time': 1774456356.51782, 'auction_closing_time': 1774603800.0}
2026-03-25 16:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1983590') HTTP/1.1" 204 0
2026-03-25 16:32:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk8/e2d3cc3442314b878f7cac74cd31e1b9/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr9%252F8f25014f625948a695f32b78b48d15bc%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr9/8f25014f625948a695f32b78b48d15bc/images/large/4.jpg not downloaded yet
2026-03-25 16:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr9%252F8f25014f625948a695f32b78b48d15bc%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr9/8f25014f625948a695f32b78b48d15bc/images/large/5.jpg not downloaded yet
2026-03-25 16:32:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk8/e2d3cc3442314b878f7cac74cd31e1b9/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk8/e2d3cc3442314b878f7cac74cd31e1b9/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh3/c5b4eed1b7d64908abba4361c9d51e42/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh3/c5b4eed1b7d64908abba4361c9d51e42/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr9%252F8f25014f625948a695f32b78b48d15bc%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr9/8f25014f625948a695f32b78b48d15bc/images/large/6.jpg not downloaded yet
2026-03-25 16:32:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh3/c5b4eed1b7d64908abba4361c9d51e42/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr9%252F8f25014f625948a695f32b78b48d15bc%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr9/8f25014f625948a695f32b78b48d15bc/images/large/7.jpg not downloaded yet
2026-03-25 16:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr9%252F8f25014f625948a695f32b78b48d15bc%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr9/8f25014f625948a695f32b78b48d15bc/images/large/8.jpg not downloaded yet
2026-03-25 16:32:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl8/da0d0ea9b518495c92ff5cba2d3b93b5/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd4/9abb9f952ccf4302a733ced9c2a2e21c/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr9%252F8f25014f625948a695f32b78b48d15bc%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr9/8f25014f625948a695f32b78b48d15bc/images/large/9.jpg not downloaded yet
2026-03-25 16:32:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc364950>
2026-03-25 16:32:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1db646ef-d42c-5ca3-a556-a3832d5be3f3/1db646ef-d42c-5ca3-a556-a3832d5be3f3_image_8.jpg HTTP/1.1" 201 0
2026-03-25 16:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk8%252Fe2d3cc3442314b878f7cac74cd31e1b9%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk8/e2d3cc3442314b878f7cac74cd31e1b9/images/large/9.jpg saved to cache
2026-03-25 16:32:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1db646ef-d42c-5ca3-a556-a3832d5be3f3
2026-03-25 16:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr9%252F8f25014f625948a695f32b78b48d15bc%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr9/8f25014f625948a695f32b78b48d15bc/images/large/10.jpg not downloaded yet
2026-03-25 16:32:36 [ayvens.it] INFO: Found listing with ID: 1983600
2026-03-25 16:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983600%27 HTTP/1.1" 200 None
2026-03-25 16:32:36 [ayvens.it] INFO: Scrape type for 1983600: 1
2026-03-25 16:32:36 [ayvens.it] INFO: Extracting data for car ID: 1983600
2026-03-25 16:32:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 929b795f-0d34-5f05-9fff-7a261b83c347 with identifier: 1983600
2026-03-25 16:32:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 929b795f-0d34-5f05-9fff-7a261b83c347 with scrape type 1
2026-03-25 16:32:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 929b795f-0d34-5f05-9fff-7a261b83c347
2026-03-25 16:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp0%252F773882662d374468ac424e8e17eef5d4%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp0/773882662d374468ac424e8e17eef5d4/images/large/1.jpg not downloaded yet
2026-03-25 16:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp0%252F773882662d374468ac424e8e17eef5d4%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp0/773882662d374468ac424e8e17eef5d4/images/large/2.jpg not downloaded yet
2026-03-25 16:32:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcacae50>
2026-03-25 16:32:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1db646ef-d42c-5ca3-a556-a3832d5be3f3/1db646ef-d42c-5ca3-a556-a3832d5be3f3_image_7.jpg HTTP/1.1" 201 0
2026-03-25 16:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk8%252Fe2d3cc3442314b878f7cac74cd31e1b9%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk8/e2d3cc3442314b878f7cac74cd31e1b9/images/large/8.jpg saved to cache
2026-03-25 16:32:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1db646ef-d42c-5ca3-a556-a3832d5be3f3
2026-03-25 16:32:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34de458150>
2026-03-25 16:32:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1db646ef-d42c-5ca3-a556-a3832d5be3f3/1db646ef-d42c-5ca3-a556-a3832d5be3f3_image_9.jpg HTTP/1.1" 201 0
2026-03-25 16:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk8%252Fe2d3cc3442314b878f7cac74cd31e1b9%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk8/e2d3cc3442314b878f7cac74cd31e1b9/images/large/10.jpg saved to cache
2026-03-25 16:32:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1db646ef-d42c-5ca3-a556-a3832d5be3f3
2026-03-25 16:32:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1db646ef-d42c-5ca3-a556-a3832d5be3f3, skipping ID generation
2026-03-25 16:32:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1db646ef-d42c-5ca3-a556-a3832d5be3f3 with scrape type 1
2026-03-25 16:32:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1db646ef-d42c-5ca3-a556-a3832d5be3f3 sending to next pipeline
2026-03-25 16:32:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 1db646ef-d42c-5ca3-a556-a3832d5be3f3, identifier: 1983597
2026-03-25 16:32:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34de161ad0>
2026-03-25 16:32:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8266c022-3d29-5bf4-b747-4794e2a2c615/8266c022-3d29-5bf4-b747-4794e2a2c615_image_7.jpg HTTP/1.1" 201 0
2026-03-25 16:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh3%252Fc5b4eed1b7d64908abba4361c9d51e42%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh3/c5b4eed1b7d64908abba4361c9d51e42/images/large/8.jpg saved to cache
2026-03-25 16:32:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8266c022-3d29-5bf4-b747-4794e2a2c615
2026-03-25 16:32:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc5d5850>
2026-03-25 16:32:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8266c022-3d29-5bf4-b747-4794e2a2c615/8266c022-3d29-5bf4-b747-4794e2a2c615_image_9.jpg HTTP/1.1" 201 0
2026-03-25 16:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh3%252Fc5b4eed1b7d64908abba4361c9d51e42%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh3/c5b4eed1b7d64908abba4361c9d51e42/images/large/10.jpg saved to cache
2026-03-25 16:32:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8266c022-3d29-5bf4-b747-4794e2a2c615
2026-03-25 16:32:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcc0b450>
2026-03-25 16:32:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8266c022-3d29-5bf4-b747-4794e2a2c615/8266c022-3d29-5bf4-b747-4794e2a2c615_image_8.jpg HTTP/1.1" 201 0
2026-03-25 16:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh3%252Fc5b4eed1b7d64908abba4361c9d51e42%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh3/c5b4eed1b7d64908abba4361c9d51e42/images/large/9.jpg saved to cache
2026-03-25 16:32:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8266c022-3d29-5bf4-b747-4794e2a2c615
2026-03-25 16:32:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8266c022-3d29-5bf4-b747-4794e2a2c615, skipping ID generation
2026-03-25 16:32:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8266c022-3d29-5bf4-b747-4794e2a2c615 with scrape type 1
2026-03-25 16:32:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8266c022-3d29-5bf4-b747-4794e2a2c615 sending to next pipeline
2026-03-25 16:32:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 8266c022-3d29-5bf4-b747-4794e2a2c615, identifier: 1983589
2026-03-25 16:32:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc868390>
2026-03-25 16:32:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80be8b73-a037-5b39-9c7c-5e1e71dbbea2/80be8b73-a037-5b39-9c7c-5e1e71dbbea2_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl8%252Fda0d0ea9b518495c92ff5cba2d3b93b5%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl8/da0d0ea9b518495c92ff5cba2d3b93b5/images/large/1.jpg saved to cache
2026-03-25 16:32:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 80be8b73-a037-5b39-9c7c-5e1e71dbbea2
2026-03-25 16:32:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dca89450>
2026-03-25 16:32:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b897a862-6b31-5274-b294-b18498275ee3/b897a862-6b31-5274-b294-b18498275ee3_image_1.jpg HTTP/1.1" 201 0
2026-03-25 16:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd4%252F9abb9f952ccf4302a733ced9c2a2e21c%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd4/9abb9f952ccf4302a733ced9c2a2e21c/images/large/2.jpg saved to cache
2026-03-25 16:32:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b897a862-6b31-5274-b294-b18498275ee3
2026-03-25 16:32:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b897a862-6b31-5274-b294-b18498275ee3, skipping ID generation
2026-03-25 16:32:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b897a862-6b31-5274-b294-b18498275ee3 with scrape type 1
2026-03-25 16:32:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b897a862-6b31-5274-b294-b18498275ee3 sending to next pipeline
2026-03-25 16:32:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: b897a862-6b31-5274-b294-b18498275ee3, identifier: 1983588
2026-03-25 16:32:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 1db646ef-d42c-5ca3-a556-a3832d5be3f3 with identifier: 1983597
2026-03-25 16:32:37 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:32:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 1db646ef-d42c-5ca3-a556-a3832d5be3f3 with identifier: 1983597
2026-03-25 16:32:37 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 1db646ef-d42c-5ca3-a556-a3832d5be3f3 with identifier: 1983597 to the API
2026-03-25 16:32:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:32:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:32:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gk8/e2d3cc3442314b878f7cac74cd31e1b9/images/large/10.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'ALPINE WHITE',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.3L',
'expiration_date': '2026-03-27T09:30:00Z',
'fuel_type': 'hybrid',
'id': '1db646ef-d42c-5ca3-a556-a3832d5be3f3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41025',
'listing': 'auction',
'location': None,
'make': 'JEEP',
'model': 'JEEP RENEGADE CONSIP 1.3 T4 PHEV 190CV LIMITED 4XE AUTO FP',
'odometer': 40915,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 20,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1db646ef-d42c-5ca3-a556-a3832d5be3f3/1db646ef-d42c-5ca3-a556-a3832d5be3f3_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 546318,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk8/e2d3cc3442314b878f7cac74cd31e1b9/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1db646ef-d42c-5ca3-a556-a3832d5be3f3/1db646ef-d42c-5ca3-a556-a3832d5be3f3_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 236871,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk8/e2d3cc3442314b878f7cac74cd31e1b9/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1db646ef-d42c-5ca3-a556-a3832d5be3f3/1db646ef-d42c-5ca3-a556-a3832d5be3f3_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 327020,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk8/e2d3cc3442314b878f7cac74cd31e1b9/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1db646ef-d42c-5ca3-a556-a3832d5be3f3/1db646ef-d42c-5ca3-a556-a3832d5be3f3_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 543089,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk8/e2d3cc3442314b878f7cac74cd31e1b9/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1db646ef-d42c-5ca3-a556-a3832d5be3f3/1db646ef-d42c-5ca3-a556-a3832d5be3f3_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 538781,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk8/e2d3cc3442314b878f7cac74cd31e1b9/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1db646ef-d42c-5ca3-a556-a3832d5be3f3/1db646ef-d42c-5ca3-a556-a3832d5be3f3_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 293074,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk8/e2d3cc3442314b878f7cac74cd31e1b9/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1db646ef-d42c-5ca3-a556-a3832d5be3f3/1db646ef-d42c-5ca3-a556-a3832d5be3f3_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 266249,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk8/e2d3cc3442314b878f7cac74cd31e1b9/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1db646ef-d42c-5ca3-a556-a3832d5be3f3/1db646ef-d42c-5ca3-a556-a3832d5be3f3_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 556258,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk8/e2d3cc3442314b878f7cac74cd31e1b9/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1db646ef-d42c-5ca3-a556-a3832d5be3f3/1db646ef-d42c-5ca3-a556-a3832d5be3f3_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 257222,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk8/e2d3cc3442314b878f7cac74cd31e1b9/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1db646ef-d42c-5ca3-a556-a3832d5be3f3/1db646ef-d42c-5ca3-a556-a3832d5be3f3_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 482219,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk8/e2d3cc3442314b878f7cac74cd31e1b9/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-06-07',
'seats_number': 5,
'seller_name': None,
'title': 'JEEP JEEP RENEGADE CONSIP 1.3 T4 PHEV 190CV LIMITED 4XE AUTO FP -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-25 16:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983597%27 HTTP/1.1" 200 None
2026-03-25 16:32:38 [ayvens.it] INFO: Saving data for 1983597: {'created_time': 1774456358.088919, 'last_price_update_time': 1774456358.088933, 'auction_closing_time': 1774603800.0}
2026-03-25 16:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1983597') HTTP/1.1" 204 0
2026-03-25 16:32:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 8266c022-3d29-5bf4-b747-4794e2a2c615 with identifier: 1983589
2026-03-25 16:32:38 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:32:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 8266c022-3d29-5bf4-b747-4794e2a2c615 with identifier: 1983589
2026-03-25 16:32:38 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 8266c022-3d29-5bf4-b747-4794e2a2c615 with identifier: 1983589 to the API
2026-03-25 16:32:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:32:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:32:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gh3/c5b4eed1b7d64908abba4361c9d51e42/images/large/9.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Unknown',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.5L',
'expiration_date': '2026-03-27T09:30:00Z',
'fuel_type': 'hybrid',
'id': '8266c022-3d29-5bf4-b747-4794e2a2c615',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41025',
'listing': 'auction',
'location': None,
'make': 'FORD',
'model': 'FORD KUGA 2.5 Benzina PHEV 225CV 2WD ST-Line Aut Sport utility '
'vehicle 5-door (Euro 6.2)',
'odometer': 70325,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 37,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8266c022-3d29-5bf4-b747-4794e2a2c615/8266c022-3d29-5bf4-b747-4794e2a2c615_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 778959,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh3/c5b4eed1b7d64908abba4361c9d51e42/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8266c022-3d29-5bf4-b747-4794e2a2c615/8266c022-3d29-5bf4-b747-4794e2a2c615_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 807816,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh3/c5b4eed1b7d64908abba4361c9d51e42/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8266c022-3d29-5bf4-b747-4794e2a2c615/8266c022-3d29-5bf4-b747-4794e2a2c615_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 778959,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh3/c5b4eed1b7d64908abba4361c9d51e42/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8266c022-3d29-5bf4-b747-4794e2a2c615/8266c022-3d29-5bf4-b747-4794e2a2c615_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 727608,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh3/c5b4eed1b7d64908abba4361c9d51e42/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8266c022-3d29-5bf4-b747-4794e2a2c615/8266c022-3d29-5bf4-b747-4794e2a2c615_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 758018,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh3/c5b4eed1b7d64908abba4361c9d51e42/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8266c022-3d29-5bf4-b747-4794e2a2c615/8266c022-3d29-5bf4-b747-4794e2a2c615_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 633845,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh3/c5b4eed1b7d64908abba4361c9d51e42/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8266c022-3d29-5bf4-b747-4794e2a2c615/8266c022-3d29-5bf4-b747-4794e2a2c615_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 496612,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh3/c5b4eed1b7d64908abba4361c9d51e42/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8266c022-3d29-5bf4-b747-4794e2a2c615/8266c022-3d29-5bf4-b747-4794e2a2c615_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 496612,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh3/c5b4eed1b7d64908abba4361c9d51e42/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8266c022-3d29-5bf4-b747-4794e2a2c615/8266c022-3d29-5bf4-b747-4794e2a2c615_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 576658,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh3/c5b4eed1b7d64908abba4361c9d51e42/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8266c022-3d29-5bf4-b747-4794e2a2c615/8266c022-3d29-5bf4-b747-4794e2a2c615_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 470221,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh3/c5b4eed1b7d64908abba4361c9d51e42/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-11-10',
'seats_number': 5,
'seller_name': None,
'title': 'FORD FORD KUGA 2.5 Benzina PHEV 225CV 2WD ST-Line Aut Sport utility '
'vehicle 5-door (Euro 6.2) -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2021}
2026-03-25 16:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983589%27 HTTP/1.1" 200 None
2026-03-25 16:32:38 [ayvens.it] INFO: Saving data for 1983589: {'created_time': 1774456358.444209, 'last_price_update_time': 1774456358.44422, 'auction_closing_time': 1774603800.0}
2026-03-25 16:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1983589') HTTP/1.1" 204 0
2026-03-25 16:32:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: b897a862-6b31-5274-b294-b18498275ee3 with identifier: 1983588
2026-03-25 16:32:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: b897a862-6b31-5274-b294-b18498275ee3 with identifier: 1983588
2026-03-25 16:32:38 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: b897a862-6b31-5274-b294-b18498275ee3 with identifier: 1983588 to the API
2026-03-25 16:32:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:32:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:32:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gd4/9abb9f952ccf4302a733ced9c2a2e21c/images/large/2.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'BIANCO PERLA METALLIZZATO',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-27T09:30:00Z',
'fuel_type': 'hybrid',
'id': 'b897a862-6b31-5274-b294-b18498275ee3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41025',
'listing': 'auction',
'location': None,
'make': 'LEXUS',
'model': 'LEXUS UX LP HYBRID BUSINESS 2WD',
'odometer': 164434,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b897a862-6b31-5274-b294-b18498275ee3/b897a862-6b31-5274-b294-b18498275ee3_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 814147,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd4/9abb9f952ccf4302a733ced9c2a2e21c/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b897a862-6b31-5274-b294-b18498275ee3/b897a862-6b31-5274-b294-b18498275ee3_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 814147,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd4/9abb9f952ccf4302a733ced9c2a2e21c/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b897a862-6b31-5274-b294-b18498275ee3/b897a862-6b31-5274-b294-b18498275ee3_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 808334,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd4/9abb9f952ccf4302a733ced9c2a2e21c/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b897a862-6b31-5274-b294-b18498275ee3/b897a862-6b31-5274-b294-b18498275ee3_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 917661,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd4/9abb9f952ccf4302a733ced9c2a2e21c/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b897a862-6b31-5274-b294-b18498275ee3/b897a862-6b31-5274-b294-b18498275ee3_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 875554,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd4/9abb9f952ccf4302a733ced9c2a2e21c/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b897a862-6b31-5274-b294-b18498275ee3/b897a862-6b31-5274-b294-b18498275ee3_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 600903,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd4/9abb9f952ccf4302a733ced9c2a2e21c/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b897a862-6b31-5274-b294-b18498275ee3/b897a862-6b31-5274-b294-b18498275ee3_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 568665,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd4/9abb9f952ccf4302a733ced9c2a2e21c/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b897a862-6b31-5274-b294-b18498275ee3/b897a862-6b31-5274-b294-b18498275ee3_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 678411,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd4/9abb9f952ccf4302a733ced9c2a2e21c/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b897a862-6b31-5274-b294-b18498275ee3/b897a862-6b31-5274-b294-b18498275ee3_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 613820,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd4/9abb9f952ccf4302a733ced9c2a2e21c/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b897a862-6b31-5274-b294-b18498275ee3/b897a862-6b31-5274-b294-b18498275ee3_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 528280,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd4/9abb9f952ccf4302a733ced9c2a2e21c/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-12-24',
'seats_number': 5,
'seller_name': None,
'title': 'LEXUS LEXUS UX LP HYBRID BUSINESS 2WD -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2020}
2026-03-25 16:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983588%27 HTTP/1.1" 200 None
2026-03-25 16:32:38 [ayvens.it] INFO: Saving data for 1983588: {'created_time': 1774456358.891506, 'last_price_update_time': 1774456358.891522, 'auction_closing_time': 1774603800.0}
2026-03-25 16:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1983588') HTTP/1.1" 204 0
2026-03-25 16:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp0%252F773882662d374468ac424e8e17eef5d4%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp0/773882662d374468ac424e8e17eef5d4/images/large/3.jpg not downloaded yet
2026-03-25 16:32:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl8/da0d0ea9b518495c92ff5cba2d3b93b5/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp0%252F773882662d374468ac424e8e17eef5d4%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp0/773882662d374468ac424e8e17eef5d4/images/large/4.jpg not downloaded yet
2026-03-25 16:32:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl8/da0d0ea9b518495c92ff5cba2d3b93b5/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge8/ebb03bf1d1c64e63b0aad99a8b2048ea/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp0%252F773882662d374468ac424e8e17eef5d4%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp0/773882662d374468ac424e8e17eef5d4/images/large/5.jpg not downloaded yet
2026-03-25 16:32:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl8/da0d0ea9b518495c92ff5cba2d3b93b5/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge8/ebb03bf1d1c64e63b0aad99a8b2048ea/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp0%252F773882662d374468ac424e8e17eef5d4%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp0/773882662d374468ac424e8e17eef5d4/images/large/6.jpg not downloaded yet
2026-03-25 16:32:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl8/da0d0ea9b518495c92ff5cba2d3b93b5/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp0%252F773882662d374468ac424e8e17eef5d4%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp0/773882662d374468ac424e8e17eef5d4/images/large/7.jpg not downloaded yet
2026-03-25 16:32:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl8/da0d0ea9b518495c92ff5cba2d3b93b5/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge8/ebb03bf1d1c64e63b0aad99a8b2048ea/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp0%252F773882662d374468ac424e8e17eef5d4%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp0/773882662d374468ac424e8e17eef5d4/images/large/8.jpg not downloaded yet
2026-03-25 16:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp0%252F773882662d374468ac424e8e17eef5d4%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp0/773882662d374468ac424e8e17eef5d4/images/large/9.jpg not downloaded yet
2026-03-25 16:32:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dca07d50>
2026-03-25 16:32:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80be8b73-a037-5b39-9c7c-5e1e71dbbea2/80be8b73-a037-5b39-9c7c-5e1e71dbbea2_image_1.jpg HTTP/1.1" 201 0
2026-03-25 16:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl8%252Fda0d0ea9b518495c92ff5cba2d3b93b5%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl8/da0d0ea9b518495c92ff5cba2d3b93b5/images/large/2.jpg saved to cache
2026-03-25 16:32:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 80be8b73-a037-5b39-9c7c-5e1e71dbbea2
2026-03-25 16:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp0%252F773882662d374468ac424e8e17eef5d4%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp0/773882662d374468ac424e8e17eef5d4/images/large/10.jpg not downloaded yet
2026-03-25 16:32:39 [ayvens.it] INFO: Fetching listings with token: 3b2cc62fd26c4e29a762db3de181266b and skip: 100
2026-03-25 16:32:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc976210>
2026-03-25 16:32:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80be8b73-a037-5b39-9c7c-5e1e71dbbea2/80be8b73-a037-5b39-9c7c-5e1e71dbbea2_image_5.jpg HTTP/1.1" 201 0
2026-03-25 16:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl8%252Fda0d0ea9b518495c92ff5cba2d3b93b5%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl8/da0d0ea9b518495c92ff5cba2d3b93b5/images/large/6.jpg saved to cache
2026-03-25 16:32:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 80be8b73-a037-5b39-9c7c-5e1e71dbbea2
2026-03-25 16:32:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34d7d7d810>
2026-03-25 16:32:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_694b6125-b8b4-5b36-922b-807c2e597f64/694b6125-b8b4-5b36-922b-807c2e597f64_image_7.jpg HTTP/1.1" 201 0
2026-03-25 16:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge8%252Febb03bf1d1c64e63b0aad99a8b2048ea%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge8/ebb03bf1d1c64e63b0aad99a8b2048ea/images/large/8.jpg saved to cache
2026-03-25 16:32:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 694b6125-b8b4-5b36-922b-807c2e597f64
2026-03-25 16:32:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34d7dafc90>
2026-03-25 16:32:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80be8b73-a037-5b39-9c7c-5e1e71dbbea2/80be8b73-a037-5b39-9c7c-5e1e71dbbea2_image_4.jpg HTTP/1.1" 201 0
2026-03-25 16:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl8%252Fda0d0ea9b518495c92ff5cba2d3b93b5%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl8/da0d0ea9b518495c92ff5cba2d3b93b5/images/large/5.jpg saved to cache
2026-03-25 16:32:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 80be8b73-a037-5b39-9c7c-5e1e71dbbea2
2026-03-25 16:32:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34d7d7d490>
2026-03-25 16:32:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_694b6125-b8b4-5b36-922b-807c2e597f64/694b6125-b8b4-5b36-922b-807c2e597f64_image_6.jpg HTTP/1.1" 201 0
2026-03-25 16:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge8%252Febb03bf1d1c64e63b0aad99a8b2048ea%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge8/ebb03bf1d1c64e63b0aad99a8b2048ea/images/large/7.jpg saved to cache
2026-03-25 16:32:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 694b6125-b8b4-5b36-922b-807c2e597f64
2026-03-25 16:32:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc63e210>
2026-03-25 16:32:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80be8b73-a037-5b39-9c7c-5e1e71dbbea2/80be8b73-a037-5b39-9c7c-5e1e71dbbea2_image_2.jpg HTTP/1.1" 201 0
2026-03-25 16:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl8%252Fda0d0ea9b518495c92ff5cba2d3b93b5%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl8/da0d0ea9b518495c92ff5cba2d3b93b5/images/large/3.jpg saved to cache
2026-03-25 16:32:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 80be8b73-a037-5b39-9c7c-5e1e71dbbea2
2026-03-25 16:32:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34d7d7f910>
2026-03-25 16:32:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80be8b73-a037-5b39-9c7c-5e1e71dbbea2/80be8b73-a037-5b39-9c7c-5e1e71dbbea2_image_3.jpg HTTP/1.1" 201 0
2026-03-25 16:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl8%252Fda0d0ea9b518495c92ff5cba2d3b93b5%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl8/da0d0ea9b518495c92ff5cba2d3b93b5/images/large/4.jpg saved to cache
2026-03-25 16:32:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 80be8b73-a037-5b39-9c7c-5e1e71dbbea2
2026-03-25 16:32:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcb154d0>
2026-03-25 16:32:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_694b6125-b8b4-5b36-922b-807c2e597f64/694b6125-b8b4-5b36-922b-807c2e597f64_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge8%252Febb03bf1d1c64e63b0aad99a8b2048ea%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge8/ebb03bf1d1c64e63b0aad99a8b2048ea/images/large/1.jpg saved to cache
2026-03-25 16:32:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 694b6125-b8b4-5b36-922b-807c2e597f64
2026-03-25 16:32:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 694b6125-b8b4-5b36-922b-807c2e597f64, skipping ID generation
2026-03-25 16:32:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 694b6125-b8b4-5b36-922b-807c2e597f64 with scrape type 1
2026-03-25 16:32:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 694b6125-b8b4-5b36-922b-807c2e597f64 sending to next pipeline
2026-03-25 16:32:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 694b6125-b8b4-5b36-922b-807c2e597f64, identifier: 1983587
2026-03-25 16:32:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 694b6125-b8b4-5b36-922b-807c2e597f64 with identifier: 1983587
2026-03-25 16:32:39 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:32:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 694b6125-b8b4-5b36-922b-807c2e597f64 with identifier: 1983587
2026-03-25 16:32:40 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 694b6125-b8b4-5b36-922b-807c2e597f64 with identifier: 1983587 to the API
2026-03-25 16:32:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:32:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:32:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/ge8/ebb03bf1d1c64e63b0aad99a8b2048ea/images/large/1.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Seoul Pearl Silver metallizzat',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-27T09:30:00Z',
'fuel_type': 'diesel',
'id': '694b6125-b8b4-5b36-922b-807c2e597f64',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41025',
'listing': 'auction',
'location': None,
'make': 'LAND ROVER',
'model': 'LAND ROVER RANGE ROVER EVOQUE 2.0 D163 MHEV Standard AWD auto Sport '
'utility vehicle 5-door (Euro 6D)',
'odometer': 99498,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 29,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_694b6125-b8b4-5b36-922b-807c2e597f64/694b6125-b8b4-5b36-922b-807c2e597f64_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 620932,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge8/ebb03bf1d1c64e63b0aad99a8b2048ea/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_694b6125-b8b4-5b36-922b-807c2e597f64/694b6125-b8b4-5b36-922b-807c2e597f64_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 591438,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge8/ebb03bf1d1c64e63b0aad99a8b2048ea/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_694b6125-b8b4-5b36-922b-807c2e597f64/694b6125-b8b4-5b36-922b-807c2e597f64_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 620932,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge8/ebb03bf1d1c64e63b0aad99a8b2048ea/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_694b6125-b8b4-5b36-922b-807c2e597f64/694b6125-b8b4-5b36-922b-807c2e597f64_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 618657,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge8/ebb03bf1d1c64e63b0aad99a8b2048ea/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_694b6125-b8b4-5b36-922b-807c2e597f64/694b6125-b8b4-5b36-922b-807c2e597f64_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 623561,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge8/ebb03bf1d1c64e63b0aad99a8b2048ea/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_694b6125-b8b4-5b36-922b-807c2e597f64/694b6125-b8b4-5b36-922b-807c2e597f64_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 475517,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge8/ebb03bf1d1c64e63b0aad99a8b2048ea/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_694b6125-b8b4-5b36-922b-807c2e597f64/694b6125-b8b4-5b36-922b-807c2e597f64_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 424746,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge8/ebb03bf1d1c64e63b0aad99a8b2048ea/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_694b6125-b8b4-5b36-922b-807c2e597f64/694b6125-b8b4-5b36-922b-807c2e597f64_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 477681,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge8/ebb03bf1d1c64e63b0aad99a8b2048ea/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_694b6125-b8b4-5b36-922b-807c2e597f64/694b6125-b8b4-5b36-922b-807c2e597f64_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 495713,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge8/ebb03bf1d1c64e63b0aad99a8b2048ea/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_694b6125-b8b4-5b36-922b-807c2e597f64/694b6125-b8b4-5b36-922b-807c2e597f64_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 442172,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge8/ebb03bf1d1c64e63b0aad99a8b2048ea/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-03-10',
'seats_number': 5,
'seller_name': None,
'title': 'LAND ROVER LAND ROVER RANGE ROVER EVOQUE 2.0 D163 MHEV Standard AWD '
'auto Sport utility vehicle 5-door (Euro 6D) -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2021}
2026-03-25 16:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983587%27 HTTP/1.1" 200 None
2026-03-25 16:32:40 [ayvens.it] INFO: Saving data for 1983587: {'created_time': 1774456360.443143, 'last_price_update_time': 1774456360.443153, 'auction_closing_time': 1774603800.0}
2026-03-25 16:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1983587') HTTP/1.1" 204 0
2026-03-25 16:32:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr9/8f25014f625948a695f32b78b48d15bc/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-25 16:32:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr9/8f25014f625948a695f32b78b48d15bc/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr9/8f25014f625948a695f32b78b48d15bc/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr9/8f25014f625948a695f32b78b48d15bc/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr9/8f25014f625948a695f32b78b48d15bc/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl8/da0d0ea9b518495c92ff5cba2d3b93b5/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr9/8f25014f625948a695f32b78b48d15bc/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr9/8f25014f625948a695f32b78b48d15bc/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34de907690>
2026-03-25 16:32:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec12762f-4c8d-5916-9c1e-b6a627d59aed/ec12762f-4c8d-5916-9c1e-b6a627d59aed_image_2.jpg HTTP/1.1" 201 0
2026-03-25 16:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr9%252F8f25014f625948a695f32b78b48d15bc%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr9/8f25014f625948a695f32b78b48d15bc/images/large/3.jpg saved to cache
2026-03-25 16:32:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ec12762f-4c8d-5916-9c1e-b6a627d59aed
2026-03-25 16:32:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc9f35d0>
2026-03-25 16:32:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec12762f-4c8d-5916-9c1e-b6a627d59aed/ec12762f-4c8d-5916-9c1e-b6a627d59aed_image_4.jpg HTTP/1.1" 201 0
2026-03-25 16:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr9%252F8f25014f625948a695f32b78b48d15bc%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr9/8f25014f625948a695f32b78b48d15bc/images/large/5.jpg saved to cache
2026-03-25 16:32:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ec12762f-4c8d-5916-9c1e-b6a627d59aed
2026-03-25 16:32:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dca625d0>
2026-03-25 16:32:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec12762f-4c8d-5916-9c1e-b6a627d59aed/ec12762f-4c8d-5916-9c1e-b6a627d59aed_image_5.jpg HTTP/1.1" 201 0
2026-03-25 16:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr9%252F8f25014f625948a695f32b78b48d15bc%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr9/8f25014f625948a695f32b78b48d15bc/images/large/6.jpg saved to cache
2026-03-25 16:32:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ec12762f-4c8d-5916-9c1e-b6a627d59aed
2026-03-25 16:32:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc637790>
2026-03-25 16:32:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec12762f-4c8d-5916-9c1e-b6a627d59aed/ec12762f-4c8d-5916-9c1e-b6a627d59aed_image_3.jpg HTTP/1.1" 201 0
2026-03-25 16:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr9%252F8f25014f625948a695f32b78b48d15bc%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr9/8f25014f625948a695f32b78b48d15bc/images/large/4.jpg saved to cache
2026-03-25 16:32:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ec12762f-4c8d-5916-9c1e-b6a627d59aed
2026-03-25 16:32:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc636b50>
2026-03-25 16:32:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec12762f-4c8d-5916-9c1e-b6a627d59aed/ec12762f-4c8d-5916-9c1e-b6a627d59aed_image_6.jpg HTTP/1.1" 201 0
2026-03-25 16:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr9%252F8f25014f625948a695f32b78b48d15bc%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr9/8f25014f625948a695f32b78b48d15bc/images/large/7.jpg saved to cache
2026-03-25 16:32:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ec12762f-4c8d-5916-9c1e-b6a627d59aed
2026-03-25 16:32:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc8793d0>
2026-03-25 16:32:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80be8b73-a037-5b39-9c7c-5e1e71dbbea2/80be8b73-a037-5b39-9c7c-5e1e71dbbea2_image_9.jpg HTTP/1.1" 201 0
2026-03-25 16:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl8%252Fda0d0ea9b518495c92ff5cba2d3b93b5%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl8/da0d0ea9b518495c92ff5cba2d3b93b5/images/large/10.jpg saved to cache
2026-03-25 16:32:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 80be8b73-a037-5b39-9c7c-5e1e71dbbea2
2026-03-25 16:32:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc944e90>
2026-03-25 16:32:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec12762f-4c8d-5916-9c1e-b6a627d59aed/ec12762f-4c8d-5916-9c1e-b6a627d59aed_image_1.jpg HTTP/1.1" 201 0
2026-03-25 16:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr9%252F8f25014f625948a695f32b78b48d15bc%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr9/8f25014f625948a695f32b78b48d15bc/images/large/2.jpg saved to cache
2026-03-25 16:32:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ec12762f-4c8d-5916-9c1e-b6a627d59aed
2026-03-25 16:32:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dca62ed0>
2026-03-25 16:32:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec12762f-4c8d-5916-9c1e-b6a627d59aed/ec12762f-4c8d-5916-9c1e-b6a627d59aed_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr9%252F8f25014f625948a695f32b78b48d15bc%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr9/8f25014f625948a695f32b78b48d15bc/images/large/1.jpg saved to cache
2026-03-25 16:32:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ec12762f-4c8d-5916-9c1e-b6a627d59aed
2026-03-25 16:32:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp0/773882662d374468ac424e8e17eef5d4/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp0/773882662d374468ac424e8e17eef5d4/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp0/773882662d374468ac424e8e17eef5d4/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp0/773882662d374468ac424e8e17eef5d4/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr9/8f25014f625948a695f32b78b48d15bc/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr9/8f25014f625948a695f32b78b48d15bc/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp0/773882662d374468ac424e8e17eef5d4/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp0/773882662d374468ac424e8e17eef5d4/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc94d510>
2026-03-25 16:32:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_929b795f-0d34-5f05-9fff-7a261b83c347/929b795f-0d34-5f05-9fff-7a261b83c347_image_1.jpg HTTP/1.1" 201 0
2026-03-25 16:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp0%252F773882662d374468ac424e8e17eef5d4%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp0/773882662d374468ac424e8e17eef5d4/images/large/2.jpg saved to cache
2026-03-25 16:32:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 929b795f-0d34-5f05-9fff-7a261b83c347
2026-03-25 16:32:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc94fb10>
2026-03-25 16:32:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_929b795f-0d34-5f05-9fff-7a261b83c347/929b795f-0d34-5f05-9fff-7a261b83c347_image_4.jpg HTTP/1.1" 201 0
2026-03-25 16:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp0%252F773882662d374468ac424e8e17eef5d4%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp0/773882662d374468ac424e8e17eef5d4/images/large/5.jpg saved to cache
2026-03-25 16:32:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 929b795f-0d34-5f05-9fff-7a261b83c347
2026-03-25 16:32:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc75b2d0>
2026-03-25 16:32:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_929b795f-0d34-5f05-9fff-7a261b83c347/929b795f-0d34-5f05-9fff-7a261b83c347_image_2.jpg HTTP/1.1" 201 0
2026-03-25 16:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp0%252F773882662d374468ac424e8e17eef5d4%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp0/773882662d374468ac424e8e17eef5d4/images/large/3.jpg saved to cache
2026-03-25 16:32:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 929b795f-0d34-5f05-9fff-7a261b83c347
2026-03-25 16:32:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc802e10>
2026-03-25 16:32:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_929b795f-0d34-5f05-9fff-7a261b83c347/929b795f-0d34-5f05-9fff-7a261b83c347_image_3.jpg HTTP/1.1" 201 0
2026-03-25 16:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp0%252F773882662d374468ac424e8e17eef5d4%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp0/773882662d374468ac424e8e17eef5d4/images/large/4.jpg saved to cache
2026-03-25 16:32:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 929b795f-0d34-5f05-9fff-7a261b83c347
2026-03-25 16:32:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc94e690>
2026-03-25 16:32:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec12762f-4c8d-5916-9c1e-b6a627d59aed/ec12762f-4c8d-5916-9c1e-b6a627d59aed_image_9.jpg HTTP/1.1" 201 0
2026-03-25 16:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr9%252F8f25014f625948a695f32b78b48d15bc%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr9/8f25014f625948a695f32b78b48d15bc/images/large/10.jpg saved to cache
2026-03-25 16:32:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ec12762f-4c8d-5916-9c1e-b6a627d59aed
2026-03-25 16:32:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcab1c10>
2026-03-25 16:32:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec12762f-4c8d-5916-9c1e-b6a627d59aed/ec12762f-4c8d-5916-9c1e-b6a627d59aed_image_8.jpg HTTP/1.1" 201 0
2026-03-25 16:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr9%252F8f25014f625948a695f32b78b48d15bc%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr9/8f25014f625948a695f32b78b48d15bc/images/large/9.jpg saved to cache
2026-03-25 16:32:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ec12762f-4c8d-5916-9c1e-b6a627d59aed
2026-03-25 16:32:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc5cec50>
2026-03-25 16:32:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_929b795f-0d34-5f05-9fff-7a261b83c347/929b795f-0d34-5f05-9fff-7a261b83c347_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp0%252F773882662d374468ac424e8e17eef5d4%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp0/773882662d374468ac424e8e17eef5d4/images/large/1.jpg saved to cache
2026-03-25 16:32:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 929b795f-0d34-5f05-9fff-7a261b83c347
2026-03-25 16:32:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc91d190>
2026-03-25 16:32:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_929b795f-0d34-5f05-9fff-7a261b83c347/929b795f-0d34-5f05-9fff-7a261b83c347_image_5.jpg HTTP/1.1" 201 0
2026-03-25 16:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp0%252F773882662d374468ac424e8e17eef5d4%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp0/773882662d374468ac424e8e17eef5d4/images/large/6.jpg saved to cache
2026-03-25 16:32:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 929b795f-0d34-5f05-9fff-7a261b83c347
2026-03-25 16:32:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp0/773882662d374468ac424e8e17eef5d4/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl8/da0d0ea9b518495c92ff5cba2d3b93b5/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl8/da0d0ea9b518495c92ff5cba2d3b93b5/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp0/773882662d374468ac424e8e17eef5d4/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp0/773882662d374468ac424e8e17eef5d4/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp0/773882662d374468ac424e8e17eef5d4/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl8/da0d0ea9b518495c92ff5cba2d3b93b5/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr9/8f25014f625948a695f32b78b48d15bc/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dca1b8d0>
2026-03-25 16:32:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_929b795f-0d34-5f05-9fff-7a261b83c347/929b795f-0d34-5f05-9fff-7a261b83c347_image_6.jpg HTTP/1.1" 201 0
2026-03-25 16:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp0%252F773882662d374468ac424e8e17eef5d4%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp0/773882662d374468ac424e8e17eef5d4/images/large/7.jpg saved to cache
2026-03-25 16:32:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 929b795f-0d34-5f05-9fff-7a261b83c347
2026-03-25 16:32:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc54f110>
2026-03-25 16:32:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80be8b73-a037-5b39-9c7c-5e1e71dbbea2/80be8b73-a037-5b39-9c7c-5e1e71dbbea2_image_8.jpg HTTP/1.1" 201 0
2026-03-25 16:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl8%252Fda0d0ea9b518495c92ff5cba2d3b93b5%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl8/da0d0ea9b518495c92ff5cba2d3b93b5/images/large/9.jpg saved to cache
2026-03-25 16:32:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 80be8b73-a037-5b39-9c7c-5e1e71dbbea2
2026-03-25 16:32:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc301950>
2026-03-25 16:32:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80be8b73-a037-5b39-9c7c-5e1e71dbbea2/80be8b73-a037-5b39-9c7c-5e1e71dbbea2_image_7.jpg HTTP/1.1" 201 0
2026-03-25 16:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl8%252Fda0d0ea9b518495c92ff5cba2d3b93b5%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl8/da0d0ea9b518495c92ff5cba2d3b93b5/images/large/8.jpg saved to cache
2026-03-25 16:32:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 80be8b73-a037-5b39-9c7c-5e1e71dbbea2
2026-03-25 16:32:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dca04810>
2026-03-25 16:32:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_929b795f-0d34-5f05-9fff-7a261b83c347/929b795f-0d34-5f05-9fff-7a261b83c347_image_7.jpg HTTP/1.1" 201 0
2026-03-25 16:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp0%252F773882662d374468ac424e8e17eef5d4%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp0/773882662d374468ac424e8e17eef5d4/images/large/8.jpg saved to cache
2026-03-25 16:32:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 929b795f-0d34-5f05-9fff-7a261b83c347
2026-03-25 16:32:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dca05a90>
2026-03-25 16:32:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_929b795f-0d34-5f05-9fff-7a261b83c347/929b795f-0d34-5f05-9fff-7a261b83c347_image_9.jpg HTTP/1.1" 201 0
2026-03-25 16:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp0%252F773882662d374468ac424e8e17eef5d4%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp0/773882662d374468ac424e8e17eef5d4/images/large/10.jpg saved to cache
2026-03-25 16:32:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 929b795f-0d34-5f05-9fff-7a261b83c347
2026-03-25 16:32:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcac8d10>
2026-03-25 16:32:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_929b795f-0d34-5f05-9fff-7a261b83c347/929b795f-0d34-5f05-9fff-7a261b83c347_image_8.jpg HTTP/1.1" 201 0
2026-03-25 16:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp0%252F773882662d374468ac424e8e17eef5d4%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp0/773882662d374468ac424e8e17eef5d4/images/large/9.jpg saved to cache
2026-03-25 16:32:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 929b795f-0d34-5f05-9fff-7a261b83c347
2026-03-25 16:32:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 929b795f-0d34-5f05-9fff-7a261b83c347, skipping ID generation
2026-03-25 16:32:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 929b795f-0d34-5f05-9fff-7a261b83c347 with scrape type 1
2026-03-25 16:32:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 929b795f-0d34-5f05-9fff-7a261b83c347 sending to next pipeline
2026-03-25 16:32:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 929b795f-0d34-5f05-9fff-7a261b83c347, identifier: 1983600
2026-03-25 16:32:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc38ee10>
2026-03-25 16:32:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80be8b73-a037-5b39-9c7c-5e1e71dbbea2/80be8b73-a037-5b39-9c7c-5e1e71dbbea2_image_6.jpg HTTP/1.1" 201 0
2026-03-25 16:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl8%252Fda0d0ea9b518495c92ff5cba2d3b93b5%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl8/da0d0ea9b518495c92ff5cba2d3b93b5/images/large/7.jpg saved to cache
2026-03-25 16:32:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 80be8b73-a037-5b39-9c7c-5e1e71dbbea2
2026-03-25 16:32:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 80be8b73-a037-5b39-9c7c-5e1e71dbbea2, skipping ID generation
2026-03-25 16:32:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 80be8b73-a037-5b39-9c7c-5e1e71dbbea2 with scrape type 1
2026-03-25 16:32:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 80be8b73-a037-5b39-9c7c-5e1e71dbbea2 sending to next pipeline
2026-03-25 16:32:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 80be8b73-a037-5b39-9c7c-5e1e71dbbea2, identifier: 1983598
2026-03-25 16:32:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34ebe57f50>
2026-03-25 16:32:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec12762f-4c8d-5916-9c1e-b6a627d59aed/ec12762f-4c8d-5916-9c1e-b6a627d59aed_image_7.jpg HTTP/1.1" 201 0
2026-03-25 16:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr9%252F8f25014f625948a695f32b78b48d15bc%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr9/8f25014f625948a695f32b78b48d15bc/images/large/8.jpg saved to cache
2026-03-25 16:32:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ec12762f-4c8d-5916-9c1e-b6a627d59aed
2026-03-25 16:32:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ec12762f-4c8d-5916-9c1e-b6a627d59aed, skipping ID generation
2026-03-25 16:32:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ec12762f-4c8d-5916-9c1e-b6a627d59aed with scrape type 1
2026-03-25 16:32:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ec12762f-4c8d-5916-9c1e-b6a627d59aed sending to next pipeline
2026-03-25 16:32:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: ec12762f-4c8d-5916-9c1e-b6a627d59aed, identifier: 1983599
2026-03-25 16:32:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 929b795f-0d34-5f05-9fff-7a261b83c347 with identifier: 1983600
2026-03-25 16:32:43 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:32:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 929b795f-0d34-5f05-9fff-7a261b83c347 with identifier: 1983600
2026-03-25 16:32:43 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 929b795f-0d34-5f05-9fff-7a261b83c347 with identifier: 1983600 to the API
2026-03-25 16:32:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:32:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:32:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gp0/773882662d374468ac424e8e17eef5d4/images/large/9.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'BIANCO GHIACCIO',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-27T09:30:00Z',
'fuel_type': 'diesel',
'id': '929b795f-0d34-5f05-9fff-7a261b83c347',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41025',
'listing': 'auction',
'location': None,
'make': 'RENAULT',
'model': 'RENAULT MEGANE SW (PC) 1.5 DCI 85KW BLUE EQUILIBRE EDC FP',
'odometer': 111127,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 34,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_929b795f-0d34-5f05-9fff-7a261b83c347/929b795f-0d34-5f05-9fff-7a261b83c347_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 764040,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp0/773882662d374468ac424e8e17eef5d4/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_929b795f-0d34-5f05-9fff-7a261b83c347/929b795f-0d34-5f05-9fff-7a261b83c347_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 211423,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp0/773882662d374468ac424e8e17eef5d4/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_929b795f-0d34-5f05-9fff-7a261b83c347/929b795f-0d34-5f05-9fff-7a261b83c347_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 398604,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp0/773882662d374468ac424e8e17eef5d4/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_929b795f-0d34-5f05-9fff-7a261b83c347/929b795f-0d34-5f05-9fff-7a261b83c347_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 324003,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp0/773882662d374468ac424e8e17eef5d4/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_929b795f-0d34-5f05-9fff-7a261b83c347/929b795f-0d34-5f05-9fff-7a261b83c347_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 419571,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp0/773882662d374468ac424e8e17eef5d4/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_929b795f-0d34-5f05-9fff-7a261b83c347/929b795f-0d34-5f05-9fff-7a261b83c347_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 696562,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp0/773882662d374468ac424e8e17eef5d4/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_929b795f-0d34-5f05-9fff-7a261b83c347/929b795f-0d34-5f05-9fff-7a261b83c347_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 298567,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp0/773882662d374468ac424e8e17eef5d4/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_929b795f-0d34-5f05-9fff-7a261b83c347/929b795f-0d34-5f05-9fff-7a261b83c347_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 560521,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp0/773882662d374468ac424e8e17eef5d4/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_929b795f-0d34-5f05-9fff-7a261b83c347/929b795f-0d34-5f05-9fff-7a261b83c347_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 336484,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp0/773882662d374468ac424e8e17eef5d4/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_929b795f-0d34-5f05-9fff-7a261b83c347/929b795f-0d34-5f05-9fff-7a261b83c347_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 380443,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp0/773882662d374468ac424e8e17eef5d4/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-05-19',
'seats_number': 5,
'seller_name': None,
'title': 'RENAULT RENAULT MEGANE SW (PC) 1.5 DCI 85KW BLUE EQUILIBRE EDC FP -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2023}
2026-03-25 16:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983600%27 HTTP/1.1" 200 None
2026-03-25 16:32:43 [ayvens.it] INFO: Saving data for 1983600: {'created_time': 1774456363.728113, 'last_price_update_time': 1774456363.728124, 'auction_closing_time': 1774603800.0}
2026-03-25 16:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1983600') HTTP/1.1" 204 0
2026-03-25 16:32:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 80be8b73-a037-5b39-9c7c-5e1e71dbbea2 with identifier: 1983598
2026-03-25 16:32:43 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:32:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 80be8b73-a037-5b39-9c7c-5e1e71dbbea2 with identifier: 1983598
2026-03-25 16:32:43 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 80be8b73-a037-5b39-9c7c-5e1e71dbbea2 with identifier: 1983598 to the API
2026-03-25 16:32:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:32:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:32:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gl8/da0d0ea9b518495c92ff5cba2d3b93b5/images/large/7.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Grigio Artense metallizzato',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-27T09:30:00Z',
'fuel_type': 'diesel',
'id': '80be8b73-a037-5b39-9c7c-5e1e71dbbea2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41025',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': 'PEUGEOT 308 SW SW Allure BlueHDi 130 EAT8 S&S aut. SW 5-door (Euro '
'6D)',
'odometer': 76746,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 30,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80be8b73-a037-5b39-9c7c-5e1e71dbbea2/80be8b73-a037-5b39-9c7c-5e1e71dbbea2_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 853670,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl8/da0d0ea9b518495c92ff5cba2d3b93b5/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80be8b73-a037-5b39-9c7c-5e1e71dbbea2/80be8b73-a037-5b39-9c7c-5e1e71dbbea2_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 394527,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl8/da0d0ea9b518495c92ff5cba2d3b93b5/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80be8b73-a037-5b39-9c7c-5e1e71dbbea2/80be8b73-a037-5b39-9c7c-5e1e71dbbea2_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 617508,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl8/da0d0ea9b518495c92ff5cba2d3b93b5/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80be8b73-a037-5b39-9c7c-5e1e71dbbea2/80be8b73-a037-5b39-9c7c-5e1e71dbbea2_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 826412,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl8/da0d0ea9b518495c92ff5cba2d3b93b5/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80be8b73-a037-5b39-9c7c-5e1e71dbbea2/80be8b73-a037-5b39-9c7c-5e1e71dbbea2_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 468283,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl8/da0d0ea9b518495c92ff5cba2d3b93b5/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80be8b73-a037-5b39-9c7c-5e1e71dbbea2/80be8b73-a037-5b39-9c7c-5e1e71dbbea2_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 511798,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl8/da0d0ea9b518495c92ff5cba2d3b93b5/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80be8b73-a037-5b39-9c7c-5e1e71dbbea2/80be8b73-a037-5b39-9c7c-5e1e71dbbea2_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 656450,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl8/da0d0ea9b518495c92ff5cba2d3b93b5/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80be8b73-a037-5b39-9c7c-5e1e71dbbea2/80be8b73-a037-5b39-9c7c-5e1e71dbbea2_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 468417,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl8/da0d0ea9b518495c92ff5cba2d3b93b5/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80be8b73-a037-5b39-9c7c-5e1e71dbbea2/80be8b73-a037-5b39-9c7c-5e1e71dbbea2_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 472418,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl8/da0d0ea9b518495c92ff5cba2d3b93b5/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80be8b73-a037-5b39-9c7c-5e1e71dbbea2/80be8b73-a037-5b39-9c7c-5e1e71dbbea2_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 410137,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl8/da0d0ea9b518495c92ff5cba2d3b93b5/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-11-10',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT PEUGEOT 308 SW SW Allure BlueHDi 130 EAT8 S&S aut. SW '
'5-door (Euro 6D) -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-25 16:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983598%27 HTTP/1.1" 200 None
2026-03-25 16:32:44 [ayvens.it] INFO: Saving data for 1983598: {'created_time': 1774456364.104856, 'last_price_update_time': 1774456364.104867, 'auction_closing_time': 1774603800.0}
2026-03-25 16:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1983598') HTTP/1.1" 204 0
2026-03-25 16:32:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: ec12762f-4c8d-5916-9c1e-b6a627d59aed with identifier: 1983599
2026-03-25 16:32:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: ec12762f-4c8d-5916-9c1e-b6a627d59aed with identifier: 1983599
2026-03-25 16:32:44 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: ec12762f-4c8d-5916-9c1e-b6a627d59aed with identifier: 1983599 to the API
2026-03-25 16:32:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:32:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:32:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gr9/8f25014f625948a695f32b78b48d15bc/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'GRIGIO ARTENSE METALLIZZATO',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-27T09:30:00Z',
'fuel_type': 'diesel',
'id': 'ec12762f-4c8d-5916-9c1e-b6a627d59aed',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41025',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': 'PEUGEOT 3008 (PC) BLUEHDI 130 EAT8 S&S ALLURE PACK',
'odometer': 54702,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 55,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec12762f-4c8d-5916-9c1e-b6a627d59aed/ec12762f-4c8d-5916-9c1e-b6a627d59aed_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 744321,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr9/8f25014f625948a695f32b78b48d15bc/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec12762f-4c8d-5916-9c1e-b6a627d59aed/ec12762f-4c8d-5916-9c1e-b6a627d59aed_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 720057,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr9/8f25014f625948a695f32b78b48d15bc/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec12762f-4c8d-5916-9c1e-b6a627d59aed/ec12762f-4c8d-5916-9c1e-b6a627d59aed_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 325844,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr9/8f25014f625948a695f32b78b48d15bc/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec12762f-4c8d-5916-9c1e-b6a627d59aed/ec12762f-4c8d-5916-9c1e-b6a627d59aed_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 546422,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr9/8f25014f625948a695f32b78b48d15bc/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec12762f-4c8d-5916-9c1e-b6a627d59aed/ec12762f-4c8d-5916-9c1e-b6a627d59aed_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 424941,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr9/8f25014f625948a695f32b78b48d15bc/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec12762f-4c8d-5916-9c1e-b6a627d59aed/ec12762f-4c8d-5916-9c1e-b6a627d59aed_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 370858,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr9/8f25014f625948a695f32b78b48d15bc/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec12762f-4c8d-5916-9c1e-b6a627d59aed/ec12762f-4c8d-5916-9c1e-b6a627d59aed_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 326588,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr9/8f25014f625948a695f32b78b48d15bc/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec12762f-4c8d-5916-9c1e-b6a627d59aed/ec12762f-4c8d-5916-9c1e-b6a627d59aed_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 559521,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr9/8f25014f625948a695f32b78b48d15bc/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec12762f-4c8d-5916-9c1e-b6a627d59aed/ec12762f-4c8d-5916-9c1e-b6a627d59aed_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 314651,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr9/8f25014f625948a695f32b78b48d15bc/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec12762f-4c8d-5916-9c1e-b6a627d59aed/ec12762f-4c8d-5916-9c1e-b6a627d59aed_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 308799,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr9/8f25014f625948a695f32b78b48d15bc/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-08-30',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT PEUGEOT 3008 (PC) BLUEHDI 130 EAT8 S&S ALLURE PACK -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2023}
2026-03-25 16:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983599%27 HTTP/1.1" 200 None
2026-03-25 16:32:44 [ayvens.it] INFO: Saving data for 1983599: {'created_time': 1774456364.46308, 'last_price_update_time': 1774456364.463089, 'auction_closing_time': 1774603800.0}
2026-03-25 16:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1983599') HTTP/1.1" 204 0
2026-03-25 16:32:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc7/0a7a0c2bd61f43fca3b045cb165cf1c9/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:44 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.aldcarmarket.com/graphql/saleevents> (referer: https://carmarket.ayvens.com/) ['zyte-api']
2026-03-25 16:32:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc7/0a7a0c2bd61f43fca3b045cb165cf1c9/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge8/b0e5fe6eced240648eb4c08016be71a1/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc0/baa087d641fd49938ba8f94137c35467/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge8/b0e5fe6eced240648eb4c08016be71a1/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc6/54b02016a093423788c505c366ea2589/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc6/54b02016a093423788c505c366ea2589/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc0/baa087d641fd49938ba8f94137c35467/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcc0a950>
2026-03-25 16:32:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa6969c7-c5db-5e4b-9e23-509bda400357/aa6969c7-c5db-5e4b-9e23-509bda400357_image_6.jpg HTTP/1.1" 201 0
2026-03-25 16:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc7%252F0a7a0c2bd61f43fca3b045cb165cf1c9%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc7/0a7a0c2bd61f43fca3b045cb165cf1c9/images/large/7.jpg saved to cache
2026-03-25 16:32:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item aa6969c7-c5db-5e4b-9e23-509bda400357
2026-03-25 16:32:44 [ayvens.it] INFO: Found listing with ID: 1983601
2026-03-25 16:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983601%27 HTTP/1.1" 200 None
2026-03-25 16:32:44 [ayvens.it] INFO: Scrape type for 1983601: 1
2026-03-25 16:32:44 [ayvens.it] INFO: Extracting data for car ID: 1983601
2026-03-25 16:32:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 41e4dd95-6716-53c2-aedf-859273b2edb6 with identifier: 1983601
2026-03-25 16:32:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 41e4dd95-6716-53c2-aedf-859273b2edb6 with scrape type 1
2026-03-25 16:32:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 41e4dd95-6716-53c2-aedf-859273b2edb6
2026-03-25 16:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm4%252Fa13df06b7b4042d4a614464e9a76a8ac%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm4/a13df06b7b4042d4a614464e9a76a8ac/images/large/1.jpg not downloaded yet
2026-03-25 16:32:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc929e50>
2026-03-25 16:32:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa6969c7-c5db-5e4b-9e23-509bda400357/aa6969c7-c5db-5e4b-9e23-509bda400357_image_7.jpg HTTP/1.1" 201 0
2026-03-25 16:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc7%252F0a7a0c2bd61f43fca3b045cb165cf1c9%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc7/0a7a0c2bd61f43fca3b045cb165cf1c9/images/large/8.jpg saved to cache
2026-03-25 16:32:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item aa6969c7-c5db-5e4b-9e23-509bda400357
2026-03-25 16:32:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: aa6969c7-c5db-5e4b-9e23-509bda400357, skipping ID generation
2026-03-25 16:32:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aa6969c7-c5db-5e4b-9e23-509bda400357 with scrape type 1
2026-03-25 16:32:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item aa6969c7-c5db-5e4b-9e23-509bda400357 sending to next pipeline
2026-03-25 16:32:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: aa6969c7-c5db-5e4b-9e23-509bda400357, identifier: 1983583
2026-03-25 16:32:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dca05950>
2026-03-25 16:32:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5105208-f25f-5aec-87b2-82099689733f/a5105208-f25f-5aec-87b2-82099689733f_image_8.jpg HTTP/1.1" 201 0
2026-03-25 16:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge8%252Fb0e5fe6eced240648eb4c08016be71a1%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge8/b0e5fe6eced240648eb4c08016be71a1/images/large/9.jpg saved to cache
2026-03-25 16:32:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a5105208-f25f-5aec-87b2-82099689733f
2026-03-25 16:32:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcc19f90>
2026-03-25 16:32:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c9dce74-d0fe-5099-a3e8-70e7e71f0b6b/8c9dce74-d0fe-5099-a3e8-70e7e71f0b6b_image_9.jpg HTTP/1.1" 201 0
2026-03-25 16:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc0%252Fbaa087d641fd49938ba8f94137c35467%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc0/baa087d641fd49938ba8f94137c35467/images/large/10.jpg saved to cache
2026-03-25 16:32:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8c9dce74-d0fe-5099-a3e8-70e7e71f0b6b
2026-03-25 16:32:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcbb4ad0>
2026-03-25 16:32:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5105208-f25f-5aec-87b2-82099689733f/a5105208-f25f-5aec-87b2-82099689733f_image_9.jpg HTTP/1.1" 201 0
2026-03-25 16:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge8%252Fb0e5fe6eced240648eb4c08016be71a1%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge8/b0e5fe6eced240648eb4c08016be71a1/images/large/10.jpg saved to cache
2026-03-25 16:32:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a5105208-f25f-5aec-87b2-82099689733f
2026-03-25 16:32:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a5105208-f25f-5aec-87b2-82099689733f, skipping ID generation
2026-03-25 16:32:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a5105208-f25f-5aec-87b2-82099689733f with scrape type 1
2026-03-25 16:32:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a5105208-f25f-5aec-87b2-82099689733f sending to next pipeline
2026-03-25 16:32:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: a5105208-f25f-5aec-87b2-82099689733f, identifier: 1983586
2026-03-25 16:32:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc9de550>
2026-03-25 16:32:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d2143ed-9432-5b83-a60a-a9f9f2c07100/9d2143ed-9432-5b83-a60a-a9f9f2c07100_image_6.jpg HTTP/1.1" 201 0
2026-03-25 16:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc6%252F54b02016a093423788c505c366ea2589%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc6/54b02016a093423788c505c366ea2589/images/large/7.jpg saved to cache
2026-03-25 16:32:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9d2143ed-9432-5b83-a60a-a9f9f2c07100
2026-03-25 16:32:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc96a190>
2026-03-25 16:32:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d2143ed-9432-5b83-a60a-a9f9f2c07100/9d2143ed-9432-5b83-a60a-a9f9f2c07100_image_1.jpg HTTP/1.1" 201 0
2026-03-25 16:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc6%252F54b02016a093423788c505c366ea2589%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc6/54b02016a093423788c505c366ea2589/images/large/2.jpg saved to cache
2026-03-25 16:32:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9d2143ed-9432-5b83-a60a-a9f9f2c07100
2026-03-25 16:32:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9d2143ed-9432-5b83-a60a-a9f9f2c07100, skipping ID generation
2026-03-25 16:32:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9d2143ed-9432-5b83-a60a-a9f9f2c07100 with scrape type 1
2026-03-25 16:32:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9d2143ed-9432-5b83-a60a-a9f9f2c07100 sending to next pipeline
2026-03-25 16:32:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 9d2143ed-9432-5b83-a60a-a9f9f2c07100, identifier: 1983581
2026-03-25 16:32:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc355550>
2026-03-25 16:32:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c9dce74-d0fe-5099-a3e8-70e7e71f0b6b/8c9dce74-d0fe-5099-a3e8-70e7e71f0b6b_image_6.jpg HTTP/1.1" 201 0
2026-03-25 16:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc0%252Fbaa087d641fd49938ba8f94137c35467%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc0/baa087d641fd49938ba8f94137c35467/images/large/7.jpg saved to cache
2026-03-25 16:32:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8c9dce74-d0fe-5099-a3e8-70e7e71f0b6b
2026-03-25 16:32:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: aa6969c7-c5db-5e4b-9e23-509bda400357 with identifier: 1983583
2026-03-25 16:32:45 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:32:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: aa6969c7-c5db-5e4b-9e23-509bda400357 with identifier: 1983583
2026-03-25 16:32:45 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: aa6969c7-c5db-5e4b-9e23-509bda400357 with identifier: 1983583 to the API
2026-03-25 16:32:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:32:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:32:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gc7/0a7a0c2bd61f43fca3b045cb165cf1c9/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Summit White brilliant',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-27T09:30:00Z',
'fuel_type': 'diesel',
'id': 'aa6969c7-c5db-5e4b-9e23-509bda400357',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41025',
'listing': 'auction',
'location': None,
'make': 'OPEL',
'model': 'OPEL ASTRA 1.5 CDTI 2020 122cv S&S MT6 Hatchback 5-door (Euro 6D)',
'odometer': 9646,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 33,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa6969c7-c5db-5e4b-9e23-509bda400357/aa6969c7-c5db-5e4b-9e23-509bda400357_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 653640,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc7/0a7a0c2bd61f43fca3b045cb165cf1c9/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa6969c7-c5db-5e4b-9e23-509bda400357/aa6969c7-c5db-5e4b-9e23-509bda400357_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 466469,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc7/0a7a0c2bd61f43fca3b045cb165cf1c9/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa6969c7-c5db-5e4b-9e23-509bda400357/aa6969c7-c5db-5e4b-9e23-509bda400357_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 653640,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc7/0a7a0c2bd61f43fca3b045cb165cf1c9/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa6969c7-c5db-5e4b-9e23-509bda400357/aa6969c7-c5db-5e4b-9e23-509bda400357_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 591694,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc7/0a7a0c2bd61f43fca3b045cb165cf1c9/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa6969c7-c5db-5e4b-9e23-509bda400357/aa6969c7-c5db-5e4b-9e23-509bda400357_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 578449,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc7/0a7a0c2bd61f43fca3b045cb165cf1c9/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa6969c7-c5db-5e4b-9e23-509bda400357/aa6969c7-c5db-5e4b-9e23-509bda400357_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 403258,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc7/0a7a0c2bd61f43fca3b045cb165cf1c9/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa6969c7-c5db-5e4b-9e23-509bda400357/aa6969c7-c5db-5e4b-9e23-509bda400357_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 411618,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc7/0a7a0c2bd61f43fca3b045cb165cf1c9/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa6969c7-c5db-5e4b-9e23-509bda400357/aa6969c7-c5db-5e4b-9e23-509bda400357_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 591324,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc7/0a7a0c2bd61f43fca3b045cb165cf1c9/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa6969c7-c5db-5e4b-9e23-509bda400357/aa6969c7-c5db-5e4b-9e23-509bda400357_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 371286,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc7/0a7a0c2bd61f43fca3b045cb165cf1c9/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa6969c7-c5db-5e4b-9e23-509bda400357/aa6969c7-c5db-5e4b-9e23-509bda400357_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 328978,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc7/0a7a0c2bd61f43fca3b045cb165cf1c9/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-10-16',
'seats_number': 5,
'seller_name': None,
'title': 'OPEL OPEL ASTRA 1.5 CDTI 2020 122cv S&S MT6 Hatchback 5-door (Euro '
'6D) -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2020}
2026-03-25 16:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983583%27 HTTP/1.1" 200 None
2026-03-25 16:32:45 [ayvens.it] INFO: Saving data for 1983583: {'created_time': 1774456365.797344, 'last_price_update_time': 1774456365.797354, 'auction_closing_time': 1774603800.0}
2026-03-25 16:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1983583') HTTP/1.1" 204 0
2026-03-25 16:32:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: a5105208-f25f-5aec-87b2-82099689733f with identifier: 1983586
2026-03-25 16:32:45 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:32:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: a5105208-f25f-5aec-87b2-82099689733f with identifier: 1983586
2026-03-25 16:32:45 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: a5105208-f25f-5aec-87b2-82099689733f with identifier: 1983586 to the API
2026-03-25 16:32:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:32:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:32:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/ge8/b0e5fe6eced240648eb4c08016be71a1/images/large/10.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'BLU CANVASITE METALLIZZATO',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-27T09:30:00Z',
'fuel_type': 'hybrid',
'id': 'a5105208-f25f-5aec-87b2-82099689733f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41025',
'listing': 'auction',
'location': None,
'make': 'MERCEDES-BENZ',
'model': 'MERCEDES GLC-CLASS 300 E 4MATIC EQ-POWER SPORT AUT. FP',
'odometer': 114387,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 42,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5105208-f25f-5aec-87b2-82099689733f/a5105208-f25f-5aec-87b2-82099689733f_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 746558,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge8/b0e5fe6eced240648eb4c08016be71a1/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5105208-f25f-5aec-87b2-82099689733f/a5105208-f25f-5aec-87b2-82099689733f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 798466,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge8/b0e5fe6eced240648eb4c08016be71a1/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5105208-f25f-5aec-87b2-82099689733f/a5105208-f25f-5aec-87b2-82099689733f_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 746558,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge8/b0e5fe6eced240648eb4c08016be71a1/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5105208-f25f-5aec-87b2-82099689733f/a5105208-f25f-5aec-87b2-82099689733f_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 775676,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge8/b0e5fe6eced240648eb4c08016be71a1/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5105208-f25f-5aec-87b2-82099689733f/a5105208-f25f-5aec-87b2-82099689733f_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 862187,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge8/b0e5fe6eced240648eb4c08016be71a1/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5105208-f25f-5aec-87b2-82099689733f/a5105208-f25f-5aec-87b2-82099689733f_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 687738,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge8/b0e5fe6eced240648eb4c08016be71a1/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5105208-f25f-5aec-87b2-82099689733f/a5105208-f25f-5aec-87b2-82099689733f_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 779917,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge8/b0e5fe6eced240648eb4c08016be71a1/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5105208-f25f-5aec-87b2-82099689733f/a5105208-f25f-5aec-87b2-82099689733f_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 693396,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge8/b0e5fe6eced240648eb4c08016be71a1/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5105208-f25f-5aec-87b2-82099689733f/a5105208-f25f-5aec-87b2-82099689733f_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 674310,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge8/b0e5fe6eced240648eb4c08016be71a1/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5105208-f25f-5aec-87b2-82099689733f/a5105208-f25f-5aec-87b2-82099689733f_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 656273,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge8/b0e5fe6eced240648eb4c08016be71a1/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-02-17',
'seats_number': 5,
'seller_name': None,
'title': 'MERCEDES-BENZ MERCEDES GLC-CLASS 300 E 4MATIC EQ-POWER SPORT AUT. '
'FP -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2021}
2026-03-25 16:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983586%27 HTTP/1.1" 200 None
2026-03-25 16:32:46 [ayvens.it] INFO: Saving data for 1983586: {'created_time': 1774456366.321019, 'last_price_update_time': 1774456366.321031, 'auction_closing_time': 1774603800.0}
2026-03-25 16:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1983586') HTTP/1.1" 204 0
2026-03-25 16:32:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 9d2143ed-9432-5b83-a60a-a9f9f2c07100 with identifier: 1983581
2026-03-25 16:32:46 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:32:46 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:32:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 9d2143ed-9432-5b83-a60a-a9f9f2c07100 with identifier: 1983581
2026-03-25 16:32:46 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 9d2143ed-9432-5b83-a60a-a9f9f2c07100 with identifier: 1983581 to the API
2026-03-25 16:32:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:32:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:32:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gc6/54b02016a093423788c505c366ea2589/images/large/2.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Noir Perla Metallizzato',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-27T09:30:00Z',
'fuel_type': 'petrol',
'id': '9d2143ed-9432-5b83-a60a-a9f9f2c07100',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41025',
'listing': 'auction',
'location': None,
'make': 'OPEL',
'model': 'OPEL CROSSLAND X 1.2 130cv Innovation S&S AT6 Cross over 5-door '
'(Euro 6D)',
'odometer': 109269,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 18,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d2143ed-9432-5b83-a60a-a9f9f2c07100/9d2143ed-9432-5b83-a60a-a9f9f2c07100_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 601733,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc6/54b02016a093423788c505c366ea2589/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d2143ed-9432-5b83-a60a-a9f9f2c07100/9d2143ed-9432-5b83-a60a-a9f9f2c07100_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 601733,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc6/54b02016a093423788c505c366ea2589/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d2143ed-9432-5b83-a60a-a9f9f2c07100/9d2143ed-9432-5b83-a60a-a9f9f2c07100_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 690817,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc6/54b02016a093423788c505c366ea2589/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d2143ed-9432-5b83-a60a-a9f9f2c07100/9d2143ed-9432-5b83-a60a-a9f9f2c07100_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 692838,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc6/54b02016a093423788c505c366ea2589/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d2143ed-9432-5b83-a60a-a9f9f2c07100/9d2143ed-9432-5b83-a60a-a9f9f2c07100_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 716063,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc6/54b02016a093423788c505c366ea2589/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d2143ed-9432-5b83-a60a-a9f9f2c07100/9d2143ed-9432-5b83-a60a-a9f9f2c07100_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 517467,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc6/54b02016a093423788c505c366ea2589/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d2143ed-9432-5b83-a60a-a9f9f2c07100/9d2143ed-9432-5b83-a60a-a9f9f2c07100_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 570929,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc6/54b02016a093423788c505c366ea2589/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d2143ed-9432-5b83-a60a-a9f9f2c07100/9d2143ed-9432-5b83-a60a-a9f9f2c07100_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 570929,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc6/54b02016a093423788c505c366ea2589/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d2143ed-9432-5b83-a60a-a9f9f2c07100/9d2143ed-9432-5b83-a60a-a9f9f2c07100_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 560724,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc6/54b02016a093423788c505c366ea2589/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d2143ed-9432-5b83-a60a-a9f9f2c07100/9d2143ed-9432-5b83-a60a-a9f9f2c07100_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 556385,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc6/54b02016a093423788c505c366ea2589/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-09-01',
'seats_number': 5,
'seller_name': None,
'title': 'OPEL OPEL CROSSLAND X 1.2 130cv Innovation S&S AT6 Cross over '
'5-door (Euro 6D) -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2020}
2026-03-25 16:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983581%27 HTTP/1.1" 200 None
2026-03-25 16:32:46 [ayvens.it] INFO: Saving data for 1983581: {'created_time': 1774456366.759076, 'last_price_update_time': 1774456366.759093, 'auction_closing_time': 1774603800.0}
2026-03-25 16:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1983581') HTTP/1.1" 204 0
2026-03-25 16:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm4%252Fa13df06b7b4042d4a614464e9a76a8ac%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm4/a13df06b7b4042d4a614464e9a76a8ac/images/large/2.jpg not downloaded yet
2026-03-25 16:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm4%252Fa13df06b7b4042d4a614464e9a76a8ac%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm4/a13df06b7b4042d4a614464e9a76a8ac/images/large/3.jpg not downloaded yet
2026-03-25 16:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm4%252Fa13df06b7b4042d4a614464e9a76a8ac%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm4/a13df06b7b4042d4a614464e9a76a8ac/images/large/4.jpg not downloaded yet
2026-03-25 16:32:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp2/a37e385c06b84afda86393014e741187/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl7/21614d75138247928df577f37a5d31c9/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm4%252Fa13df06b7b4042d4a614464e9a76a8ac%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm4/a13df06b7b4042d4a614464e9a76a8ac/images/large/5.jpg not downloaded yet
2026-03-25 16:32:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc0/baa087d641fd49938ba8f94137c35467/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl7/21614d75138247928df577f37a5d31c9/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl7/21614d75138247928df577f37a5d31c9/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl5/f22afccf1e954bfa9f1b1b2193624fc7/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm4%252Fa13df06b7b4042d4a614464e9a76a8ac%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm4/a13df06b7b4042d4a614464e9a76a8ac/images/large/6.jpg not downloaded yet
2026-03-25 16:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm4%252Fa13df06b7b4042d4a614464e9a76a8ac%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm4/a13df06b7b4042d4a614464e9a76a8ac/images/large/7.jpg not downloaded yet
2026-03-25 16:32:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl7/21614d75138247928df577f37a5d31c9/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl7/21614d75138247928df577f37a5d31c9/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm4%252Fa13df06b7b4042d4a614464e9a76a8ac%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm4/a13df06b7b4042d4a614464e9a76a8ac/images/large/8.jpg not downloaded yet
2026-03-25 16:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm4%252Fa13df06b7b4042d4a614464e9a76a8ac%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm4/a13df06b7b4042d4a614464e9a76a8ac/images/large/9.jpg not downloaded yet
2026-03-25 16:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm4%252Fa13df06b7b4042d4a614464e9a76a8ac%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm4/a13df06b7b4042d4a614464e9a76a8ac/images/large/10.jpg not downloaded yet
2026-03-25 16:32:46 [ayvens.it] INFO: Found listing with ID: 1983602
2026-03-25 16:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983602%27 HTTP/1.1" 200 None
2026-03-25 16:32:47 [ayvens.it] INFO: Scrape type for 1983602: 1
2026-03-25 16:32:47 [ayvens.it] INFO: Extracting data for car ID: 1983602
2026-03-25 16:32:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 14f4c1e9-3777-50bd-a1b5-1f001441b2b5 with identifier: 1983602
2026-03-25 16:32:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 14f4c1e9-3777-50bd-a1b5-1f001441b2b5 with scrape type 1
2026-03-25 16:32:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 14f4c1e9-3777-50bd-a1b5-1f001441b2b5
2026-03-25 16:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp4%252Fbe3ef3582f0f439ba8022810d5a35b53%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp4/be3ef3582f0f439ba8022810d5a35b53/images/large/1.jpg not downloaded yet
2026-03-25 16:32:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34d6b59090>
2026-03-25 16:32:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_577ed7fb-462d-5f01-a2d2-27ca01a91c58/577ed7fb-462d-5f01-a2d2-27ca01a91c58_image_9.jpg HTTP/1.1" 201 0
2026-03-25 16:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp2%252Fa37e385c06b84afda86393014e741187%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp2/a37e385c06b84afda86393014e741187/images/large/10.jpg saved to cache
2026-03-25 16:32:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 577ed7fb-462d-5f01-a2d2-27ca01a91c58
2026-03-25 16:32:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 577ed7fb-462d-5f01-a2d2-27ca01a91c58, skipping ID generation
2026-03-25 16:32:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 577ed7fb-462d-5f01-a2d2-27ca01a91c58 with scrape type 1
2026-03-25 16:32:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 577ed7fb-462d-5f01-a2d2-27ca01a91c58 sending to next pipeline
2026-03-25 16:32:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 577ed7fb-462d-5f01-a2d2-27ca01a91c58, identifier: 1983579
2026-03-25 16:32:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc64b250>
2026-03-25 16:32:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82fe7289-ecaf-5d10-ab83-a98c9b2a2945/82fe7289-ecaf-5d10-ab83-a98c9b2a2945_image_7.jpg HTTP/1.1" 201 0
2026-03-25 16:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl7%252F21614d75138247928df577f37a5d31c9%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl7/21614d75138247928df577f37a5d31c9/images/large/8.jpg saved to cache
2026-03-25 16:32:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 82fe7289-ecaf-5d10-ab83-a98c9b2a2945
2026-03-25 16:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp4%252Fbe3ef3582f0f439ba8022810d5a35b53%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp4/be3ef3582f0f439ba8022810d5a35b53/images/large/2.jpg not downloaded yet
2026-03-25 16:32:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 577ed7fb-462d-5f01-a2d2-27ca01a91c58 with identifier: 1983579
2026-03-25 16:32:47 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:32:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 577ed7fb-462d-5f01-a2d2-27ca01a91c58 with identifier: 1983579
2026-03-25 16:32:47 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 577ed7fb-462d-5f01-a2d2-27ca01a91c58 with identifier: 1983579 to the API
2026-03-25 16:32:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:32:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:32:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gp2/a37e385c06b84afda86393014e741187/images/large/10.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'ARGENTO BRILLANTE',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-27T09:30:00Z',
'fuel_type': 'diesel',
'id': '577ed7fb-462d-5f01-a2d2-27ca01a91c58',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41025',
'listing': 'auction',
'location': None,
'make': 'SKODA',
'model': 'SKODA OCTAVIA SW 2.0 TDI EVO 110KW EXECUTIVE DSG FP',
'odometer': 193393,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 19,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_577ed7fb-462d-5f01-a2d2-27ca01a91c58/577ed7fb-462d-5f01-a2d2-27ca01a91c58_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 884900,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp2/a37e385c06b84afda86393014e741187/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_577ed7fb-462d-5f01-a2d2-27ca01a91c58/577ed7fb-462d-5f01-a2d2-27ca01a91c58_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 818083,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp2/a37e385c06b84afda86393014e741187/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_577ed7fb-462d-5f01-a2d2-27ca01a91c58/577ed7fb-462d-5f01-a2d2-27ca01a91c58_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 884900,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp2/a37e385c06b84afda86393014e741187/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_577ed7fb-462d-5f01-a2d2-27ca01a91c58/577ed7fb-462d-5f01-a2d2-27ca01a91c58_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 814699,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp2/a37e385c06b84afda86393014e741187/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_577ed7fb-462d-5f01-a2d2-27ca01a91c58/577ed7fb-462d-5f01-a2d2-27ca01a91c58_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 836206,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp2/a37e385c06b84afda86393014e741187/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_577ed7fb-462d-5f01-a2d2-27ca01a91c58/577ed7fb-462d-5f01-a2d2-27ca01a91c58_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 720521,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp2/a37e385c06b84afda86393014e741187/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_577ed7fb-462d-5f01-a2d2-27ca01a91c58/577ed7fb-462d-5f01-a2d2-27ca01a91c58_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 690761,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp2/a37e385c06b84afda86393014e741187/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_577ed7fb-462d-5f01-a2d2-27ca01a91c58/577ed7fb-462d-5f01-a2d2-27ca01a91c58_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 621627,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp2/a37e385c06b84afda86393014e741187/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_577ed7fb-462d-5f01-a2d2-27ca01a91c58/577ed7fb-462d-5f01-a2d2-27ca01a91c58_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 735995,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp2/a37e385c06b84afda86393014e741187/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_577ed7fb-462d-5f01-a2d2-27ca01a91c58/577ed7fb-462d-5f01-a2d2-27ca01a91c58_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 663739,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp2/a37e385c06b84afda86393014e741187/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-06-28',
'seats_number': 5,
'seller_name': None,
'title': 'SKODA SKODA OCTAVIA SW 2.0 TDI EVO 110KW EXECUTIVE DSG FP -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2023}
2026-03-25 16:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983579%27 HTTP/1.1" 200 None
2026-03-25 16:32:47 [ayvens.it] INFO: Saving data for 1983579: {'created_time': 1774456367.684996, 'last_price_update_time': 1774456367.685007, 'auction_closing_time': 1774603800.0}
2026-03-25 16:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1983579') HTTP/1.1" 204 0
2026-03-25 16:32:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc550c10>
2026-03-25 16:32:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c9dce74-d0fe-5099-a3e8-70e7e71f0b6b/8c9dce74-d0fe-5099-a3e8-70e7e71f0b6b_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc0%252Fbaa087d641fd49938ba8f94137c35467%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc0/baa087d641fd49938ba8f94137c35467/images/large/1.jpg saved to cache
2026-03-25 16:32:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8c9dce74-d0fe-5099-a3e8-70e7e71f0b6b
2026-03-25 16:32:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8c9dce74-d0fe-5099-a3e8-70e7e71f0b6b, skipping ID generation
2026-03-25 16:32:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8c9dce74-d0fe-5099-a3e8-70e7e71f0b6b with scrape type 1
2026-03-25 16:32:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8c9dce74-d0fe-5099-a3e8-70e7e71f0b6b sending to next pipeline
2026-03-25 16:32:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 8c9dce74-d0fe-5099-a3e8-70e7e71f0b6b, identifier: 1983580
2026-03-25 16:32:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc8e3090>
2026-03-25 16:32:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82fe7289-ecaf-5d10-ab83-a98c9b2a2945/82fe7289-ecaf-5d10-ab83-a98c9b2a2945_image_5.jpg HTTP/1.1" 201 0
2026-03-25 16:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl7%252F21614d75138247928df577f37a5d31c9%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl7/21614d75138247928df577f37a5d31c9/images/large/6.jpg saved to cache
2026-03-25 16:32:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 82fe7289-ecaf-5d10-ab83-a98c9b2a2945
2026-03-25 16:32:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc53c910>
2026-03-25 16:32:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82fe7289-ecaf-5d10-ab83-a98c9b2a2945/82fe7289-ecaf-5d10-ab83-a98c9b2a2945_image_6.jpg HTTP/1.1" 201 0
2026-03-25 16:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl7%252F21614d75138247928df577f37a5d31c9%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl7/21614d75138247928df577f37a5d31c9/images/large/7.jpg saved to cache
2026-03-25 16:32:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 82fe7289-ecaf-5d10-ab83-a98c9b2a2945
2026-03-25 16:32:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc9d7cd0>
2026-03-25 16:32:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c177fe8-417c-56d6-9b50-32e8a80cea69/8c177fe8-417c-56d6-9b50-32e8a80cea69_image_6.jpg HTTP/1.1" 201 0
2026-03-25 16:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl5%252Ff22afccf1e954bfa9f1b1b2193624fc7%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl5/f22afccf1e954bfa9f1b1b2193624fc7/images/large/7.jpg saved to cache
2026-03-25 16:32:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8c177fe8-417c-56d6-9b50-32e8a80cea69
2026-03-25 16:32:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8c177fe8-417c-56d6-9b50-32e8a80cea69, skipping ID generation
2026-03-25 16:32:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8c177fe8-417c-56d6-9b50-32e8a80cea69 with scrape type 1
2026-03-25 16:32:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8c177fe8-417c-56d6-9b50-32e8a80cea69 sending to next pipeline
2026-03-25 16:32:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 8c177fe8-417c-56d6-9b50-32e8a80cea69, identifier: 1983573
2026-03-25 16:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp4%252Fbe3ef3582f0f439ba8022810d5a35b53%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp4/be3ef3582f0f439ba8022810d5a35b53/images/large/3.jpg not downloaded yet
2026-03-25 16:32:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 8c9dce74-d0fe-5099-a3e8-70e7e71f0b6b with identifier: 1983580
2026-03-25 16:32:48 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:32:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 8c9dce74-d0fe-5099-a3e8-70e7e71f0b6b with identifier: 1983580
2026-03-25 16:32:48 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 8c9dce74-d0fe-5099-a3e8-70e7e71f0b6b with identifier: 1983580 to the API
2026-03-25 16:32:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:32:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:32:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gc0/baa087d641fd49938ba8f94137c35467/images/large/1.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Eiger Grey metallizzato',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-27T09:30:00Z',
'fuel_type': 'diesel',
'id': '8c9dce74-d0fe-5099-a3e8-70e7e71f0b6b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41025',
'listing': 'auction',
'location': None,
'make': 'LAND ROVER',
'model': 'LAND ROVER RANGE ROVER EVOQUE 2.0 D150 BUSINESS EDITION AWD auto '
'Sport utility vehicle 5-door (Euro 6.2)',
'odometer': 66505,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 26,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c9dce74-d0fe-5099-a3e8-70e7e71f0b6b/8c9dce74-d0fe-5099-a3e8-70e7e71f0b6b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 670878,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc0/baa087d641fd49938ba8f94137c35467/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c9dce74-d0fe-5099-a3e8-70e7e71f0b6b/8c9dce74-d0fe-5099-a3e8-70e7e71f0b6b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 670878,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc0/baa087d641fd49938ba8f94137c35467/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c9dce74-d0fe-5099-a3e8-70e7e71f0b6b/8c9dce74-d0fe-5099-a3e8-70e7e71f0b6b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 682380,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc0/baa087d641fd49938ba8f94137c35467/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c9dce74-d0fe-5099-a3e8-70e7e71f0b6b/8c9dce74-d0fe-5099-a3e8-70e7e71f0b6b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 724862,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc0/baa087d641fd49938ba8f94137c35467/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c9dce74-d0fe-5099-a3e8-70e7e71f0b6b/8c9dce74-d0fe-5099-a3e8-70e7e71f0b6b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 705512,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc0/baa087d641fd49938ba8f94137c35467/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c9dce74-d0fe-5099-a3e8-70e7e71f0b6b/8c9dce74-d0fe-5099-a3e8-70e7e71f0b6b_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 638294,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc0/baa087d641fd49938ba8f94137c35467/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c9dce74-d0fe-5099-a3e8-70e7e71f0b6b/8c9dce74-d0fe-5099-a3e8-70e7e71f0b6b_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 572629,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc0/baa087d641fd49938ba8f94137c35467/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c9dce74-d0fe-5099-a3e8-70e7e71f0b6b/8c9dce74-d0fe-5099-a3e8-70e7e71f0b6b_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 606459,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc0/baa087d641fd49938ba8f94137c35467/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c9dce74-d0fe-5099-a3e8-70e7e71f0b6b/8c9dce74-d0fe-5099-a3e8-70e7e71f0b6b_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 671926,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc0/baa087d641fd49938ba8f94137c35467/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c9dce74-d0fe-5099-a3e8-70e7e71f0b6b/8c9dce74-d0fe-5099-a3e8-70e7e71f0b6b_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 546644,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc0/baa087d641fd49938ba8f94137c35467/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-09-15',
'seats_number': 5,
'seller_name': None,
'title': 'LAND ROVER LAND ROVER RANGE ROVER EVOQUE 2.0 D150 BUSINESS EDITION '
'AWD auto Sport utility vehicle 5-door (Euro 6.2) -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2020}
2026-03-25 16:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983580%27 HTTP/1.1" 200 None
2026-03-25 16:32:48 [ayvens.it] INFO: Saving data for 1983580: {'created_time': 1774456368.517311, 'last_price_update_time': 1774456368.517326, 'auction_closing_time': 1774603800.0}
2026-03-25 16:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1983580') HTTP/1.1" 204 0
2026-03-25 16:32:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 8c177fe8-417c-56d6-9b50-32e8a80cea69 with identifier: 1983573
2026-03-25 16:32:48 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:32:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 8c177fe8-417c-56d6-9b50-32e8a80cea69 with identifier: 1983573
2026-03-25 16:32:48 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 8c177fe8-417c-56d6-9b50-32e8a80cea69 with identifier: 1983573 to the API
2026-03-25 16:32:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:32:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:32:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gl5/f22afccf1e954bfa9f1b1b2193624fc7/images/large/7.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'NERO ABSOLUTE METALLIZZATO',
'currency': 'EUR',
'doors_number': 4,
'engine': '1.5L',
'expiration_date': '2026-03-27T09:30:00Z',
'fuel_type': 'diesel',
'id': '8c177fe8-417c-56d6-9b50-32e8a80cea69',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41025',
'listing': 'auction',
'location': None,
'make': 'FORD',
'model': 'FORD TRANSIT CONNECT 1.5 TDCI 120CV AUTO S&S TREND 220 L1H1 FP',
'odometer': 78140,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 21,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c177fe8-417c-56d6-9b50-32e8a80cea69/8c177fe8-417c-56d6-9b50-32e8a80cea69_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 618300,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl5/f22afccf1e954bfa9f1b1b2193624fc7/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c177fe8-417c-56d6-9b50-32e8a80cea69/8c177fe8-417c-56d6-9b50-32e8a80cea69_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 618300,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl5/f22afccf1e954bfa9f1b1b2193624fc7/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c177fe8-417c-56d6-9b50-32e8a80cea69/8c177fe8-417c-56d6-9b50-32e8a80cea69_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 642418,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl5/f22afccf1e954bfa9f1b1b2193624fc7/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c177fe8-417c-56d6-9b50-32e8a80cea69/8c177fe8-417c-56d6-9b50-32e8a80cea69_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 644332,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl5/f22afccf1e954bfa9f1b1b2193624fc7/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c177fe8-417c-56d6-9b50-32e8a80cea69/8c177fe8-417c-56d6-9b50-32e8a80cea69_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 663808,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl5/f22afccf1e954bfa9f1b1b2193624fc7/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c177fe8-417c-56d6-9b50-32e8a80cea69/8c177fe8-417c-56d6-9b50-32e8a80cea69_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 573433,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl5/f22afccf1e954bfa9f1b1b2193624fc7/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c177fe8-417c-56d6-9b50-32e8a80cea69/8c177fe8-417c-56d6-9b50-32e8a80cea69_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 518435,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl5/f22afccf1e954bfa9f1b1b2193624fc7/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c177fe8-417c-56d6-9b50-32e8a80cea69/8c177fe8-417c-56d6-9b50-32e8a80cea69_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 505123,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl5/f22afccf1e954bfa9f1b1b2193624fc7/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c177fe8-417c-56d6-9b50-32e8a80cea69/8c177fe8-417c-56d6-9b50-32e8a80cea69_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 555095,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl5/f22afccf1e954bfa9f1b1b2193624fc7/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c177fe8-417c-56d6-9b50-32e8a80cea69/8c177fe8-417c-56d6-9b50-32e8a80cea69_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 493463,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl5/f22afccf1e954bfa9f1b1b2193624fc7/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-11-03',
'seats_number': 5,
'seller_name': None,
'title': 'FORD FORD TRANSIT CONNECT 1.5 TDCI 120CV AUTO S&S TREND 220 L1H1 FP '
'-',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-25 16:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983573%27 HTTP/1.1" 200 None
2026-03-25 16:32:48 [ayvens.it] INFO: Saving data for 1983573: {'created_time': 1774456368.908513, 'last_price_update_time': 1774456368.908526, 'auction_closing_time': 1774603800.0}
2026-03-25 16:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1983573') HTTP/1.1" 204 0
2026-03-25 16:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp4%252Fbe3ef3582f0f439ba8022810d5a35b53%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp4/be3ef3582f0f439ba8022810d5a35b53/images/large/4.jpg not downloaded yet
2026-03-25 16:32:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc7f8c50>
2026-03-25 16:32:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82fe7289-ecaf-5d10-ab83-a98c9b2a2945/82fe7289-ecaf-5d10-ab83-a98c9b2a2945_image_3.jpg HTTP/1.1" 201 0
2026-03-25 16:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl7%252F21614d75138247928df577f37a5d31c9%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl7/21614d75138247928df577f37a5d31c9/images/large/4.jpg saved to cache
2026-03-25 16:32:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 82fe7289-ecaf-5d10-ab83-a98c9b2a2945
2026-03-25 16:32:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcc4d450>
2026-03-25 16:32:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82fe7289-ecaf-5d10-ab83-a98c9b2a2945/82fe7289-ecaf-5d10-ab83-a98c9b2a2945_image_4.jpg HTTP/1.1" 201 0
2026-03-25 16:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl7%252F21614d75138247928df577f37a5d31c9%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl7/21614d75138247928df577f37a5d31c9/images/large/5.jpg saved to cache
2026-03-25 16:32:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 82fe7289-ecaf-5d10-ab83-a98c9b2a2945
2026-03-25 16:32:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 82fe7289-ecaf-5d10-ab83-a98c9b2a2945, skipping ID generation
2026-03-25 16:32:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 82fe7289-ecaf-5d10-ab83-a98c9b2a2945 with scrape type 1
2026-03-25 16:32:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 82fe7289-ecaf-5d10-ab83-a98c9b2a2945 sending to next pipeline
2026-03-25 16:32:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 82fe7289-ecaf-5d10-ab83-a98c9b2a2945, identifier: 1983576
2026-03-25 16:32:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 82fe7289-ecaf-5d10-ab83-a98c9b2a2945 with identifier: 1983576
2026-03-25 16:32:49 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:32:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 82fe7289-ecaf-5d10-ab83-a98c9b2a2945 with identifier: 1983576
2026-03-25 16:32:49 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 82fe7289-ecaf-5d10-ab83-a98c9b2a2945 with identifier: 1983576 to the API
2026-03-25 16:32:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:32:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:32:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gl7/21614d75138247928df577f37a5d31c9/images/large/5.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'AGATE BLACK METALIZZATO',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.5L',
'expiration_date': '2026-03-27T09:30:00Z',
'fuel_type': 'hybrid',
'id': '82fe7289-ecaf-5d10-ab83-a98c9b2a2945',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41025',
'listing': 'auction',
'location': None,
'make': 'FORD',
'model': 'FORD KUGA 2.5 BENZINA FHEV 190CV AWD ST-LINE X AUT FP',
'odometer': 94563,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 27,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82fe7289-ecaf-5d10-ab83-a98c9b2a2945/82fe7289-ecaf-5d10-ab83-a98c9b2a2945_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 868195,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl7/21614d75138247928df577f37a5d31c9/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82fe7289-ecaf-5d10-ab83-a98c9b2a2945/82fe7289-ecaf-5d10-ab83-a98c9b2a2945_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 880881,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl7/21614d75138247928df577f37a5d31c9/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82fe7289-ecaf-5d10-ab83-a98c9b2a2945/82fe7289-ecaf-5d10-ab83-a98c9b2a2945_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 868195,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl7/21614d75138247928df577f37a5d31c9/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82fe7289-ecaf-5d10-ab83-a98c9b2a2945/82fe7289-ecaf-5d10-ab83-a98c9b2a2945_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 842484,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl7/21614d75138247928df577f37a5d31c9/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82fe7289-ecaf-5d10-ab83-a98c9b2a2945/82fe7289-ecaf-5d10-ab83-a98c9b2a2945_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 791992,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl7/21614d75138247928df577f37a5d31c9/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82fe7289-ecaf-5d10-ab83-a98c9b2a2945/82fe7289-ecaf-5d10-ab83-a98c9b2a2945_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 597713,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl7/21614d75138247928df577f37a5d31c9/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82fe7289-ecaf-5d10-ab83-a98c9b2a2945/82fe7289-ecaf-5d10-ab83-a98c9b2a2945_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 557750,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl7/21614d75138247928df577f37a5d31c9/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82fe7289-ecaf-5d10-ab83-a98c9b2a2945/82fe7289-ecaf-5d10-ab83-a98c9b2a2945_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 562276,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl7/21614d75138247928df577f37a5d31c9/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82fe7289-ecaf-5d10-ab83-a98c9b2a2945/82fe7289-ecaf-5d10-ab83-a98c9b2a2945_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 750727,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl7/21614d75138247928df577f37a5d31c9/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82fe7289-ecaf-5d10-ab83-a98c9b2a2945/82fe7289-ecaf-5d10-ab83-a98c9b2a2945_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 694790,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl7/21614d75138247928df577f37a5d31c9/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-10-20',
'seats_number': 5,
'seller_name': None,
'title': 'FORD FORD KUGA 2.5 BENZINA FHEV 190CV AWD ST-LINE X AUT FP -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-25 16:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983576%27 HTTP/1.1" 200 None
2026-03-25 16:32:49 [ayvens.it] INFO: Saving data for 1983576: {'created_time': 1774456369.747171, 'last_price_update_time': 1774456369.747183, 'auction_closing_time': 1774603800.0}
2026-03-25 16:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1983576') HTTP/1.1" 204 0
2026-03-25 16:32:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt2/3c1a9c2048584c9189c0ceebca59932d/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz5/7e72cb4365644e098575536eb40d16f0/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz5/7e72cb4365644e098575536eb40d16f0/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp4%252Fbe3ef3582f0f439ba8022810d5a35b53%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp4/be3ef3582f0f439ba8022810d5a35b53/images/large/5.jpg not downloaded yet
2026-03-25 16:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp4%252Fbe3ef3582f0f439ba8022810d5a35b53%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp4/be3ef3582f0f439ba8022810d5a35b53/images/large/6.jpg not downloaded yet
2026-03-25 16:32:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk7/e8586465ad154df7bfd871928aa8223e/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz5/7e72cb4365644e098575536eb40d16f0/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fs9/9f795b6663ec44e39f880b25b0ec85d1/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz5/7e72cb4365644e098575536eb40d16f0/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fp3/f8f5f0bd09f044839ea959000278651e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp4%252Fbe3ef3582f0f439ba8022810d5a35b53%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp4/be3ef3582f0f439ba8022810d5a35b53/images/large/7.jpg not downloaded yet
2026-03-25 16:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp4%252Fbe3ef3582f0f439ba8022810d5a35b53%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp4/be3ef3582f0f439ba8022810d5a35b53/images/large/8.jpg not downloaded yet
2026-03-25 16:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp4%252Fbe3ef3582f0f439ba8022810d5a35b53%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp4/be3ef3582f0f439ba8022810d5a35b53/images/large/9.jpg not downloaded yet
2026-03-25 16:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp4%252Fbe3ef3582f0f439ba8022810d5a35b53%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp4/be3ef3582f0f439ba8022810d5a35b53/images/large/10.jpg not downloaded yet
2026-03-25 16:32:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc5eb110>
2026-03-25 16:32:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9acdc625-040e-58de-8b6a-cf7077ee2720/9acdc625-040e-58de-8b6a-cf7077ee2720_image_7.jpg HTTP/1.1" 201 0
2026-03-25 16:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt2%252F3c1a9c2048584c9189c0ceebca59932d%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt2/3c1a9c2048584c9189c0ceebca59932d/images/large/8.jpg saved to cache
2026-03-25 16:32:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9acdc625-040e-58de-8b6a-cf7077ee2720
2026-03-25 16:32:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9acdc625-040e-58de-8b6a-cf7077ee2720, skipping ID generation
2026-03-25 16:32:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9acdc625-040e-58de-8b6a-cf7077ee2720 with scrape type 1
2026-03-25 16:32:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9acdc625-040e-58de-8b6a-cf7077ee2720 sending to next pipeline
2026-03-25 16:32:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 9acdc625-040e-58de-8b6a-cf7077ee2720, identifier: 1983572
2026-03-25 16:32:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcb1dad0>
2026-03-25 16:32:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0c8faa7c-fdbc-584f-86a1-1d12a13c64bf/0c8faa7c-fdbc-584f-86a1-1d12a13c64bf_image_8.jpg HTTP/1.1" 201 0
2026-03-25 16:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz5%252F7e72cb4365644e098575536eb40d16f0%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz5/7e72cb4365644e098575536eb40d16f0/images/large/9.jpg saved to cache
2026-03-25 16:32:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0c8faa7c-fdbc-584f-86a1-1d12a13c64bf
2026-03-25 16:32:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcae81d0>
2026-03-25 16:32:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0c8faa7c-fdbc-584f-86a1-1d12a13c64bf/0c8faa7c-fdbc-584f-86a1-1d12a13c64bf_image_7.jpg HTTP/1.1" 201 0
2026-03-25 16:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz5%252F7e72cb4365644e098575536eb40d16f0%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz5/7e72cb4365644e098575536eb40d16f0/images/large/8.jpg saved to cache
2026-03-25 16:32:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0c8faa7c-fdbc-584f-86a1-1d12a13c64bf
2026-03-25 16:32:50 [ayvens.it] INFO: Found listing with ID: 1983603
2026-03-25 16:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983603%27 HTTP/1.1" 200 None
2026-03-25 16:32:50 [ayvens.it] INFO: Scrape type for 1983603: 1
2026-03-25 16:32:50 [ayvens.it] INFO: Extracting data for car ID: 1983603
2026-03-25 16:32:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 25281f6d-89b3-5e6e-b5f9-4a5841838a94 with identifier: 1983603
2026-03-25 16:32:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 25281f6d-89b3-5e6e-b5f9-4a5841838a94 with scrape type 1
2026-03-25 16:32:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 25281f6d-89b3-5e6e-b5f9-4a5841838a94
2026-03-25 16:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm7%252F21e046b1c7d54c9f984c355cc889538d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm7/21e046b1c7d54c9f984c355cc889538d/images/large/1.jpg not downloaded yet
2026-03-25 16:32:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 9acdc625-040e-58de-8b6a-cf7077ee2720 with identifier: 1983572
2026-03-25 16:32:50 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:32:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 9acdc625-040e-58de-8b6a-cf7077ee2720 with identifier: 1983572
2026-03-25 16:32:50 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 9acdc625-040e-58de-8b6a-cf7077ee2720 with identifier: 1983572 to the API
2026-03-25 16:32:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:32:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:32:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gt2/3c1a9c2048584c9189c0ceebca59932d/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'BLUE CELEBES METALLIZZATO',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-27T09:30:00Z',
'fuel_type': 'diesel',
'id': '9acdc625-040e-58de-8b6a-cf7077ee2720',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41025',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': 'PEUGEOT 3008 (PC) BLUEHDI 130 EAT8 S&S ALLURE PACK FP',
'odometer': 41925,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 34,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9acdc625-040e-58de-8b6a-cf7077ee2720/9acdc625-040e-58de-8b6a-cf7077ee2720_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 820354,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt2/3c1a9c2048584c9189c0ceebca59932d/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9acdc625-040e-58de-8b6a-cf7077ee2720/9acdc625-040e-58de-8b6a-cf7077ee2720_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 813781,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt2/3c1a9c2048584c9189c0ceebca59932d/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9acdc625-040e-58de-8b6a-cf7077ee2720/9acdc625-040e-58de-8b6a-cf7077ee2720_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 820354,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt2/3c1a9c2048584c9189c0ceebca59932d/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9acdc625-040e-58de-8b6a-cf7077ee2720/9acdc625-040e-58de-8b6a-cf7077ee2720_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 810772,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt2/3c1a9c2048584c9189c0ceebca59932d/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9acdc625-040e-58de-8b6a-cf7077ee2720/9acdc625-040e-58de-8b6a-cf7077ee2720_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 841179,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt2/3c1a9c2048584c9189c0ceebca59932d/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9acdc625-040e-58de-8b6a-cf7077ee2720/9acdc625-040e-58de-8b6a-cf7077ee2720_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 589685,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt2/3c1a9c2048584c9189c0ceebca59932d/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9acdc625-040e-58de-8b6a-cf7077ee2720/9acdc625-040e-58de-8b6a-cf7077ee2720_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 544929,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt2/3c1a9c2048584c9189c0ceebca59932d/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9acdc625-040e-58de-8b6a-cf7077ee2720/9acdc625-040e-58de-8b6a-cf7077ee2720_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 481761,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt2/3c1a9c2048584c9189c0ceebca59932d/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9acdc625-040e-58de-8b6a-cf7077ee2720/9acdc625-040e-58de-8b6a-cf7077ee2720_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 603023,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt2/3c1a9c2048584c9189c0ceebca59932d/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9acdc625-040e-58de-8b6a-cf7077ee2720/9acdc625-040e-58de-8b6a-cf7077ee2720_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 502928,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt2/3c1a9c2048584c9189c0ceebca59932d/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-02-21',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT PEUGEOT 3008 (PC) BLUEHDI 130 EAT8 S&S ALLURE PACK FP -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2024}
2026-03-25 16:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983572%27 HTTP/1.1" 200 None
2026-03-25 16:32:50 [ayvens.it] INFO: Saving data for 1983572: {'created_time': 1774456370.627272, 'last_price_update_time': 1774456370.627285, 'auction_closing_time': 1774603800.0}
2026-03-25 16:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1983572') HTTP/1.1" 204 0
2026-03-25 16:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm7%252F21e046b1c7d54c9f984c355cc889538d%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm7/21e046b1c7d54c9f984c355cc889538d/images/large/2.jpg not downloaded yet
2026-03-25 16:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm7%252F21e046b1c7d54c9f984c355cc889538d%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm7/21e046b1c7d54c9f984c355cc889538d/images/large/3.jpg not downloaded yet
2026-03-25 16:32:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc354c10>
2026-03-25 16:32:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a93b19a2-927a-558e-ae38-ec141e724405/a93b19a2-927a-558e-ae38-ec141e724405_image_7.jpg HTTP/1.1" 201 0
2026-03-25 16:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk7%252Fe8586465ad154df7bfd871928aa8223e%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk7/e8586465ad154df7bfd871928aa8223e/images/large/8.jpg saved to cache
2026-03-25 16:32:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a93b19a2-927a-558e-ae38-ec141e724405
2026-03-25 16:32:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a93b19a2-927a-558e-ae38-ec141e724405, skipping ID generation
2026-03-25 16:32:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a93b19a2-927a-558e-ae38-ec141e724405 with scrape type 1
2026-03-25 16:32:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a93b19a2-927a-558e-ae38-ec141e724405 sending to next pipeline
2026-03-25 16:32:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: a93b19a2-927a-558e-ae38-ec141e724405, identifier: 1983571
2026-03-25 16:32:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34d7dacb10>
2026-03-25 16:32:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0c8faa7c-fdbc-584f-86a1-1d12a13c64bf/0c8faa7c-fdbc-584f-86a1-1d12a13c64bf_image_6.jpg HTTP/1.1" 201 0
2026-03-25 16:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz5%252F7e72cb4365644e098575536eb40d16f0%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz5/7e72cb4365644e098575536eb40d16f0/images/large/7.jpg saved to cache
2026-03-25 16:32:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0c8faa7c-fdbc-584f-86a1-1d12a13c64bf
2026-03-25 16:32:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc758190>
2026-03-25 16:32:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bf8bec1d-86ad-5e60-a97b-f1847175df2c/bf8bec1d-86ad-5e60-a97b-f1847175df2c_image_9.jpg HTTP/1.1" 201 0
2026-03-25 16:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs9%252F9f795b6663ec44e39f880b25b0ec85d1%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs9/9f795b6663ec44e39f880b25b0ec85d1/images/large/10.jpg saved to cache
2026-03-25 16:32:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item bf8bec1d-86ad-5e60-a97b-f1847175df2c
2026-03-25 16:32:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34d7dafc90>
2026-03-25 16:32:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0c8faa7c-fdbc-584f-86a1-1d12a13c64bf/0c8faa7c-fdbc-584f-86a1-1d12a13c64bf_image_9.jpg HTTP/1.1" 201 0
2026-03-25 16:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz5%252F7e72cb4365644e098575536eb40d16f0%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz5/7e72cb4365644e098575536eb40d16f0/images/large/10.jpg saved to cache
2026-03-25 16:32:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0c8faa7c-fdbc-584f-86a1-1d12a13c64bf
2026-03-25 16:32:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0c8faa7c-fdbc-584f-86a1-1d12a13c64bf, skipping ID generation
2026-03-25 16:32:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0c8faa7c-fdbc-584f-86a1-1d12a13c64bf with scrape type 1
2026-03-25 16:32:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0c8faa7c-fdbc-584f-86a1-1d12a13c64bf sending to next pipeline
2026-03-25 16:32:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 0c8faa7c-fdbc-584f-86a1-1d12a13c64bf, identifier: 1983570
2026-03-25 16:32:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc9e4d50>
2026-03-25 16:32:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98bc6a7b-8683-5ee8-af10-4ff6f5eb34f9/98bc6a7b-8683-5ee8-af10-4ff6f5eb34f9_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffp3%252Ff8f5f0bd09f044839ea959000278651e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fp3/f8f5f0bd09f044839ea959000278651e/images/large/1.jpg saved to cache
2026-03-25 16:32:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 98bc6a7b-8683-5ee8-af10-4ff6f5eb34f9
2026-03-25 16:32:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 98bc6a7b-8683-5ee8-af10-4ff6f5eb34f9, skipping ID generation
2026-03-25 16:32:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 98bc6a7b-8683-5ee8-af10-4ff6f5eb34f9 with scrape type 1
2026-03-25 16:32:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 98bc6a7b-8683-5ee8-af10-4ff6f5eb34f9 sending to next pipeline
2026-03-25 16:32:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 98bc6a7b-8683-5ee8-af10-4ff6f5eb34f9, identifier: 1983569
2026-03-25 16:32:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: a93b19a2-927a-558e-ae38-ec141e724405 with identifier: 1983571
2026-03-25 16:32:51 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:32:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: a93b19a2-927a-558e-ae38-ec141e724405 with identifier: 1983571
2026-03-25 16:32:51 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: a93b19a2-927a-558e-ae38-ec141e724405 with identifier: 1983571 to the API
2026-03-25 16:32:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:32:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:32:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gk7/e8586465ad154df7bfd871928aa8223e/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'STEEL GREY METALL',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-27T09:30:00Z',
'fuel_type': 'diesel',
'id': 'a93b19a2-927a-558e-ae38-ec141e724405',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41025',
'listing': 'auction',
'location': None,
'make': 'CITROËN',
'model': 'CITROËN C5 AIRCROSS BlueHDi 130 S&S Business EAT8 Sport utility '
'vehicle 5-door (Euro 6D)',
'odometer': 92255,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 25,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a93b19a2-927a-558e-ae38-ec141e724405/a93b19a2-927a-558e-ae38-ec141e724405_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 763553,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk7/e8586465ad154df7bfd871928aa8223e/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a93b19a2-927a-558e-ae38-ec141e724405/a93b19a2-927a-558e-ae38-ec141e724405_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 771920,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk7/e8586465ad154df7bfd871928aa8223e/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a93b19a2-927a-558e-ae38-ec141e724405/a93b19a2-927a-558e-ae38-ec141e724405_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 763553,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk7/e8586465ad154df7bfd871928aa8223e/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a93b19a2-927a-558e-ae38-ec141e724405/a93b19a2-927a-558e-ae38-ec141e724405_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 703525,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk7/e8586465ad154df7bfd871928aa8223e/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a93b19a2-927a-558e-ae38-ec141e724405/a93b19a2-927a-558e-ae38-ec141e724405_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 797083,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk7/e8586465ad154df7bfd871928aa8223e/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a93b19a2-927a-558e-ae38-ec141e724405/a93b19a2-927a-558e-ae38-ec141e724405_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 618537,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk7/e8586465ad154df7bfd871928aa8223e/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a93b19a2-927a-558e-ae38-ec141e724405/a93b19a2-927a-558e-ae38-ec141e724405_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 574094,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk7/e8586465ad154df7bfd871928aa8223e/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a93b19a2-927a-558e-ae38-ec141e724405/a93b19a2-927a-558e-ae38-ec141e724405_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 673203,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk7/e8586465ad154df7bfd871928aa8223e/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a93b19a2-927a-558e-ae38-ec141e724405/a93b19a2-927a-558e-ae38-ec141e724405_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 687781,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk7/e8586465ad154df7bfd871928aa8223e/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a93b19a2-927a-558e-ae38-ec141e724405/a93b19a2-927a-558e-ae38-ec141e724405_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 652950,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk7/e8586465ad154df7bfd871928aa8223e/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-06-28',
'seats_number': 5,
'seller_name': None,
'title': 'CITROËN CITROËN C5 AIRCROSS BlueHDi 130 S&S Business EAT8 Sport '
'utility vehicle 5-door (Euro 6D) -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-25 16:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983571%27 HTTP/1.1" 200 None
2026-03-25 16:32:51 [ayvens.it] INFO: Saving data for 1983571: {'created_time': 1774456371.947395, 'last_price_update_time': 1774456371.947409, 'auction_closing_time': 1774603800.0}
2026-03-25 16:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1983571') HTTP/1.1" 204 0
2026-03-25 16:32:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 0c8faa7c-fdbc-584f-86a1-1d12a13c64bf with identifier: 1983570
2026-03-25 16:32:51 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:32:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 0c8faa7c-fdbc-584f-86a1-1d12a13c64bf with identifier: 1983570
2026-03-25 16:32:52 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 0c8faa7c-fdbc-584f-86a1-1d12a13c64bf with identifier: 1983570 to the API
2026-03-25 16:32:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:32:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:32:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fz5/7e72cb4365644e098575536eb40d16f0/images/large/10.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Indium Grey Metall',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-27T09:30:00Z',
'fuel_type': 'diesel',
'id': '0c8faa7c-fdbc-584f-86a1-1d12a13c64bf',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41025',
'listing': 'auction',
'location': None,
'make': 'VOLKSWAGEN',
'model': 'VOLKSWAGEN TIGUAN 2.0 TDI SCR 110KW Business BMT DSG Sport utility '
'vehicle 5-door (Euro 6.2)',
'odometer': 107183,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 22,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0c8faa7c-fdbc-584f-86a1-1d12a13c64bf/0c8faa7c-fdbc-584f-86a1-1d12a13c64bf_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 788490,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz5/7e72cb4365644e098575536eb40d16f0/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0c8faa7c-fdbc-584f-86a1-1d12a13c64bf/0c8faa7c-fdbc-584f-86a1-1d12a13c64bf_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 692430,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz5/7e72cb4365644e098575536eb40d16f0/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0c8faa7c-fdbc-584f-86a1-1d12a13c64bf/0c8faa7c-fdbc-584f-86a1-1d12a13c64bf_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 704491,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz5/7e72cb4365644e098575536eb40d16f0/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0c8faa7c-fdbc-584f-86a1-1d12a13c64bf/0c8faa7c-fdbc-584f-86a1-1d12a13c64bf_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 714161,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz5/7e72cb4365644e098575536eb40d16f0/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0c8faa7c-fdbc-584f-86a1-1d12a13c64bf/0c8faa7c-fdbc-584f-86a1-1d12a13c64bf_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 758078,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz5/7e72cb4365644e098575536eb40d16f0/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0c8faa7c-fdbc-584f-86a1-1d12a13c64bf/0c8faa7c-fdbc-584f-86a1-1d12a13c64bf_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 876587,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz5/7e72cb4365644e098575536eb40d16f0/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0c8faa7c-fdbc-584f-86a1-1d12a13c64bf/0c8faa7c-fdbc-584f-86a1-1d12a13c64bf_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 586380,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz5/7e72cb4365644e098575536eb40d16f0/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0c8faa7c-fdbc-584f-86a1-1d12a13c64bf/0c8faa7c-fdbc-584f-86a1-1d12a13c64bf_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 429541,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz5/7e72cb4365644e098575536eb40d16f0/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0c8faa7c-fdbc-584f-86a1-1d12a13c64bf/0c8faa7c-fdbc-584f-86a1-1d12a13c64bf_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 456687,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz5/7e72cb4365644e098575536eb40d16f0/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0c8faa7c-fdbc-584f-86a1-1d12a13c64bf/0c8faa7c-fdbc-584f-86a1-1d12a13c64bf_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 712721,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz5/7e72cb4365644e098575536eb40d16f0/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-10-30',
'seats_number': 5,
'seller_name': None,
'title': 'VOLKSWAGEN VOLKSWAGEN TIGUAN 2.0 TDI SCR 110KW Business BMT DSG '
'Sport utility vehicle 5-door (Euro 6.2) -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2019}
2026-03-25 16:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983570%27 HTTP/1.1" 200 None
2026-03-25 16:32:52 [ayvens.it] INFO: Saving data for 1983570: {'created_time': 1774456372.444076, 'last_price_update_time': 1774456372.444088, 'auction_closing_time': 1774603800.0}
2026-03-25 16:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1983570') HTTP/1.1" 204 0
2026-03-25 16:32:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 98bc6a7b-8683-5ee8-af10-4ff6f5eb34f9 with identifier: 1983569
2026-03-25 16:32:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 98bc6a7b-8683-5ee8-af10-4ff6f5eb34f9 with identifier: 1983569
2026-03-25 16:32:52 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 98bc6a7b-8683-5ee8-af10-4ff6f5eb34f9 with identifier: 1983569 to the API
2026-03-25 16:32:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:32:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:32:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fp3/f8f5f0bd09f044839ea959000278651e/images/large/1.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Indium Grey Metall',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-27T09:30:00Z',
'fuel_type': 'diesel',
'id': '98bc6a7b-8683-5ee8-af10-4ff6f5eb34f9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41025',
'listing': 'auction',
'location': None,
'make': 'VOLKSWAGEN',
'model': 'VOLKSWAGEN TIGUAN 2.0 TDI SCR 110KW Style BMT 4MOTION DSG Sport '
'utility vehicle 5-door',
'odometer': 121599,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 26,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98bc6a7b-8683-5ee8-af10-4ff6f5eb34f9/98bc6a7b-8683-5ee8-af10-4ff6f5eb34f9_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 686276,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fp3/f8f5f0bd09f044839ea959000278651e/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98bc6a7b-8683-5ee8-af10-4ff6f5eb34f9/98bc6a7b-8683-5ee8-af10-4ff6f5eb34f9_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 614040,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fp3/f8f5f0bd09f044839ea959000278651e/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98bc6a7b-8683-5ee8-af10-4ff6f5eb34f9/98bc6a7b-8683-5ee8-af10-4ff6f5eb34f9_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 302811,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fp3/f8f5f0bd09f044839ea959000278651e/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98bc6a7b-8683-5ee8-af10-4ff6f5eb34f9/98bc6a7b-8683-5ee8-af10-4ff6f5eb34f9_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 557201,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fp3/f8f5f0bd09f044839ea959000278651e/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98bc6a7b-8683-5ee8-af10-4ff6f5eb34f9/98bc6a7b-8683-5ee8-af10-4ff6f5eb34f9_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 335285,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fp3/f8f5f0bd09f044839ea959000278651e/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98bc6a7b-8683-5ee8-af10-4ff6f5eb34f9/98bc6a7b-8683-5ee8-af10-4ff6f5eb34f9_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 438688,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fp3/f8f5f0bd09f044839ea959000278651e/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98bc6a7b-8683-5ee8-af10-4ff6f5eb34f9/98bc6a7b-8683-5ee8-af10-4ff6f5eb34f9_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 373618,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fp3/f8f5f0bd09f044839ea959000278651e/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98bc6a7b-8683-5ee8-af10-4ff6f5eb34f9/98bc6a7b-8683-5ee8-af10-4ff6f5eb34f9_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 571665,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fp3/f8f5f0bd09f044839ea959000278651e/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98bc6a7b-8683-5ee8-af10-4ff6f5eb34f9/98bc6a7b-8683-5ee8-af10-4ff6f5eb34f9_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 375501,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fp3/f8f5f0bd09f044839ea959000278651e/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98bc6a7b-8683-5ee8-af10-4ff6f5eb34f9/98bc6a7b-8683-5ee8-af10-4ff6f5eb34f9_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 614040,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fp3/f8f5f0bd09f044839ea959000278651e/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-03-26',
'seats_number': 5,
'seller_name': None,
'title': 'VOLKSWAGEN VOLKSWAGEN TIGUAN 2.0 TDI SCR 110KW Style BMT 4MOTION '
'DSG Sport utility vehicle 5-door -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2018}
2026-03-25 16:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983569%27 HTTP/1.1" 200 None
2026-03-25 16:32:52 [ayvens.it] INFO: Saving data for 1983569: {'created_time': 1774456372.797188, 'last_price_update_time': 1774456372.797201, 'auction_closing_time': 1774603800.0}
2026-03-25 16:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1983569') HTTP/1.1" 204 0
2026-03-25 16:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm7%252F21e046b1c7d54c9f984c355cc889538d%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm7/21e046b1c7d54c9f984c355cc889538d/images/large/4.jpg not downloaded yet
2026-03-25 16:32:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm4/a13df06b7b4042d4a614464e9a76a8ac/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm7%252F21e046b1c7d54c9f984c355cc889538d%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm7/21e046b1c7d54c9f984c355cc889538d/images/large/5.jpg not downloaded yet
2026-03-25 16:32:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp4/be3ef3582f0f439ba8022810d5a35b53/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm4/a13df06b7b4042d4a614464e9a76a8ac/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm7%252F21e046b1c7d54c9f984c355cc889538d%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm7/21e046b1c7d54c9f984c355cc889538d/images/large/6.jpg not downloaded yet
2026-03-25 16:32:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm4/a13df06b7b4042d4a614464e9a76a8ac/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm4/a13df06b7b4042d4a614464e9a76a8ac/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm4/a13df06b7b4042d4a614464e9a76a8ac/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fs9/9f795b6663ec44e39f880b25b0ec85d1/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm7%252F21e046b1c7d54c9f984c355cc889538d%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm7/21e046b1c7d54c9f984c355cc889538d/images/large/7.jpg not downloaded yet
2026-03-25 16:32:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm4/a13df06b7b4042d4a614464e9a76a8ac/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm7%252F21e046b1c7d54c9f984c355cc889538d%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm7/21e046b1c7d54c9f984c355cc889538d/images/large/8.jpg not downloaded yet
2026-03-25 16:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm7%252F21e046b1c7d54c9f984c355cc889538d%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm7/21e046b1c7d54c9f984c355cc889538d/images/large/9.jpg not downloaded yet
2026-03-25 16:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm7%252F21e046b1c7d54c9f984c355cc889538d%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm7/21e046b1c7d54c9f984c355cc889538d/images/large/10.jpg not downloaded yet
2026-03-25 16:32:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc785b50>
2026-03-25 16:32:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41e4dd95-6716-53c2-aedf-859273b2edb6/41e4dd95-6716-53c2-aedf-859273b2edb6_image_1.jpg HTTP/1.1" 201 0
2026-03-25 16:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm4%252Fa13df06b7b4042d4a614464e9a76a8ac%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm4/a13df06b7b4042d4a614464e9a76a8ac/images/large/2.jpg saved to cache
2026-03-25 16:32:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 41e4dd95-6716-53c2-aedf-859273b2edb6
2026-03-25 16:32:53 [ayvens.it] INFO: Found listing with ID: 1983604
2026-03-25 16:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983604%27 HTTP/1.1" 200 None
2026-03-25 16:32:53 [ayvens.it] INFO: Scrape type for 1983604: 1
2026-03-25 16:32:53 [ayvens.it] INFO: Extracting data for car ID: 1983604
2026-03-25 16:32:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d1b0989d-57ab-5507-bdc7-3f770acef6c2 with identifier: 1983604
2026-03-25 16:32:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d1b0989d-57ab-5507-bdc7-3f770acef6c2 with scrape type 1
2026-03-25 16:32:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d1b0989d-57ab-5507-bdc7-3f770acef6c2
2026-03-25 16:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffp3%252F995329f594e147ad8cb3d2b2f62a3af2%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fp3/995329f594e147ad8cb3d2b2f62a3af2/images/large/1.jpg not downloaded yet
2026-03-25 16:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffp3%252F995329f594e147ad8cb3d2b2f62a3af2%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fp3/995329f594e147ad8cb3d2b2f62a3af2/images/large/2.jpg not downloaded yet
2026-03-25 16:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffp3%252F995329f594e147ad8cb3d2b2f62a3af2%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fp3/995329f594e147ad8cb3d2b2f62a3af2/images/large/3.jpg not downloaded yet
2026-03-25 16:32:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc785510>
2026-03-25 16:32:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14f4c1e9-3777-50bd-a1b5-1f001441b2b5/14f4c1e9-3777-50bd-a1b5-1f001441b2b5_image_2.jpg HTTP/1.1" 201 0
2026-03-25 16:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp4%252Fbe3ef3582f0f439ba8022810d5a35b53%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp4/be3ef3582f0f439ba8022810d5a35b53/images/large/3.jpg saved to cache
2026-03-25 16:32:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 14f4c1e9-3777-50bd-a1b5-1f001441b2b5
2026-03-25 16:32:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc592090>
2026-03-25 16:32:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41e4dd95-6716-53c2-aedf-859273b2edb6/41e4dd95-6716-53c2-aedf-859273b2edb6_image_4.jpg HTTP/1.1" 201 0
2026-03-25 16:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm4%252Fa13df06b7b4042d4a614464e9a76a8ac%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm4/a13df06b7b4042d4a614464e9a76a8ac/images/large/5.jpg saved to cache
2026-03-25 16:32:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 41e4dd95-6716-53c2-aedf-859273b2edb6
2026-03-25 16:32:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcc1a810>
2026-03-25 16:32:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41e4dd95-6716-53c2-aedf-859273b2edb6/41e4dd95-6716-53c2-aedf-859273b2edb6_image_2.jpg HTTP/1.1" 201 0
2026-03-25 16:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm4%252Fa13df06b7b4042d4a614464e9a76a8ac%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm4/a13df06b7b4042d4a614464e9a76a8ac/images/large/3.jpg saved to cache
2026-03-25 16:32:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 41e4dd95-6716-53c2-aedf-859273b2edb6
2026-03-25 16:32:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34de565c10>
2026-03-25 16:32:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41e4dd95-6716-53c2-aedf-859273b2edb6/41e4dd95-6716-53c2-aedf-859273b2edb6_image_3.jpg HTTP/1.1" 201 0
2026-03-25 16:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm4%252Fa13df06b7b4042d4a614464e9a76a8ac%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm4/a13df06b7b4042d4a614464e9a76a8ac/images/large/4.jpg saved to cache
2026-03-25 16:32:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 41e4dd95-6716-53c2-aedf-859273b2edb6
2026-03-25 16:32:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcad85d0>
2026-03-25 16:32:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41e4dd95-6716-53c2-aedf-859273b2edb6/41e4dd95-6716-53c2-aedf-859273b2edb6_image_5.jpg HTTP/1.1" 201 0
2026-03-25 16:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm4%252Fa13df06b7b4042d4a614464e9a76a8ac%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm4/a13df06b7b4042d4a614464e9a76a8ac/images/large/6.jpg saved to cache
2026-03-25 16:32:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 41e4dd95-6716-53c2-aedf-859273b2edb6
2026-03-25 16:32:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc592550>
2026-03-25 16:32:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bf8bec1d-86ad-5e60-a97b-f1847175df2c/bf8bec1d-86ad-5e60-a97b-f1847175df2c_image_8.jpg HTTP/1.1" 201 0
2026-03-25 16:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs9%252F9f795b6663ec44e39f880b25b0ec85d1%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs9/9f795b6663ec44e39f880b25b0ec85d1/images/large/9.jpg saved to cache
2026-03-25 16:32:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item bf8bec1d-86ad-5e60-a97b-f1847175df2c
2026-03-25 16:32:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcc1a850>
2026-03-25 16:32:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41e4dd95-6716-53c2-aedf-859273b2edb6/41e4dd95-6716-53c2-aedf-859273b2edb6_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm4%252Fa13df06b7b4042d4a614464e9a76a8ac%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm4/a13df06b7b4042d4a614464e9a76a8ac/images/large/1.jpg saved to cache
2026-03-25 16:32:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 41e4dd95-6716-53c2-aedf-859273b2edb6
2026-03-25 16:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffp3%252F995329f594e147ad8cb3d2b2f62a3af2%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fp3/995329f594e147ad8cb3d2b2f62a3af2/images/large/4.jpg not downloaded yet
2026-03-25 16:32:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm4/a13df06b7b4042d4a614464e9a76a8ac/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffp3%252F995329f594e147ad8cb3d2b2f62a3af2%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fp3/995329f594e147ad8cb3d2b2f62a3af2/images/large/5.jpg not downloaded yet
2026-03-25 16:32:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp4/be3ef3582f0f439ba8022810d5a35b53/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm4/a13df06b7b4042d4a614464e9a76a8ac/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm4/a13df06b7b4042d4a614464e9a76a8ac/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffp3%252F995329f594e147ad8cb3d2b2f62a3af2%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fp3/995329f594e147ad8cb3d2b2f62a3af2/images/large/6.jpg not downloaded yet
2026-03-25 16:32:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp4/be3ef3582f0f439ba8022810d5a35b53/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp4/be3ef3582f0f439ba8022810d5a35b53/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp4/be3ef3582f0f439ba8022810d5a35b53/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffp3%252F995329f594e147ad8cb3d2b2f62a3af2%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fp3/995329f594e147ad8cb3d2b2f62a3af2/images/large/7.jpg not downloaded yet
2026-03-25 16:32:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp4/be3ef3582f0f439ba8022810d5a35b53/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffp3%252F995329f594e147ad8cb3d2b2f62a3af2%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fp3/995329f594e147ad8cb3d2b2f62a3af2/images/large/8.jpg not downloaded yet
2026-03-25 16:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffp3%252F995329f594e147ad8cb3d2b2f62a3af2%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fp3/995329f594e147ad8cb3d2b2f62a3af2/images/large/9.jpg not downloaded yet
2026-03-25 16:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffp3%252F995329f594e147ad8cb3d2b2f62a3af2%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fp3/995329f594e147ad8cb3d2b2f62a3af2/images/large/10.jpg not downloaded yet
2026-03-25 16:32:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34de143710>
2026-03-25 16:32:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41e4dd95-6716-53c2-aedf-859273b2edb6/41e4dd95-6716-53c2-aedf-859273b2edb6_image_8.jpg HTTP/1.1" 201 0
2026-03-25 16:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm4%252Fa13df06b7b4042d4a614464e9a76a8ac%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm4/a13df06b7b4042d4a614464e9a76a8ac/images/large/9.jpg saved to cache
2026-03-25 16:32:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 41e4dd95-6716-53c2-aedf-859273b2edb6
2026-03-25 16:32:54 [ayvens.it] INFO: Found listing with ID: 1983605
2026-03-25 16:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983605%27 HTTP/1.1" 200 None
2026-03-25 16:32:54 [ayvens.it] INFO: Scrape type for 1983605: 1
2026-03-25 16:32:54 [ayvens.it] INFO: Extracting data for car ID: 1983605
2026-03-25 16:32:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5bee9c67-9006-551f-9e88-b8306f3ee2d3 with identifier: 1983605
2026-03-25 16:32:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5bee9c67-9006-551f-9e88-b8306f3ee2d3 with scrape type 1
2026-03-25 16:32:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5bee9c67-9006-551f-9e88-b8306f3ee2d3
2026-03-25 16:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf0%252F9aeecd2a601d4c749caa25c6462e0087%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf0/9aeecd2a601d4c749caa25c6462e0087/images/large/1.jpg not downloaded yet
2026-03-25 16:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf0%252F9aeecd2a601d4c749caa25c6462e0087%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf0/9aeecd2a601d4c749caa25c6462e0087/images/large/2.jpg not downloaded yet
2026-03-25 16:32:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm7/21e046b1c7d54c9f984c355cc889538d/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf0%252F9aeecd2a601d4c749caa25c6462e0087%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf0/9aeecd2a601d4c749caa25c6462e0087/images/large/3.jpg not downloaded yet
2026-03-25 16:32:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34d74011d0>
2026-03-25 16:32:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14f4c1e9-3777-50bd-a1b5-1f001441b2b5/14f4c1e9-3777-50bd-a1b5-1f001441b2b5_image_3.jpg HTTP/1.1" 201 0
2026-03-25 16:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp4%252Fbe3ef3582f0f439ba8022810d5a35b53%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp4/be3ef3582f0f439ba8022810d5a35b53/images/large/4.jpg saved to cache
2026-03-25 16:32:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 14f4c1e9-3777-50bd-a1b5-1f001441b2b5
2026-03-25 16:32:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc593f90>
2026-03-25 16:32:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41e4dd95-6716-53c2-aedf-859273b2edb6/41e4dd95-6716-53c2-aedf-859273b2edb6_image_9.jpg HTTP/1.1" 201 0
2026-03-25 16:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm4%252Fa13df06b7b4042d4a614464e9a76a8ac%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm4/a13df06b7b4042d4a614464e9a76a8ac/images/large/10.jpg saved to cache
2026-03-25 16:32:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 41e4dd95-6716-53c2-aedf-859273b2edb6
2026-03-25 16:32:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcb9a350>
2026-03-25 16:32:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41e4dd95-6716-53c2-aedf-859273b2edb6/41e4dd95-6716-53c2-aedf-859273b2edb6_image_7.jpg HTTP/1.1" 201 0
2026-03-25 16:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm4%252Fa13df06b7b4042d4a614464e9a76a8ac%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm4/a13df06b7b4042d4a614464e9a76a8ac/images/large/8.jpg saved to cache
2026-03-25 16:32:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 41e4dd95-6716-53c2-aedf-859273b2edb6
2026-03-25 16:32:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcac85d0>
2026-03-25 16:32:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14f4c1e9-3777-50bd-a1b5-1f001441b2b5/14f4c1e9-3777-50bd-a1b5-1f001441b2b5_image_1.jpg HTTP/1.1" 201 0
2026-03-25 16:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp4%252Fbe3ef3582f0f439ba8022810d5a35b53%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp4/be3ef3582f0f439ba8022810d5a35b53/images/large/2.jpg saved to cache
2026-03-25 16:32:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 14f4c1e9-3777-50bd-a1b5-1f001441b2b5
2026-03-25 16:32:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc7dcfd0>
2026-03-25 16:32:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14f4c1e9-3777-50bd-a1b5-1f001441b2b5/14f4c1e9-3777-50bd-a1b5-1f001441b2b5_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp4%252Fbe3ef3582f0f439ba8022810d5a35b53%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp4/be3ef3582f0f439ba8022810d5a35b53/images/large/1.jpg saved to cache
2026-03-25 16:32:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 14f4c1e9-3777-50bd-a1b5-1f001441b2b5
2026-03-25 16:32:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc7dd650>
2026-03-25 16:32:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14f4c1e9-3777-50bd-a1b5-1f001441b2b5/14f4c1e9-3777-50bd-a1b5-1f001441b2b5_image_5.jpg HTTP/1.1" 201 0
2026-03-25 16:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp4%252Fbe3ef3582f0f439ba8022810d5a35b53%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp4/be3ef3582f0f439ba8022810d5a35b53/images/large/6.jpg saved to cache
2026-03-25 16:32:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 14f4c1e9-3777-50bd-a1b5-1f001441b2b5
2026-03-25 16:32:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34d74ccc90>
2026-03-25 16:32:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14f4c1e9-3777-50bd-a1b5-1f001441b2b5/14f4c1e9-3777-50bd-a1b5-1f001441b2b5_image_4.jpg HTTP/1.1" 201 0
2026-03-25 16:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp4%252Fbe3ef3582f0f439ba8022810d5a35b53%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp4/be3ef3582f0f439ba8022810d5a35b53/images/large/5.jpg saved to cache
2026-03-25 16:32:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 14f4c1e9-3777-50bd-a1b5-1f001441b2b5
2026-03-25 16:32:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm7/21e046b1c7d54c9f984c355cc889538d/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm7/21e046b1c7d54c9f984c355cc889538d/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf0%252F9aeecd2a601d4c749caa25c6462e0087%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf0/9aeecd2a601d4c749caa25c6462e0087/images/large/4.jpg not downloaded yet
2026-03-25 16:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf0%252F9aeecd2a601d4c749caa25c6462e0087%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf0/9aeecd2a601d4c749caa25c6462e0087/images/large/5.jpg not downloaded yet
2026-03-25 16:32:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fp3/995329f594e147ad8cb3d2b2f62a3af2/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm7/21e046b1c7d54c9f984c355cc889538d/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc64b310>
2026-03-25 16:32:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25281f6d-89b3-5e6e-b5f9-4a5841838a94/25281f6d-89b3-5e6e-b5f9-4a5841838a94_image_3.jpg HTTP/1.1" 201 0
2026-03-25 16:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm7%252F21e046b1c7d54c9f984c355cc889538d%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm7/21e046b1c7d54c9f984c355cc889538d/images/large/4.jpg saved to cache
2026-03-25 16:32:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 25281f6d-89b3-5e6e-b5f9-4a5841838a94
2026-03-25 16:32:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm7/21e046b1c7d54c9f984c355cc889538d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf0%252F9aeecd2a601d4c749caa25c6462e0087%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf0/9aeecd2a601d4c749caa25c6462e0087/images/large/6.jpg not downloaded yet
2026-03-25 16:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf0%252F9aeecd2a601d4c749caa25c6462e0087%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf0/9aeecd2a601d4c749caa25c6462e0087/images/large/7.jpg not downloaded yet
2026-03-25 16:32:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fp3/995329f594e147ad8cb3d2b2f62a3af2/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp4/be3ef3582f0f439ba8022810d5a35b53/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf0%252F9aeecd2a601d4c749caa25c6462e0087%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf0/9aeecd2a601d4c749caa25c6462e0087/images/large/8.jpg not downloaded yet
2026-03-25 16:32:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcb87cd0>
2026-03-25 16:32:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25281f6d-89b3-5e6e-b5f9-4a5841838a94/25281f6d-89b3-5e6e-b5f9-4a5841838a94_image_1.jpg HTTP/1.1" 201 0
2026-03-25 16:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm7%252F21e046b1c7d54c9f984c355cc889538d%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm7/21e046b1c7d54c9f984c355cc889538d/images/large/2.jpg saved to cache
2026-03-25 16:32:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 25281f6d-89b3-5e6e-b5f9-4a5841838a94
2026-03-25 16:32:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc9f3710>
2026-03-25 16:32:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25281f6d-89b3-5e6e-b5f9-4a5841838a94/25281f6d-89b3-5e6e-b5f9-4a5841838a94_image_2.jpg HTTP/1.1" 201 0
2026-03-25 16:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm7%252F21e046b1c7d54c9f984c355cc889538d%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm7/21e046b1c7d54c9f984c355cc889538d/images/large/3.jpg saved to cache
2026-03-25 16:32:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 25281f6d-89b3-5e6e-b5f9-4a5841838a94
2026-03-25 16:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf0%252F9aeecd2a601d4c749caa25c6462e0087%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf0/9aeecd2a601d4c749caa25c6462e0087/images/large/9.jpg not downloaded yet
2026-03-25 16:32:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fp3/995329f594e147ad8cb3d2b2f62a3af2/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc5a2c50>
2026-03-25 16:32:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1b0989d-57ab-5507-bdc7-3f770acef6c2/d1b0989d-57ab-5507-bdc7-3f770acef6c2_image_3.jpg HTTP/1.1" 201 0
2026-03-25 16:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffp3%252F995329f594e147ad8cb3d2b2f62a3af2%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fp3/995329f594e147ad8cb3d2b2f62a3af2/images/large/4.jpg saved to cache
2026-03-25 16:32:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d1b0989d-57ab-5507-bdc7-3f770acef6c2
2026-03-25 16:32:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc9d5f50>
2026-03-25 16:32:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25281f6d-89b3-5e6e-b5f9-4a5841838a94/25281f6d-89b3-5e6e-b5f9-4a5841838a94_image_4.jpg HTTP/1.1" 201 0
2026-03-25 16:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm7%252F21e046b1c7d54c9f984c355cc889538d%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm7/21e046b1c7d54c9f984c355cc889538d/images/large/5.jpg saved to cache
2026-03-25 16:32:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 25281f6d-89b3-5e6e-b5f9-4a5841838a94
2026-03-25 16:32:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc975650>
2026-03-25 16:32:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25281f6d-89b3-5e6e-b5f9-4a5841838a94/25281f6d-89b3-5e6e-b5f9-4a5841838a94_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm7%252F21e046b1c7d54c9f984c355cc889538d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm7/21e046b1c7d54c9f984c355cc889538d/images/large/1.jpg saved to cache
2026-03-25 16:32:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 25281f6d-89b3-5e6e-b5f9-4a5841838a94
2026-03-25 16:32:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34d7d7f2d0>
2026-03-25 16:32:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1b0989d-57ab-5507-bdc7-3f770acef6c2/d1b0989d-57ab-5507-bdc7-3f770acef6c2_image_2.jpg HTTP/1.1" 201 0
2026-03-25 16:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffp3%252F995329f594e147ad8cb3d2b2f62a3af2%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fp3/995329f594e147ad8cb3d2b2f62a3af2/images/large/3.jpg saved to cache
2026-03-25 16:32:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d1b0989d-57ab-5507-bdc7-3f770acef6c2
2026-03-25 16:32:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc648250>
2026-03-25 16:32:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14f4c1e9-3777-50bd-a1b5-1f001441b2b5/14f4c1e9-3777-50bd-a1b5-1f001441b2b5_image_9.jpg HTTP/1.1" 201 0
2026-03-25 16:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp4%252Fbe3ef3582f0f439ba8022810d5a35b53%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp4/be3ef3582f0f439ba8022810d5a35b53/images/large/10.jpg saved to cache
2026-03-25 16:32:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 14f4c1e9-3777-50bd-a1b5-1f001441b2b5
2026-03-25 16:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf0%252F9aeecd2a601d4c749caa25c6462e0087%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf0/9aeecd2a601d4c749caa25c6462e0087/images/large/10.jpg not downloaded yet
2026-03-25 16:32:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm7/21e046b1c7d54c9f984c355cc889538d/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:55 [ayvens.it] INFO: Found listing with ID: 1983606
2026-03-25 16:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983606%27 HTTP/1.1" 200 None
2026-03-25 16:32:55 [ayvens.it] INFO: Scrape type for 1983606: 1
2026-03-25 16:32:55 [ayvens.it] INFO: Extracting data for car ID: 1983606
2026-03-25 16:32:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f634e5cb-f2a2-5a2e-a318-4ce192defad6 with identifier: 1983606
2026-03-25 16:32:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f634e5cb-f2a2-5a2e-a318-4ce192defad6 with scrape type 1
2026-03-25 16:32:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f634e5cb-f2a2-5a2e-a318-4ce192defad6
2026-03-25 16:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga0%252Ff57cc380721d481c8e03509c4a3c6729%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga0/f57cc380721d481c8e03509c4a3c6729/images/large/1.jpg not downloaded yet
2026-03-25 16:32:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc5516d0>
2026-03-25 16:32:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1b0989d-57ab-5507-bdc7-3f770acef6c2/d1b0989d-57ab-5507-bdc7-3f770acef6c2_image_1.jpg HTTP/1.1" 201 0
2026-03-25 16:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffp3%252F995329f594e147ad8cb3d2b2f62a3af2%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fp3/995329f594e147ad8cb3d2b2f62a3af2/images/large/2.jpg saved to cache
2026-03-25 16:32:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d1b0989d-57ab-5507-bdc7-3f770acef6c2
2026-03-25 16:32:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fp3/995329f594e147ad8cb3d2b2f62a3af2/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fp3/995329f594e147ad8cb3d2b2f62a3af2/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga0%252Ff57cc380721d481c8e03509c4a3c6729%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga0/f57cc380721d481c8e03509c4a3c6729/images/large/2.jpg not downloaded yet
2026-03-25 16:32:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fp3/995329f594e147ad8cb3d2b2f62a3af2/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm7/21e046b1c7d54c9f984c355cc889538d/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm7/21e046b1c7d54c9f984c355cc889538d/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga0%252Ff57cc380721d481c8e03509c4a3c6729%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga0/f57cc380721d481c8e03509c4a3c6729/images/large/3.jpg not downloaded yet
2026-03-25 16:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga0%252Ff57cc380721d481c8e03509c4a3c6729%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga0/f57cc380721d481c8e03509c4a3c6729/images/large/4.jpg not downloaded yet
2026-03-25 16:32:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc62a6d0>
2026-03-25 16:32:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25281f6d-89b3-5e6e-b5f9-4a5841838a94/25281f6d-89b3-5e6e-b5f9-4a5841838a94_image_8.jpg HTTP/1.1" 201 0
2026-03-25 16:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm7%252F21e046b1c7d54c9f984c355cc889538d%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm7/21e046b1c7d54c9f984c355cc889538d/images/large/9.jpg saved to cache
2026-03-25 16:32:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 25281f6d-89b3-5e6e-b5f9-4a5841838a94
2026-03-25 16:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga0%252Ff57cc380721d481c8e03509c4a3c6729%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga0/f57cc380721d481c8e03509c4a3c6729/images/large/5.jpg not downloaded yet
2026-03-25 16:32:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf0/9aeecd2a601d4c749caa25c6462e0087/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga0%252Ff57cc380721d481c8e03509c4a3c6729%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga0/f57cc380721d481c8e03509c4a3c6729/images/large/6.jpg not downloaded yet
2026-03-25 16:32:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc54be90>
2026-03-25 16:32:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1b0989d-57ab-5507-bdc7-3f770acef6c2/d1b0989d-57ab-5507-bdc7-3f770acef6c2_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffp3%252F995329f594e147ad8cb3d2b2f62a3af2%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fp3/995329f594e147ad8cb3d2b2f62a3af2/images/large/1.jpg saved to cache
2026-03-25 16:32:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d1b0989d-57ab-5507-bdc7-3f770acef6c2
2026-03-25 16:32:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc976010>
2026-03-25 16:32:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1b0989d-57ab-5507-bdc7-3f770acef6c2/d1b0989d-57ab-5507-bdc7-3f770acef6c2_image_5.jpg HTTP/1.1" 201 0
2026-03-25 16:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffp3%252F995329f594e147ad8cb3d2b2f62a3af2%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fp3/995329f594e147ad8cb3d2b2f62a3af2/images/large/6.jpg saved to cache
2026-03-25 16:32:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d1b0989d-57ab-5507-bdc7-3f770acef6c2
2026-03-25 16:32:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dca76f10>
2026-03-25 16:32:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1b0989d-57ab-5507-bdc7-3f770acef6c2/d1b0989d-57ab-5507-bdc7-3f770acef6c2_image_4.jpg HTTP/1.1" 201 0
2026-03-25 16:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffp3%252F995329f594e147ad8cb3d2b2f62a3af2%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fp3/995329f594e147ad8cb3d2b2f62a3af2/images/large/5.jpg saved to cache
2026-03-25 16:32:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d1b0989d-57ab-5507-bdc7-3f770acef6c2
2026-03-25 16:32:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcc4f650>
2026-03-25 16:32:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25281f6d-89b3-5e6e-b5f9-4a5841838a94/25281f6d-89b3-5e6e-b5f9-4a5841838a94_image_9.jpg HTTP/1.1" 201 0
2026-03-25 16:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm7%252F21e046b1c7d54c9f984c355cc889538d%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm7/21e046b1c7d54c9f984c355cc889538d/images/large/10.jpg saved to cache
2026-03-25 16:32:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 25281f6d-89b3-5e6e-b5f9-4a5841838a94
2026-03-25 16:32:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc5af390>
2026-03-25 16:32:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25281f6d-89b3-5e6e-b5f9-4a5841838a94/25281f6d-89b3-5e6e-b5f9-4a5841838a94_image_7.jpg HTTP/1.1" 201 0
2026-03-25 16:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm7%252F21e046b1c7d54c9f984c355cc889538d%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm7/21e046b1c7d54c9f984c355cc889538d/images/large/8.jpg saved to cache
2026-03-25 16:32:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 25281f6d-89b3-5e6e-b5f9-4a5841838a94
2026-03-25 16:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga0%252Ff57cc380721d481c8e03509c4a3c6729%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga0/f57cc380721d481c8e03509c4a3c6729/images/large/7.jpg not downloaded yet
2026-03-25 16:32:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fp3/995329f594e147ad8cb3d2b2f62a3af2/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga0%252Ff57cc380721d481c8e03509c4a3c6729%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga0/f57cc380721d481c8e03509c4a3c6729/images/large/8.jpg not downloaded yet
2026-03-25 16:32:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf0/9aeecd2a601d4c749caa25c6462e0087/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga0%252Ff57cc380721d481c8e03509c4a3c6729%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga0/f57cc380721d481c8e03509c4a3c6729/images/large/9.jpg not downloaded yet
2026-03-25 16:32:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc5ae7d0>
2026-03-25 16:32:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5bee9c67-9006-551f-9e88-b8306f3ee2d3/5bee9c67-9006-551f-9e88-b8306f3ee2d3_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf0%252F9aeecd2a601d4c749caa25c6462e0087%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf0/9aeecd2a601d4c749caa25c6462e0087/images/large/1.jpg saved to cache
2026-03-25 16:32:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5bee9c67-9006-551f-9e88-b8306f3ee2d3
2026-03-25 16:32:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fp3/995329f594e147ad8cb3d2b2f62a3af2/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga0%252Ff57cc380721d481c8e03509c4a3c6729%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga0/f57cc380721d481c8e03509c4a3c6729/images/large/10.jpg not downloaded yet
2026-03-25 16:32:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf0/9aeecd2a601d4c749caa25c6462e0087/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:56 [ayvens.it] INFO: Found listing with ID: 1983607
2026-03-25 16:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983607%27 HTTP/1.1" 200 None
2026-03-25 16:32:56 [ayvens.it] INFO: Scrape type for 1983607: 1
2026-03-25 16:32:56 [ayvens.it] INFO: Extracting data for car ID: 1983607
2026-03-25 16:32:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 166c235c-fba1-541a-853a-5e48031d6a94 with identifier: 1983607
2026-03-25 16:32:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 166c235c-fba1-541a-853a-5e48031d6a94 with scrape type 1
2026-03-25 16:32:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 166c235c-fba1-541a-853a-5e48031d6a94
2026-03-25 16:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd2%252Ff96989d644f7422ebbf9391d13cabf2b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd2/f96989d644f7422ebbf9391d13cabf2b/images/large/1.jpg not downloaded yet
2026-03-25 16:32:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc7f8490>
2026-03-25 16:32:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1b0989d-57ab-5507-bdc7-3f770acef6c2/d1b0989d-57ab-5507-bdc7-3f770acef6c2_image_9.jpg HTTP/1.1" 201 0
2026-03-25 16:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffp3%252F995329f594e147ad8cb3d2b2f62a3af2%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fp3/995329f594e147ad8cb3d2b2f62a3af2/images/large/10.jpg saved to cache
2026-03-25 16:32:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d1b0989d-57ab-5507-bdc7-3f770acef6c2
2026-03-25 16:32:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dca1ae90>
2026-03-25 16:32:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5bee9c67-9006-551f-9e88-b8306f3ee2d3/5bee9c67-9006-551f-9e88-b8306f3ee2d3_image_2.jpg HTTP/1.1" 201 0
2026-03-25 16:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf0%252F9aeecd2a601d4c749caa25c6462e0087%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf0/9aeecd2a601d4c749caa25c6462e0087/images/large/3.jpg saved to cache
2026-03-25 16:32:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5bee9c67-9006-551f-9e88-b8306f3ee2d3
2026-03-25 16:32:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf0/9aeecd2a601d4c749caa25c6462e0087/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd2%252Ff96989d644f7422ebbf9391d13cabf2b%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd2/f96989d644f7422ebbf9391d13cabf2b/images/large/2.jpg not downloaded yet
2026-03-25 16:32:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf0/9aeecd2a601d4c749caa25c6462e0087/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf0/9aeecd2a601d4c749caa25c6462e0087/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd2%252Ff96989d644f7422ebbf9391d13cabf2b%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd2/f96989d644f7422ebbf9391d13cabf2b/images/large/3.jpg not downloaded yet
2026-03-25 16:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd2%252Ff96989d644f7422ebbf9391d13cabf2b%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd2/f96989d644f7422ebbf9391d13cabf2b/images/large/4.jpg not downloaded yet
2026-03-25 16:32:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc326dd0>
2026-03-25 16:32:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1b0989d-57ab-5507-bdc7-3f770acef6c2/d1b0989d-57ab-5507-bdc7-3f770acef6c2_image_8.jpg HTTP/1.1" 201 0
2026-03-25 16:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffp3%252F995329f594e147ad8cb3d2b2f62a3af2%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fp3/995329f594e147ad8cb3d2b2f62a3af2/images/large/9.jpg saved to cache
2026-03-25 16:32:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d1b0989d-57ab-5507-bdc7-3f770acef6c2
2026-03-25 16:32:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc96be90>
2026-03-25 16:32:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5bee9c67-9006-551f-9e88-b8306f3ee2d3/5bee9c67-9006-551f-9e88-b8306f3ee2d3_image_4.jpg HTTP/1.1" 201 0
2026-03-25 16:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf0%252F9aeecd2a601d4c749caa25c6462e0087%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf0/9aeecd2a601d4c749caa25c6462e0087/images/large/5.jpg saved to cache
2026-03-25 16:32:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5bee9c67-9006-551f-9e88-b8306f3ee2d3
2026-03-25 16:32:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf0/9aeecd2a601d4c749caa25c6462e0087/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd2%252Ff96989d644f7422ebbf9391d13cabf2b%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd2/f96989d644f7422ebbf9391d13cabf2b/images/large/5.jpg not downloaded yet
2026-03-25 16:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd2%252Ff96989d644f7422ebbf9391d13cabf2b%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd2/f96989d644f7422ebbf9391d13cabf2b/images/large/6.jpg not downloaded yet
2026-03-25 16:32:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf0/9aeecd2a601d4c749caa25c6462e0087/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc905b90>
2026-03-25 16:32:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5bee9c67-9006-551f-9e88-b8306f3ee2d3/5bee9c67-9006-551f-9e88-b8306f3ee2d3_image_6.jpg HTTP/1.1" 201 0
2026-03-25 16:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf0%252F9aeecd2a601d4c749caa25c6462e0087%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf0/9aeecd2a601d4c749caa25c6462e0087/images/large/7.jpg saved to cache
2026-03-25 16:32:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5bee9c67-9006-551f-9e88-b8306f3ee2d3
2026-03-25 16:32:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34d7dad450>
2026-03-25 16:32:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5bee9c67-9006-551f-9e88-b8306f3ee2d3/5bee9c67-9006-551f-9e88-b8306f3ee2d3_image_5.jpg HTTP/1.1" 201 0
2026-03-25 16:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf0%252F9aeecd2a601d4c749caa25c6462e0087%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf0/9aeecd2a601d4c749caa25c6462e0087/images/large/6.jpg saved to cache
2026-03-25 16:32:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5bee9c67-9006-551f-9e88-b8306f3ee2d3
2026-03-25 16:32:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc5cc090>
2026-03-25 16:32:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5bee9c67-9006-551f-9e88-b8306f3ee2d3/5bee9c67-9006-551f-9e88-b8306f3ee2d3_image_1.jpg HTTP/1.1" 201 0
2026-03-25 16:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf0%252F9aeecd2a601d4c749caa25c6462e0087%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf0/9aeecd2a601d4c749caa25c6462e0087/images/large/2.jpg saved to cache
2026-03-25 16:32:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5bee9c67-9006-551f-9e88-b8306f3ee2d3
2026-03-25 16:32:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf0/9aeecd2a601d4c749caa25c6462e0087/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fp3/995329f594e147ad8cb3d2b2f62a3af2/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd2%252Ff96989d644f7422ebbf9391d13cabf2b%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd2/f96989d644f7422ebbf9391d13cabf2b/images/large/7.jpg not downloaded yet
2026-03-25 16:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd2%252Ff96989d644f7422ebbf9391d13cabf2b%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd2/f96989d644f7422ebbf9391d13cabf2b/images/large/8.jpg not downloaded yet
2026-03-25 16:32:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc649910>
2026-03-25 16:32:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5bee9c67-9006-551f-9e88-b8306f3ee2d3/5bee9c67-9006-551f-9e88-b8306f3ee2d3_image_3.jpg HTTP/1.1" 201 0
2026-03-25 16:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf0%252F9aeecd2a601d4c749caa25c6462e0087%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf0/9aeecd2a601d4c749caa25c6462e0087/images/large/4.jpg saved to cache
2026-03-25 16:32:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5bee9c67-9006-551f-9e88-b8306f3ee2d3
2026-03-25 16:32:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcab3610>
2026-03-25 16:32:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5bee9c67-9006-551f-9e88-b8306f3ee2d3/5bee9c67-9006-551f-9e88-b8306f3ee2d3_image_9.jpg HTTP/1.1" 201 0
2026-03-25 16:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf0%252F9aeecd2a601d4c749caa25c6462e0087%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf0/9aeecd2a601d4c749caa25c6462e0087/images/large/10.jpg saved to cache
2026-03-25 16:32:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5bee9c67-9006-551f-9e88-b8306f3ee2d3
2026-03-25 16:32:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga0/f57cc380721d481c8e03509c4a3c6729/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fp3/995329f594e147ad8cb3d2b2f62a3af2/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd2%252Ff96989d644f7422ebbf9391d13cabf2b%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd2/f96989d644f7422ebbf9391d13cabf2b/images/large/9.jpg not downloaded yet
2026-03-25 16:32:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga0/f57cc380721d481c8e03509c4a3c6729/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf0/9aeecd2a601d4c749caa25c6462e0087/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd2%252Ff96989d644f7422ebbf9391d13cabf2b%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd2/f96989d644f7422ebbf9391d13cabf2b/images/large/10.jpg not downloaded yet
2026-03-25 16:32:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc944890>
2026-03-25 16:32:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5bee9c67-9006-551f-9e88-b8306f3ee2d3/5bee9c67-9006-551f-9e88-b8306f3ee2d3_image_7.jpg HTTP/1.1" 201 0
2026-03-25 16:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf0%252F9aeecd2a601d4c749caa25c6462e0087%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf0/9aeecd2a601d4c749caa25c6462e0087/images/large/8.jpg saved to cache
2026-03-25 16:32:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5bee9c67-9006-551f-9e88-b8306f3ee2d3
2026-03-25 16:32:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc309810>
2026-03-25 16:32:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1b0989d-57ab-5507-bdc7-3f770acef6c2/d1b0989d-57ab-5507-bdc7-3f770acef6c2_image_6.jpg HTTP/1.1" 201 0
2026-03-25 16:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffp3%252F995329f594e147ad8cb3d2b2f62a3af2%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fp3/995329f594e147ad8cb3d2b2f62a3af2/images/large/7.jpg saved to cache
2026-03-25 16:32:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d1b0989d-57ab-5507-bdc7-3f770acef6c2
2026-03-25 16:32:57 [ayvens.it] INFO: Found listing with ID: 1983608
2026-03-25 16:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983608%27 HTTP/1.1" 200 None
2026-03-25 16:32:57 [ayvens.it] INFO: Scrape type for 1983608: 1
2026-03-25 16:32:57 [ayvens.it] INFO: Extracting data for car ID: 1983608
2026-03-25 16:32:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b4163907-708f-5dbb-a964-1694c3d13cd1 with identifier: 1983608
2026-03-25 16:32:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b4163907-708f-5dbb-a964-1694c3d13cd1 with scrape type 1
2026-03-25 16:32:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b4163907-708f-5dbb-a964-1694c3d13cd1
2026-03-25 16:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf8%252F016015cd842040f0a65de46159343182%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf8/016015cd842040f0a65de46159343182/images/large/1.jpg not downloaded yet
2026-03-25 16:32:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga0/f57cc380721d481c8e03509c4a3c6729/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf8%252F016015cd842040f0a65de46159343182%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf8/016015cd842040f0a65de46159343182/images/large/2.jpg not downloaded yet
2026-03-25 16:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf8%252F016015cd842040f0a65de46159343182%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf8/016015cd842040f0a65de46159343182/images/large/3.jpg not downloaded yet
2026-03-25 16:32:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc993c90>
2026-03-25 16:32:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f634e5cb-f2a2-5a2e-a318-4ce192defad6/f634e5cb-f2a2-5a2e-a318-4ce192defad6_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga0%252Ff57cc380721d481c8e03509c4a3c6729%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga0/f57cc380721d481c8e03509c4a3c6729/images/large/1.jpg saved to cache
2026-03-25 16:32:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f634e5cb-f2a2-5a2e-a318-4ce192defad6
2026-03-25 16:32:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc34f0d0>
2026-03-25 16:32:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1b0989d-57ab-5507-bdc7-3f770acef6c2/d1b0989d-57ab-5507-bdc7-3f770acef6c2_image_7.jpg HTTP/1.1" 201 0
2026-03-25 16:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffp3%252F995329f594e147ad8cb3d2b2f62a3af2%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fp3/995329f594e147ad8cb3d2b2f62a3af2/images/large/8.jpg saved to cache
2026-03-25 16:32:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d1b0989d-57ab-5507-bdc7-3f770acef6c2
2026-03-25 16:32:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d1b0989d-57ab-5507-bdc7-3f770acef6c2, skipping ID generation
2026-03-25 16:32:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d1b0989d-57ab-5507-bdc7-3f770acef6c2 with scrape type 1
2026-03-25 16:32:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d1b0989d-57ab-5507-bdc7-3f770acef6c2 sending to next pipeline
2026-03-25 16:32:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: d1b0989d-57ab-5507-bdc7-3f770acef6c2, identifier: 1983604
2026-03-25 16:32:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc942d90>
2026-03-25 16:32:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f634e5cb-f2a2-5a2e-a318-4ce192defad6/f634e5cb-f2a2-5a2e-a318-4ce192defad6_image_1.jpg HTTP/1.1" 201 0
2026-03-25 16:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga0%252Ff57cc380721d481c8e03509c4a3c6729%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga0/f57cc380721d481c8e03509c4a3c6729/images/large/2.jpg saved to cache
2026-03-25 16:32:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f634e5cb-f2a2-5a2e-a318-4ce192defad6
2026-03-25 16:32:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc905490>
2026-03-25 16:32:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5bee9c67-9006-551f-9e88-b8306f3ee2d3/5bee9c67-9006-551f-9e88-b8306f3ee2d3_image_8.jpg HTTP/1.1" 201 0
2026-03-25 16:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf0%252F9aeecd2a601d4c749caa25c6462e0087%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf0/9aeecd2a601d4c749caa25c6462e0087/images/large/9.jpg saved to cache
2026-03-25 16:32:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5bee9c67-9006-551f-9e88-b8306f3ee2d3
2026-03-25 16:32:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5bee9c67-9006-551f-9e88-b8306f3ee2d3, skipping ID generation
2026-03-25 16:32:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5bee9c67-9006-551f-9e88-b8306f3ee2d3 with scrape type 1
2026-03-25 16:32:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5bee9c67-9006-551f-9e88-b8306f3ee2d3 sending to next pipeline
2026-03-25 16:32:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 5bee9c67-9006-551f-9e88-b8306f3ee2d3, identifier: 1983605
2026-03-25 16:32:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga0/f57cc380721d481c8e03509c4a3c6729/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: d1b0989d-57ab-5507-bdc7-3f770acef6c2 with identifier: 1983604
2026-03-25 16:32:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: d1b0989d-57ab-5507-bdc7-3f770acef6c2 with identifier: 1983604
2026-03-25 16:32:58 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: d1b0989d-57ab-5507-bdc7-3f770acef6c2 with identifier: 1983604 to the API
2026-03-25 16:32:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:32:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:32:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fp3/995329f594e147ad8cb3d2b2f62a3af2/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'BIANCO',
'currency': 'EUR',
'doors_number': 2,
'engine': '2.3L',
'expiration_date': '2026-03-27T09:30:00Z',
'fuel_type': 'diesel',
'id': 'd1b0989d-57ab-5507-bdc7-3f770acef6c2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41025',
'listing': 'auction',
'location': None,
'make': 'OPEL',
'model': 'OPEL MOVANO CAB 2.3 CDTI 130 QLI35 L2 EU6 RWD HD FP',
'odometer': 239211,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 36,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1b0989d-57ab-5507-bdc7-3f770acef6c2/d1b0989d-57ab-5507-bdc7-3f770acef6c2_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 439597,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fp3/995329f594e147ad8cb3d2b2f62a3af2/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1b0989d-57ab-5507-bdc7-3f770acef6c2/d1b0989d-57ab-5507-bdc7-3f770acef6c2_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 319001,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fp3/995329f594e147ad8cb3d2b2f62a3af2/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1b0989d-57ab-5507-bdc7-3f770acef6c2/d1b0989d-57ab-5507-bdc7-3f770acef6c2_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 573239,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fp3/995329f594e147ad8cb3d2b2f62a3af2/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1b0989d-57ab-5507-bdc7-3f770acef6c2/d1b0989d-57ab-5507-bdc7-3f770acef6c2_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 254650,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fp3/995329f594e147ad8cb3d2b2f62a3af2/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1b0989d-57ab-5507-bdc7-3f770acef6c2/d1b0989d-57ab-5507-bdc7-3f770acef6c2_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 481886,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fp3/995329f594e147ad8cb3d2b2f62a3af2/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1b0989d-57ab-5507-bdc7-3f770acef6c2/d1b0989d-57ab-5507-bdc7-3f770acef6c2_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 334090,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fp3/995329f594e147ad8cb3d2b2f62a3af2/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1b0989d-57ab-5507-bdc7-3f770acef6c2/d1b0989d-57ab-5507-bdc7-3f770acef6c2_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 299641,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fp3/995329f594e147ad8cb3d2b2f62a3af2/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1b0989d-57ab-5507-bdc7-3f770acef6c2/d1b0989d-57ab-5507-bdc7-3f770acef6c2_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 496257,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fp3/995329f594e147ad8cb3d2b2f62a3af2/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1b0989d-57ab-5507-bdc7-3f770acef6c2/d1b0989d-57ab-5507-bdc7-3f770acef6c2_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 439727,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fp3/995329f594e147ad8cb3d2b2f62a3af2/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1b0989d-57ab-5507-bdc7-3f770acef6c2/d1b0989d-57ab-5507-bdc7-3f770acef6c2_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 300555,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fp3/995329f594e147ad8cb3d2b2f62a3af2/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-05-17',
'seats_number': 5,
'seller_name': None,
'title': 'OPEL OPEL MOVANO CAB 2.3 CDTI 130 QLI35 L2 EU6 RWD HD FP -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2018}
2026-03-25 16:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983604%27 HTTP/1.1" 200 None
2026-03-25 16:32:59 [ayvens.it] INFO: Saving data for 1983604: {'created_time': 1774456379.170452, 'last_price_update_time': 1774456379.170462, 'auction_closing_time': 1774603800.0}
2026-03-25 16:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1983604') HTTP/1.1" 204 0
2026-03-25 16:32:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 5bee9c67-9006-551f-9e88-b8306f3ee2d3 with identifier: 1983605
2026-03-25 16:32:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 5bee9c67-9006-551f-9e88-b8306f3ee2d3 with identifier: 1983605
2026-03-25 16:32:59 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 5bee9c67-9006-551f-9e88-b8306f3ee2d3 with identifier: 1983605 to the API
2026-03-25 16:32:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:32:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:32:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gf0/9aeecd2a601d4c749caa25c6462e0087/images/large/9.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'BIANCO GELATO PASTELLO',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-27T09:30:00Z',
'fuel_type': 'petrol_lpg',
'id': '5bee9c67-9006-551f-9e88-b8306f3ee2d3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41025',
'listing': 'auction',
'location': None,
'make': 'FIAT',
'model': 'FIAT PANDA CONSIPAQ1 1.2 FIRE 69CV S&S EASYPOWER CITY LIFE FP',
'odometer': 45324,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 20,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5bee9c67-9006-551f-9e88-b8306f3ee2d3/5bee9c67-9006-551f-9e88-b8306f3ee2d3_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 698531,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf0/9aeecd2a601d4c749caa25c6462e0087/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5bee9c67-9006-551f-9e88-b8306f3ee2d3/5bee9c67-9006-551f-9e88-b8306f3ee2d3_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 729915,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf0/9aeecd2a601d4c749caa25c6462e0087/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5bee9c67-9006-551f-9e88-b8306f3ee2d3/5bee9c67-9006-551f-9e88-b8306f3ee2d3_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 698531,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf0/9aeecd2a601d4c749caa25c6462e0087/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5bee9c67-9006-551f-9e88-b8306f3ee2d3/5bee9c67-9006-551f-9e88-b8306f3ee2d3_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 757578,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf0/9aeecd2a601d4c749caa25c6462e0087/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5bee9c67-9006-551f-9e88-b8306f3ee2d3/5bee9c67-9006-551f-9e88-b8306f3ee2d3_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 742672,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf0/9aeecd2a601d4c749caa25c6462e0087/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5bee9c67-9006-551f-9e88-b8306f3ee2d3/5bee9c67-9006-551f-9e88-b8306f3ee2d3_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 688150,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf0/9aeecd2a601d4c749caa25c6462e0087/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5bee9c67-9006-551f-9e88-b8306f3ee2d3/5bee9c67-9006-551f-9e88-b8306f3ee2d3_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 650938,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf0/9aeecd2a601d4c749caa25c6462e0087/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5bee9c67-9006-551f-9e88-b8306f3ee2d3/5bee9c67-9006-551f-9e88-b8306f3ee2d3_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 695906,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf0/9aeecd2a601d4c749caa25c6462e0087/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5bee9c67-9006-551f-9e88-b8306f3ee2d3/5bee9c67-9006-551f-9e88-b8306f3ee2d3_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 692506,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf0/9aeecd2a601d4c749caa25c6462e0087/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5bee9c67-9006-551f-9e88-b8306f3ee2d3/5bee9c67-9006-551f-9e88-b8306f3ee2d3_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 636264,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf0/9aeecd2a601d4c749caa25c6462e0087/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-04-29',
'seats_number': 5,
'seller_name': None,
'title': 'FIAT FIAT PANDA CONSIPAQ1 1.2 FIRE 69CV S&S EASYPOWER CITY LIFE FP '
'-',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2021}
2026-03-25 16:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983605%27 HTTP/1.1" 200 None
2026-03-25 16:32:59 [ayvens.it] INFO: Saving data for 1983605: {'created_time': 1774456379.538166, 'last_price_update_time': 1774456379.538178, 'auction_closing_time': 1774603800.0}
2026-03-25 16:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1983605') HTTP/1.1" 204 0
2026-03-25 16:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf8%252F016015cd842040f0a65de46159343182%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf8/016015cd842040f0a65de46159343182/images/large/4.jpg not downloaded yet
2026-03-25 16:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf8%252F016015cd842040f0a65de46159343182%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf8/016015cd842040f0a65de46159343182/images/large/5.jpg not downloaded yet
2026-03-25 16:32:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga0/f57cc380721d481c8e03509c4a3c6729/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga0/f57cc380721d481c8e03509c4a3c6729/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc5bf8d0>
2026-03-25 16:32:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f634e5cb-f2a2-5a2e-a318-4ce192defad6/f634e5cb-f2a2-5a2e-a318-4ce192defad6_image_3.jpg HTTP/1.1" 201 0
2026-03-25 16:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga0%252Ff57cc380721d481c8e03509c4a3c6729%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga0/f57cc380721d481c8e03509c4a3c6729/images/large/4.jpg saved to cache
2026-03-25 16:32:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f634e5cb-f2a2-5a2e-a318-4ce192defad6
2026-03-25 16:32:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc557f50>
2026-03-25 16:32:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f634e5cb-f2a2-5a2e-a318-4ce192defad6/f634e5cb-f2a2-5a2e-a318-4ce192defad6_image_6.jpg HTTP/1.1" 201 0
2026-03-25 16:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga0%252Ff57cc380721d481c8e03509c4a3c6729%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga0/f57cc380721d481c8e03509c4a3c6729/images/large/7.jpg saved to cache
2026-03-25 16:32:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f634e5cb-f2a2-5a2e-a318-4ce192defad6
2026-03-25 16:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf8%252F016015cd842040f0a65de46159343182%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf8/016015cd842040f0a65de46159343182/images/large/6.jpg not downloaded yet
2026-03-25 16:32:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd2/f96989d644f7422ebbf9391d13cabf2b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga0/f57cc380721d481c8e03509c4a3c6729/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf8%252F016015cd842040f0a65de46159343182%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf8/016015cd842040f0a65de46159343182/images/large/7.jpg not downloaded yet
2026-03-25 16:32:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc5a1150>
2026-03-25 16:32:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f634e5cb-f2a2-5a2e-a318-4ce192defad6/f634e5cb-f2a2-5a2e-a318-4ce192defad6_image_7.jpg HTTP/1.1" 201 0
2026-03-25 16:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga0%252Ff57cc380721d481c8e03509c4a3c6729%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga0/f57cc380721d481c8e03509c4a3c6729/images/large/8.jpg saved to cache
2026-03-25 16:32:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f634e5cb-f2a2-5a2e-a318-4ce192defad6
2026-03-25 16:32:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc557fd0>
2026-03-25 16:32:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:32:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f634e5cb-f2a2-5a2e-a318-4ce192defad6/f634e5cb-f2a2-5a2e-a318-4ce192defad6_image_8.jpg HTTP/1.1" 201 0
2026-03-25 16:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga0%252Ff57cc380721d481c8e03509c4a3c6729%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 16:32:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga0/f57cc380721d481c8e03509c4a3c6729/images/large/9.jpg saved to cache
2026-03-25 16:32:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f634e5cb-f2a2-5a2e-a318-4ce192defad6
2026-03-25 16:32:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga0/f57cc380721d481c8e03509c4a3c6729/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga0/f57cc380721d481c8e03509c4a3c6729/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf8%252F016015cd842040f0a65de46159343182%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf8/016015cd842040f0a65de46159343182/images/large/8.jpg not downloaded yet
2026-03-25 16:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf8%252F016015cd842040f0a65de46159343182%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:32:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf8/016015cd842040f0a65de46159343182/images/large/9.jpg not downloaded yet
2026-03-25 16:32:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:32:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc5b5290>
2026-03-25 16:32:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:32:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:32:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_166c235c-fba1-541a-853a-5e48031d6a94/166c235c-fba1-541a-853a-5e48031d6a94_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd2%252Ff96989d644f7422ebbf9391d13cabf2b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd2/f96989d644f7422ebbf9391d13cabf2b/images/large/1.jpg saved to cache
2026-03-25 16:33:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 166c235c-fba1-541a-853a-5e48031d6a94
2026-03-25 16:33:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc8d7610>
2026-03-25 16:33:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f634e5cb-f2a2-5a2e-a318-4ce192defad6/f634e5cb-f2a2-5a2e-a318-4ce192defad6_image_9.jpg HTTP/1.1" 201 0
2026-03-25 16:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga0%252Ff57cc380721d481c8e03509c4a3c6729%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga0/f57cc380721d481c8e03509c4a3c6729/images/large/10.jpg saved to cache
2026-03-25 16:33:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f634e5cb-f2a2-5a2e-a318-4ce192defad6
2026-03-25 16:33:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd2/f96989d644f7422ebbf9391d13cabf2b/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf8%252F016015cd842040f0a65de46159343182%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf8/016015cd842040f0a65de46159343182/images/large/10.jpg not downloaded yet
2026-03-25 16:33:00 [ayvens.it] INFO: Found listing with ID: 1983609
2026-03-25 16:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983609%27 HTTP/1.1" 200 None
2026-03-25 16:33:00 [ayvens.it] INFO: Scrape type for 1983609: 1
2026-03-25 16:33:00 [ayvens.it] INFO: Extracting data for car ID: 1983609
2026-03-25 16:33:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 46002a01-82ce-5602-af6d-4600ad468b8f with identifier: 1983609
2026-03-25 16:33:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 46002a01-82ce-5602-af6d-4600ad468b8f with scrape type 1
2026-03-25 16:33:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 46002a01-82ce-5602-af6d-4600ad468b8f
2026-03-25 16:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge8%252Fe73ece421b584be293c89f0b51b9cfee%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge8/e73ece421b584be293c89f0b51b9cfee/images/large/1.jpg not downloaded yet
2026-03-25 16:33:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd2/f96989d644f7422ebbf9391d13cabf2b/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge8%252Fe73ece421b584be293c89f0b51b9cfee%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge8/e73ece421b584be293c89f0b51b9cfee/images/large/2.jpg not downloaded yet
2026-03-25 16:33:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc879a10>
2026-03-25 16:33:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f634e5cb-f2a2-5a2e-a318-4ce192defad6/f634e5cb-f2a2-5a2e-a318-4ce192defad6_image_5.jpg HTTP/1.1" 201 0
2026-03-25 16:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga0%252Ff57cc380721d481c8e03509c4a3c6729%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga0/f57cc380721d481c8e03509c4a3c6729/images/large/6.jpg saved to cache
2026-03-25 16:33:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f634e5cb-f2a2-5a2e-a318-4ce192defad6
2026-03-25 16:33:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc5ce990>
2026-03-25 16:33:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f634e5cb-f2a2-5a2e-a318-4ce192defad6/f634e5cb-f2a2-5a2e-a318-4ce192defad6_image_4.jpg HTTP/1.1" 201 0
2026-03-25 16:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga0%252Ff57cc380721d481c8e03509c4a3c6729%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga0/f57cc380721d481c8e03509c4a3c6729/images/large/5.jpg saved to cache
2026-03-25 16:33:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f634e5cb-f2a2-5a2e-a318-4ce192defad6
2026-03-25 16:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge8%252Fe73ece421b584be293c89f0b51b9cfee%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge8/e73ece421b584be293c89f0b51b9cfee/images/large/3.jpg not downloaded yet
2026-03-25 16:33:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd2/f96989d644f7422ebbf9391d13cabf2b/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd2/f96989d644f7422ebbf9391d13cabf2b/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd2/f96989d644f7422ebbf9391d13cabf2b/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge8%252Fe73ece421b584be293c89f0b51b9cfee%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge8/e73ece421b584be293c89f0b51b9cfee/images/large/4.jpg not downloaded yet
2026-03-25 16:33:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcaabad0>
2026-03-25 16:33:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_166c235c-fba1-541a-853a-5e48031d6a94/166c235c-fba1-541a-853a-5e48031d6a94_image_3.jpg HTTP/1.1" 201 0
2026-03-25 16:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd2%252Ff96989d644f7422ebbf9391d13cabf2b%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd2/f96989d644f7422ebbf9391d13cabf2b/images/large/4.jpg saved to cache
2026-03-25 16:33:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 166c235c-fba1-541a-853a-5e48031d6a94
2026-03-25 16:33:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34d7daca90>
2026-03-25 16:33:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_166c235c-fba1-541a-853a-5e48031d6a94/166c235c-fba1-541a-853a-5e48031d6a94_image_4.jpg HTTP/1.1" 201 0
2026-03-25 16:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd2%252Ff96989d644f7422ebbf9391d13cabf2b%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd2/f96989d644f7422ebbf9391d13cabf2b/images/large/5.jpg saved to cache
2026-03-25 16:33:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 166c235c-fba1-541a-853a-5e48031d6a94
2026-03-25 16:33:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd2/f96989d644f7422ebbf9391d13cabf2b/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd2/f96989d644f7422ebbf9391d13cabf2b/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge8%252Fe73ece421b584be293c89f0b51b9cfee%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge8/e73ece421b584be293c89f0b51b9cfee/images/large/5.jpg not downloaded yet
2026-03-25 16:33:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd2/f96989d644f7422ebbf9391d13cabf2b/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge8%252Fe73ece421b584be293c89f0b51b9cfee%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge8/e73ece421b584be293c89f0b51b9cfee/images/large/6.jpg not downloaded yet
2026-03-25 16:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge8%252Fe73ece421b584be293c89f0b51b9cfee%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge8/e73ece421b584be293c89f0b51b9cfee/images/large/7.jpg not downloaded yet
2026-03-25 16:33:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc54cf90>
2026-03-25 16:33:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_166c235c-fba1-541a-853a-5e48031d6a94/166c235c-fba1-541a-853a-5e48031d6a94_image_2.jpg HTTP/1.1" 201 0
2026-03-25 16:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd2%252Ff96989d644f7422ebbf9391d13cabf2b%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd2/f96989d644f7422ebbf9391d13cabf2b/images/large/3.jpg saved to cache
2026-03-25 16:33:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 166c235c-fba1-541a-853a-5e48031d6a94
2026-03-25 16:33:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34d7d5ad90>
2026-03-25 16:33:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_166c235c-fba1-541a-853a-5e48031d6a94/166c235c-fba1-541a-853a-5e48031d6a94_image_6.jpg HTTP/1.1" 201 0
2026-03-25 16:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd2%252Ff96989d644f7422ebbf9391d13cabf2b%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd2/f96989d644f7422ebbf9391d13cabf2b/images/large/7.jpg saved to cache
2026-03-25 16:33:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 166c235c-fba1-541a-853a-5e48031d6a94
2026-03-25 16:33:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc60ef10>
2026-03-25 16:33:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_166c235c-fba1-541a-853a-5e48031d6a94/166c235c-fba1-541a-853a-5e48031d6a94_image_7.jpg HTTP/1.1" 201 0
2026-03-25 16:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd2%252Ff96989d644f7422ebbf9391d13cabf2b%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd2/f96989d644f7422ebbf9391d13cabf2b/images/large/8.jpg saved to cache
2026-03-25 16:33:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 166c235c-fba1-541a-853a-5e48031d6a94
2026-03-25 16:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge8%252Fe73ece421b584be293c89f0b51b9cfee%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge8/e73ece421b584be293c89f0b51b9cfee/images/large/8.jpg not downloaded yet
2026-03-25 16:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge8%252Fe73ece421b584be293c89f0b51b9cfee%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge8/e73ece421b584be293c89f0b51b9cfee/images/large/9.jpg not downloaded yet
2026-03-25 16:33:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf8/016015cd842040f0a65de46159343182/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcb151d0>
2026-03-25 16:33:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_166c235c-fba1-541a-853a-5e48031d6a94/166c235c-fba1-541a-853a-5e48031d6a94_image_8.jpg HTTP/1.1" 201 0
2026-03-25 16:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd2%252Ff96989d644f7422ebbf9391d13cabf2b%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd2/f96989d644f7422ebbf9391d13cabf2b/images/large/9.jpg saved to cache
2026-03-25 16:33:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 166c235c-fba1-541a-853a-5e48031d6a94
2026-03-25 16:33:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc5f9f50>
2026-03-25 16:33:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_166c235c-fba1-541a-853a-5e48031d6a94/166c235c-fba1-541a-853a-5e48031d6a94_image_5.jpg HTTP/1.1" 201 0
2026-03-25 16:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd2%252Ff96989d644f7422ebbf9391d13cabf2b%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd2/f96989d644f7422ebbf9391d13cabf2b/images/large/6.jpg saved to cache
2026-03-25 16:33:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 166c235c-fba1-541a-853a-5e48031d6a94
2026-03-25 16:33:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc8d7810>
2026-03-25 16:33:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_166c235c-fba1-541a-853a-5e48031d6a94/166c235c-fba1-541a-853a-5e48031d6a94_image_1.jpg HTTP/1.1" 201 0
2026-03-25 16:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd2%252Ff96989d644f7422ebbf9391d13cabf2b%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd2/f96989d644f7422ebbf9391d13cabf2b/images/large/2.jpg saved to cache
2026-03-25 16:33:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 166c235c-fba1-541a-853a-5e48031d6a94
2026-03-25 16:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge8%252Fe73ece421b584be293c89f0b51b9cfee%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge8/e73ece421b584be293c89f0b51b9cfee/images/large/10.jpg not downloaded yet
2026-03-25 16:33:01 [ayvens.it] INFO: Found listing with ID: 1983610
2026-03-25 16:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983610%27 HTTP/1.1" 200 None
2026-03-25 16:33:01 [ayvens.it] INFO: Scrape type for 1983610: 1
2026-03-25 16:33:01 [ayvens.it] INFO: Extracting data for car ID: 1983610
2026-03-25 16:33:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d3fda564-e6a5-5114-a0e6-852d4adbc8c3 with identifier: 1983610
2026-03-25 16:33:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d3fda564-e6a5-5114-a0e6-852d4adbc8c3 with scrape type 1
2026-03-25 16:33:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d3fda564-e6a5-5114-a0e6-852d4adbc8c3
2026-03-25 16:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge1%252F8c560ec4c27c4f06af9446bb842ca078%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge1/8c560ec4c27c4f06af9446bb842ca078/images/large/1.jpg not downloaded yet
2026-03-25 16:33:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd2/f96989d644f7422ebbf9391d13cabf2b/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge1%252F8c560ec4c27c4f06af9446bb842ca078%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge1/8c560ec4c27c4f06af9446bb842ca078/images/large/2.jpg not downloaded yet
2026-03-25 16:33:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc57b490>
2026-03-25 16:33:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4163907-708f-5dbb-a964-1694c3d13cd1/b4163907-708f-5dbb-a964-1694c3d13cd1_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf8%252F016015cd842040f0a65de46159343182%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf8/016015cd842040f0a65de46159343182/images/large/1.jpg saved to cache
2026-03-25 16:33:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b4163907-708f-5dbb-a964-1694c3d13cd1
2026-03-25 16:33:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf8/016015cd842040f0a65de46159343182/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf8/016015cd842040f0a65de46159343182/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf8/016015cd842040f0a65de46159343182/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge1%252F8c560ec4c27c4f06af9446bb842ca078%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge1/8c560ec4c27c4f06af9446bb842ca078/images/large/3.jpg not downloaded yet
2026-03-25 16:33:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf8/016015cd842040f0a65de46159343182/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf8/016015cd842040f0a65de46159343182/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge1%252F8c560ec4c27c4f06af9446bb842ca078%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge1/8c560ec4c27c4f06af9446bb842ca078/images/large/4.jpg not downloaded yet
2026-03-25 16:33:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf8/016015cd842040f0a65de46159343182/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dca46d50>
2026-03-25 16:33:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_166c235c-fba1-541a-853a-5e48031d6a94/166c235c-fba1-541a-853a-5e48031d6a94_image_9.jpg HTTP/1.1" 201 0
2026-03-25 16:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd2%252Ff96989d644f7422ebbf9391d13cabf2b%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd2/f96989d644f7422ebbf9391d13cabf2b/images/large/10.jpg saved to cache
2026-03-25 16:33:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 166c235c-fba1-541a-853a-5e48031d6a94
2026-03-25 16:33:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 166c235c-fba1-541a-853a-5e48031d6a94, skipping ID generation
2026-03-25 16:33:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 166c235c-fba1-541a-853a-5e48031d6a94 with scrape type 1
2026-03-25 16:33:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 166c235c-fba1-541a-853a-5e48031d6a94 sending to next pipeline
2026-03-25 16:33:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 166c235c-fba1-541a-853a-5e48031d6a94, identifier: 1983607
2026-03-25 16:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge1%252F8c560ec4c27c4f06af9446bb842ca078%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge1/8c560ec4c27c4f06af9446bb842ca078/images/large/5.jpg not downloaded yet
2026-03-25 16:33:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 166c235c-fba1-541a-853a-5e48031d6a94 with identifier: 1983607
2026-03-25 16:33:01 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:33:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 166c235c-fba1-541a-853a-5e48031d6a94 with identifier: 1983607
2026-03-25 16:33:02 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 166c235c-fba1-541a-853a-5e48031d6a94 with identifier: 1983607 to the API
2026-03-25 16:33:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:33:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:33:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gd2/f96989d644f7422ebbf9391d13cabf2b/images/large/10.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'BIANCO GHIACCIO METALLIZZATO',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-27T09:30:00Z',
'fuel_type': 'diesel',
'id': '166c235c-fba1-541a-853a-5e48031d6a94',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41025',
'listing': 'auction',
'location': None,
'make': 'AUDI',
'model': 'AUDI A4 AVANT 2.0 30 TDI 100KW BUSIN ADVAN. S TRONIC SW 5-door '
'(Euro 6.2) mild hybrid',
'odometer': 117109,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 18,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_166c235c-fba1-541a-853a-5e48031d6a94/166c235c-fba1-541a-853a-5e48031d6a94_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 709947,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd2/f96989d644f7422ebbf9391d13cabf2b/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_166c235c-fba1-541a-853a-5e48031d6a94/166c235c-fba1-541a-853a-5e48031d6a94_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 746237,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd2/f96989d644f7422ebbf9391d13cabf2b/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_166c235c-fba1-541a-853a-5e48031d6a94/166c235c-fba1-541a-853a-5e48031d6a94_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 709947,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd2/f96989d644f7422ebbf9391d13cabf2b/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_166c235c-fba1-541a-853a-5e48031d6a94/166c235c-fba1-541a-853a-5e48031d6a94_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 838446,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd2/f96989d644f7422ebbf9391d13cabf2b/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_166c235c-fba1-541a-853a-5e48031d6a94/166c235c-fba1-541a-853a-5e48031d6a94_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 777018,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd2/f96989d644f7422ebbf9391d13cabf2b/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_166c235c-fba1-541a-853a-5e48031d6a94/166c235c-fba1-541a-853a-5e48031d6a94_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 673179,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd2/f96989d644f7422ebbf9391d13cabf2b/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_166c235c-fba1-541a-853a-5e48031d6a94/166c235c-fba1-541a-853a-5e48031d6a94_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 533385,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd2/f96989d644f7422ebbf9391d13cabf2b/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_166c235c-fba1-541a-853a-5e48031d6a94/166c235c-fba1-541a-853a-5e48031d6a94_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 536652,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd2/f96989d644f7422ebbf9391d13cabf2b/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_166c235c-fba1-541a-853a-5e48031d6a94/166c235c-fba1-541a-853a-5e48031d6a94_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 606705,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd2/f96989d644f7422ebbf9391d13cabf2b/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_166c235c-fba1-541a-853a-5e48031d6a94/166c235c-fba1-541a-853a-5e48031d6a94_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 539468,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd2/f96989d644f7422ebbf9391d13cabf2b/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-12-28',
'seats_number': 5,
'seller_name': None,
'title': 'AUDI AUDI A4 AVANT 2.0 30 TDI 100KW BUSIN ADVAN. S TRONIC SW 5-door '
'(Euro 6.2) mild hybrid -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2020}
2026-03-25 16:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983607%27 HTTP/1.1" 200 None
2026-03-25 16:33:02 [ayvens.it] INFO: Saving data for 1983607: {'created_time': 1774456382.553344, 'last_price_update_time': 1774456382.553355, 'auction_closing_time': 1774603800.0}
2026-03-25 16:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1983607') HTTP/1.1" 204 0
2026-03-25 16:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge1%252F8c560ec4c27c4f06af9446bb842ca078%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge1/8c560ec4c27c4f06af9446bb842ca078/images/large/6.jpg not downloaded yet
2026-03-25 16:33:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34d7d60790>
2026-03-25 16:33:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4163907-708f-5dbb-a964-1694c3d13cd1/b4163907-708f-5dbb-a964-1694c3d13cd1_image_2.jpg HTTP/1.1" 201 0
2026-03-25 16:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf8%252F016015cd842040f0a65de46159343182%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf8/016015cd842040f0a65de46159343182/images/large/3.jpg saved to cache
2026-03-25 16:33:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b4163907-708f-5dbb-a964-1694c3d13cd1
2026-03-25 16:33:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc787bd0>
2026-03-25 16:33:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4163907-708f-5dbb-a964-1694c3d13cd1/b4163907-708f-5dbb-a964-1694c3d13cd1_image_5.jpg HTTP/1.1" 201 0
2026-03-25 16:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf8%252F016015cd842040f0a65de46159343182%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf8/016015cd842040f0a65de46159343182/images/large/6.jpg saved to cache
2026-03-25 16:33:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b4163907-708f-5dbb-a964-1694c3d13cd1
2026-03-25 16:33:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcb9a410>
2026-03-25 16:33:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4163907-708f-5dbb-a964-1694c3d13cd1/b4163907-708f-5dbb-a964-1694c3d13cd1_image_6.jpg HTTP/1.1" 201 0
2026-03-25 16:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf8%252F016015cd842040f0a65de46159343182%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf8/016015cd842040f0a65de46159343182/images/large/7.jpg saved to cache
2026-03-25 16:33:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b4163907-708f-5dbb-a964-1694c3d13cd1
2026-03-25 16:33:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34d6b4bd90>
2026-03-25 16:33:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4163907-708f-5dbb-a964-1694c3d13cd1/b4163907-708f-5dbb-a964-1694c3d13cd1_image_3.jpg HTTP/1.1" 201 0
2026-03-25 16:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf8%252F016015cd842040f0a65de46159343182%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf8/016015cd842040f0a65de46159343182/images/large/4.jpg saved to cache
2026-03-25 16:33:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b4163907-708f-5dbb-a964-1694c3d13cd1
2026-03-25 16:33:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcb9a610>
2026-03-25 16:33:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4163907-708f-5dbb-a964-1694c3d13cd1/b4163907-708f-5dbb-a964-1694c3d13cd1_image_4.jpg HTTP/1.1" 201 0
2026-03-25 16:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf8%252F016015cd842040f0a65de46159343182%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf8/016015cd842040f0a65de46159343182/images/large/5.jpg saved to cache
2026-03-25 16:33:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b4163907-708f-5dbb-a964-1694c3d13cd1
2026-03-25 16:33:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc929d10>
2026-03-25 16:33:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4163907-708f-5dbb-a964-1694c3d13cd1/b4163907-708f-5dbb-a964-1694c3d13cd1_image_1.jpg HTTP/1.1" 201 0
2026-03-25 16:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf8%252F016015cd842040f0a65de46159343182%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf8/016015cd842040f0a65de46159343182/images/large/2.jpg saved to cache
2026-03-25 16:33:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b4163907-708f-5dbb-a964-1694c3d13cd1
2026-03-25 16:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge1%252F8c560ec4c27c4f06af9446bb842ca078%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge1/8c560ec4c27c4f06af9446bb842ca078/images/large/7.jpg not downloaded yet
2026-03-25 16:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge1%252F8c560ec4c27c4f06af9446bb842ca078%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge1/8c560ec4c27c4f06af9446bb842ca078/images/large/8.jpg not downloaded yet
2026-03-25 16:33:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge8/e73ece421b584be293c89f0b51b9cfee/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge8/e73ece421b584be293c89f0b51b9cfee/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge8/e73ece421b584be293c89f0b51b9cfee/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge1%252F8c560ec4c27c4f06af9446bb842ca078%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge1/8c560ec4c27c4f06af9446bb842ca078/images/large/9.jpg not downloaded yet
2026-03-25 16:33:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf8/016015cd842040f0a65de46159343182/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf8/016015cd842040f0a65de46159343182/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge8/e73ece421b584be293c89f0b51b9cfee/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge8/e73ece421b584be293c89f0b51b9cfee/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge1%252F8c560ec4c27c4f06af9446bb842ca078%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge1/8c560ec4c27c4f06af9446bb842ca078/images/large/10.jpg not downloaded yet
2026-03-25 16:33:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf8/016015cd842040f0a65de46159343182/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:03 [ayvens.it] INFO: Found listing with ID: 1983611
2026-03-25 16:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983611%27 HTTP/1.1" 200 None
2026-03-25 16:33:03 [ayvens.it] INFO: Scrape type for 1983611: 1
2026-03-25 16:33:03 [ayvens.it] INFO: Extracting data for car ID: 1983611
2026-03-25 16:33:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7cdfe783-01ef-5813-824c-ed9e64604ad9 with identifier: 1983611
2026-03-25 16:33:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7cdfe783-01ef-5813-824c-ed9e64604ad9 with scrape type 1
2026-03-25 16:33:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7cdfe783-01ef-5813-824c-ed9e64604ad9
2026-03-25 16:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc4%252Ffa0188f63eec458c8153df5741b8198f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc4/fa0188f63eec458c8153df5741b8198f/images/large/1.jpg not downloaded yet
2026-03-25 16:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc4%252Ffa0188f63eec458c8153df5741b8198f%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc4/fa0188f63eec458c8153df5741b8198f/images/large/2.jpg not downloaded yet
2026-03-25 16:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc4%252Ffa0188f63eec458c8153df5741b8198f%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc4/fa0188f63eec458c8153df5741b8198f/images/large/3.jpg not downloaded yet
2026-03-25 16:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc4%252Ffa0188f63eec458c8153df5741b8198f%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc4/fa0188f63eec458c8153df5741b8198f/images/large/4.jpg not downloaded yet
2026-03-25 16:33:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcb98250>
2026-03-25 16:33:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46002a01-82ce-5602-af6d-4600ad468b8f/46002a01-82ce-5602-af6d-4600ad468b8f_image_1.jpg HTTP/1.1" 201 0
2026-03-25 16:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge8%252Fe73ece421b584be293c89f0b51b9cfee%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge8/e73ece421b584be293c89f0b51b9cfee/images/large/2.jpg saved to cache
2026-03-25 16:33:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 46002a01-82ce-5602-af6d-4600ad468b8f
2026-03-25 16:33:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcbe5810>
2026-03-25 16:33:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46002a01-82ce-5602-af6d-4600ad468b8f/46002a01-82ce-5602-af6d-4600ad468b8f_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge8%252Fe73ece421b584be293c89f0b51b9cfee%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge8/e73ece421b584be293c89f0b51b9cfee/images/large/1.jpg saved to cache
2026-03-25 16:33:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 46002a01-82ce-5602-af6d-4600ad468b8f
2026-03-25 16:33:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc5d6750>
2026-03-25 16:33:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46002a01-82ce-5602-af6d-4600ad468b8f/46002a01-82ce-5602-af6d-4600ad468b8f_image_4.jpg HTTP/1.1" 201 0
2026-03-25 16:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge8%252Fe73ece421b584be293c89f0b51b9cfee%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge8/e73ece421b584be293c89f0b51b9cfee/images/large/5.jpg saved to cache
2026-03-25 16:33:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 46002a01-82ce-5602-af6d-4600ad468b8f
2026-03-25 16:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc4%252Ffa0188f63eec458c8153df5741b8198f%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc4/fa0188f63eec458c8153df5741b8198f/images/large/5.jpg not downloaded yet
2026-03-25 16:33:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc907250>
2026-03-25 16:33:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4163907-708f-5dbb-a964-1694c3d13cd1/b4163907-708f-5dbb-a964-1694c3d13cd1_image_8.jpg HTTP/1.1" 201 0
2026-03-25 16:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf8%252F016015cd842040f0a65de46159343182%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf8/016015cd842040f0a65de46159343182/images/large/9.jpg saved to cache
2026-03-25 16:33:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b4163907-708f-5dbb-a964-1694c3d13cd1
2026-03-25 16:33:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34de16cb90>
2026-03-25 16:33:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4163907-708f-5dbb-a964-1694c3d13cd1/b4163907-708f-5dbb-a964-1694c3d13cd1_image_9.jpg HTTP/1.1" 201 0
2026-03-25 16:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf8%252F016015cd842040f0a65de46159343182%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf8/016015cd842040f0a65de46159343182/images/large/10.jpg saved to cache
2026-03-25 16:33:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b4163907-708f-5dbb-a964-1694c3d13cd1
2026-03-25 16:33:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34de454cd0>
2026-03-25 16:33:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46002a01-82ce-5602-af6d-4600ad468b8f/46002a01-82ce-5602-af6d-4600ad468b8f_image_3.jpg HTTP/1.1" 201 0
2026-03-25 16:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge8%252Fe73ece421b584be293c89f0b51b9cfee%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge8/e73ece421b584be293c89f0b51b9cfee/images/large/4.jpg saved to cache
2026-03-25 16:33:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 46002a01-82ce-5602-af6d-4600ad468b8f
2026-03-25 16:33:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dca06550>
2026-03-25 16:33:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46002a01-82ce-5602-af6d-4600ad468b8f/46002a01-82ce-5602-af6d-4600ad468b8f_image_2.jpg HTTP/1.1" 201 0
2026-03-25 16:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge8%252Fe73ece421b584be293c89f0b51b9cfee%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge8/e73ece421b584be293c89f0b51b9cfee/images/large/3.jpg saved to cache
2026-03-25 16:33:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 46002a01-82ce-5602-af6d-4600ad468b8f
2026-03-25 16:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc4%252Ffa0188f63eec458c8153df5741b8198f%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc4/fa0188f63eec458c8153df5741b8198f/images/large/6.jpg not downloaded yet
2026-03-25 16:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc4%252Ffa0188f63eec458c8153df5741b8198f%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc4/fa0188f63eec458c8153df5741b8198f/images/large/7.jpg not downloaded yet
2026-03-25 16:33:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34de140d10>
2026-03-25 16:33:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4163907-708f-5dbb-a964-1694c3d13cd1/b4163907-708f-5dbb-a964-1694c3d13cd1_image_7.jpg HTTP/1.1" 201 0
2026-03-25 16:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf8%252F016015cd842040f0a65de46159343182%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf8/016015cd842040f0a65de46159343182/images/large/8.jpg saved to cache
2026-03-25 16:33:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b4163907-708f-5dbb-a964-1694c3d13cd1
2026-03-25 16:33:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b4163907-708f-5dbb-a964-1694c3d13cd1, skipping ID generation
2026-03-25 16:33:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b4163907-708f-5dbb-a964-1694c3d13cd1 with scrape type 1
2026-03-25 16:33:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b4163907-708f-5dbb-a964-1694c3d13cd1 sending to next pipeline
2026-03-25 16:33:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: b4163907-708f-5dbb-a964-1694c3d13cd1, identifier: 1983608
2026-03-25 16:33:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge8/e73ece421b584be293c89f0b51b9cfee/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: b4163907-708f-5dbb-a964-1694c3d13cd1 with identifier: 1983608
2026-03-25 16:33:04 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:33:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: b4163907-708f-5dbb-a964-1694c3d13cd1 with identifier: 1983608
2026-03-25 16:33:04 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: b4163907-708f-5dbb-a964-1694c3d13cd1 with identifier: 1983608 to the API
2026-03-25 16:33:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:33:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:33:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gf8/016015cd842040f0a65de46159343182/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'GRIGIO URANO PASTELLO',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-27T09:30:00Z',
'fuel_type': 'hybrid',
'id': 'b4163907-708f-5dbb-a964-1694c3d13cd1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41025',
'listing': 'auction',
'location': None,
'make': 'VOLKSWAGEN',
'model': 'VOLKSWAGEN GOLF 1.5 eTSI EVO ACT 96kW Life DSG Hatchback 5-door '
'(Euro 6.2) mild hybrid',
'odometer': 207171,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 29,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4163907-708f-5dbb-a964-1694c3d13cd1/b4163907-708f-5dbb-a964-1694c3d13cd1_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 857411,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf8/016015cd842040f0a65de46159343182/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4163907-708f-5dbb-a964-1694c3d13cd1/b4163907-708f-5dbb-a964-1694c3d13cd1_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 854526,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf8/016015cd842040f0a65de46159343182/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4163907-708f-5dbb-a964-1694c3d13cd1/b4163907-708f-5dbb-a964-1694c3d13cd1_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 857411,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf8/016015cd842040f0a65de46159343182/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4163907-708f-5dbb-a964-1694c3d13cd1/b4163907-708f-5dbb-a964-1694c3d13cd1_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 809710,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf8/016015cd842040f0a65de46159343182/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4163907-708f-5dbb-a964-1694c3d13cd1/b4163907-708f-5dbb-a964-1694c3d13cd1_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 808646,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf8/016015cd842040f0a65de46159343182/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4163907-708f-5dbb-a964-1694c3d13cd1/b4163907-708f-5dbb-a964-1694c3d13cd1_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 642938,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf8/016015cd842040f0a65de46159343182/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4163907-708f-5dbb-a964-1694c3d13cd1/b4163907-708f-5dbb-a964-1694c3d13cd1_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 596832,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf8/016015cd842040f0a65de46159343182/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4163907-708f-5dbb-a964-1694c3d13cd1/b4163907-708f-5dbb-a964-1694c3d13cd1_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 640177,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf8/016015cd842040f0a65de46159343182/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4163907-708f-5dbb-a964-1694c3d13cd1/b4163907-708f-5dbb-a964-1694c3d13cd1_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 660348,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf8/016015cd842040f0a65de46159343182/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4163907-708f-5dbb-a964-1694c3d13cd1/b4163907-708f-5dbb-a964-1694c3d13cd1_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 573499,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf8/016015cd842040f0a65de46159343182/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-04-08',
'seats_number': 5,
'seller_name': None,
'title': 'VOLKSWAGEN VOLKSWAGEN GOLF 1.5 eTSI EVO ACT 96kW Life DSG Hatchback '
'5-door (Euro 6.2) mild hybrid -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2021}
2026-03-25 16:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983608%27 HTTP/1.1" 200 None
2026-03-25 16:33:05 [ayvens.it] INFO: Saving data for 1983608: {'created_time': 1774456385.113393, 'last_price_update_time': 1774456385.113405, 'auction_closing_time': 1774603800.0}
2026-03-25 16:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1983608') HTTP/1.1" 204 0
2026-03-25 16:33:05 [scrapy.extensions.logstats] INFO: Crawled 14 pages (at -6 pages/min), scraped 62 items (at 34 items/min)
2026-03-25 16:33:05 [scrapy.extensions.memusage] INFO: Peak memory usage is 182MiB
2026-03-25 16:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc4%252Ffa0188f63eec458c8153df5741b8198f%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc4/fa0188f63eec458c8153df5741b8198f/images/large/8.jpg not downloaded yet
2026-03-25 16:33:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge8/e73ece421b584be293c89f0b51b9cfee/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc4%252Ffa0188f63eec458c8153df5741b8198f%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc4/fa0188f63eec458c8153df5741b8198f/images/large/9.jpg not downloaded yet
2026-03-25 16:33:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge8/e73ece421b584be293c89f0b51b9cfee/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcb155d0>
2026-03-25 16:33:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46002a01-82ce-5602-af6d-4600ad468b8f/46002a01-82ce-5602-af6d-4600ad468b8f_image_8.jpg HTTP/1.1" 201 0
2026-03-25 16:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge8%252Fe73ece421b584be293c89f0b51b9cfee%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge8/e73ece421b584be293c89f0b51b9cfee/images/large/9.jpg saved to cache
2026-03-25 16:33:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 46002a01-82ce-5602-af6d-4600ad468b8f
2026-03-25 16:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc4%252Ffa0188f63eec458c8153df5741b8198f%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc4/fa0188f63eec458c8153df5741b8198f/images/large/10.jpg not downloaded yet
2026-03-25 16:33:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge1/8c560ec4c27c4f06af9446bb842ca078/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge1/8c560ec4c27c4f06af9446bb842ca078/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge1/8c560ec4c27c4f06af9446bb842ca078/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:05 [ayvens.it] INFO: Found listing with ID: 1983612
2026-03-25 16:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983612%27 HTTP/1.1" 200 None
2026-03-25 16:33:05 [ayvens.it] INFO: Scrape type for 1983612: 1
2026-03-25 16:33:05 [ayvens.it] INFO: Extracting data for car ID: 1983612
2026-03-25 16:33:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: daf30eeb-d6ed-5fdf-b722-14c7428ae08e with identifier: 1983612
2026-03-25 16:33:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item daf30eeb-d6ed-5fdf-b722-14c7428ae08e with scrape type 1
2026-03-25 16:33:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item daf30eeb-d6ed-5fdf-b722-14c7428ae08e
2026-03-25 16:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg0%252F590a5f9873ed4487ab2b6876ce6fedc9%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg0/590a5f9873ed4487ab2b6876ce6fedc9/images/large/1.jpg not downloaded yet
2026-03-25 16:33:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc800310>
2026-03-25 16:33:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46002a01-82ce-5602-af6d-4600ad468b8f/46002a01-82ce-5602-af6d-4600ad468b8f_image_9.jpg HTTP/1.1" 201 0
2026-03-25 16:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge8%252Fe73ece421b584be293c89f0b51b9cfee%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge8/e73ece421b584be293c89f0b51b9cfee/images/large/10.jpg saved to cache
2026-03-25 16:33:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 46002a01-82ce-5602-af6d-4600ad468b8f
2026-03-25 16:33:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge1/8c560ec4c27c4f06af9446bb842ca078/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge1/8c560ec4c27c4f06af9446bb842ca078/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg0%252F590a5f9873ed4487ab2b6876ce6fedc9%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg0/590a5f9873ed4487ab2b6876ce6fedc9/images/large/2.jpg not downloaded yet
2026-03-25 16:33:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34de16fbd0>
2026-03-25 16:33:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46002a01-82ce-5602-af6d-4600ad468b8f/46002a01-82ce-5602-af6d-4600ad468b8f_image_7.jpg HTTP/1.1" 201 0
2026-03-25 16:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge8%252Fe73ece421b584be293c89f0b51b9cfee%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge8/e73ece421b584be293c89f0b51b9cfee/images/large/8.jpg saved to cache
2026-03-25 16:33:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 46002a01-82ce-5602-af6d-4600ad468b8f
2026-03-25 16:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg0%252F590a5f9873ed4487ab2b6876ce6fedc9%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg0/590a5f9873ed4487ab2b6876ce6fedc9/images/large/3.jpg not downloaded yet
2026-03-25 16:33:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dca51d10>
2026-03-25 16:33:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3fda564-e6a5-5114-a0e6-852d4adbc8c3/d3fda564-e6a5-5114-a0e6-852d4adbc8c3_image_1.jpg HTTP/1.1" 201 0
2026-03-25 16:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge1%252F8c560ec4c27c4f06af9446bb842ca078%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge1/8c560ec4c27c4f06af9446bb842ca078/images/large/2.jpg saved to cache
2026-03-25 16:33:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d3fda564-e6a5-5114-a0e6-852d4adbc8c3
2026-03-25 16:33:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcaf5990>
2026-03-25 16:33:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3fda564-e6a5-5114-a0e6-852d4adbc8c3/d3fda564-e6a5-5114-a0e6-852d4adbc8c3_image_5.jpg HTTP/1.1" 201 0
2026-03-25 16:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge1%252F8c560ec4c27c4f06af9446bb842ca078%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge1/8c560ec4c27c4f06af9446bb842ca078/images/large/6.jpg saved to cache
2026-03-25 16:33:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d3fda564-e6a5-5114-a0e6-852d4adbc8c3
2026-03-25 16:33:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc5b5e50>
2026-03-25 16:33:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3fda564-e6a5-5114-a0e6-852d4adbc8c3/d3fda564-e6a5-5114-a0e6-852d4adbc8c3_image_4.jpg HTTP/1.1" 201 0
2026-03-25 16:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge1%252F8c560ec4c27c4f06af9446bb842ca078%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge1/8c560ec4c27c4f06af9446bb842ca078/images/large/5.jpg saved to cache
2026-03-25 16:33:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d3fda564-e6a5-5114-a0e6-852d4adbc8c3
2026-03-25 16:33:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcaf5510>
2026-03-25 16:33:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3fda564-e6a5-5114-a0e6-852d4adbc8c3/d3fda564-e6a5-5114-a0e6-852d4adbc8c3_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge1%252F8c560ec4c27c4f06af9446bb842ca078%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge1/8c560ec4c27c4f06af9446bb842ca078/images/large/1.jpg saved to cache
2026-03-25 16:33:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d3fda564-e6a5-5114-a0e6-852d4adbc8c3
2026-03-25 16:33:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc785c50>
2026-03-25 16:33:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3fda564-e6a5-5114-a0e6-852d4adbc8c3/d3fda564-e6a5-5114-a0e6-852d4adbc8c3_image_3.jpg HTTP/1.1" 201 0
2026-03-25 16:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge1%252F8c560ec4c27c4f06af9446bb842ca078%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge1/8c560ec4c27c4f06af9446bb842ca078/images/large/4.jpg saved to cache
2026-03-25 16:33:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d3fda564-e6a5-5114-a0e6-852d4adbc8c3
2026-03-25 16:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg0%252F590a5f9873ed4487ab2b6876ce6fedc9%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg0/590a5f9873ed4487ab2b6876ce6fedc9/images/large/4.jpg not downloaded yet
2026-03-25 16:33:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge1/8c560ec4c27c4f06af9446bb842ca078/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg0%252F590a5f9873ed4487ab2b6876ce6fedc9%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg0/590a5f9873ed4487ab2b6876ce6fedc9/images/large/5.jpg not downloaded yet
2026-03-25 16:33:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge1/8c560ec4c27c4f06af9446bb842ca078/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge8/e73ece421b584be293c89f0b51b9cfee/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg0%252F590a5f9873ed4487ab2b6876ce6fedc9%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg0/590a5f9873ed4487ab2b6876ce6fedc9/images/large/6.jpg not downloaded yet
2026-03-25 16:33:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge8/e73ece421b584be293c89f0b51b9cfee/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg0%252F590a5f9873ed4487ab2b6876ce6fedc9%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg0/590a5f9873ed4487ab2b6876ce6fedc9/images/large/7.jpg not downloaded yet
2026-03-25 16:33:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge1/8c560ec4c27c4f06af9446bb842ca078/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg0%252F590a5f9873ed4487ab2b6876ce6fedc9%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg0/590a5f9873ed4487ab2b6876ce6fedc9/images/large/8.jpg not downloaded yet
2026-03-25 16:33:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga0/f57cc380721d481c8e03509c4a3c6729/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg0%252F590a5f9873ed4487ab2b6876ce6fedc9%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg0/590a5f9873ed4487ab2b6876ce6fedc9/images/large/9.jpg not downloaded yet
2026-03-25 16:33:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge1/8c560ec4c27c4f06af9446bb842ca078/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge1/8c560ec4c27c4f06af9446bb842ca078/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcaf6d90>
2026-03-25 16:33:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3fda564-e6a5-5114-a0e6-852d4adbc8c3/d3fda564-e6a5-5114-a0e6-852d4adbc8c3_image_7.jpg HTTP/1.1" 201 0
2026-03-25 16:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge1%252F8c560ec4c27c4f06af9446bb842ca078%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge1/8c560ec4c27c4f06af9446bb842ca078/images/large/8.jpg saved to cache
2026-03-25 16:33:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d3fda564-e6a5-5114-a0e6-852d4adbc8c3
2026-03-25 16:33:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc308a50>
2026-03-25 16:33:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3fda564-e6a5-5114-a0e6-852d4adbc8c3/d3fda564-e6a5-5114-a0e6-852d4adbc8c3_image_6.jpg HTTP/1.1" 201 0
2026-03-25 16:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge1%252F8c560ec4c27c4f06af9446bb842ca078%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge1/8c560ec4c27c4f06af9446bb842ca078/images/large/7.jpg saved to cache
2026-03-25 16:33:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d3fda564-e6a5-5114-a0e6-852d4adbc8c3
2026-03-25 16:33:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc7871d0>
2026-03-25 16:33:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46002a01-82ce-5602-af6d-4600ad468b8f/46002a01-82ce-5602-af6d-4600ad468b8f_image_5.jpg HTTP/1.1" 201 0
2026-03-25 16:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge8%252Fe73ece421b584be293c89f0b51b9cfee%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge8/e73ece421b584be293c89f0b51b9cfee/images/large/6.jpg saved to cache
2026-03-25 16:33:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 46002a01-82ce-5602-af6d-4600ad468b8f
2026-03-25 16:33:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc327d90>
2026-03-25 16:33:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46002a01-82ce-5602-af6d-4600ad468b8f/46002a01-82ce-5602-af6d-4600ad468b8f_image_6.jpg HTTP/1.1" 201 0
2026-03-25 16:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge8%252Fe73ece421b584be293c89f0b51b9cfee%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge8/e73ece421b584be293c89f0b51b9cfee/images/large/7.jpg saved to cache
2026-03-25 16:33:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 46002a01-82ce-5602-af6d-4600ad468b8f
2026-03-25 16:33:06 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 46002a01-82ce-5602-af6d-4600ad468b8f, skipping ID generation
2026-03-25 16:33:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 46002a01-82ce-5602-af6d-4600ad468b8f with scrape type 1
2026-03-25 16:33:06 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 46002a01-82ce-5602-af6d-4600ad468b8f sending to next pipeline
2026-03-25 16:33:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 46002a01-82ce-5602-af6d-4600ad468b8f, identifier: 1983609
2026-03-25 16:33:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcbe5390>
2026-03-25 16:33:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3fda564-e6a5-5114-a0e6-852d4adbc8c3/d3fda564-e6a5-5114-a0e6-852d4adbc8c3_image_2.jpg HTTP/1.1" 201 0
2026-03-25 16:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge1%252F8c560ec4c27c4f06af9446bb842ca078%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge1/8c560ec4c27c4f06af9446bb842ca078/images/large/3.jpg saved to cache
2026-03-25 16:33:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d3fda564-e6a5-5114-a0e6-852d4adbc8c3
2026-03-25 16:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg0%252F590a5f9873ed4487ab2b6876ce6fedc9%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg0/590a5f9873ed4487ab2b6876ce6fedc9/images/large/10.jpg not downloaded yet
2026-03-25 16:33:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 46002a01-82ce-5602-af6d-4600ad468b8f with identifier: 1983609
2026-03-25 16:33:06 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:33:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 46002a01-82ce-5602-af6d-4600ad468b8f with identifier: 1983609
2026-03-25 16:33:06 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 46002a01-82ce-5602-af6d-4600ad468b8f with identifier: 1983609 to the API
2026-03-25 16:33:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:33:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:33:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/ge8/e73ece421b584be293c89f0b51b9cfee/images/large/7.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'GRIGIO SELENITE MAGNO DESIGNO',
'currency': 'EUR',
'doors_number': 4,
'engine': '2.0L',
'expiration_date': '2026-03-27T09:30:00Z',
'fuel_type': 'hybrid',
'id': '46002a01-82ce-5602-af6d-4600ad468b8f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41025',
'listing': 'auction',
'location': None,
'make': 'MERCEDES-BENZ',
'model': 'MERCEDES GLC COUPE 300 4MATIC EQ-BOOST PREMIUM PLUS AUT. FP',
'odometer': 55227,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 20,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46002a01-82ce-5602-af6d-4600ad468b8f/46002a01-82ce-5602-af6d-4600ad468b8f_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 419603,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge8/e73ece421b584be293c89f0b51b9cfee/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46002a01-82ce-5602-af6d-4600ad468b8f/46002a01-82ce-5602-af6d-4600ad468b8f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 419603,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge8/e73ece421b584be293c89f0b51b9cfee/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46002a01-82ce-5602-af6d-4600ad468b8f/46002a01-82ce-5602-af6d-4600ad468b8f_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 607168,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge8/e73ece421b584be293c89f0b51b9cfee/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46002a01-82ce-5602-af6d-4600ad468b8f/46002a01-82ce-5602-af6d-4600ad468b8f_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 474069,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge8/e73ece421b584be293c89f0b51b9cfee/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46002a01-82ce-5602-af6d-4600ad468b8f/46002a01-82ce-5602-af6d-4600ad468b8f_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 401061,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge8/e73ece421b584be293c89f0b51b9cfee/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46002a01-82ce-5602-af6d-4600ad468b8f/46002a01-82ce-5602-af6d-4600ad468b8f_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 417778,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge8/e73ece421b584be293c89f0b51b9cfee/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46002a01-82ce-5602-af6d-4600ad468b8f/46002a01-82ce-5602-af6d-4600ad468b8f_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 376589,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge8/e73ece421b584be293c89f0b51b9cfee/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46002a01-82ce-5602-af6d-4600ad468b8f/46002a01-82ce-5602-af6d-4600ad468b8f_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 750395,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge8/e73ece421b584be293c89f0b51b9cfee/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46002a01-82ce-5602-af6d-4600ad468b8f/46002a01-82ce-5602-af6d-4600ad468b8f_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 423239,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge8/e73ece421b584be293c89f0b51b9cfee/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46002a01-82ce-5602-af6d-4600ad468b8f/46002a01-82ce-5602-af6d-4600ad468b8f_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 391995,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge8/e73ece421b584be293c89f0b51b9cfee/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-02-17',
'seats_number': 5,
'seller_name': None,
'title': 'MERCEDES-BENZ MERCEDES GLC COUPE 300 4MATIC EQ-BOOST PREMIUM PLUS '
'AUT. FP -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2021}
2026-03-25 16:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983609%27 HTTP/1.1" 200 None
2026-03-25 16:33:08 [ayvens.it] INFO: Saving data for 1983609: {'created_time': 1774456388.066142, 'last_price_update_time': 1774456388.066155, 'auction_closing_time': 1774603800.0}
2026-03-25 16:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1983609') HTTP/1.1" 204 0
2026-03-25 16:33:08 [ayvens.it] INFO: Found listing with ID: 1983613
2026-03-25 16:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983613%27 HTTP/1.1" 200 None
2026-03-25 16:33:08 [ayvens.it] INFO: Scrape type for 1983613: 1
2026-03-25 16:33:08 [ayvens.it] INFO: Extracting data for car ID: 1983613
2026-03-25 16:33:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 23fafe66-5f7d-5e27-8abe-0d833cc15db0 with identifier: 1983613
2026-03-25 16:33:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 23fafe66-5f7d-5e27-8abe-0d833cc15db0 with scrape type 1
2026-03-25 16:33:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 23fafe66-5f7d-5e27-8abe-0d833cc15db0
2026-03-25 16:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg3%252F69bc720cc60b4c49b4f73ff7cf290539%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg3/69bc720cc60b4c49b4f73ff7cf290539/images/large/1.jpg not downloaded yet
2026-03-25 16:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg3%252F69bc720cc60b4c49b4f73ff7cf290539%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg3/69bc720cc60b4c49b4f73ff7cf290539/images/large/2.jpg not downloaded yet
2026-03-25 16:33:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc9f0ed0>
2026-03-25 16:33:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f634e5cb-f2a2-5a2e-a318-4ce192defad6/f634e5cb-f2a2-5a2e-a318-4ce192defad6_image_2.jpg HTTP/1.1" 201 0
2026-03-25 16:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga0%252Ff57cc380721d481c8e03509c4a3c6729%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga0/f57cc380721d481c8e03509c4a3c6729/images/large/3.jpg saved to cache
2026-03-25 16:33:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f634e5cb-f2a2-5a2e-a318-4ce192defad6
2026-03-25 16:33:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f634e5cb-f2a2-5a2e-a318-4ce192defad6, skipping ID generation
2026-03-25 16:33:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f634e5cb-f2a2-5a2e-a318-4ce192defad6 with scrape type 1
2026-03-25 16:33:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f634e5cb-f2a2-5a2e-a318-4ce192defad6 sending to next pipeline
2026-03-25 16:33:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: f634e5cb-f2a2-5a2e-a318-4ce192defad6, identifier: 1983606
2026-03-25 16:33:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc54f610>
2026-03-25 16:33:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3fda564-e6a5-5114-a0e6-852d4adbc8c3/d3fda564-e6a5-5114-a0e6-852d4adbc8c3_image_8.jpg HTTP/1.1" 201 0
2026-03-25 16:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge1%252F8c560ec4c27c4f06af9446bb842ca078%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge1/8c560ec4c27c4f06af9446bb842ca078/images/large/9.jpg saved to cache
2026-03-25 16:33:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d3fda564-e6a5-5114-a0e6-852d4adbc8c3
2026-03-25 16:33:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc9e53d0>
2026-03-25 16:33:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3fda564-e6a5-5114-a0e6-852d4adbc8c3/d3fda564-e6a5-5114-a0e6-852d4adbc8c3_image_9.jpg HTTP/1.1" 201 0
2026-03-25 16:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge1%252F8c560ec4c27c4f06af9446bb842ca078%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge1/8c560ec4c27c4f06af9446bb842ca078/images/large/10.jpg saved to cache
2026-03-25 16:33:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d3fda564-e6a5-5114-a0e6-852d4adbc8c3
2026-03-25 16:33:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d3fda564-e6a5-5114-a0e6-852d4adbc8c3, skipping ID generation
2026-03-25 16:33:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d3fda564-e6a5-5114-a0e6-852d4adbc8c3 with scrape type 1
2026-03-25 16:33:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d3fda564-e6a5-5114-a0e6-852d4adbc8c3 sending to next pipeline
2026-03-25 16:33:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: d3fda564-e6a5-5114-a0e6-852d4adbc8c3, identifier: 1983610
2026-03-25 16:33:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc4/fa0188f63eec458c8153df5741b8198f/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: f634e5cb-f2a2-5a2e-a318-4ce192defad6 with identifier: 1983606
2026-03-25 16:33:08 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:33:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: f634e5cb-f2a2-5a2e-a318-4ce192defad6 with identifier: 1983606
2026-03-25 16:33:08 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: f634e5cb-f2a2-5a2e-a318-4ce192defad6 with identifier: 1983606 to the API
2026-03-25 16:33:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:33:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:33:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/ga0/f57cc380721d481c8e03509c4a3c6729/images/large/3.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'MINERAL BLACK METALLIZZATO',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-27T09:30:00Z',
'fuel_type': 'diesel',
'id': 'f634e5cb-f2a2-5a2e-a318-4ce192defad6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41025',
'listing': 'auction',
'location': None,
'make': 'OPEL',
'model': 'OPEL CROSSLAND X LP 1.5 DIESEL 102CV INNOVATION S&S MT6 FP',
'odometer': 131733,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 52,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f634e5cb-f2a2-5a2e-a318-4ce192defad6/f634e5cb-f2a2-5a2e-a318-4ce192defad6_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 669065,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga0/f57cc380721d481c8e03509c4a3c6729/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f634e5cb-f2a2-5a2e-a318-4ce192defad6/f634e5cb-f2a2-5a2e-a318-4ce192defad6_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 669065,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga0/f57cc380721d481c8e03509c4a3c6729/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f634e5cb-f2a2-5a2e-a318-4ce192defad6/f634e5cb-f2a2-5a2e-a318-4ce192defad6_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 619021,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga0/f57cc380721d481c8e03509c4a3c6729/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f634e5cb-f2a2-5a2e-a318-4ce192defad6/f634e5cb-f2a2-5a2e-a318-4ce192defad6_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 598433,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga0/f57cc380721d481c8e03509c4a3c6729/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f634e5cb-f2a2-5a2e-a318-4ce192defad6/f634e5cb-f2a2-5a2e-a318-4ce192defad6_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 527490,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga0/f57cc380721d481c8e03509c4a3c6729/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f634e5cb-f2a2-5a2e-a318-4ce192defad6/f634e5cb-f2a2-5a2e-a318-4ce192defad6_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 529122,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga0/f57cc380721d481c8e03509c4a3c6729/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f634e5cb-f2a2-5a2e-a318-4ce192defad6/f634e5cb-f2a2-5a2e-a318-4ce192defad6_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 607440,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga0/f57cc380721d481c8e03509c4a3c6729/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f634e5cb-f2a2-5a2e-a318-4ce192defad6/f634e5cb-f2a2-5a2e-a318-4ce192defad6_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 610299,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga0/f57cc380721d481c8e03509c4a3c6729/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f634e5cb-f2a2-5a2e-a318-4ce192defad6/f634e5cb-f2a2-5a2e-a318-4ce192defad6_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 557144,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga0/f57cc380721d481c8e03509c4a3c6729/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f634e5cb-f2a2-5a2e-a318-4ce192defad6/f634e5cb-f2a2-5a2e-a318-4ce192defad6_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 557418,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga0/f57cc380721d481c8e03509c4a3c6729/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-02-18',
'seats_number': 5,
'seller_name': None,
'title': 'OPEL OPEL CROSSLAND X LP 1.5 DIESEL 102CV INNOVATION S&S MT6 FP -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2020}
2026-03-25 16:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983606%27 HTTP/1.1" 200 None
2026-03-25 16:33:09 [ayvens.it] INFO: Saving data for 1983606: {'created_time': 1774456389.668116, 'last_price_update_time': 1774456389.668127, 'auction_closing_time': 1774603800.0}
2026-03-25 16:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1983606') HTTP/1.1" 204 0
2026-03-25 16:33:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: d3fda564-e6a5-5114-a0e6-852d4adbc8c3 with identifier: 1983610
2026-03-25 16:33:09 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:33:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: d3fda564-e6a5-5114-a0e6-852d4adbc8c3 with identifier: 1983610
2026-03-25 16:33:09 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: d3fda564-e6a5-5114-a0e6-852d4adbc8c3 with identifier: 1983610 to the API
2026-03-25 16:33:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:33:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:33:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/ge1/8c560ec4c27c4f06af9446bb842ca078/images/large/10.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'SANTORINI BLACK MTZ',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-27T09:30:00Z',
'fuel_type': 'diesel',
'id': 'd3fda564-e6a5-5114-a0e6-852d4adbc8c3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41025',
'listing': 'auction',
'location': None,
'make': 'LAND ROVER',
'model': 'LAND ROVER RANGE ROVER EVO 2.0 D200 MHEV S AWD AUTO FP',
'odometer': 107704,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 37,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3fda564-e6a5-5114-a0e6-852d4adbc8c3/d3fda564-e6a5-5114-a0e6-852d4adbc8c3_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 823917,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge1/8c560ec4c27c4f06af9446bb842ca078/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3fda564-e6a5-5114-a0e6-852d4adbc8c3/d3fda564-e6a5-5114-a0e6-852d4adbc8c3_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 822750,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge1/8c560ec4c27c4f06af9446bb842ca078/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3fda564-e6a5-5114-a0e6-852d4adbc8c3/d3fda564-e6a5-5114-a0e6-852d4adbc8c3_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 823917,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge1/8c560ec4c27c4f06af9446bb842ca078/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3fda564-e6a5-5114-a0e6-852d4adbc8c3/d3fda564-e6a5-5114-a0e6-852d4adbc8c3_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 869861,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge1/8c560ec4c27c4f06af9446bb842ca078/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3fda564-e6a5-5114-a0e6-852d4adbc8c3/d3fda564-e6a5-5114-a0e6-852d4adbc8c3_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 846942,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge1/8c560ec4c27c4f06af9446bb842ca078/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3fda564-e6a5-5114-a0e6-852d4adbc8c3/d3fda564-e6a5-5114-a0e6-852d4adbc8c3_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 692619,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge1/8c560ec4c27c4f06af9446bb842ca078/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3fda564-e6a5-5114-a0e6-852d4adbc8c3/d3fda564-e6a5-5114-a0e6-852d4adbc8c3_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 637996,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge1/8c560ec4c27c4f06af9446bb842ca078/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3fda564-e6a5-5114-a0e6-852d4adbc8c3/d3fda564-e6a5-5114-a0e6-852d4adbc8c3_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 580332,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge1/8c560ec4c27c4f06af9446bb842ca078/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3fda564-e6a5-5114-a0e6-852d4adbc8c3/d3fda564-e6a5-5114-a0e6-852d4adbc8c3_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 777051,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge1/8c560ec4c27c4f06af9446bb842ca078/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3fda564-e6a5-5114-a0e6-852d4adbc8c3/d3fda564-e6a5-5114-a0e6-852d4adbc8c3_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 668123,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge1/8c560ec4c27c4f06af9446bb842ca078/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-02-26',
'seats_number': 5,
'seller_name': None,
'title': 'LAND ROVER LAND ROVER RANGE ROVER EVO 2.0 D200 MHEV S AWD AUTO FP -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2021}
2026-03-25 16:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983610%27 HTTP/1.1" 200 None
2026-03-25 16:33:10 [ayvens.it] INFO: Saving data for 1983610: {'created_time': 1774456390.047073, 'last_price_update_time': 1774456390.047082, 'auction_closing_time': 1774603800.0}
2026-03-25 16:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1983610') HTTP/1.1" 204 0
2026-03-25 16:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg3%252F69bc720cc60b4c49b4f73ff7cf290539%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg3/69bc720cc60b4c49b4f73ff7cf290539/images/large/3.jpg not downloaded yet
2026-03-25 16:33:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc4/fa0188f63eec458c8153df5741b8198f/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc4/fa0188f63eec458c8153df5741b8198f/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg3%252F69bc720cc60b4c49b4f73ff7cf290539%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg3/69bc720cc60b4c49b4f73ff7cf290539/images/large/4.jpg not downloaded yet
2026-03-25 16:33:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc4/fa0188f63eec458c8153df5741b8198f/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc4/fa0188f63eec458c8153df5741b8198f/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34d745b350>
2026-03-25 16:33:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7cdfe783-01ef-5813-824c-ed9e64604ad9/7cdfe783-01ef-5813-824c-ed9e64604ad9_image_6.jpg HTTP/1.1" 201 0
2026-03-25 16:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc4%252Ffa0188f63eec458c8153df5741b8198f%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc4/fa0188f63eec458c8153df5741b8198f/images/large/7.jpg saved to cache
2026-03-25 16:33:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7cdfe783-01ef-5813-824c-ed9e64604ad9
2026-03-25 16:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg3%252F69bc720cc60b4c49b4f73ff7cf290539%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg3/69bc720cc60b4c49b4f73ff7cf290539/images/large/5.jpg not downloaded yet
2026-03-25 16:33:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg0/590a5f9873ed4487ab2b6876ce6fedc9/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg0/590a5f9873ed4487ab2b6876ce6fedc9/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc4/fa0188f63eec458c8153df5741b8198f/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg3%252F69bc720cc60b4c49b4f73ff7cf290539%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg3/69bc720cc60b4c49b4f73ff7cf290539/images/large/6.jpg not downloaded yet
2026-03-25 16:33:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34d6b37490>
2026-03-25 16:33:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7cdfe783-01ef-5813-824c-ed9e64604ad9/7cdfe783-01ef-5813-824c-ed9e64604ad9_image_7.jpg HTTP/1.1" 201 0
2026-03-25 16:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc4%252Ffa0188f63eec458c8153df5741b8198f%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc4/fa0188f63eec458c8153df5741b8198f/images/large/8.jpg saved to cache
2026-03-25 16:33:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7cdfe783-01ef-5813-824c-ed9e64604ad9
2026-03-25 16:33:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc555850>
2026-03-25 16:33:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7cdfe783-01ef-5813-824c-ed9e64604ad9/7cdfe783-01ef-5813-824c-ed9e64604ad9_image_9.jpg HTTP/1.1" 201 0
2026-03-25 16:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc4%252Ffa0188f63eec458c8153df5741b8198f%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc4/fa0188f63eec458c8153df5741b8198f/images/large/10.jpg saved to cache
2026-03-25 16:33:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7cdfe783-01ef-5813-824c-ed9e64604ad9
2026-03-25 16:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg3%252F69bc720cc60b4c49b4f73ff7cf290539%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg3/69bc720cc60b4c49b4f73ff7cf290539/images/large/7.jpg not downloaded yet
2026-03-25 16:33:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcbdd610>
2026-03-25 16:33:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7cdfe783-01ef-5813-824c-ed9e64604ad9/7cdfe783-01ef-5813-824c-ed9e64604ad9_image_5.jpg HTTP/1.1" 201 0
2026-03-25 16:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc4%252Ffa0188f63eec458c8153df5741b8198f%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc4/fa0188f63eec458c8153df5741b8198f/images/large/6.jpg saved to cache
2026-03-25 16:33:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7cdfe783-01ef-5813-824c-ed9e64604ad9
2026-03-25 16:33:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc9f2250>
2026-03-25 16:33:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7cdfe783-01ef-5813-824c-ed9e64604ad9/7cdfe783-01ef-5813-824c-ed9e64604ad9_image_8.jpg HTTP/1.1" 201 0
2026-03-25 16:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc4%252Ffa0188f63eec458c8153df5741b8198f%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc4/fa0188f63eec458c8153df5741b8198f/images/large/9.jpg saved to cache
2026-03-25 16:33:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7cdfe783-01ef-5813-824c-ed9e64604ad9
2026-03-25 16:33:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcbe7bd0>
2026-03-25 16:33:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_daf30eeb-d6ed-5fdf-b722-14c7428ae08e/daf30eeb-d6ed-5fdf-b722-14c7428ae08e_image_1.jpg HTTP/1.1" 201 0
2026-03-25 16:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg0%252F590a5f9873ed4487ab2b6876ce6fedc9%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg0/590a5f9873ed4487ab2b6876ce6fedc9/images/large/2.jpg saved to cache
2026-03-25 16:33:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item daf30eeb-d6ed-5fdf-b722-14c7428ae08e
2026-03-25 16:33:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcbb73d0>
2026-03-25 16:33:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_daf30eeb-d6ed-5fdf-b722-14c7428ae08e/daf30eeb-d6ed-5fdf-b722-14c7428ae08e_image_2.jpg HTTP/1.1" 201 0
2026-03-25 16:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg0%252F590a5f9873ed4487ab2b6876ce6fedc9%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg0/590a5f9873ed4487ab2b6876ce6fedc9/images/large/3.jpg saved to cache
2026-03-25 16:33:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item daf30eeb-d6ed-5fdf-b722-14c7428ae08e
2026-03-25 16:33:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc8d6090>
2026-03-25 16:33:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7cdfe783-01ef-5813-824c-ed9e64604ad9/7cdfe783-01ef-5813-824c-ed9e64604ad9_image_4.jpg HTTP/1.1" 201 0
2026-03-25 16:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc4%252Ffa0188f63eec458c8153df5741b8198f%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc4/fa0188f63eec458c8153df5741b8198f/images/large/5.jpg saved to cache
2026-03-25 16:33:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7cdfe783-01ef-5813-824c-ed9e64604ad9
2026-03-25 16:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg3%252F69bc720cc60b4c49b4f73ff7cf290539%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg3/69bc720cc60b4c49b4f73ff7cf290539/images/large/8.jpg not downloaded yet
2026-03-25 16:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg3%252F69bc720cc60b4c49b4f73ff7cf290539%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg3/69bc720cc60b4c49b4f73ff7cf290539/images/large/9.jpg not downloaded yet
2026-03-25 16:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg3%252F69bc720cc60b4c49b4f73ff7cf290539%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg3/69bc720cc60b4c49b4f73ff7cf290539/images/large/10.jpg not downloaded yet
2026-03-25 16:33:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg0/590a5f9873ed4487ab2b6876ce6fedc9/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg0/590a5f9873ed4487ab2b6876ce6fedc9/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:10 [ayvens.it] INFO: Found listing with ID: 1983614
2026-03-25 16:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983614%27 HTTP/1.1" 200 None
2026-03-25 16:33:10 [ayvens.it] INFO: Scrape type for 1983614: 1
2026-03-25 16:33:10 [ayvens.it] INFO: Extracting data for car ID: 1983614
2026-03-25 16:33:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 92e97984-3c60-5ae7-8361-7f46776a7fa3 with identifier: 1983614
2026-03-25 16:33:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 92e97984-3c60-5ae7-8361-7f46776a7fa3 with scrape type 1
2026-03-25 16:33:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 92e97984-3c60-5ae7-8361-7f46776a7fa3
2026-03-25 16:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh3%252F700134c2c14b4111a68be65a411f0ec9%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh3/700134c2c14b4111a68be65a411f0ec9/images/large/1.jpg not downloaded yet
2026-03-25 16:33:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg0/590a5f9873ed4487ab2b6876ce6fedc9/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg0/590a5f9873ed4487ab2b6876ce6fedc9/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc4/fa0188f63eec458c8153df5741b8198f/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh3%252F700134c2c14b4111a68be65a411f0ec9%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh3/700134c2c14b4111a68be65a411f0ec9/images/large/2.jpg not downloaded yet
2026-03-25 16:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh3%252F700134c2c14b4111a68be65a411f0ec9%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh3/700134c2c14b4111a68be65a411f0ec9/images/large/3.jpg not downloaded yet
2026-03-25 16:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh3%252F700134c2c14b4111a68be65a411f0ec9%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh3/700134c2c14b4111a68be65a411f0ec9/images/large/4.jpg not downloaded yet
2026-03-25 16:33:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg0/590a5f9873ed4487ab2b6876ce6fedc9/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh3%252F700134c2c14b4111a68be65a411f0ec9%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh3/700134c2c14b4111a68be65a411f0ec9/images/large/5.jpg not downloaded yet
2026-03-25 16:33:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg0/590a5f9873ed4487ab2b6876ce6fedc9/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh3%252F700134c2c14b4111a68be65a411f0ec9%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh3/700134c2c14b4111a68be65a411f0ec9/images/large/6.jpg not downloaded yet
2026-03-25 16:33:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dca469d0>
2026-03-25 16:33:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_daf30eeb-d6ed-5fdf-b722-14c7428ae08e/daf30eeb-d6ed-5fdf-b722-14c7428ae08e_image_9.jpg HTTP/1.1" 201 0
2026-03-25 16:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg0%252F590a5f9873ed4487ab2b6876ce6fedc9%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg0/590a5f9873ed4487ab2b6876ce6fedc9/images/large/10.jpg saved to cache
2026-03-25 16:33:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item daf30eeb-d6ed-5fdf-b722-14c7428ae08e
2026-03-25 16:33:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcc08f50>
2026-03-25 16:33:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_daf30eeb-d6ed-5fdf-b722-14c7428ae08e/daf30eeb-d6ed-5fdf-b722-14c7428ae08e_image_4.jpg HTTP/1.1" 201 0
2026-03-25 16:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg0%252F590a5f9873ed4487ab2b6876ce6fedc9%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg0/590a5f9873ed4487ab2b6876ce6fedc9/images/large/5.jpg saved to cache
2026-03-25 16:33:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item daf30eeb-d6ed-5fdf-b722-14c7428ae08e
2026-03-25 16:33:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg0/590a5f9873ed4487ab2b6876ce6fedc9/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh3%252F700134c2c14b4111a68be65a411f0ec9%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh3/700134c2c14b4111a68be65a411f0ec9/images/large/7.jpg not downloaded yet
2026-03-25 16:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh3%252F700134c2c14b4111a68be65a411f0ec9%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh3/700134c2c14b4111a68be65a411f0ec9/images/large/8.jpg not downloaded yet
2026-03-25 16:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh3%252F700134c2c14b4111a68be65a411f0ec9%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh3/700134c2c14b4111a68be65a411f0ec9/images/large/9.jpg not downloaded yet
2026-03-25 16:33:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc553d90>
2026-03-25 16:33:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_daf30eeb-d6ed-5fdf-b722-14c7428ae08e/daf30eeb-d6ed-5fdf-b722-14c7428ae08e_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg0%252F590a5f9873ed4487ab2b6876ce6fedc9%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg0/590a5f9873ed4487ab2b6876ce6fedc9/images/large/1.jpg saved to cache
2026-03-25 16:33:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item daf30eeb-d6ed-5fdf-b722-14c7428ae08e
2026-03-25 16:33:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcbe6910>
2026-03-25 16:33:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_daf30eeb-d6ed-5fdf-b722-14c7428ae08e/daf30eeb-d6ed-5fdf-b722-14c7428ae08e_image_3.jpg HTTP/1.1" 201 0
2026-03-25 16:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg0%252F590a5f9873ed4487ab2b6876ce6fedc9%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg0/590a5f9873ed4487ab2b6876ce6fedc9/images/large/4.jpg saved to cache
2026-03-25 16:33:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item daf30eeb-d6ed-5fdf-b722-14c7428ae08e
2026-03-25 16:33:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc991150>
2026-03-25 16:33:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7cdfe783-01ef-5813-824c-ed9e64604ad9/7cdfe783-01ef-5813-824c-ed9e64604ad9_image_3.jpg HTTP/1.1" 201 0
2026-03-25 16:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc4%252Ffa0188f63eec458c8153df5741b8198f%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc4/fa0188f63eec458c8153df5741b8198f/images/large/4.jpg saved to cache
2026-03-25 16:33:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7cdfe783-01ef-5813-824c-ed9e64604ad9
2026-03-25 16:33:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc711950>
2026-03-25 16:33:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_daf30eeb-d6ed-5fdf-b722-14c7428ae08e/daf30eeb-d6ed-5fdf-b722-14c7428ae08e_image_7.jpg HTTP/1.1" 201 0
2026-03-25 16:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg0%252F590a5f9873ed4487ab2b6876ce6fedc9%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg0/590a5f9873ed4487ab2b6876ce6fedc9/images/large/8.jpg saved to cache
2026-03-25 16:33:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item daf30eeb-d6ed-5fdf-b722-14c7428ae08e
2026-03-25 16:33:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc54e590>
2026-03-25 16:33:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_daf30eeb-d6ed-5fdf-b722-14c7428ae08e/daf30eeb-d6ed-5fdf-b722-14c7428ae08e_image_8.jpg HTTP/1.1" 201 0
2026-03-25 16:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg0%252F590a5f9873ed4487ab2b6876ce6fedc9%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg0/590a5f9873ed4487ab2b6876ce6fedc9/images/large/9.jpg saved to cache
2026-03-25 16:33:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item daf30eeb-d6ed-5fdf-b722-14c7428ae08e
2026-03-25 16:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh3%252F700134c2c14b4111a68be65a411f0ec9%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh3/700134c2c14b4111a68be65a411f0ec9/images/large/10.jpg not downloaded yet
2026-03-25 16:33:11 [ayvens.it] INFO: Found listing with ID: 1983615
2026-03-25 16:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983615%27 HTTP/1.1" 200 None
2026-03-25 16:33:11 [ayvens.it] INFO: Scrape type for 1983615: 1
2026-03-25 16:33:11 [ayvens.it] INFO: Extracting data for car ID: 1983615
2026-03-25 16:33:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bae7b0ab-d3f1-5faa-b791-6aebd7901c84 with identifier: 1983615
2026-03-25 16:33:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bae7b0ab-d3f1-5faa-b791-6aebd7901c84 with scrape type 1
2026-03-25 16:33:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item bae7b0ab-d3f1-5faa-b791-6aebd7901c84
2026-03-25 16:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj3%252F8661dce11a8046839dc010c5b08a8138%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj3/8661dce11a8046839dc010c5b08a8138/images/large/1.jpg not downloaded yet
2026-03-25 16:33:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg3/69bc720cc60b4c49b4f73ff7cf290539/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc89ff90>
2026-03-25 16:33:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_daf30eeb-d6ed-5fdf-b722-14c7428ae08e/daf30eeb-d6ed-5fdf-b722-14c7428ae08e_image_6.jpg HTTP/1.1" 201 0
2026-03-25 16:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg0%252F590a5f9873ed4487ab2b6876ce6fedc9%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg0/590a5f9873ed4487ab2b6876ce6fedc9/images/large/7.jpg saved to cache
2026-03-25 16:33:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item daf30eeb-d6ed-5fdf-b722-14c7428ae08e
2026-03-25 16:33:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg3/69bc720cc60b4c49b4f73ff7cf290539/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj3%252F8661dce11a8046839dc010c5b08a8138%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj3/8661dce11a8046839dc010c5b08a8138/images/large/2.jpg not downloaded yet
2026-03-25 16:33:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg0/590a5f9873ed4487ab2b6876ce6fedc9/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc4/fa0188f63eec458c8153df5741b8198f/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg3/69bc720cc60b4c49b4f73ff7cf290539/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj3%252F8661dce11a8046839dc010c5b08a8138%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj3/8661dce11a8046839dc010c5b08a8138/images/large/3.jpg not downloaded yet
2026-03-25 16:33:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg3/69bc720cc60b4c49b4f73ff7cf290539/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj3%252F8661dce11a8046839dc010c5b08a8138%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj3/8661dce11a8046839dc010c5b08a8138/images/large/4.jpg not downloaded yet
2026-03-25 16:33:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc34c090>
2026-03-25 16:33:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_23fafe66-5f7d-5e27-8abe-0d833cc15db0/23fafe66-5f7d-5e27-8abe-0d833cc15db0_image_1.jpg HTTP/1.1" 201 0
2026-03-25 16:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg3%252F69bc720cc60b4c49b4f73ff7cf290539%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg3/69bc720cc60b4c49b4f73ff7cf290539/images/large/2.jpg saved to cache
2026-03-25 16:33:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 23fafe66-5f7d-5e27-8abe-0d833cc15db0
2026-03-25 16:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj3%252F8661dce11a8046839dc010c5b08a8138%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj3/8661dce11a8046839dc010c5b08a8138/images/large/5.jpg not downloaded yet
2026-03-25 16:33:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg3/69bc720cc60b4c49b4f73ff7cf290539/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj3%252F8661dce11a8046839dc010c5b08a8138%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj3/8661dce11a8046839dc010c5b08a8138/images/large/6.jpg not downloaded yet
2026-03-25 16:33:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dca20350>
2026-03-25 16:33:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_23fafe66-5f7d-5e27-8abe-0d833cc15db0/23fafe66-5f7d-5e27-8abe-0d833cc15db0_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg3%252F69bc720cc60b4c49b4f73ff7cf290539%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg3/69bc720cc60b4c49b4f73ff7cf290539/images/large/1.jpg saved to cache
2026-03-25 16:33:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 23fafe66-5f7d-5e27-8abe-0d833cc15db0
2026-03-25 16:33:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34d7459790>
2026-03-25 16:33:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_daf30eeb-d6ed-5fdf-b722-14c7428ae08e/daf30eeb-d6ed-5fdf-b722-14c7428ae08e_image_5.jpg HTTP/1.1" 201 0
2026-03-25 16:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg0%252F590a5f9873ed4487ab2b6876ce6fedc9%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg0/590a5f9873ed4487ab2b6876ce6fedc9/images/large/6.jpg saved to cache
2026-03-25 16:33:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item daf30eeb-d6ed-5fdf-b722-14c7428ae08e
2026-03-25 16:33:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: daf30eeb-d6ed-5fdf-b722-14c7428ae08e, skipping ID generation
2026-03-25 16:33:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item daf30eeb-d6ed-5fdf-b722-14c7428ae08e with scrape type 1
2026-03-25 16:33:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item daf30eeb-d6ed-5fdf-b722-14c7428ae08e sending to next pipeline
2026-03-25 16:33:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: daf30eeb-d6ed-5fdf-b722-14c7428ae08e, identifier: 1983612
2026-03-25 16:33:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dca9f950>
2026-03-25 16:33:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7cdfe783-01ef-5813-824c-ed9e64604ad9/7cdfe783-01ef-5813-824c-ed9e64604ad9_image_2.jpg HTTP/1.1" 201 0
2026-03-25 16:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc4%252Ffa0188f63eec458c8153df5741b8198f%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc4/fa0188f63eec458c8153df5741b8198f/images/large/3.jpg saved to cache
2026-03-25 16:33:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7cdfe783-01ef-5813-824c-ed9e64604ad9
2026-03-25 16:33:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc9347d0>
2026-03-25 16:33:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_23fafe66-5f7d-5e27-8abe-0d833cc15db0/23fafe66-5f7d-5e27-8abe-0d833cc15db0_image_2.jpg HTTP/1.1" 201 0
2026-03-25 16:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg3%252F69bc720cc60b4c49b4f73ff7cf290539%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg3/69bc720cc60b4c49b4f73ff7cf290539/images/large/3.jpg saved to cache
2026-03-25 16:33:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 23fafe66-5f7d-5e27-8abe-0d833cc15db0
2026-03-25 16:33:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcb9b510>
2026-03-25 16:33:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_23fafe66-5f7d-5e27-8abe-0d833cc15db0/23fafe66-5f7d-5e27-8abe-0d833cc15db0_image_3.jpg HTTP/1.1" 201 0
2026-03-25 16:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg3%252F69bc720cc60b4c49b4f73ff7cf290539%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg3/69bc720cc60b4c49b4f73ff7cf290539/images/large/4.jpg saved to cache
2026-03-25 16:33:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 23fafe66-5f7d-5e27-8abe-0d833cc15db0
2026-03-25 16:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj3%252F8661dce11a8046839dc010c5b08a8138%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj3/8661dce11a8046839dc010c5b08a8138/images/large/7.jpg not downloaded yet
2026-03-25 16:33:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: daf30eeb-d6ed-5fdf-b722-14c7428ae08e with identifier: 1983612
2026-03-25 16:33:12 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:33:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: daf30eeb-d6ed-5fdf-b722-14c7428ae08e with identifier: 1983612
2026-03-25 16:33:12 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: daf30eeb-d6ed-5fdf-b722-14c7428ae08e with identifier: 1983612 to the API
2026-03-25 16:33:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:33:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:33:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gg0/590a5f9873ed4487ab2b6876ce6fedc9/images/large/6.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Avorio Chic pastello',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-27T09:30:00Z',
'fuel_type': 'hybrid',
'id': 'daf30eeb-d6ed-5fdf-b722-14c7428ae08e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41025',
'listing': 'auction',
'location': None,
'make': 'LANCIA',
'model': 'LANCIA YPSILON ECOCHIC 1.0 FireFly 70cv S&S Hybrid SILVER Hatchback '
'5-door (Euro 6D)',
'odometer': 74475,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 28,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_daf30eeb-d6ed-5fdf-b722-14c7428ae08e/daf30eeb-d6ed-5fdf-b722-14c7428ae08e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 631101,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg0/590a5f9873ed4487ab2b6876ce6fedc9/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_daf30eeb-d6ed-5fdf-b722-14c7428ae08e/daf30eeb-d6ed-5fdf-b722-14c7428ae08e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 631101,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg0/590a5f9873ed4487ab2b6876ce6fedc9/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_daf30eeb-d6ed-5fdf-b722-14c7428ae08e/daf30eeb-d6ed-5fdf-b722-14c7428ae08e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 666853,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg0/590a5f9873ed4487ab2b6876ce6fedc9/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_daf30eeb-d6ed-5fdf-b722-14c7428ae08e/daf30eeb-d6ed-5fdf-b722-14c7428ae08e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 666100,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg0/590a5f9873ed4487ab2b6876ce6fedc9/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_daf30eeb-d6ed-5fdf-b722-14c7428ae08e/daf30eeb-d6ed-5fdf-b722-14c7428ae08e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 630813,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg0/590a5f9873ed4487ab2b6876ce6fedc9/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_daf30eeb-d6ed-5fdf-b722-14c7428ae08e/daf30eeb-d6ed-5fdf-b722-14c7428ae08e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 619891,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg0/590a5f9873ed4487ab2b6876ce6fedc9/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_daf30eeb-d6ed-5fdf-b722-14c7428ae08e/daf30eeb-d6ed-5fdf-b722-14c7428ae08e_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 561418,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg0/590a5f9873ed4487ab2b6876ce6fedc9/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_daf30eeb-d6ed-5fdf-b722-14c7428ae08e/daf30eeb-d6ed-5fdf-b722-14c7428ae08e_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 602949,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg0/590a5f9873ed4487ab2b6876ce6fedc9/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_daf30eeb-d6ed-5fdf-b722-14c7428ae08e/daf30eeb-d6ed-5fdf-b722-14c7428ae08e_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 585768,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg0/590a5f9873ed4487ab2b6876ce6fedc9/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_daf30eeb-d6ed-5fdf-b722-14c7428ae08e/daf30eeb-d6ed-5fdf-b722-14c7428ae08e_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 503527,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg0/590a5f9873ed4487ab2b6876ce6fedc9/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-10-07',
'seats_number': 5,
'seller_name': None,
'title': 'LANCIA LANCIA YPSILON ECOCHIC 1.0 FireFly 70cv S&S Hybrid SILVER '
'Hatchback 5-door (Euro 6D) -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2021}
2026-03-25 16:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983612%27 HTTP/1.1" 200 None
2026-03-25 16:33:12 [ayvens.it] INFO: Saving data for 1983612: {'created_time': 1774456392.953173, 'last_price_update_time': 1774456392.953184, 'auction_closing_time': 1774603800.0}
2026-03-25 16:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1983612') HTTP/1.1" 204 0
2026-03-25 16:33:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc4/fa0188f63eec458c8153df5741b8198f/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj3%252F8661dce11a8046839dc010c5b08a8138%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj3/8661dce11a8046839dc010c5b08a8138/images/large/8.jpg not downloaded yet
2026-03-25 16:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj3%252F8661dce11a8046839dc010c5b08a8138%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj3/8661dce11a8046839dc010c5b08a8138/images/large/9.jpg not downloaded yet
2026-03-25 16:33:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc826990>
2026-03-25 16:33:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_23fafe66-5f7d-5e27-8abe-0d833cc15db0/23fafe66-5f7d-5e27-8abe-0d833cc15db0_image_4.jpg HTTP/1.1" 201 0
2026-03-25 16:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg3%252F69bc720cc60b4c49b4f73ff7cf290539%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg3/69bc720cc60b4c49b4f73ff7cf290539/images/large/5.jpg saved to cache
2026-03-25 16:33:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 23fafe66-5f7d-5e27-8abe-0d833cc15db0
2026-03-25 16:33:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg3/69bc720cc60b4c49b4f73ff7cf290539/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg3/69bc720cc60b4c49b4f73ff7cf290539/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj3%252F8661dce11a8046839dc010c5b08a8138%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj3/8661dce11a8046839dc010c5b08a8138/images/large/10.jpg not downloaded yet
2026-03-25 16:33:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg3/69bc720cc60b4c49b4f73ff7cf290539/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh3/700134c2c14b4111a68be65a411f0ec9/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh3/700134c2c14b4111a68be65a411f0ec9/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh3/700134c2c14b4111a68be65a411f0ec9/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg3/69bc720cc60b4c49b4f73ff7cf290539/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:13 [ayvens.it] INFO: Found listing with ID: 1983616
2026-03-25 16:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983616%27 HTTP/1.1" 200 None
2026-03-25 16:33:13 [ayvens.it] INFO: Scrape type for 1983616: 1
2026-03-25 16:33:13 [ayvens.it] INFO: Extracting data for car ID: 1983616
2026-03-25 16:33:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a12546fb-f357-594e-bbea-faeef33b4a72 with identifier: 1983616
2026-03-25 16:33:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a12546fb-f357-594e-bbea-faeef33b4a72 with scrape type 1
2026-03-25 16:33:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a12546fb-f357-594e-bbea-faeef33b4a72
2026-03-25 16:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh8%252F25077950dc8b42969b582ab34accf07a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh8/25077950dc8b42969b582ab34accf07a/images/large/1.jpg not downloaded yet
2026-03-25 16:33:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcde28d0>
2026-03-25 16:33:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7cdfe783-01ef-5813-824c-ed9e64604ad9/7cdfe783-01ef-5813-824c-ed9e64604ad9_image_1.jpg HTTP/1.1" 201 0
2026-03-25 16:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc4%252Ffa0188f63eec458c8153df5741b8198f%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc4/fa0188f63eec458c8153df5741b8198f/images/large/2.jpg saved to cache
2026-03-25 16:33:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7cdfe783-01ef-5813-824c-ed9e64604ad9
2026-03-25 16:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh8%252F25077950dc8b42969b582ab34accf07a%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh8/25077950dc8b42969b582ab34accf07a/images/large/2.jpg not downloaded yet
2026-03-25 16:33:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34de456c90>
2026-03-25 16:33:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_23fafe66-5f7d-5e27-8abe-0d833cc15db0/23fafe66-5f7d-5e27-8abe-0d833cc15db0_image_9.jpg HTTP/1.1" 201 0
2026-03-25 16:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg3%252F69bc720cc60b4c49b4f73ff7cf290539%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg3/69bc720cc60b4c49b4f73ff7cf290539/images/large/10.jpg saved to cache
2026-03-25 16:33:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 23fafe66-5f7d-5e27-8abe-0d833cc15db0
2026-03-25 16:33:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc38f710>
2026-03-25 16:33:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_23fafe66-5f7d-5e27-8abe-0d833cc15db0/23fafe66-5f7d-5e27-8abe-0d833cc15db0_image_6.jpg HTTP/1.1" 201 0
2026-03-25 16:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg3%252F69bc720cc60b4c49b4f73ff7cf290539%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg3/69bc720cc60b4c49b4f73ff7cf290539/images/large/7.jpg saved to cache
2026-03-25 16:33:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 23fafe66-5f7d-5e27-8abe-0d833cc15db0
2026-03-25 16:33:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc628cd0>
2026-03-25 16:33:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_23fafe66-5f7d-5e27-8abe-0d833cc15db0/23fafe66-5f7d-5e27-8abe-0d833cc15db0_image_8.jpg HTTP/1.1" 201 0
2026-03-25 16:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg3%252F69bc720cc60b4c49b4f73ff7cf290539%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg3/69bc720cc60b4c49b4f73ff7cf290539/images/large/9.jpg saved to cache
2026-03-25 16:33:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 23fafe66-5f7d-5e27-8abe-0d833cc15db0
2026-03-25 16:33:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34d7d7ead0>
2026-03-25 16:33:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92e97984-3c60-5ae7-8361-7f46776a7fa3/92e97984-3c60-5ae7-8361-7f46776a7fa3_image_2.jpg HTTP/1.1" 201 0
2026-03-25 16:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh3%252F700134c2c14b4111a68be65a411f0ec9%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh3/700134c2c14b4111a68be65a411f0ec9/images/large/3.jpg saved to cache
2026-03-25 16:33:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 92e97984-3c60-5ae7-8361-7f46776a7fa3
2026-03-25 16:33:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcbddb50>
2026-03-25 16:33:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92e97984-3c60-5ae7-8361-7f46776a7fa3/92e97984-3c60-5ae7-8361-7f46776a7fa3_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh3%252F700134c2c14b4111a68be65a411f0ec9%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh3/700134c2c14b4111a68be65a411f0ec9/images/large/1.jpg saved to cache
2026-03-25 16:33:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 92e97984-3c60-5ae7-8361-7f46776a7fa3
2026-03-25 16:33:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc547bd0>
2026-03-25 16:33:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92e97984-3c60-5ae7-8361-7f46776a7fa3/92e97984-3c60-5ae7-8361-7f46776a7fa3_image_3.jpg HTTP/1.1" 201 0
2026-03-25 16:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh3%252F700134c2c14b4111a68be65a411f0ec9%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh3/700134c2c14b4111a68be65a411f0ec9/images/large/4.jpg saved to cache
2026-03-25 16:33:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 92e97984-3c60-5ae7-8361-7f46776a7fa3
2026-03-25 16:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh8%252F25077950dc8b42969b582ab34accf07a%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh8/25077950dc8b42969b582ab34accf07a/images/large/3.jpg not downloaded yet
2026-03-25 16:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh8%252F25077950dc8b42969b582ab34accf07a%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh8/25077950dc8b42969b582ab34accf07a/images/large/4.jpg not downloaded yet
2026-03-25 16:33:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc928bd0>
2026-03-25 16:33:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_23fafe66-5f7d-5e27-8abe-0d833cc15db0/23fafe66-5f7d-5e27-8abe-0d833cc15db0_image_7.jpg HTTP/1.1" 201 0
2026-03-25 16:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg3%252F69bc720cc60b4c49b4f73ff7cf290539%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg3/69bc720cc60b4c49b4f73ff7cf290539/images/large/8.jpg saved to cache
2026-03-25 16:33:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 23fafe66-5f7d-5e27-8abe-0d833cc15db0
2026-03-25 16:33:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh3/700134c2c14b4111a68be65a411f0ec9/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh3/700134c2c14b4111a68be65a411f0ec9/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh8%252F25077950dc8b42969b582ab34accf07a%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh8/25077950dc8b42969b582ab34accf07a/images/large/5.jpg not downloaded yet
2026-03-25 16:33:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh3/700134c2c14b4111a68be65a411f0ec9/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh8%252F25077950dc8b42969b582ab34accf07a%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh8/25077950dc8b42969b582ab34accf07a/images/large/6.jpg not downloaded yet
2026-03-25 16:33:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh3/700134c2c14b4111a68be65a411f0ec9/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh8%252F25077950dc8b42969b582ab34accf07a%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh8/25077950dc8b42969b582ab34accf07a/images/large/7.jpg not downloaded yet
2026-03-25 16:33:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj3/8661dce11a8046839dc010c5b08a8138/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh8%252F25077950dc8b42969b582ab34accf07a%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh8/25077950dc8b42969b582ab34accf07a/images/large/8.jpg not downloaded yet
2026-03-25 16:33:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj3/8661dce11a8046839dc010c5b08a8138/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj3/8661dce11a8046839dc010c5b08a8138/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj3/8661dce11a8046839dc010c5b08a8138/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh8%252F25077950dc8b42969b582ab34accf07a%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh8/25077950dc8b42969b582ab34accf07a/images/large/9.jpg not downloaded yet
2026-03-25 16:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh8%252F25077950dc8b42969b582ab34accf07a%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh8/25077950dc8b42969b582ab34accf07a/images/large/10.jpg not downloaded yet
2026-03-25 16:33:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc37ed10>
2026-03-25 16:33:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92e97984-3c60-5ae7-8361-7f46776a7fa3/92e97984-3c60-5ae7-8361-7f46776a7fa3_image_6.jpg HTTP/1.1" 201 0
2026-03-25 16:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh3%252F700134c2c14b4111a68be65a411f0ec9%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh3/700134c2c14b4111a68be65a411f0ec9/images/large/7.jpg saved to cache
2026-03-25 16:33:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 92e97984-3c60-5ae7-8361-7f46776a7fa3
2026-03-25 16:33:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34d7d61fd0>
2026-03-25 16:33:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92e97984-3c60-5ae7-8361-7f46776a7fa3/92e97984-3c60-5ae7-8361-7f46776a7fa3_image_9.jpg HTTP/1.1" 201 0
2026-03-25 16:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh3%252F700134c2c14b4111a68be65a411f0ec9%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh3/700134c2c14b4111a68be65a411f0ec9/images/large/10.jpg saved to cache
2026-03-25 16:33:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 92e97984-3c60-5ae7-8361-7f46776a7fa3
2026-03-25 16:33:14 [ayvens.it] INFO: Found listing with ID: 1983617
2026-03-25 16:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983617%27 HTTP/1.1" 200 None
2026-03-25 16:33:14 [ayvens.it] INFO: Scrape type for 1983617: 1
2026-03-25 16:33:14 [ayvens.it] INFO: Extracting data for car ID: 1983617
2026-03-25 16:33:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aad6231e-71a2-5614-85d8-887e7eb3c91a with identifier: 1983617
2026-03-25 16:33:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aad6231e-71a2-5614-85d8-887e7eb3c91a with scrape type 1
2026-03-25 16:33:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item aad6231e-71a2-5614-85d8-887e7eb3c91a
2026-03-25 16:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg6%252F5188b70e7e9c4f1a9e8ac0b56981065f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg6/5188b70e7e9c4f1a9e8ac0b56981065f/images/large/1.jpg not downloaded yet
2026-03-25 16:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg6%252F5188b70e7e9c4f1a9e8ac0b56981065f%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg6/5188b70e7e9c4f1a9e8ac0b56981065f/images/large/2.jpg not downloaded yet
2026-03-25 16:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg6%252F5188b70e7e9c4f1a9e8ac0b56981065f%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg6/5188b70e7e9c4f1a9e8ac0b56981065f/images/large/3.jpg not downloaded yet
2026-03-25 16:33:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc365510>
2026-03-25 16:33:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92e97984-3c60-5ae7-8361-7f46776a7fa3/92e97984-3c60-5ae7-8361-7f46776a7fa3_image_8.jpg HTTP/1.1" 201 0
2026-03-25 16:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh3%252F700134c2c14b4111a68be65a411f0ec9%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh3/700134c2c14b4111a68be65a411f0ec9/images/large/9.jpg saved to cache
2026-03-25 16:33:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 92e97984-3c60-5ae7-8361-7f46776a7fa3
2026-03-25 16:33:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34de456e50>
2026-03-25 16:33:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92e97984-3c60-5ae7-8361-7f46776a7fa3/92e97984-3c60-5ae7-8361-7f46776a7fa3_image_7.jpg HTTP/1.1" 201 0
2026-03-25 16:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh3%252F700134c2c14b4111a68be65a411f0ec9%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh3/700134c2c14b4111a68be65a411f0ec9/images/large/8.jpg saved to cache
2026-03-25 16:33:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 92e97984-3c60-5ae7-8361-7f46776a7fa3
2026-03-25 16:33:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc5ce390>
2026-03-25 16:33:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bae7b0ab-d3f1-5faa-b791-6aebd7901c84/bae7b0ab-d3f1-5faa-b791-6aebd7901c84_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj3%252F8661dce11a8046839dc010c5b08a8138%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj3/8661dce11a8046839dc010c5b08a8138/images/large/1.jpg saved to cache
2026-03-25 16:33:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bae7b0ab-d3f1-5faa-b791-6aebd7901c84
2026-03-25 16:33:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc3256d0>
2026-03-25 16:33:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bae7b0ab-d3f1-5faa-b791-6aebd7901c84/bae7b0ab-d3f1-5faa-b791-6aebd7901c84_image_1.jpg HTTP/1.1" 201 0
2026-03-25 16:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj3%252F8661dce11a8046839dc010c5b08a8138%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj3/8661dce11a8046839dc010c5b08a8138/images/large/2.jpg saved to cache
2026-03-25 16:33:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item bae7b0ab-d3f1-5faa-b791-6aebd7901c84
2026-03-25 16:33:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc54cfd0>
2026-03-25 16:33:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bae7b0ab-d3f1-5faa-b791-6aebd7901c84/bae7b0ab-d3f1-5faa-b791-6aebd7901c84_image_2.jpg HTTP/1.1" 201 0
2026-03-25 16:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj3%252F8661dce11a8046839dc010c5b08a8138%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj3/8661dce11a8046839dc010c5b08a8138/images/large/3.jpg saved to cache
2026-03-25 16:33:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item bae7b0ab-d3f1-5faa-b791-6aebd7901c84
2026-03-25 16:33:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc5cf1d0>
2026-03-25 16:33:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bae7b0ab-d3f1-5faa-b791-6aebd7901c84/bae7b0ab-d3f1-5faa-b791-6aebd7901c84_image_3.jpg HTTP/1.1" 201 0
2026-03-25 16:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj3%252F8661dce11a8046839dc010c5b08a8138%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj3/8661dce11a8046839dc010c5b08a8138/images/large/4.jpg saved to cache
2026-03-25 16:33:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item bae7b0ab-d3f1-5faa-b791-6aebd7901c84
2026-03-25 16:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg6%252F5188b70e7e9c4f1a9e8ac0b56981065f%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg6/5188b70e7e9c4f1a9e8ac0b56981065f/images/large/4.jpg not downloaded yet
2026-03-25 16:33:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj3/8661dce11a8046839dc010c5b08a8138/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh3/700134c2c14b4111a68be65a411f0ec9/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj3/8661dce11a8046839dc010c5b08a8138/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg6%252F5188b70e7e9c4f1a9e8ac0b56981065f%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg6/5188b70e7e9c4f1a9e8ac0b56981065f/images/large/5.jpg not downloaded yet
2026-03-25 16:33:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj3/8661dce11a8046839dc010c5b08a8138/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj3/8661dce11a8046839dc010c5b08a8138/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh3/700134c2c14b4111a68be65a411f0ec9/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg6%252F5188b70e7e9c4f1a9e8ac0b56981065f%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg6/5188b70e7e9c4f1a9e8ac0b56981065f/images/large/6.jpg not downloaded yet
2026-03-25 16:33:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj3/8661dce11a8046839dc010c5b08a8138/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj3/8661dce11a8046839dc010c5b08a8138/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg6%252F5188b70e7e9c4f1a9e8ac0b56981065f%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg6/5188b70e7e9c4f1a9e8ac0b56981065f/images/large/7.jpg not downloaded yet
2026-03-25 16:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg6%252F5188b70e7e9c4f1a9e8ac0b56981065f%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg6/5188b70e7e9c4f1a9e8ac0b56981065f/images/large/8.jpg not downloaded yet
2026-03-25 16:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg6%252F5188b70e7e9c4f1a9e8ac0b56981065f%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg6/5188b70e7e9c4f1a9e8ac0b56981065f/images/large/9.jpg not downloaded yet
2026-03-25 16:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg6%252F5188b70e7e9c4f1a9e8ac0b56981065f%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg6/5188b70e7e9c4f1a9e8ac0b56981065f/images/large/10.jpg not downloaded yet
2026-03-25 16:33:14 [ayvens.it] INFO: Found listing with ID: 1983618
2026-03-25 16:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983618%27 HTTP/1.1" 200 None
2026-03-25 16:33:14 [ayvens.it] INFO: Scrape type for 1983618: 1
2026-03-25 16:33:14 [ayvens.it] INFO: Extracting data for car ID: 1983618
2026-03-25 16:33:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d9a3271e-25b7-5f7a-aff8-28aa46299a87 with identifier: 1983618
2026-03-25 16:33:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d9a3271e-25b7-5f7a-aff8-28aa46299a87 with scrape type 1
2026-03-25 16:33:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d9a3271e-25b7-5f7a-aff8-28aa46299a87
2026-03-25 16:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh0%252Febe36cf566d4486cba2be86f61b41eeb%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh0/ebe36cf566d4486cba2be86f61b41eeb/images/large/1.jpg not downloaded yet
2026-03-25 16:33:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34de457710>
2026-03-25 16:33:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bae7b0ab-d3f1-5faa-b791-6aebd7901c84/bae7b0ab-d3f1-5faa-b791-6aebd7901c84_image_7.jpg HTTP/1.1" 201 0
2026-03-25 16:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj3%252F8661dce11a8046839dc010c5b08a8138%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj3/8661dce11a8046839dc010c5b08a8138/images/large/8.jpg saved to cache
2026-03-25 16:33:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item bae7b0ab-d3f1-5faa-b791-6aebd7901c84
2026-03-25 16:33:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc89d050>
2026-03-25 16:33:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92e97984-3c60-5ae7-8361-7f46776a7fa3/92e97984-3c60-5ae7-8361-7f46776a7fa3_image_4.jpg HTTP/1.1" 201 0
2026-03-25 16:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh3%252F700134c2c14b4111a68be65a411f0ec9%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh3/700134c2c14b4111a68be65a411f0ec9/images/large/5.jpg saved to cache
2026-03-25 16:33:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 92e97984-3c60-5ae7-8361-7f46776a7fa3
2026-03-25 16:33:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcaf6590>
2026-03-25 16:33:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bae7b0ab-d3f1-5faa-b791-6aebd7901c84/bae7b0ab-d3f1-5faa-b791-6aebd7901c84_image_6.jpg HTTP/1.1" 201 0
2026-03-25 16:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj3%252F8661dce11a8046839dc010c5b08a8138%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj3/8661dce11a8046839dc010c5b08a8138/images/large/7.jpg saved to cache
2026-03-25 16:33:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item bae7b0ab-d3f1-5faa-b791-6aebd7901c84
2026-03-25 16:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh0%252Febe36cf566d4486cba2be86f61b41eeb%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh0/ebe36cf566d4486cba2be86f61b41eeb/images/large/2.jpg not downloaded yet
2026-03-25 16:33:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc94f490>
2026-03-25 16:33:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bae7b0ab-d3f1-5faa-b791-6aebd7901c84/bae7b0ab-d3f1-5faa-b791-6aebd7901c84_image_8.jpg HTTP/1.1" 201 0
2026-03-25 16:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj3%252F8661dce11a8046839dc010c5b08a8138%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj3/8661dce11a8046839dc010c5b08a8138/images/large/9.jpg saved to cache
2026-03-25 16:33:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item bae7b0ab-d3f1-5faa-b791-6aebd7901c84
2026-03-25 16:33:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dca1a1d0>
2026-03-25 16:33:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bae7b0ab-d3f1-5faa-b791-6aebd7901c84/bae7b0ab-d3f1-5faa-b791-6aebd7901c84_image_9.jpg HTTP/1.1" 201 0
2026-03-25 16:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj3%252F8661dce11a8046839dc010c5b08a8138%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj3/8661dce11a8046839dc010c5b08a8138/images/large/10.jpg saved to cache
2026-03-25 16:33:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item bae7b0ab-d3f1-5faa-b791-6aebd7901c84
2026-03-25 16:33:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc9b2b50>
2026-03-25 16:33:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92e97984-3c60-5ae7-8361-7f46776a7fa3/92e97984-3c60-5ae7-8361-7f46776a7fa3_image_5.jpg HTTP/1.1" 201 0
2026-03-25 16:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh3%252F700134c2c14b4111a68be65a411f0ec9%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh3/700134c2c14b4111a68be65a411f0ec9/images/large/6.jpg saved to cache
2026-03-25 16:33:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 92e97984-3c60-5ae7-8361-7f46776a7fa3
2026-03-25 16:33:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc327150>
2026-03-25 16:33:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bae7b0ab-d3f1-5faa-b791-6aebd7901c84/bae7b0ab-d3f1-5faa-b791-6aebd7901c84_image_5.jpg HTTP/1.1" 201 0
2026-03-25 16:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj3%252F8661dce11a8046839dc010c5b08a8138%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj3/8661dce11a8046839dc010c5b08a8138/images/large/6.jpg saved to cache
2026-03-25 16:33:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item bae7b0ab-d3f1-5faa-b791-6aebd7901c84
2026-03-25 16:33:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dca272d0>
2026-03-25 16:33:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bae7b0ab-d3f1-5faa-b791-6aebd7901c84/bae7b0ab-d3f1-5faa-b791-6aebd7901c84_image_4.jpg HTTP/1.1" 201 0
2026-03-25 16:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj3%252F8661dce11a8046839dc010c5b08a8138%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj3/8661dce11a8046839dc010c5b08a8138/images/large/5.jpg saved to cache
2026-03-25 16:33:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item bae7b0ab-d3f1-5faa-b791-6aebd7901c84
2026-03-25 16:33:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bae7b0ab-d3f1-5faa-b791-6aebd7901c84, skipping ID generation
2026-03-25 16:33:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bae7b0ab-d3f1-5faa-b791-6aebd7901c84 with scrape type 1
2026-03-25 16:33:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bae7b0ab-d3f1-5faa-b791-6aebd7901c84 sending to next pipeline
2026-03-25 16:33:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: bae7b0ab-d3f1-5faa-b791-6aebd7901c84, identifier: 1983615
2026-03-25 16:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh0%252Febe36cf566d4486cba2be86f61b41eeb%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh0/ebe36cf566d4486cba2be86f61b41eeb/images/large/3.jpg not downloaded yet
2026-03-25 16:33:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: bae7b0ab-d3f1-5faa-b791-6aebd7901c84 with identifier: 1983615
2026-03-25 16:33:15 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:33:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: bae7b0ab-d3f1-5faa-b791-6aebd7901c84 with identifier: 1983615
2026-03-25 16:33:15 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: bae7b0ab-d3f1-5faa-b791-6aebd7901c84 with identifier: 1983615 to the API
2026-03-25 16:33:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:33:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:33:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gj3/8661dce11a8046839dc010c5b08a8138/images/large/5.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'ARGENTO RIFLESSO MTZ',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-27T09:30:00Z',
'fuel_type': 'diesel',
'id': 'bae7b0ab-d3f1-5faa-b791-6aebd7901c84',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41025',
'listing': 'auction',
'location': None,
'make': 'VOLKSWAGEN',
'model': 'VOLKSWAGEN TIGUAN (PC) 2.0 TDI SCR 110KW LIFE DSG FP',
'odometer': 226093,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 29,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bae7b0ab-d3f1-5faa-b791-6aebd7901c84/bae7b0ab-d3f1-5faa-b791-6aebd7901c84_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 728021,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj3/8661dce11a8046839dc010c5b08a8138/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bae7b0ab-d3f1-5faa-b791-6aebd7901c84/bae7b0ab-d3f1-5faa-b791-6aebd7901c84_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 716657,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj3/8661dce11a8046839dc010c5b08a8138/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bae7b0ab-d3f1-5faa-b791-6aebd7901c84/bae7b0ab-d3f1-5faa-b791-6aebd7901c84_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 728021,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj3/8661dce11a8046839dc010c5b08a8138/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bae7b0ab-d3f1-5faa-b791-6aebd7901c84/bae7b0ab-d3f1-5faa-b791-6aebd7901c84_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 656366,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj3/8661dce11a8046839dc010c5b08a8138/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bae7b0ab-d3f1-5faa-b791-6aebd7901c84/bae7b0ab-d3f1-5faa-b791-6aebd7901c84_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 622049,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj3/8661dce11a8046839dc010c5b08a8138/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bae7b0ab-d3f1-5faa-b791-6aebd7901c84/bae7b0ab-d3f1-5faa-b791-6aebd7901c84_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 669688,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj3/8661dce11a8046839dc010c5b08a8138/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bae7b0ab-d3f1-5faa-b791-6aebd7901c84/bae7b0ab-d3f1-5faa-b791-6aebd7901c84_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 438068,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj3/8661dce11a8046839dc010c5b08a8138/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bae7b0ab-d3f1-5faa-b791-6aebd7901c84/bae7b0ab-d3f1-5faa-b791-6aebd7901c84_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 536407,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj3/8661dce11a8046839dc010c5b08a8138/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bae7b0ab-d3f1-5faa-b791-6aebd7901c84/bae7b0ab-d3f1-5faa-b791-6aebd7901c84_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 574292,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj3/8661dce11a8046839dc010c5b08a8138/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bae7b0ab-d3f1-5faa-b791-6aebd7901c84/bae7b0ab-d3f1-5faa-b791-6aebd7901c84_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 548595,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj3/8661dce11a8046839dc010c5b08a8138/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-01-20',
'seats_number': 5,
'seller_name': None,
'title': 'VOLKSWAGEN VOLKSWAGEN TIGUAN (PC) 2.0 TDI SCR 110KW LIFE DSG FP -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-25 16:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983615%27 HTTP/1.1" 200 None
2026-03-25 16:33:16 [ayvens.it] INFO: Saving data for 1983615: {'created_time': 1774456396.157867, 'last_price_update_time': 1774456396.157881, 'auction_closing_time': 1774603800.0}
2026-03-25 16:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1983615') HTTP/1.1" 204 0
2026-03-25 16:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh0%252Febe36cf566d4486cba2be86f61b41eeb%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh0/ebe36cf566d4486cba2be86f61b41eeb/images/large/4.jpg not downloaded yet
2026-03-25 16:33:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh8/25077950dc8b42969b582ab34accf07a/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh0%252Febe36cf566d4486cba2be86f61b41eeb%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh0/ebe36cf566d4486cba2be86f61b41eeb/images/large/5.jpg not downloaded yet
2026-03-25 16:33:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh8/25077950dc8b42969b582ab34accf07a/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh8/25077950dc8b42969b582ab34accf07a/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh0%252Febe36cf566d4486cba2be86f61b41eeb%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh0/ebe36cf566d4486cba2be86f61b41eeb/images/large/6.jpg not downloaded yet
2026-03-25 16:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh0%252Febe36cf566d4486cba2be86f61b41eeb%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh0/ebe36cf566d4486cba2be86f61b41eeb/images/large/7.jpg not downloaded yet
2026-03-25 16:33:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh8/25077950dc8b42969b582ab34accf07a/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh8/25077950dc8b42969b582ab34accf07a/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh8/25077950dc8b42969b582ab34accf07a/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh8/25077950dc8b42969b582ab34accf07a/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh0%252Febe36cf566d4486cba2be86f61b41eeb%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh0/ebe36cf566d4486cba2be86f61b41eeb/images/large/8.jpg not downloaded yet
2026-03-25 16:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh0%252Febe36cf566d4486cba2be86f61b41eeb%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh0/ebe36cf566d4486cba2be86f61b41eeb/images/large/9.jpg not downloaded yet
2026-03-25 16:33:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg6/5188b70e7e9c4f1a9e8ac0b56981065f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh0%252Febe36cf566d4486cba2be86f61b41eeb%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh0/ebe36cf566d4486cba2be86f61b41eeb/images/large/10.jpg not downloaded yet
2026-03-25 16:33:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34de9682d0>
2026-03-25 16:33:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a12546fb-f357-594e-bbea-faeef33b4a72/a12546fb-f357-594e-bbea-faeef33b4a72_image_9.jpg HTTP/1.1" 201 0
2026-03-25 16:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh8%252F25077950dc8b42969b582ab34accf07a%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh8/25077950dc8b42969b582ab34accf07a/images/large/10.jpg saved to cache
2026-03-25 16:33:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a12546fb-f357-594e-bbea-faeef33b4a72
2026-03-25 16:33:16 [ayvens.it] INFO: Found listing with ID: 1983619
2026-03-25 16:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983619%27 HTTP/1.1" 200 None
2026-03-25 16:33:16 [ayvens.it] INFO: Scrape type for 1983619: 1
2026-03-25 16:33:16 [ayvens.it] INFO: Extracting data for car ID: 1983619
2026-03-25 16:33:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4c474d98-cccb-5fbf-b068-42106c966b49 with identifier: 1983619
2026-03-25 16:33:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4c474d98-cccb-5fbf-b068-42106c966b49 with scrape type 1
2026-03-25 16:33:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4c474d98-cccb-5fbf-b068-42106c966b49
2026-03-25 16:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh6%252F2db0980c609a4a65869ed93e19806416%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh6/2db0980c609a4a65869ed93e19806416/images/large/1.jpg not downloaded yet
2026-03-25 16:33:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34d74003d0>
2026-03-25 16:33:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a12546fb-f357-594e-bbea-faeef33b4a72/a12546fb-f357-594e-bbea-faeef33b4a72_image_5.jpg HTTP/1.1" 201 0
2026-03-25 16:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh8%252F25077950dc8b42969b582ab34accf07a%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh8/25077950dc8b42969b582ab34accf07a/images/large/6.jpg saved to cache
2026-03-25 16:33:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a12546fb-f357-594e-bbea-faeef33b4a72
2026-03-25 16:33:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc2fde50>
2026-03-25 16:33:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a12546fb-f357-594e-bbea-faeef33b4a72/a12546fb-f357-594e-bbea-faeef33b4a72_image_6.jpg HTTP/1.1" 201 0
2026-03-25 16:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh8%252F25077950dc8b42969b582ab34accf07a%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh8/25077950dc8b42969b582ab34accf07a/images/large/7.jpg saved to cache
2026-03-25 16:33:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a12546fb-f357-594e-bbea-faeef33b4a72
2026-03-25 16:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh6%252F2db0980c609a4a65869ed93e19806416%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh6/2db0980c609a4a65869ed93e19806416/images/large/2.jpg not downloaded yet
2026-03-25 16:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh6%252F2db0980c609a4a65869ed93e19806416%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh6/2db0980c609a4a65869ed93e19806416/images/large/3.jpg not downloaded yet
2026-03-25 16:33:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34d7496910>
2026-03-25 16:33:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a12546fb-f357-594e-bbea-faeef33b4a72/a12546fb-f357-594e-bbea-faeef33b4a72_image_3.jpg HTTP/1.1" 201 0
2026-03-25 16:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh8%252F25077950dc8b42969b582ab34accf07a%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh8/25077950dc8b42969b582ab34accf07a/images/large/4.jpg saved to cache
2026-03-25 16:33:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a12546fb-f357-594e-bbea-faeef33b4a72
2026-03-25 16:33:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc5e9790>
2026-03-25 16:33:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a12546fb-f357-594e-bbea-faeef33b4a72/a12546fb-f357-594e-bbea-faeef33b4a72_image_4.jpg HTTP/1.1" 201 0
2026-03-25 16:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh8%252F25077950dc8b42969b582ab34accf07a%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh8/25077950dc8b42969b582ab34accf07a/images/large/5.jpg saved to cache
2026-03-25 16:33:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a12546fb-f357-594e-bbea-faeef33b4a72
2026-03-25 16:33:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc62a610>
2026-03-25 16:33:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a12546fb-f357-594e-bbea-faeef33b4a72/a12546fb-f357-594e-bbea-faeef33b4a72_image_2.jpg HTTP/1.1" 201 0
2026-03-25 16:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh8%252F25077950dc8b42969b582ab34accf07a%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh8/25077950dc8b42969b582ab34accf07a/images/large/3.jpg saved to cache
2026-03-25 16:33:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a12546fb-f357-594e-bbea-faeef33b4a72
2026-03-25 16:33:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34d74949d0>
2026-03-25 16:33:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a12546fb-f357-594e-bbea-faeef33b4a72/a12546fb-f357-594e-bbea-faeef33b4a72_image_1.jpg HTTP/1.1" 201 0
2026-03-25 16:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh8%252F25077950dc8b42969b582ab34accf07a%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh8/25077950dc8b42969b582ab34accf07a/images/large/2.jpg saved to cache
2026-03-25 16:33:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a12546fb-f357-594e-bbea-faeef33b4a72
2026-03-25 16:33:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc92e890>
2026-03-25 16:33:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aad6231e-71a2-5614-85d8-887e7eb3c91a/aad6231e-71a2-5614-85d8-887e7eb3c91a_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg6%252F5188b70e7e9c4f1a9e8ac0b56981065f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg6/5188b70e7e9c4f1a9e8ac0b56981065f/images/large/1.jpg saved to cache
2026-03-25 16:33:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item aad6231e-71a2-5614-85d8-887e7eb3c91a
2026-03-25 16:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh6%252F2db0980c609a4a65869ed93e19806416%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh6/2db0980c609a4a65869ed93e19806416/images/large/4.jpg not downloaded yet
2026-03-25 16:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh6%252F2db0980c609a4a65869ed93e19806416%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh6/2db0980c609a4a65869ed93e19806416/images/large/5.jpg not downloaded yet
2026-03-25 16:33:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh8/25077950dc8b42969b582ab34accf07a/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh3/700134c2c14b4111a68be65a411f0ec9/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh6%252F2db0980c609a4a65869ed93e19806416%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh6/2db0980c609a4a65869ed93e19806416/images/large/6.jpg not downloaded yet
2026-03-25 16:33:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh8/25077950dc8b42969b582ab34accf07a/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg6/5188b70e7e9c4f1a9e8ac0b56981065f/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh6%252F2db0980c609a4a65869ed93e19806416%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh6/2db0980c609a4a65869ed93e19806416/images/large/7.jpg not downloaded yet
2026-03-25 16:33:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh8/25077950dc8b42969b582ab34accf07a/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg6/5188b70e7e9c4f1a9e8ac0b56981065f/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh6%252F2db0980c609a4a65869ed93e19806416%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh6/2db0980c609a4a65869ed93e19806416/images/large/8.jpg not downloaded yet
2026-03-25 16:33:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg6/5188b70e7e9c4f1a9e8ac0b56981065f/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh6%252F2db0980c609a4a65869ed93e19806416%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh6/2db0980c609a4a65869ed93e19806416/images/large/9.jpg not downloaded yet
2026-03-25 16:33:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg6/5188b70e7e9c4f1a9e8ac0b56981065f/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh6%252F2db0980c609a4a65869ed93e19806416%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh6/2db0980c609a4a65869ed93e19806416/images/large/10.jpg not downloaded yet
2026-03-25 16:33:17 [ayvens.it] INFO: Found listing with ID: 1983620
2026-03-25 16:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983620%27 HTTP/1.1" 200 None
2026-03-25 16:33:17 [ayvens.it] INFO: Scrape type for 1983620: 1
2026-03-25 16:33:17 [ayvens.it] INFO: Extracting data for car ID: 1983620
2026-03-25 16:33:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bce268a8-273a-5a1e-8706-946ac8db3862 with identifier: 1983620
2026-03-25 16:33:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bce268a8-273a-5a1e-8706-946ac8db3862 with scrape type 1
2026-03-25 16:33:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item bce268a8-273a-5a1e-8706-946ac8db3862
2026-03-25 16:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr6%252F3fdc4b196fd840789c94643c58daa4f3%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr6/3fdc4b196fd840789c94643c58daa4f3/images/large/1.jpg not downloaded yet
2026-03-25 16:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr6%252F3fdc4b196fd840789c94643c58daa4f3%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr6/3fdc4b196fd840789c94643c58daa4f3/images/large/2.jpg not downloaded yet
2026-03-25 16:33:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcb84c50>
2026-03-25 16:33:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a12546fb-f357-594e-bbea-faeef33b4a72/a12546fb-f357-594e-bbea-faeef33b4a72_image_7.jpg HTTP/1.1" 201 0
2026-03-25 16:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh8%252F25077950dc8b42969b582ab34accf07a%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh8/25077950dc8b42969b582ab34accf07a/images/large/8.jpg saved to cache
2026-03-25 16:33:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a12546fb-f357-594e-bbea-faeef33b4a72
2026-03-25 16:33:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34d7494fd0>
2026-03-25 16:33:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92e97984-3c60-5ae7-8361-7f46776a7fa3/92e97984-3c60-5ae7-8361-7f46776a7fa3_image_1.jpg HTTP/1.1" 201 0
2026-03-25 16:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh3%252F700134c2c14b4111a68be65a411f0ec9%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh3/700134c2c14b4111a68be65a411f0ec9/images/large/2.jpg saved to cache
2026-03-25 16:33:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 92e97984-3c60-5ae7-8361-7f46776a7fa3
2026-03-25 16:33:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 92e97984-3c60-5ae7-8361-7f46776a7fa3, skipping ID generation
2026-03-25 16:33:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 92e97984-3c60-5ae7-8361-7f46776a7fa3 with scrape type 1
2026-03-25 16:33:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 92e97984-3c60-5ae7-8361-7f46776a7fa3 sending to next pipeline
2026-03-25 16:33:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 92e97984-3c60-5ae7-8361-7f46776a7fa3, identifier: 1983614
2026-03-25 16:33:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc2fcb50>
2026-03-25 16:33:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a12546fb-f357-594e-bbea-faeef33b4a72/a12546fb-f357-594e-bbea-faeef33b4a72_image_8.jpg HTTP/1.1" 201 0
2026-03-25 16:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh8%252F25077950dc8b42969b582ab34accf07a%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh8/25077950dc8b42969b582ab34accf07a/images/large/9.jpg saved to cache
2026-03-25 16:33:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a12546fb-f357-594e-bbea-faeef33b4a72
2026-03-25 16:33:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc80c1d0>
2026-03-25 16:33:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aad6231e-71a2-5614-85d8-887e7eb3c91a/aad6231e-71a2-5614-85d8-887e7eb3c91a_image_3.jpg HTTP/1.1" 201 0
2026-03-25 16:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg6%252F5188b70e7e9c4f1a9e8ac0b56981065f%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg6/5188b70e7e9c4f1a9e8ac0b56981065f/images/large/4.jpg saved to cache
2026-03-25 16:33:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item aad6231e-71a2-5614-85d8-887e7eb3c91a
2026-03-25 16:33:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc57b790>
2026-03-25 16:33:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a12546fb-f357-594e-bbea-faeef33b4a72/a12546fb-f357-594e-bbea-faeef33b4a72_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh8%252F25077950dc8b42969b582ab34accf07a%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh8/25077950dc8b42969b582ab34accf07a/images/large/1.jpg saved to cache
2026-03-25 16:33:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a12546fb-f357-594e-bbea-faeef33b4a72
2026-03-25 16:33:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a12546fb-f357-594e-bbea-faeef33b4a72, skipping ID generation
2026-03-25 16:33:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a12546fb-f357-594e-bbea-faeef33b4a72 with scrape type 1
2026-03-25 16:33:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a12546fb-f357-594e-bbea-faeef33b4a72 sending to next pipeline
2026-03-25 16:33:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: a12546fb-f357-594e-bbea-faeef33b4a72, identifier: 1983616
2026-03-25 16:33:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc578550>
2026-03-25 16:33:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aad6231e-71a2-5614-85d8-887e7eb3c91a/aad6231e-71a2-5614-85d8-887e7eb3c91a_image_4.jpg HTTP/1.1" 201 0
2026-03-25 16:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg6%252F5188b70e7e9c4f1a9e8ac0b56981065f%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg6/5188b70e7e9c4f1a9e8ac0b56981065f/images/large/5.jpg saved to cache
2026-03-25 16:33:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item aad6231e-71a2-5614-85d8-887e7eb3c91a
2026-03-25 16:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr6%252F3fdc4b196fd840789c94643c58daa4f3%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr6/3fdc4b196fd840789c94643c58daa4f3/images/large/3.jpg not downloaded yet
2026-03-25 16:33:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 92e97984-3c60-5ae7-8361-7f46776a7fa3 with identifier: 1983614
2026-03-25 16:33:18 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:33:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 92e97984-3c60-5ae7-8361-7f46776a7fa3 with identifier: 1983614
2026-03-25 16:33:18 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 92e97984-3c60-5ae7-8361-7f46776a7fa3 with identifier: 1983614 to the API
2026-03-25 16:33:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:33:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:33:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gh3/700134c2c14b4111a68be65a411f0ec9/images/large/2.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'GRIGIO CRISTALLO MTZ',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-27T09:30:00Z',
'fuel_type': 'hybrid',
'id': '92e97984-3c60-5ae7-8361-7f46776a7fa3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41025',
'listing': 'auction',
'location': None,
'make': 'CITROËN',
'model': 'CITROEN DS 7 CROSSBACK E-TENSE AUTOMATICA BUSINESS FP(PC) FP',
'odometer': 105735,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 29,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92e97984-3c60-5ae7-8361-7f46776a7fa3/92e97984-3c60-5ae7-8361-7f46776a7fa3_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 414897,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh3/700134c2c14b4111a68be65a411f0ec9/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92e97984-3c60-5ae7-8361-7f46776a7fa3/92e97984-3c60-5ae7-8361-7f46776a7fa3_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 504472,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh3/700134c2c14b4111a68be65a411f0ec9/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92e97984-3c60-5ae7-8361-7f46776a7fa3/92e97984-3c60-5ae7-8361-7f46776a7fa3_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 414897,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh3/700134c2c14b4111a68be65a411f0ec9/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92e97984-3c60-5ae7-8361-7f46776a7fa3/92e97984-3c60-5ae7-8361-7f46776a7fa3_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 441650,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh3/700134c2c14b4111a68be65a411f0ec9/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92e97984-3c60-5ae7-8361-7f46776a7fa3/92e97984-3c60-5ae7-8361-7f46776a7fa3_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 470934,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh3/700134c2c14b4111a68be65a411f0ec9/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92e97984-3c60-5ae7-8361-7f46776a7fa3/92e97984-3c60-5ae7-8361-7f46776a7fa3_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 504888,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh3/700134c2c14b4111a68be65a411f0ec9/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92e97984-3c60-5ae7-8361-7f46776a7fa3/92e97984-3c60-5ae7-8361-7f46776a7fa3_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 468176,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh3/700134c2c14b4111a68be65a411f0ec9/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92e97984-3c60-5ae7-8361-7f46776a7fa3/92e97984-3c60-5ae7-8361-7f46776a7fa3_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 496372,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh3/700134c2c14b4111a68be65a411f0ec9/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92e97984-3c60-5ae7-8361-7f46776a7fa3/92e97984-3c60-5ae7-8361-7f46776a7fa3_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 491954,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh3/700134c2c14b4111a68be65a411f0ec9/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92e97984-3c60-5ae7-8361-7f46776a7fa3/92e97984-3c60-5ae7-8361-7f46776a7fa3_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 386706,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh3/700134c2c14b4111a68be65a411f0ec9/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-11-30',
'seats_number': 5,
'seller_name': None,
'title': 'CITROËN CITROEN DS 7 CROSSBACK E-TENSE AUTOMATICA BUSINESS FP(PC) '
'FP -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2021}
2026-03-25 16:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983614%27 HTTP/1.1" 200 None
2026-03-25 16:33:18 [ayvens.it] INFO: Saving data for 1983614: {'created_time': 1774456398.434216, 'last_price_update_time': 1774456398.434227, 'auction_closing_time': 1774603800.0}
2026-03-25 16:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1983614') HTTP/1.1" 204 0
2026-03-25 16:33:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: a12546fb-f357-594e-bbea-faeef33b4a72 with identifier: 1983616
2026-03-25 16:33:18 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:33:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: a12546fb-f357-594e-bbea-faeef33b4a72 with identifier: 1983616
2026-03-25 16:33:18 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: a12546fb-f357-594e-bbea-faeef33b4a72 with identifier: 1983616 to the API
2026-03-25 16:33:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:33:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:33:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gh8/25077950dc8b42969b582ab34accf07a/images/large/1.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'SUPER RED',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.8L',
'expiration_date': '2026-03-27T09:30:00Z',
'fuel_type': 'hybrid',
'id': 'a12546fb-f357-594e-bbea-faeef33b4a72',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41025',
'listing': 'auction',
'location': None,
'make': 'TOYOTA',
'model': 'TOYOTA COROLLA SW N1 TS HYBRID BUSINESS TECH FP',
'odometer': 74503,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 36,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a12546fb-f357-594e-bbea-faeef33b4a72/a12546fb-f357-594e-bbea-faeef33b4a72_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 664496,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh8/25077950dc8b42969b582ab34accf07a/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a12546fb-f357-594e-bbea-faeef33b4a72/a12546fb-f357-594e-bbea-faeef33b4a72_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 760553,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh8/25077950dc8b42969b582ab34accf07a/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a12546fb-f357-594e-bbea-faeef33b4a72/a12546fb-f357-594e-bbea-faeef33b4a72_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 664496,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh8/25077950dc8b42969b582ab34accf07a/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a12546fb-f357-594e-bbea-faeef33b4a72/a12546fb-f357-594e-bbea-faeef33b4a72_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 751304,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh8/25077950dc8b42969b582ab34accf07a/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a12546fb-f357-594e-bbea-faeef33b4a72/a12546fb-f357-594e-bbea-faeef33b4a72_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 776653,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh8/25077950dc8b42969b582ab34accf07a/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a12546fb-f357-594e-bbea-faeef33b4a72/a12546fb-f357-594e-bbea-faeef33b4a72_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 505123,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh8/25077950dc8b42969b582ab34accf07a/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a12546fb-f357-594e-bbea-faeef33b4a72/a12546fb-f357-594e-bbea-faeef33b4a72_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 555636,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh8/25077950dc8b42969b582ab34accf07a/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a12546fb-f357-594e-bbea-faeef33b4a72/a12546fb-f357-594e-bbea-faeef33b4a72_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 585932,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh8/25077950dc8b42969b582ab34accf07a/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a12546fb-f357-594e-bbea-faeef33b4a72/a12546fb-f357-594e-bbea-faeef33b4a72_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 597391,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh8/25077950dc8b42969b582ab34accf07a/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a12546fb-f357-594e-bbea-faeef33b4a72/a12546fb-f357-594e-bbea-faeef33b4a72_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 443679,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh8/25077950dc8b42969b582ab34accf07a/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-12-03',
'seats_number': 5,
'seller_name': None,
'title': 'TOYOTA TOYOTA COROLLA SW N1 TS HYBRID BUSINESS TECH FP -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2021}
2026-03-25 16:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983616%27 HTTP/1.1" 200 None
2026-03-25 16:33:19 [ayvens.it] INFO: Saving data for 1983616: {'created_time': 1774456399.530463, 'last_price_update_time': 1774456399.530486, 'auction_closing_time': 1774603800.0}
2026-03-25 16:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1983616') HTTP/1.1" 204 0
2026-03-25 16:33:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc8d6710>
2026-03-25 16:33:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aad6231e-71a2-5614-85d8-887e7eb3c91a/aad6231e-71a2-5614-85d8-887e7eb3c91a_image_2.jpg HTTP/1.1" 201 0
2026-03-25 16:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg6%252F5188b70e7e9c4f1a9e8ac0b56981065f%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg6/5188b70e7e9c4f1a9e8ac0b56981065f/images/large/3.jpg saved to cache
2026-03-25 16:33:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item aad6231e-71a2-5614-85d8-887e7eb3c91a
2026-03-25 16:33:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc53d910>
2026-03-25 16:33:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aad6231e-71a2-5614-85d8-887e7eb3c91a/aad6231e-71a2-5614-85d8-887e7eb3c91a_image_1.jpg HTTP/1.1" 201 0
2026-03-25 16:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg6%252F5188b70e7e9c4f1a9e8ac0b56981065f%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg6/5188b70e7e9c4f1a9e8ac0b56981065f/images/large/2.jpg saved to cache
2026-03-25 16:33:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item aad6231e-71a2-5614-85d8-887e7eb3c91a
2026-03-25 16:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr6%252F3fdc4b196fd840789c94643c58daa4f3%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr6/3fdc4b196fd840789c94643c58daa4f3/images/large/4.jpg not downloaded yet
2026-03-25 16:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr6%252F3fdc4b196fd840789c94643c58daa4f3%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr6/3fdc4b196fd840789c94643c58daa4f3/images/large/5.jpg not downloaded yet
2026-03-25 16:33:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh0/ebe36cf566d4486cba2be86f61b41eeb/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh0/ebe36cf566d4486cba2be86f61b41eeb/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh0/ebe36cf566d4486cba2be86f61b41eeb/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh0/ebe36cf566d4486cba2be86f61b41eeb/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr6%252F3fdc4b196fd840789c94643c58daa4f3%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr6/3fdc4b196fd840789c94643c58daa4f3/images/large/6.jpg not downloaded yet
2026-03-25 16:33:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh0/ebe36cf566d4486cba2be86f61b41eeb/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh0/ebe36cf566d4486cba2be86f61b41eeb/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh0/ebe36cf566d4486cba2be86f61b41eeb/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr6%252F3fdc4b196fd840789c94643c58daa4f3%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr6/3fdc4b196fd840789c94643c58daa4f3/images/large/7.jpg not downloaded yet
2026-03-25 16:33:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh6/2db0980c609a4a65869ed93e19806416/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr6%252F3fdc4b196fd840789c94643c58daa4f3%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr6/3fdc4b196fd840789c94643c58daa4f3/images/large/8.jpg not downloaded yet
2026-03-25 16:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr6%252F3fdc4b196fd840789c94643c58daa4f3%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr6/3fdc4b196fd840789c94643c58daa4f3/images/large/9.jpg not downloaded yet
2026-03-25 16:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr6%252F3fdc4b196fd840789c94643c58daa4f3%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr6/3fdc4b196fd840789c94643c58daa4f3/images/large/10.jpg not downloaded yet
2026-03-25 16:33:19 [ayvens.it] INFO: Found listing with ID: 1983621
2026-03-25 16:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983621%27 HTTP/1.1" 200 None
2026-03-25 16:33:19 [ayvens.it] INFO: Scrape type for 1983621: 1
2026-03-25 16:33:19 [ayvens.it] INFO: Extracting data for car ID: 1983621
2026-03-25 16:33:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 95217f32-f9d7-5868-b63d-86254a35ea78 with identifier: 1983621
2026-03-25 16:33:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 95217f32-f9d7-5868-b63d-86254a35ea78 with scrape type 1
2026-03-25 16:33:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 95217f32-f9d7-5868-b63d-86254a35ea78
2026-03-25 16:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl9%252F5eb47c0ca41242638cdb8b1659971e9f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl9/5eb47c0ca41242638cdb8b1659971e9f/images/large/1.jpg not downloaded yet
2026-03-25 16:33:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34d7dac690>
2026-03-25 16:33:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9a3271e-25b7-5f7a-aff8-28aa46299a87/d9a3271e-25b7-5f7a-aff8-28aa46299a87_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh0%252Febe36cf566d4486cba2be86f61b41eeb%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh0/ebe36cf566d4486cba2be86f61b41eeb/images/large/1.jpg saved to cache
2026-03-25 16:33:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d9a3271e-25b7-5f7a-aff8-28aa46299a87
2026-03-25 16:33:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc89df50>
2026-03-25 16:33:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9a3271e-25b7-5f7a-aff8-28aa46299a87/d9a3271e-25b7-5f7a-aff8-28aa46299a87_image_5.jpg HTTP/1.1" 201 0
2026-03-25 16:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh0%252Febe36cf566d4486cba2be86f61b41eeb%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh0/ebe36cf566d4486cba2be86f61b41eeb/images/large/6.jpg saved to cache
2026-03-25 16:33:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d9a3271e-25b7-5f7a-aff8-28aa46299a87
2026-03-25 16:33:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc711d90>
2026-03-25 16:33:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9a3271e-25b7-5f7a-aff8-28aa46299a87/d9a3271e-25b7-5f7a-aff8-28aa46299a87_image_6.jpg HTTP/1.1" 201 0
2026-03-25 16:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh0%252Febe36cf566d4486cba2be86f61b41eeb%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh0/ebe36cf566d4486cba2be86f61b41eeb/images/large/7.jpg saved to cache
2026-03-25 16:33:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d9a3271e-25b7-5f7a-aff8-28aa46299a87
2026-03-25 16:33:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34d7402910>
2026-03-25 16:33:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9a3271e-25b7-5f7a-aff8-28aa46299a87/d9a3271e-25b7-5f7a-aff8-28aa46299a87_image_2.jpg HTTP/1.1" 201 0
2026-03-25 16:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh0%252Febe36cf566d4486cba2be86f61b41eeb%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh0/ebe36cf566d4486cba2be86f61b41eeb/images/large/3.jpg saved to cache
2026-03-25 16:33:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d9a3271e-25b7-5f7a-aff8-28aa46299a87
2026-03-25 16:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl9%252F5eb47c0ca41242638cdb8b1659971e9f%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl9/5eb47c0ca41242638cdb8b1659971e9f/images/large/2.jpg not downloaded yet
2026-03-25 16:33:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc5cff50>
2026-03-25 16:33:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9a3271e-25b7-5f7a-aff8-28aa46299a87/d9a3271e-25b7-5f7a-aff8-28aa46299a87_image_4.jpg HTTP/1.1" 201 0
2026-03-25 16:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh0%252Febe36cf566d4486cba2be86f61b41eeb%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh0/ebe36cf566d4486cba2be86f61b41eeb/images/large/5.jpg saved to cache
2026-03-25 16:33:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d9a3271e-25b7-5f7a-aff8-28aa46299a87
2026-03-25 16:33:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc54d0d0>
2026-03-25 16:33:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9a3271e-25b7-5f7a-aff8-28aa46299a87/d9a3271e-25b7-5f7a-aff8-28aa46299a87_image_3.jpg HTTP/1.1" 201 0
2026-03-25 16:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh0%252Febe36cf566d4486cba2be86f61b41eeb%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh0/ebe36cf566d4486cba2be86f61b41eeb/images/large/4.jpg saved to cache
2026-03-25 16:33:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d9a3271e-25b7-5f7a-aff8-28aa46299a87
2026-03-25 16:33:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc38fb90>
2026-03-25 16:33:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9a3271e-25b7-5f7a-aff8-28aa46299a87/d9a3271e-25b7-5f7a-aff8-28aa46299a87_image_1.jpg HTTP/1.1" 201 0
2026-03-25 16:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh0%252Febe36cf566d4486cba2be86f61b41eeb%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh0/ebe36cf566d4486cba2be86f61b41eeb/images/large/2.jpg saved to cache
2026-03-25 16:33:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d9a3271e-25b7-5f7a-aff8-28aa46299a87
2026-03-25 16:33:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34d7497890>
2026-03-25 16:33:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c474d98-cccb-5fbf-b068-42106c966b49/4c474d98-cccb-5fbf-b068-42106c966b49_image_1.jpg HTTP/1.1" 201 0
2026-03-25 16:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh6%252F2db0980c609a4a65869ed93e19806416%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh6/2db0980c609a4a65869ed93e19806416/images/large/2.jpg saved to cache
2026-03-25 16:33:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4c474d98-cccb-5fbf-b068-42106c966b49
2026-03-25 16:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl9%252F5eb47c0ca41242638cdb8b1659971e9f%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl9/5eb47c0ca41242638cdb8b1659971e9f/images/large/3.jpg not downloaded yet
2026-03-25 16:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl9%252F5eb47c0ca41242638cdb8b1659971e9f%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl9/5eb47c0ca41242638cdb8b1659971e9f/images/large/4.jpg not downloaded yet
2026-03-25 16:33:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh6/2db0980c609a4a65869ed93e19806416/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fr6/3fdc4b196fd840789c94643c58daa4f3/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl9%252F5eb47c0ca41242638cdb8b1659971e9f%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl9/5eb47c0ca41242638cdb8b1659971e9f/images/large/5.jpg not downloaded yet
2026-03-25 16:33:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh6/2db0980c609a4a65869ed93e19806416/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh6/2db0980c609a4a65869ed93e19806416/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh6/2db0980c609a4a65869ed93e19806416/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl9%252F5eb47c0ca41242638cdb8b1659971e9f%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl9/5eb47c0ca41242638cdb8b1659971e9f/images/large/6.jpg not downloaded yet
2026-03-25 16:33:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fr6/3fdc4b196fd840789c94643c58daa4f3/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh6/2db0980c609a4a65869ed93e19806416/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh6/2db0980c609a4a65869ed93e19806416/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl9%252F5eb47c0ca41242638cdb8b1659971e9f%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl9/5eb47c0ca41242638cdb8b1659971e9f/images/large/7.jpg not downloaded yet
2026-03-25 16:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl9%252F5eb47c0ca41242638cdb8b1659971e9f%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl9/5eb47c0ca41242638cdb8b1659971e9f/images/large/8.jpg not downloaded yet
2026-03-25 16:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl9%252F5eb47c0ca41242638cdb8b1659971e9f%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl9/5eb47c0ca41242638cdb8b1659971e9f/images/large/9.jpg not downloaded yet
2026-03-25 16:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl9%252F5eb47c0ca41242638cdb8b1659971e9f%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl9/5eb47c0ca41242638cdb8b1659971e9f/images/large/10.jpg not downloaded yet
2026-03-25 16:33:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc54f0d0>
2026-03-25 16:33:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c474d98-cccb-5fbf-b068-42106c966b49/4c474d98-cccb-5fbf-b068-42106c966b49_image_6.jpg HTTP/1.1" 201 0
2026-03-25 16:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh6%252F2db0980c609a4a65869ed93e19806416%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh6/2db0980c609a4a65869ed93e19806416/images/large/7.jpg saved to cache
2026-03-25 16:33:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4c474d98-cccb-5fbf-b068-42106c966b49
2026-03-25 16:33:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcab20d0>
2026-03-25 16:33:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bce268a8-273a-5a1e-8706-946ac8db3862/bce268a8-273a-5a1e-8706-946ac8db3862_image_2.jpg HTTP/1.1" 201 0
2026-03-25 16:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr6%252F3fdc4b196fd840789c94643c58daa4f3%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr6/3fdc4b196fd840789c94643c58daa4f3/images/large/3.jpg saved to cache
2026-03-25 16:33:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item bce268a8-273a-5a1e-8706-946ac8db3862
2026-03-25 16:33:21 [ayvens.it] INFO: Found listing with ID: 1983622
2026-03-25 16:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983622%27 HTTP/1.1" 200 None
2026-03-25 16:33:21 [ayvens.it] INFO: Scrape type for 1983622: 1
2026-03-25 16:33:21 [ayvens.it] INFO: Extracting data for car ID: 1983622
2026-03-25 16:33:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fc6f7d34-d2f5-5554-be9d-90ec57e1a887 with identifier: 1983622
2026-03-25 16:33:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fc6f7d34-d2f5-5554-be9d-90ec57e1a887 with scrape type 1
2026-03-25 16:33:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item fc6f7d34-d2f5-5554-be9d-90ec57e1a887
2026-03-25 16:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg1%252F0012bd9b17724fa4ae7e969cb4721d11%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg1/0012bd9b17724fa4ae7e969cb4721d11/images/large/1.jpg not downloaded yet
2026-03-25 16:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg1%252F0012bd9b17724fa4ae7e969cb4721d11%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg1/0012bd9b17724fa4ae7e969cb4721d11/images/large/2.jpg not downloaded yet
2026-03-25 16:33:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc5b5fd0>
2026-03-25 16:33:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c474d98-cccb-5fbf-b068-42106c966b49/4c474d98-cccb-5fbf-b068-42106c966b49_image_3.jpg HTTP/1.1" 201 0
2026-03-25 16:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh6%252F2db0980c609a4a65869ed93e19806416%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh6/2db0980c609a4a65869ed93e19806416/images/large/4.jpg saved to cache
2026-03-25 16:33:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4c474d98-cccb-5fbf-b068-42106c966b49
2026-03-25 16:33:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc63f510>
2026-03-25 16:33:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c474d98-cccb-5fbf-b068-42106c966b49/4c474d98-cccb-5fbf-b068-42106c966b49_image_4.jpg HTTP/1.1" 201 0
2026-03-25 16:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh6%252F2db0980c609a4a65869ed93e19806416%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh6/2db0980c609a4a65869ed93e19806416/images/large/5.jpg saved to cache
2026-03-25 16:33:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4c474d98-cccb-5fbf-b068-42106c966b49
2026-03-25 16:33:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc991d10>
2026-03-25 16:33:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c474d98-cccb-5fbf-b068-42106c966b49/4c474d98-cccb-5fbf-b068-42106c966b49_image_5.jpg HTTP/1.1" 201 0
2026-03-25 16:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh6%252F2db0980c609a4a65869ed93e19806416%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh6/2db0980c609a4a65869ed93e19806416/images/large/6.jpg saved to cache
2026-03-25 16:33:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4c474d98-cccb-5fbf-b068-42106c966b49
2026-03-25 16:33:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dca27490>
2026-03-25 16:33:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bce268a8-273a-5a1e-8706-946ac8db3862/bce268a8-273a-5a1e-8706-946ac8db3862_image_1.jpg HTTP/1.1" 201 0
2026-03-25 16:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr6%252F3fdc4b196fd840789c94643c58daa4f3%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr6/3fdc4b196fd840789c94643c58daa4f3/images/large/2.jpg saved to cache
2026-03-25 16:33:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item bce268a8-273a-5a1e-8706-946ac8db3862
2026-03-25 16:33:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc548150>
2026-03-25 16:33:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c474d98-cccb-5fbf-b068-42106c966b49/4c474d98-cccb-5fbf-b068-42106c966b49_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh6%252F2db0980c609a4a65869ed93e19806416%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh6/2db0980c609a4a65869ed93e19806416/images/large/1.jpg saved to cache
2026-03-25 16:33:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4c474d98-cccb-5fbf-b068-42106c966b49
2026-03-25 16:33:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc38cb50>
2026-03-25 16:33:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c474d98-cccb-5fbf-b068-42106c966b49/4c474d98-cccb-5fbf-b068-42106c966b49_image_2.jpg HTTP/1.1" 201 0
2026-03-25 16:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh6%252F2db0980c609a4a65869ed93e19806416%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh6/2db0980c609a4a65869ed93e19806416/images/large/3.jpg saved to cache
2026-03-25 16:33:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4c474d98-cccb-5fbf-b068-42106c966b49
2026-03-25 16:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg1%252F0012bd9b17724fa4ae7e969cb4721d11%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg1/0012bd9b17724fa4ae7e969cb4721d11/images/large/3.jpg not downloaded yet
2026-03-25 16:33:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh0/ebe36cf566d4486cba2be86f61b41eeb/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg1%252F0012bd9b17724fa4ae7e969cb4721d11%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg1/0012bd9b17724fa4ae7e969cb4721d11/images/large/4.jpg not downloaded yet
2026-03-25 16:33:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh6/2db0980c609a4a65869ed93e19806416/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh6/2db0980c609a4a65869ed93e19806416/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg1%252F0012bd9b17724fa4ae7e969cb4721d11%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg1/0012bd9b17724fa4ae7e969cb4721d11/images/large/5.jpg not downloaded yet
2026-03-25 16:33:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh6/2db0980c609a4a65869ed93e19806416/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fr6/3fdc4b196fd840789c94643c58daa4f3/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fr6/3fdc4b196fd840789c94643c58daa4f3/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg1%252F0012bd9b17724fa4ae7e969cb4721d11%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg1/0012bd9b17724fa4ae7e969cb4721d11/images/large/6.jpg not downloaded yet
2026-03-25 16:33:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fr6/3fdc4b196fd840789c94643c58daa4f3/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fr6/3fdc4b196fd840789c94643c58daa4f3/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg1%252F0012bd9b17724fa4ae7e969cb4721d11%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg1/0012bd9b17724fa4ae7e969cb4721d11/images/large/7.jpg not downloaded yet
2026-03-25 16:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg1%252F0012bd9b17724fa4ae7e969cb4721d11%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg1/0012bd9b17724fa4ae7e969cb4721d11/images/large/8.jpg not downloaded yet
2026-03-25 16:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg1%252F0012bd9b17724fa4ae7e969cb4721d11%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg1/0012bd9b17724fa4ae7e969cb4721d11/images/large/9.jpg not downloaded yet
2026-03-25 16:33:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc366610>
2026-03-25 16:33:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9a3271e-25b7-5f7a-aff8-28aa46299a87/d9a3271e-25b7-5f7a-aff8-28aa46299a87_image_9.jpg HTTP/1.1" 201 0
2026-03-25 16:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh0%252Febe36cf566d4486cba2be86f61b41eeb%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh0/ebe36cf566d4486cba2be86f61b41eeb/images/large/10.jpg saved to cache
2026-03-25 16:33:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d9a3271e-25b7-5f7a-aff8-28aa46299a87
2026-03-25 16:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg1%252F0012bd9b17724fa4ae7e969cb4721d11%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg1/0012bd9b17724fa4ae7e969cb4721d11/images/large/10.jpg not downloaded yet
2026-03-25 16:33:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc784f50>
2026-03-25 16:33:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c474d98-cccb-5fbf-b068-42106c966b49/4c474d98-cccb-5fbf-b068-42106c966b49_image_9.jpg HTTP/1.1" 201 0
2026-03-25 16:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh6%252F2db0980c609a4a65869ed93e19806416%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh6/2db0980c609a4a65869ed93e19806416/images/large/10.jpg saved to cache
2026-03-25 16:33:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4c474d98-cccb-5fbf-b068-42106c966b49
2026-03-25 16:33:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34d7d60950>
2026-03-25 16:33:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c474d98-cccb-5fbf-b068-42106c966b49/4c474d98-cccb-5fbf-b068-42106c966b49_image_7.jpg HTTP/1.1" 201 0
2026-03-25 16:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh6%252F2db0980c609a4a65869ed93e19806416%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh6/2db0980c609a4a65869ed93e19806416/images/large/8.jpg saved to cache
2026-03-25 16:33:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4c474d98-cccb-5fbf-b068-42106c966b49
2026-03-25 16:33:22 [ayvens.it] INFO: Found listing with ID: 1983623
2026-03-25 16:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983623%27 HTTP/1.1" 200 None
2026-03-25 16:33:22 [ayvens.it] INFO: Scrape type for 1983623: 1
2026-03-25 16:33:22 [ayvens.it] INFO: Extracting data for car ID: 1983623
2026-03-25 16:33:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 38f59106-c5da-55a8-b129-c35e036bbc57 with identifier: 1983623
2026-03-25 16:33:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 38f59106-c5da-55a8-b129-c35e036bbc57 with scrape type 1
2026-03-25 16:33:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 38f59106-c5da-55a8-b129-c35e036bbc57
2026-03-25 16:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg6%252F51b29edad358416cbc39c3ff6cb87881%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg6/51b29edad358416cbc39c3ff6cb87881/images/large/1.jpg not downloaded yet
2026-03-25 16:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg6%252F51b29edad358416cbc39c3ff6cb87881%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg6/51b29edad358416cbc39c3ff6cb87881/images/large/2.jpg not downloaded yet
2026-03-25 16:33:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34d7d604d0>
2026-03-25 16:33:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c474d98-cccb-5fbf-b068-42106c966b49/4c474d98-cccb-5fbf-b068-42106c966b49_image_8.jpg HTTP/1.1" 201 0
2026-03-25 16:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh6%252F2db0980c609a4a65869ed93e19806416%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh6/2db0980c609a4a65869ed93e19806416/images/large/9.jpg saved to cache
2026-03-25 16:33:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4c474d98-cccb-5fbf-b068-42106c966b49
2026-03-25 16:33:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4c474d98-cccb-5fbf-b068-42106c966b49, skipping ID generation
2026-03-25 16:33:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4c474d98-cccb-5fbf-b068-42106c966b49 with scrape type 1
2026-03-25 16:33:22 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4c474d98-cccb-5fbf-b068-42106c966b49 sending to next pipeline
2026-03-25 16:33:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 4c474d98-cccb-5fbf-b068-42106c966b49, identifier: 1983619
2026-03-25 16:33:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc7d1bd0>
2026-03-25 16:33:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bce268a8-273a-5a1e-8706-946ac8db3862/bce268a8-273a-5a1e-8706-946ac8db3862_image_3.jpg HTTP/1.1" 201 0
2026-03-25 16:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr6%252F3fdc4b196fd840789c94643c58daa4f3%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr6/3fdc4b196fd840789c94643c58daa4f3/images/large/4.jpg saved to cache
2026-03-25 16:33:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item bce268a8-273a-5a1e-8706-946ac8db3862
2026-03-25 16:33:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc34d010>
2026-03-25 16:33:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bce268a8-273a-5a1e-8706-946ac8db3862/bce268a8-273a-5a1e-8706-946ac8db3862_image_4.jpg HTTP/1.1" 201 0
2026-03-25 16:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr6%252F3fdc4b196fd840789c94643c58daa4f3%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr6/3fdc4b196fd840789c94643c58daa4f3/images/large/5.jpg saved to cache
2026-03-25 16:33:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item bce268a8-273a-5a1e-8706-946ac8db3862
2026-03-25 16:33:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34d74cdc90>
2026-03-25 16:33:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bce268a8-273a-5a1e-8706-946ac8db3862/bce268a8-273a-5a1e-8706-946ac8db3862_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr6%252F3fdc4b196fd840789c94643c58daa4f3%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr6/3fdc4b196fd840789c94643c58daa4f3/images/large/1.jpg saved to cache
2026-03-25 16:33:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bce268a8-273a-5a1e-8706-946ac8db3862
2026-03-25 16:33:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34d7d60910>
2026-03-25 16:33:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bce268a8-273a-5a1e-8706-946ac8db3862/bce268a8-273a-5a1e-8706-946ac8db3862_image_5.jpg HTTP/1.1" 201 0
2026-03-25 16:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr6%252F3fdc4b196fd840789c94643c58daa4f3%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr6/3fdc4b196fd840789c94643c58daa4f3/images/large/6.jpg saved to cache
2026-03-25 16:33:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item bce268a8-273a-5a1e-8706-946ac8db3862
2026-03-25 16:33:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 4c474d98-cccb-5fbf-b068-42106c966b49 with identifier: 1983619
2026-03-25 16:33:22 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:33:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 4c474d98-cccb-5fbf-b068-42106c966b49 with identifier: 1983619
2026-03-25 16:33:22 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 4c474d98-cccb-5fbf-b068-42106c966b49 with identifier: 1983619 to the API
2026-03-25 16:33:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:33:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:33:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gh6/2db0980c609a4a65869ed93e19806416/images/large/9.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Bianco pastello',
'currency': 'EUR',
'doors_number': 4,
'engine': '1.6L',
'expiration_date': '2026-03-27T09:30:00Z',
'fuel_type': 'diesel',
'id': '4c474d98-cccb-5fbf-b068-42106c966b49',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41025',
'listing': 'auction',
'location': None,
'make': 'FIAT',
'model': 'FIAT DOBLÃ’ CARGO MAXI LH1 LOUNGE 1.6 Mjet 105cv E6D-f S&S Vettura '
'Furgonata 4-door (Euro 6D)',
'odometer': 207981,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 35,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c474d98-cccb-5fbf-b068-42106c966b49/4c474d98-cccb-5fbf-b068-42106c966b49_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 649940,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh6/2db0980c609a4a65869ed93e19806416/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c474d98-cccb-5fbf-b068-42106c966b49/4c474d98-cccb-5fbf-b068-42106c966b49_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 649940,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh6/2db0980c609a4a65869ed93e19806416/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c474d98-cccb-5fbf-b068-42106c966b49/4c474d98-cccb-5fbf-b068-42106c966b49_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 678141,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh6/2db0980c609a4a65869ed93e19806416/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c474d98-cccb-5fbf-b068-42106c966b49/4c474d98-cccb-5fbf-b068-42106c966b49_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 577211,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh6/2db0980c609a4a65869ed93e19806416/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c474d98-cccb-5fbf-b068-42106c966b49/4c474d98-cccb-5fbf-b068-42106c966b49_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 568777,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh6/2db0980c609a4a65869ed93e19806416/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c474d98-cccb-5fbf-b068-42106c966b49/4c474d98-cccb-5fbf-b068-42106c966b49_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 558525,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh6/2db0980c609a4a65869ed93e19806416/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c474d98-cccb-5fbf-b068-42106c966b49/4c474d98-cccb-5fbf-b068-42106c966b49_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 440316,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh6/2db0980c609a4a65869ed93e19806416/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c474d98-cccb-5fbf-b068-42106c966b49/4c474d98-cccb-5fbf-b068-42106c966b49_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 483723,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh6/2db0980c609a4a65869ed93e19806416/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c474d98-cccb-5fbf-b068-42106c966b49/4c474d98-cccb-5fbf-b068-42106c966b49_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 570978,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh6/2db0980c609a4a65869ed93e19806416/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c474d98-cccb-5fbf-b068-42106c966b49/4c474d98-cccb-5fbf-b068-42106c966b49_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 459505,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh6/2db0980c609a4a65869ed93e19806416/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-01-10',
'seats_number': 5,
'seller_name': None,
'title': 'FIAT FIAT DOBLÃ’ CARGO MAXI LH1 LOUNGE 1.6 Mjet 105cv E6D-f S&S '
'Vettura Furgonata 4-door (Euro 6D) -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-25 16:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983619%27 HTTP/1.1" 200 None
2026-03-25 16:33:23 [ayvens.it] INFO: Saving data for 1983619: {'created_time': 1774456403.293341, 'last_price_update_time': 1774456403.293351, 'auction_closing_time': 1774603800.0}
2026-03-25 16:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1983619') HTTP/1.1" 204 0
2026-03-25 16:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg6%252F51b29edad358416cbc39c3ff6cb87881%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg6/51b29edad358416cbc39c3ff6cb87881/images/large/3.jpg not downloaded yet
2026-03-25 16:33:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl9/5eb47c0ca41242638cdb8b1659971e9f/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg6%252F51b29edad358416cbc39c3ff6cb87881%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg6/51b29edad358416cbc39c3ff6cb87881/images/large/4.jpg not downloaded yet
2026-03-25 16:33:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl9/5eb47c0ca41242638cdb8b1659971e9f/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl9/5eb47c0ca41242638cdb8b1659971e9f/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg6%252F51b29edad358416cbc39c3ff6cb87881%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg6/51b29edad358416cbc39c3ff6cb87881/images/large/5.jpg not downloaded yet
2026-03-25 16:33:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl9/5eb47c0ca41242638cdb8b1659971e9f/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl9/5eb47c0ca41242638cdb8b1659971e9f/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fr6/3fdc4b196fd840789c94643c58daa4f3/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl9/5eb47c0ca41242638cdb8b1659971e9f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg6%252F51b29edad358416cbc39c3ff6cb87881%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg6/51b29edad358416cbc39c3ff6cb87881/images/large/6.jpg not downloaded yet
2026-03-25 16:33:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fr6/3fdc4b196fd840789c94643c58daa4f3/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg6%252F51b29edad358416cbc39c3ff6cb87881%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg6/51b29edad358416cbc39c3ff6cb87881/images/large/7.jpg not downloaded yet
2026-03-25 16:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg6%252F51b29edad358416cbc39c3ff6cb87881%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg6/51b29edad358416cbc39c3ff6cb87881/images/large/8.jpg not downloaded yet
2026-03-25 16:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg6%252F51b29edad358416cbc39c3ff6cb87881%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg6/51b29edad358416cbc39c3ff6cb87881/images/large/9.jpg not downloaded yet
2026-03-25 16:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg6%252F51b29edad358416cbc39c3ff6cb87881%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg6/51b29edad358416cbc39c3ff6cb87881/images/large/10.jpg not downloaded yet
2026-03-25 16:33:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc906c90>
2026-03-25 16:33:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95217f32-f9d7-5868-b63d-86254a35ea78/95217f32-f9d7-5868-b63d-86254a35ea78_image_5.jpg HTTP/1.1" 201 0
2026-03-25 16:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl9%252F5eb47c0ca41242638cdb8b1659971e9f%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl9/5eb47c0ca41242638cdb8b1659971e9f/images/large/6.jpg saved to cache
2026-03-25 16:33:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 95217f32-f9d7-5868-b63d-86254a35ea78
2026-03-25 16:33:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc7656d0>
2026-03-25 16:33:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95217f32-f9d7-5868-b63d-86254a35ea78/95217f32-f9d7-5868-b63d-86254a35ea78_image_3.jpg HTTP/1.1" 201 0
2026-03-25 16:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl9%252F5eb47c0ca41242638cdb8b1659971e9f%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl9/5eb47c0ca41242638cdb8b1659971e9f/images/large/4.jpg saved to cache
2026-03-25 16:33:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 95217f32-f9d7-5868-b63d-86254a35ea78
2026-03-25 16:33:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc928a50>
2026-03-25 16:33:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95217f32-f9d7-5868-b63d-86254a35ea78/95217f32-f9d7-5868-b63d-86254a35ea78_image_2.jpg HTTP/1.1" 201 0
2026-03-25 16:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl9%252F5eb47c0ca41242638cdb8b1659971e9f%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl9/5eb47c0ca41242638cdb8b1659971e9f/images/large/3.jpg saved to cache
2026-03-25 16:33:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 95217f32-f9d7-5868-b63d-86254a35ea78
2026-03-25 16:33:23 [ayvens.it] INFO: Found listing with ID: 1983624
2026-03-25 16:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983624%27 HTTP/1.1" 200 None
2026-03-25 16:33:23 [ayvens.it] INFO: Scrape type for 1983624: 1
2026-03-25 16:33:23 [ayvens.it] INFO: Extracting data for car ID: 1983624
2026-03-25 16:33:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 454e79ed-e4ef-57c3-8a76-dde56cc48ce6 with identifier: 1983624
2026-03-25 16:33:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 454e79ed-e4ef-57c3-8a76-dde56cc48ce6 with scrape type 1
2026-03-25 16:33:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 454e79ed-e4ef-57c3-8a76-dde56cc48ce6
2026-03-25 16:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd9%252F550a805a5c44465fb82fa126ddcf4bc6%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd9/550a805a5c44465fb82fa126ddcf4bc6/images/large/1.jpg not downloaded yet
2026-03-25 16:33:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg1/0012bd9b17724fa4ae7e969cb4721d11/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd9%252F550a805a5c44465fb82fa126ddcf4bc6%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd9/550a805a5c44465fb82fa126ddcf4bc6/images/large/2.jpg not downloaded yet
2026-03-25 16:33:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34de160610>
2026-03-25 16:33:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95217f32-f9d7-5868-b63d-86254a35ea78/95217f32-f9d7-5868-b63d-86254a35ea78_image_1.jpg HTTP/1.1" 201 0
2026-03-25 16:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl9%252F5eb47c0ca41242638cdb8b1659971e9f%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl9/5eb47c0ca41242638cdb8b1659971e9f/images/large/2.jpg saved to cache
2026-03-25 16:33:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 95217f32-f9d7-5868-b63d-86254a35ea78
2026-03-25 16:33:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc5884d0>
2026-03-25 16:33:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95217f32-f9d7-5868-b63d-86254a35ea78/95217f32-f9d7-5868-b63d-86254a35ea78_image_4.jpg HTTP/1.1" 201 0
2026-03-25 16:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl9%252F5eb47c0ca41242638cdb8b1659971e9f%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl9/5eb47c0ca41242638cdb8b1659971e9f/images/large/5.jpg saved to cache
2026-03-25 16:33:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 95217f32-f9d7-5868-b63d-86254a35ea78
2026-03-25 16:33:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcc1a190>
2026-03-25 16:33:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bce268a8-273a-5a1e-8706-946ac8db3862/bce268a8-273a-5a1e-8706-946ac8db3862_image_9.jpg HTTP/1.1" 201 0
2026-03-25 16:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr6%252F3fdc4b196fd840789c94643c58daa4f3%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr6/3fdc4b196fd840789c94643c58daa4f3/images/large/10.jpg saved to cache
2026-03-25 16:33:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item bce268a8-273a-5a1e-8706-946ac8db3862
2026-03-25 16:33:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc34c7d0>
2026-03-25 16:33:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95217f32-f9d7-5868-b63d-86254a35ea78/95217f32-f9d7-5868-b63d-86254a35ea78_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl9%252F5eb47c0ca41242638cdb8b1659971e9f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl9/5eb47c0ca41242638cdb8b1659971e9f/images/large/1.jpg saved to cache
2026-03-25 16:33:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 95217f32-f9d7-5868-b63d-86254a35ea78
2026-03-25 16:33:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc76c690>
2026-03-25 16:33:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bce268a8-273a-5a1e-8706-946ac8db3862/bce268a8-273a-5a1e-8706-946ac8db3862_image_8.jpg HTTP/1.1" 201 0
2026-03-25 16:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr6%252F3fdc4b196fd840789c94643c58daa4f3%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr6/3fdc4b196fd840789c94643c58daa4f3/images/large/9.jpg saved to cache
2026-03-25 16:33:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item bce268a8-273a-5a1e-8706-946ac8db3862
2026-03-25 16:33:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg1/0012bd9b17724fa4ae7e969cb4721d11/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd9%252F550a805a5c44465fb82fa126ddcf4bc6%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd9/550a805a5c44465fb82fa126ddcf4bc6/images/large/3.jpg not downloaded yet
2026-03-25 16:33:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg1/0012bd9b17724fa4ae7e969cb4721d11/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg1/0012bd9b17724fa4ae7e969cb4721d11/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd9%252F550a805a5c44465fb82fa126ddcf4bc6%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd9/550a805a5c44465fb82fa126ddcf4bc6/images/large/4.jpg not downloaded yet
2026-03-25 16:33:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg1/0012bd9b17724fa4ae7e969cb4721d11/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc8d7190>
2026-03-25 16:33:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc6f7d34-d2f5-5554-be9d-90ec57e1a887/fc6f7d34-d2f5-5554-be9d-90ec57e1a887_image_3.jpg HTTP/1.1" 201 0
2026-03-25 16:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg1%252F0012bd9b17724fa4ae7e969cb4721d11%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg1/0012bd9b17724fa4ae7e969cb4721d11/images/large/4.jpg saved to cache
2026-03-25 16:33:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item fc6f7d34-d2f5-5554-be9d-90ec57e1a887
2026-03-25 16:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd9%252F550a805a5c44465fb82fa126ddcf4bc6%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd9/550a805a5c44465fb82fa126ddcf4bc6/images/large/5.jpg not downloaded yet
2026-03-25 16:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd9%252F550a805a5c44465fb82fa126ddcf4bc6%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd9/550a805a5c44465fb82fa126ddcf4bc6/images/large/6.jpg not downloaded yet
2026-03-25 16:33:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg1/0012bd9b17724fa4ae7e969cb4721d11/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg1/0012bd9b17724fa4ae7e969cb4721d11/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd9%252F550a805a5c44465fb82fa126ddcf4bc6%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd9/550a805a5c44465fb82fa126ddcf4bc6/images/large/7.jpg not downloaded yet
2026-03-25 16:33:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc5be7d0>
2026-03-25 16:33:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc6f7d34-d2f5-5554-be9d-90ec57e1a887/fc6f7d34-d2f5-5554-be9d-90ec57e1a887_image_9.jpg HTTP/1.1" 201 0
2026-03-25 16:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg1%252F0012bd9b17724fa4ae7e969cb4721d11%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg1/0012bd9b17724fa4ae7e969cb4721d11/images/large/10.jpg saved to cache
2026-03-25 16:33:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item fc6f7d34-d2f5-5554-be9d-90ec57e1a887
2026-03-25 16:33:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc5be950>
2026-03-25 16:33:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc6f7d34-d2f5-5554-be9d-90ec57e1a887/fc6f7d34-d2f5-5554-be9d-90ec57e1a887_image_2.jpg HTTP/1.1" 201 0
2026-03-25 16:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg1%252F0012bd9b17724fa4ae7e969cb4721d11%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg1/0012bd9b17724fa4ae7e969cb4721d11/images/large/3.jpg saved to cache
2026-03-25 16:33:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item fc6f7d34-d2f5-5554-be9d-90ec57e1a887
2026-03-25 16:33:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc711050>
2026-03-25 16:33:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc6f7d34-d2f5-5554-be9d-90ec57e1a887/fc6f7d34-d2f5-5554-be9d-90ec57e1a887_image_6.jpg HTTP/1.1" 201 0
2026-03-25 16:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg1%252F0012bd9b17724fa4ae7e969cb4721d11%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg1/0012bd9b17724fa4ae7e969cb4721d11/images/large/7.jpg saved to cache
2026-03-25 16:33:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item fc6f7d34-d2f5-5554-be9d-90ec57e1a887
2026-03-25 16:33:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg1/0012bd9b17724fa4ae7e969cb4721d11/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd9%252F550a805a5c44465fb82fa126ddcf4bc6%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd9/550a805a5c44465fb82fa126ddcf4bc6/images/large/8.jpg not downloaded yet
2026-03-25 16:33:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc628a90>
2026-03-25 16:33:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc6f7d34-d2f5-5554-be9d-90ec57e1a887/fc6f7d34-d2f5-5554-be9d-90ec57e1a887_image_7.jpg HTTP/1.1" 201 0
2026-03-25 16:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg1%252F0012bd9b17724fa4ae7e969cb4721d11%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg1/0012bd9b17724fa4ae7e969cb4721d11/images/large/8.jpg saved to cache
2026-03-25 16:33:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item fc6f7d34-d2f5-5554-be9d-90ec57e1a887
2026-03-25 16:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd9%252F550a805a5c44465fb82fa126ddcf4bc6%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd9/550a805a5c44465fb82fa126ddcf4bc6/images/large/9.jpg not downloaded yet
2026-03-25 16:33:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcad94d0>
2026-03-25 16:33:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc6f7d34-d2f5-5554-be9d-90ec57e1a887/fc6f7d34-d2f5-5554-be9d-90ec57e1a887_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg1%252F0012bd9b17724fa4ae7e969cb4721d11%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg1/0012bd9b17724fa4ae7e969cb4721d11/images/large/1.jpg saved to cache
2026-03-25 16:33:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fc6f7d34-d2f5-5554-be9d-90ec57e1a887
2026-03-25 16:33:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dca97e10>
2026-03-25 16:33:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc6f7d34-d2f5-5554-be9d-90ec57e1a887/fc6f7d34-d2f5-5554-be9d-90ec57e1a887_image_8.jpg HTTP/1.1" 201 0
2026-03-25 16:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg1%252F0012bd9b17724fa4ae7e969cb4721d11%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg1/0012bd9b17724fa4ae7e969cb4721d11/images/large/9.jpg saved to cache
2026-03-25 16:33:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item fc6f7d34-d2f5-5554-be9d-90ec57e1a887
2026-03-25 16:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd9%252F550a805a5c44465fb82fa126ddcf4bc6%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd9/550a805a5c44465fb82fa126ddcf4bc6/images/large/10.jpg not downloaded yet
2026-03-25 16:33:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcaf6310>
2026-03-25 16:33:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc6f7d34-d2f5-5554-be9d-90ec57e1a887/fc6f7d34-d2f5-5554-be9d-90ec57e1a887_image_1.jpg HTTP/1.1" 201 0
2026-03-25 16:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg1%252F0012bd9b17724fa4ae7e969cb4721d11%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg1/0012bd9b17724fa4ae7e969cb4721d11/images/large/2.jpg saved to cache
2026-03-25 16:33:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item fc6f7d34-d2f5-5554-be9d-90ec57e1a887
2026-03-25 16:33:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg6/51b29edad358416cbc39c3ff6cb87881/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:25 [ayvens.it] INFO: Found listing with ID: 1983625
2026-03-25 16:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983625%27 HTTP/1.1" 200 None
2026-03-25 16:33:25 [ayvens.it] INFO: Scrape type for 1983625: 1
2026-03-25 16:33:25 [ayvens.it] INFO: Extracting data for car ID: 1983625
2026-03-25 16:33:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8e2d6e5b-fb6b-559f-81a9-c47f5fb5a609 with identifier: 1983625
2026-03-25 16:33:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8e2d6e5b-fb6b-559f-81a9-c47f5fb5a609 with scrape type 1
2026-03-25 16:33:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8e2d6e5b-fb6b-559f-81a9-c47f5fb5a609
2026-03-25 16:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl4%252F25ae0912f8cd497189bd7ed0ba2ec4ef%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl4/25ae0912f8cd497189bd7ed0ba2ec4ef/images/large/1.jpg not downloaded yet
2026-03-25 16:33:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg6/51b29edad358416cbc39c3ff6cb87881/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl4%252F25ae0912f8cd497189bd7ed0ba2ec4ef%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl4/25ae0912f8cd497189bd7ed0ba2ec4ef/images/large/2.jpg not downloaded yet
2026-03-25 16:33:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg6/51b29edad358416cbc39c3ff6cb87881/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg6/51b29edad358416cbc39c3ff6cb87881/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl4%252F25ae0912f8cd497189bd7ed0ba2ec4ef%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl4/25ae0912f8cd497189bd7ed0ba2ec4ef/images/large/3.jpg not downloaded yet
2026-03-25 16:33:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd9/550a805a5c44465fb82fa126ddcf4bc6/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg6/51b29edad358416cbc39c3ff6cb87881/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl4%252F25ae0912f8cd497189bd7ed0ba2ec4ef%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl4/25ae0912f8cd497189bd7ed0ba2ec4ef/images/large/4.jpg not downloaded yet
2026-03-25 16:33:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg6/51b29edad358416cbc39c3ff6cb87881/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg6/51b29edad358416cbc39c3ff6cb87881/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl4%252F25ae0912f8cd497189bd7ed0ba2ec4ef%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl4/25ae0912f8cd497189bd7ed0ba2ec4ef/images/large/5.jpg not downloaded yet
2026-03-25 16:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl4%252F25ae0912f8cd497189bd7ed0ba2ec4ef%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl4/25ae0912f8cd497189bd7ed0ba2ec4ef/images/large/6.jpg not downloaded yet
2026-03-25 16:33:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcb2fdd0>
2026-03-25 16:33:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38f59106-c5da-55a8-b129-c35e036bbc57/38f59106-c5da-55a8-b129-c35e036bbc57_image_2.jpg HTTP/1.1" 201 0
2026-03-25 16:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg6%252F51b29edad358416cbc39c3ff6cb87881%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg6/51b29edad358416cbc39c3ff6cb87881/images/large/3.jpg saved to cache
2026-03-25 16:33:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 38f59106-c5da-55a8-b129-c35e036bbc57
2026-03-25 16:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl4%252F25ae0912f8cd497189bd7ed0ba2ec4ef%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl4/25ae0912f8cd497189bd7ed0ba2ec4ef/images/large/7.jpg not downloaded yet
2026-03-25 16:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl4%252F25ae0912f8cd497189bd7ed0ba2ec4ef%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl4/25ae0912f8cd497189bd7ed0ba2ec4ef/images/large/8.jpg not downloaded yet
2026-03-25 16:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl4%252F25ae0912f8cd497189bd7ed0ba2ec4ef%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl4/25ae0912f8cd497189bd7ed0ba2ec4ef/images/large/9.jpg not downloaded yet
2026-03-25 16:33:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc91f710>
2026-03-25 16:33:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38f59106-c5da-55a8-b129-c35e036bbc57/38f59106-c5da-55a8-b129-c35e036bbc57_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg6%252F51b29edad358416cbc39c3ff6cb87881%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg6/51b29edad358416cbc39c3ff6cb87881/images/large/1.jpg saved to cache
2026-03-25 16:33:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 38f59106-c5da-55a8-b129-c35e036bbc57
2026-03-25 16:33:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcb1fa90>
2026-03-25 16:33:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38f59106-c5da-55a8-b129-c35e036bbc57/38f59106-c5da-55a8-b129-c35e036bbc57_image_3.jpg HTTP/1.1" 201 0
2026-03-25 16:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg6%252F51b29edad358416cbc39c3ff6cb87881%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg6/51b29edad358416cbc39c3ff6cb87881/images/large/4.jpg saved to cache
2026-03-25 16:33:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 38f59106-c5da-55a8-b129-c35e036bbc57
2026-03-25 16:33:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34de457990>
2026-03-25 16:33:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38f59106-c5da-55a8-b129-c35e036bbc57/38f59106-c5da-55a8-b129-c35e036bbc57_image_1.jpg HTTP/1.1" 201 0
2026-03-25 16:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg6%252F51b29edad358416cbc39c3ff6cb87881%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg6/51b29edad358416cbc39c3ff6cb87881/images/large/2.jpg saved to cache
2026-03-25 16:33:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 38f59106-c5da-55a8-b129-c35e036bbc57
2026-03-25 16:33:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc942e90>
2026-03-25 16:33:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_454e79ed-e4ef-57c3-8a76-dde56cc48ce6/454e79ed-e4ef-57c3-8a76-dde56cc48ce6_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd9%252F550a805a5c44465fb82fa126ddcf4bc6%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd9/550a805a5c44465fb82fa126ddcf4bc6/images/large/1.jpg saved to cache
2026-03-25 16:33:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 454e79ed-e4ef-57c3-8a76-dde56cc48ce6
2026-03-25 16:33:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc53fb10>
2026-03-25 16:33:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38f59106-c5da-55a8-b129-c35e036bbc57/38f59106-c5da-55a8-b129-c35e036bbc57_image_9.jpg HTTP/1.1" 201 0
2026-03-25 16:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg6%252F51b29edad358416cbc39c3ff6cb87881%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg6/51b29edad358416cbc39c3ff6cb87881/images/large/10.jpg saved to cache
2026-03-25 16:33:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 38f59106-c5da-55a8-b129-c35e036bbc57
2026-03-25 16:33:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc309210>
2026-03-25 16:33:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38f59106-c5da-55a8-b129-c35e036bbc57/38f59106-c5da-55a8-b129-c35e036bbc57_image_8.jpg HTTP/1.1" 201 0
2026-03-25 16:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg6%252F51b29edad358416cbc39c3ff6cb87881%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg6/51b29edad358416cbc39c3ff6cb87881/images/large/9.jpg saved to cache
2026-03-25 16:33:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 38f59106-c5da-55a8-b129-c35e036bbc57
2026-03-25 16:33:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34d742c3d0>
2026-03-25 16:33:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38f59106-c5da-55a8-b129-c35e036bbc57/38f59106-c5da-55a8-b129-c35e036bbc57_image_7.jpg HTTP/1.1" 201 0
2026-03-25 16:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg6%252F51b29edad358416cbc39c3ff6cb87881%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg6/51b29edad358416cbc39c3ff6cb87881/images/large/8.jpg saved to cache
2026-03-25 16:33:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 38f59106-c5da-55a8-b129-c35e036bbc57
2026-03-25 16:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl4%252F25ae0912f8cd497189bd7ed0ba2ec4ef%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl4/25ae0912f8cd497189bd7ed0ba2ec4ef/images/large/10.jpg not downloaded yet
2026-03-25 16:33:26 [ayvens.it] INFO: Found listing with ID: 1983626
2026-03-25 16:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983626%27 HTTP/1.1" 200 None
2026-03-25 16:33:26 [ayvens.it] INFO: Scrape type for 1983626: 1
2026-03-25 16:33:26 [ayvens.it] INFO: Extracting data for car ID: 1983626
2026-03-25 16:33:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f546f75c-0089-5ab2-8797-45d810f1df9d with identifier: 1983626
2026-03-25 16:33:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f546f75c-0089-5ab2-8797-45d810f1df9d with scrape type 1
2026-03-25 16:33:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f546f75c-0089-5ab2-8797-45d810f1df9d
2026-03-25 16:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs9%252F18426bbc778648bd901230c8baae5eff%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs9/18426bbc778648bd901230c8baae5eff/images/large/1.jpg not downloaded yet
2026-03-25 16:33:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg6/51b29edad358416cbc39c3ff6cb87881/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs9%252F18426bbc778648bd901230c8baae5eff%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs9/18426bbc778648bd901230c8baae5eff/images/large/2.jpg not downloaded yet
2026-03-25 16:33:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd9/550a805a5c44465fb82fa126ddcf4bc6/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd9/550a805a5c44465fb82fa126ddcf4bc6/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs9%252F18426bbc778648bd901230c8baae5eff%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs9/18426bbc778648bd901230c8baae5eff/images/large/3.jpg not downloaded yet
2026-03-25 16:33:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd9/550a805a5c44465fb82fa126ddcf4bc6/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg6/51b29edad358416cbc39c3ff6cb87881/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd9/550a805a5c44465fb82fa126ddcf4bc6/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd9/550a805a5c44465fb82fa126ddcf4bc6/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs9%252F18426bbc778648bd901230c8baae5eff%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs9/18426bbc778648bd901230c8baae5eff/images/large/4.jpg not downloaded yet
2026-03-25 16:33:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg6/51b29edad358416cbc39c3ff6cb87881/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs9%252F18426bbc778648bd901230c8baae5eff%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs9/18426bbc778648bd901230c8baae5eff/images/large/5.jpg not downloaded yet
2026-03-25 16:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs9%252F18426bbc778648bd901230c8baae5eff%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs9/18426bbc778648bd901230c8baae5eff/images/large/6.jpg not downloaded yet
2026-03-25 16:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs9%252F18426bbc778648bd901230c8baae5eff%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs9/18426bbc778648bd901230c8baae5eff/images/large/7.jpg not downloaded yet
2026-03-25 16:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs9%252F18426bbc778648bd901230c8baae5eff%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs9/18426bbc778648bd901230c8baae5eff/images/large/8.jpg not downloaded yet
2026-03-25 16:33:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34de4575d0>
2026-03-25 16:33:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38f59106-c5da-55a8-b129-c35e036bbc57/38f59106-c5da-55a8-b129-c35e036bbc57_image_6.jpg HTTP/1.1" 201 0
2026-03-25 16:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg6%252F51b29edad358416cbc39c3ff6cb87881%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg6/51b29edad358416cbc39c3ff6cb87881/images/large/7.jpg saved to cache
2026-03-25 16:33:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 38f59106-c5da-55a8-b129-c35e036bbc57
2026-03-25 16:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs9%252F18426bbc778648bd901230c8baae5eff%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs9/18426bbc778648bd901230c8baae5eff/images/large/9.jpg not downloaded yet
2026-03-25 16:33:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc940250>
2026-03-25 16:33:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_454e79ed-e4ef-57c3-8a76-dde56cc48ce6/454e79ed-e4ef-57c3-8a76-dde56cc48ce6_image_6.jpg HTTP/1.1" 201 0
2026-03-25 16:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd9%252F550a805a5c44465fb82fa126ddcf4bc6%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd9/550a805a5c44465fb82fa126ddcf4bc6/images/large/7.jpg saved to cache
2026-03-25 16:33:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 454e79ed-e4ef-57c3-8a76-dde56cc48ce6
2026-03-25 16:33:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34de4553d0>
2026-03-25 16:33:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_454e79ed-e4ef-57c3-8a76-dde56cc48ce6/454e79ed-e4ef-57c3-8a76-dde56cc48ce6_image_1.jpg HTTP/1.1" 201 0
2026-03-25 16:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd9%252F550a805a5c44465fb82fa126ddcf4bc6%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd9/550a805a5c44465fb82fa126ddcf4bc6/images/large/2.jpg saved to cache
2026-03-25 16:33:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 454e79ed-e4ef-57c3-8a76-dde56cc48ce6
2026-03-25 16:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs9%252F18426bbc778648bd901230c8baae5eff%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs9/18426bbc778648bd901230c8baae5eff/images/large/10.jpg not downloaded yet
2026-03-25 16:33:26 [ayvens.it] INFO: Found listing with ID: 1983627
2026-03-25 16:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983627%27 HTTP/1.1" 200 None
2026-03-25 16:33:26 [ayvens.it] INFO: Scrape type for 1983627: 1
2026-03-25 16:33:26 [ayvens.it] INFO: Extracting data for car ID: 1983627
2026-03-25 16:33:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fe7a7a81-f812-55d1-b287-e9ac51e6562b with identifier: 1983627
2026-03-25 16:33:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fe7a7a81-f812-55d1-b287-e9ac51e6562b with scrape type 1
2026-03-25 16:33:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item fe7a7a81-f812-55d1-b287-e9ac51e6562b
2026-03-25 16:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm2%252Fbaf415c092c24cd79c96f548a2af1c5e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm2/baf415c092c24cd79c96f548a2af1c5e/images/large/1.jpg not downloaded yet
2026-03-25 16:33:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc9c2bd0>
2026-03-25 16:33:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_454e79ed-e4ef-57c3-8a76-dde56cc48ce6/454e79ed-e4ef-57c3-8a76-dde56cc48ce6_image_4.jpg HTTP/1.1" 201 0
2026-03-25 16:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd9%252F550a805a5c44465fb82fa126ddcf4bc6%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd9/550a805a5c44465fb82fa126ddcf4bc6/images/large/5.jpg saved to cache
2026-03-25 16:33:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 454e79ed-e4ef-57c3-8a76-dde56cc48ce6
2026-03-25 16:33:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc34cb10>
2026-03-25 16:33:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38f59106-c5da-55a8-b129-c35e036bbc57/38f59106-c5da-55a8-b129-c35e036bbc57_image_5.jpg HTTP/1.1" 201 0
2026-03-25 16:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg6%252F51b29edad358416cbc39c3ff6cb87881%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg6/51b29edad358416cbc39c3ff6cb87881/images/large/6.jpg saved to cache
2026-03-25 16:33:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 38f59106-c5da-55a8-b129-c35e036bbc57
2026-03-25 16:33:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc87ab10>
2026-03-25 16:33:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_454e79ed-e4ef-57c3-8a76-dde56cc48ce6/454e79ed-e4ef-57c3-8a76-dde56cc48ce6_image_2.jpg HTTP/1.1" 201 0
2026-03-25 16:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd9%252F550a805a5c44465fb82fa126ddcf4bc6%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd9/550a805a5c44465fb82fa126ddcf4bc6/images/large/3.jpg saved to cache
2026-03-25 16:33:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 454e79ed-e4ef-57c3-8a76-dde56cc48ce6
2026-03-25 16:33:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcc4e4d0>
2026-03-25 16:33:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_454e79ed-e4ef-57c3-8a76-dde56cc48ce6/454e79ed-e4ef-57c3-8a76-dde56cc48ce6_image_5.jpg HTTP/1.1" 201 0
2026-03-25 16:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd9%252F550a805a5c44465fb82fa126ddcf4bc6%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd9/550a805a5c44465fb82fa126ddcf4bc6/images/large/6.jpg saved to cache
2026-03-25 16:33:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 454e79ed-e4ef-57c3-8a76-dde56cc48ce6
2026-03-25 16:33:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcb1fed0>
2026-03-25 16:33:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38f59106-c5da-55a8-b129-c35e036bbc57/38f59106-c5da-55a8-b129-c35e036bbc57_image_4.jpg HTTP/1.1" 201 0
2026-03-25 16:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg6%252F51b29edad358416cbc39c3ff6cb87881%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg6/51b29edad358416cbc39c3ff6cb87881/images/large/5.jpg saved to cache
2026-03-25 16:33:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 38f59106-c5da-55a8-b129-c35e036bbc57
2026-03-25 16:33:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 38f59106-c5da-55a8-b129-c35e036bbc57, skipping ID generation
2026-03-25 16:33:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 38f59106-c5da-55a8-b129-c35e036bbc57 with scrape type 1
2026-03-25 16:33:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 38f59106-c5da-55a8-b129-c35e036bbc57 sending to next pipeline
2026-03-25 16:33:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 38f59106-c5da-55a8-b129-c35e036bbc57, identifier: 1983623
2026-03-25 16:33:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 38f59106-c5da-55a8-b129-c35e036bbc57 with identifier: 1983623
2026-03-25 16:33:27 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:33:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 38f59106-c5da-55a8-b129-c35e036bbc57 with identifier: 1983623
2026-03-25 16:33:27 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 38f59106-c5da-55a8-b129-c35e036bbc57 with identifier: 1983623 to the API
2026-03-25 16:33:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:33:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:33:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gg6/51b29edad358416cbc39c3ff6cb87881/images/large/5.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'ICE WHITE PASTELLO',
'currency': 'EUR',
'doors_number': 3,
'engine': '',
'expiration_date': '2026-03-27T09:30:00Z',
'fuel_type': 'electric',
'id': '38f59106-c5da-55a8-b129-c35e036bbc57',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41025',
'listing': 'auction',
'location': None,
'make': 'FIAT',
'model': 'FIAT 500 Elettrica Icon Hatchback 3-door',
'odometer': 49495,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 35,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38f59106-c5da-55a8-b129-c35e036bbc57/38f59106-c5da-55a8-b129-c35e036bbc57_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 576177,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg6/51b29edad358416cbc39c3ff6cb87881/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38f59106-c5da-55a8-b129-c35e036bbc57/38f59106-c5da-55a8-b129-c35e036bbc57_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 673511,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg6/51b29edad358416cbc39c3ff6cb87881/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38f59106-c5da-55a8-b129-c35e036bbc57/38f59106-c5da-55a8-b129-c35e036bbc57_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 576177,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg6/51b29edad358416cbc39c3ff6cb87881/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38f59106-c5da-55a8-b129-c35e036bbc57/38f59106-c5da-55a8-b129-c35e036bbc57_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 654892,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg6/51b29edad358416cbc39c3ff6cb87881/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38f59106-c5da-55a8-b129-c35e036bbc57/38f59106-c5da-55a8-b129-c35e036bbc57_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 656673,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg6/51b29edad358416cbc39c3ff6cb87881/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38f59106-c5da-55a8-b129-c35e036bbc57/38f59106-c5da-55a8-b129-c35e036bbc57_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 489758,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg6/51b29edad358416cbc39c3ff6cb87881/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38f59106-c5da-55a8-b129-c35e036bbc57/38f59106-c5da-55a8-b129-c35e036bbc57_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 501083,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg6/51b29edad358416cbc39c3ff6cb87881/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38f59106-c5da-55a8-b129-c35e036bbc57/38f59106-c5da-55a8-b129-c35e036bbc57_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 626177,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg6/51b29edad358416cbc39c3ff6cb87881/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38f59106-c5da-55a8-b129-c35e036bbc57/38f59106-c5da-55a8-b129-c35e036bbc57_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 585496,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg6/51b29edad358416cbc39c3ff6cb87881/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38f59106-c5da-55a8-b129-c35e036bbc57/38f59106-c5da-55a8-b129-c35e036bbc57_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 505454,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg6/51b29edad358416cbc39c3ff6cb87881/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-09-23',
'seats_number': 5,
'seller_name': None,
'title': 'FIAT FIAT 500 Elettrica Icon Hatchback 3-door -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2021}
2026-03-25 16:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983623%27 HTTP/1.1" 200 None
2026-03-25 16:33:28 [ayvens.it] INFO: Saving data for 1983623: {'created_time': 1774456408.54186, 'last_price_update_time': 1774456408.541871, 'auction_closing_time': 1774603800.0}
2026-03-25 16:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1983623') HTTP/1.1" 204 0
2026-03-25 16:33:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl4/25ae0912f8cd497189bd7ed0ba2ec4ef/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm2%252Fbaf415c092c24cd79c96f548a2af1c5e%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm2/baf415c092c24cd79c96f548a2af1c5e/images/large/2.jpg not downloaded yet
2026-03-25 16:33:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd9/550a805a5c44465fb82fa126ddcf4bc6/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl4/25ae0912f8cd497189bd7ed0ba2ec4ef/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm2%252Fbaf415c092c24cd79c96f548a2af1c5e%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm2/baf415c092c24cd79c96f548a2af1c5e/images/large/3.jpg not downloaded yet
2026-03-25 16:33:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl4/25ae0912f8cd497189bd7ed0ba2ec4ef/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd9/550a805a5c44465fb82fa126ddcf4bc6/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl4/25ae0912f8cd497189bd7ed0ba2ec4ef/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm2%252Fbaf415c092c24cd79c96f548a2af1c5e%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm2/baf415c092c24cd79c96f548a2af1c5e/images/large/4.jpg not downloaded yet
2026-03-25 16:33:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd9/550a805a5c44465fb82fa126ddcf4bc6/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm2%252Fbaf415c092c24cd79c96f548a2af1c5e%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm2/baf415c092c24cd79c96f548a2af1c5e/images/large/5.jpg not downloaded yet
2026-03-25 16:33:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd9/550a805a5c44465fb82fa126ddcf4bc6/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm2%252Fbaf415c092c24cd79c96f548a2af1c5e%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm2/baf415c092c24cd79c96f548a2af1c5e/images/large/6.jpg not downloaded yet
2026-03-25 16:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm2%252Fbaf415c092c24cd79c96f548a2af1c5e%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm2/baf415c092c24cd79c96f548a2af1c5e/images/large/7.jpg not downloaded yet
2026-03-25 16:33:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34d6b58bd0>
2026-03-25 16:33:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e2d6e5b-fb6b-559f-81a9-c47f5fb5a609/8e2d6e5b-fb6b-559f-81a9-c47f5fb5a609_image_1.jpg HTTP/1.1" 201 0
2026-03-25 16:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl4%252F25ae0912f8cd497189bd7ed0ba2ec4ef%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl4/25ae0912f8cd497189bd7ed0ba2ec4ef/images/large/2.jpg saved to cache
2026-03-25 16:33:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8e2d6e5b-fb6b-559f-81a9-c47f5fb5a609
2026-03-25 16:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm2%252Fbaf415c092c24cd79c96f548a2af1c5e%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm2/baf415c092c24cd79c96f548a2af1c5e/images/large/8.jpg not downloaded yet
2026-03-25 16:33:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc9de5d0>
2026-03-25 16:33:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_454e79ed-e4ef-57c3-8a76-dde56cc48ce6/454e79ed-e4ef-57c3-8a76-dde56cc48ce6_image_9.jpg HTTP/1.1" 201 0
2026-03-25 16:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd9%252F550a805a5c44465fb82fa126ddcf4bc6%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd9/550a805a5c44465fb82fa126ddcf4bc6/images/large/10.jpg saved to cache
2026-03-25 16:33:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 454e79ed-e4ef-57c3-8a76-dde56cc48ce6
2026-03-25 16:33:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc968050>
2026-03-25 16:33:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e2d6e5b-fb6b-559f-81a9-c47f5fb5a609/8e2d6e5b-fb6b-559f-81a9-c47f5fb5a609_image_2.jpg HTTP/1.1" 201 0
2026-03-25 16:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl4%252F25ae0912f8cd497189bd7ed0ba2ec4ef%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl4/25ae0912f8cd497189bd7ed0ba2ec4ef/images/large/3.jpg saved to cache
2026-03-25 16:33:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8e2d6e5b-fb6b-559f-81a9-c47f5fb5a609
2026-03-25 16:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm2%252Fbaf415c092c24cd79c96f548a2af1c5e%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm2/baf415c092c24cd79c96f548a2af1c5e/images/large/9.jpg not downloaded yet
2026-03-25 16:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm2%252Fbaf415c092c24cd79c96f548a2af1c5e%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm2/baf415c092c24cd79c96f548a2af1c5e/images/large/10.jpg not downloaded yet
2026-03-25 16:33:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34d6b3ff50>
2026-03-25 16:33:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e2d6e5b-fb6b-559f-81a9-c47f5fb5a609/8e2d6e5b-fb6b-559f-81a9-c47f5fb5a609_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl4%252F25ae0912f8cd497189bd7ed0ba2ec4ef%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl4/25ae0912f8cd497189bd7ed0ba2ec4ef/images/large/1.jpg saved to cache
2026-03-25 16:33:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8e2d6e5b-fb6b-559f-81a9-c47f5fb5a609
2026-03-25 16:33:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc5539d0>
2026-03-25 16:33:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_454e79ed-e4ef-57c3-8a76-dde56cc48ce6/454e79ed-e4ef-57c3-8a76-dde56cc48ce6_image_7.jpg HTTP/1.1" 201 0
2026-03-25 16:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd9%252F550a805a5c44465fb82fa126ddcf4bc6%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd9/550a805a5c44465fb82fa126ddcf4bc6/images/large/8.jpg saved to cache
2026-03-25 16:33:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 454e79ed-e4ef-57c3-8a76-dde56cc48ce6
2026-03-25 16:33:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34d6b4ae90>
2026-03-25 16:33:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e2d6e5b-fb6b-559f-81a9-c47f5fb5a609/8e2d6e5b-fb6b-559f-81a9-c47f5fb5a609_image_6.jpg HTTP/1.1" 201 0
2026-03-25 16:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl4%252F25ae0912f8cd497189bd7ed0ba2ec4ef%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl4/25ae0912f8cd497189bd7ed0ba2ec4ef/images/large/7.jpg saved to cache
2026-03-25 16:33:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8e2d6e5b-fb6b-559f-81a9-c47f5fb5a609
2026-03-25 16:33:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc551c50>
2026-03-25 16:33:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_454e79ed-e4ef-57c3-8a76-dde56cc48ce6/454e79ed-e4ef-57c3-8a76-dde56cc48ce6_image_3.jpg HTTP/1.1" 201 0
2026-03-25 16:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd9%252F550a805a5c44465fb82fa126ddcf4bc6%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd9/550a805a5c44465fb82fa126ddcf4bc6/images/large/4.jpg saved to cache
2026-03-25 16:33:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 454e79ed-e4ef-57c3-8a76-dde56cc48ce6
2026-03-25 16:33:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc801710>
2026-03-25 16:33:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_454e79ed-e4ef-57c3-8a76-dde56cc48ce6/454e79ed-e4ef-57c3-8a76-dde56cc48ce6_image_8.jpg HTTP/1.1" 201 0
2026-03-25 16:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd9%252F550a805a5c44465fb82fa126ddcf4bc6%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd9/550a805a5c44465fb82fa126ddcf4bc6/images/large/9.jpg saved to cache
2026-03-25 16:33:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 454e79ed-e4ef-57c3-8a76-dde56cc48ce6
2026-03-25 16:33:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 454e79ed-e4ef-57c3-8a76-dde56cc48ce6, skipping ID generation
2026-03-25 16:33:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 454e79ed-e4ef-57c3-8a76-dde56cc48ce6 with scrape type 1
2026-03-25 16:33:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 454e79ed-e4ef-57c3-8a76-dde56cc48ce6 sending to next pipeline
2026-03-25 16:33:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 454e79ed-e4ef-57c3-8a76-dde56cc48ce6, identifier: 1983624
2026-03-25 16:33:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 454e79ed-e4ef-57c3-8a76-dde56cc48ce6 with identifier: 1983624
2026-03-25 16:33:29 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:33:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 454e79ed-e4ef-57c3-8a76-dde56cc48ce6 with identifier: 1983624
2026-03-25 16:33:29 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 454e79ed-e4ef-57c3-8a76-dde56cc48ce6 with identifier: 1983624 to the API
2026-03-25 16:33:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:33:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:33:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gd9/550a805a5c44465fb82fa126ddcf4bc6/images/large/9.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Unknown',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-27T09:30:00Z',
'fuel_type': 'petrol',
'id': '454e79ed-e4ef-57c3-8a76-dde56cc48ce6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41025',
'listing': 'auction',
'location': None,
'make': 'FORD',
'model': 'FORD PUMA 1.0 Ecoboost 125CV Titanium Auto Sport utility vehicle '
'5-door (Euro 6.2)',
'odometer': 63239,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 49,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_454e79ed-e4ef-57c3-8a76-dde56cc48ce6/454e79ed-e4ef-57c3-8a76-dde56cc48ce6_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 735199,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd9/550a805a5c44465fb82fa126ddcf4bc6/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_454e79ed-e4ef-57c3-8a76-dde56cc48ce6/454e79ed-e4ef-57c3-8a76-dde56cc48ce6_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 623057,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd9/550a805a5c44465fb82fa126ddcf4bc6/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_454e79ed-e4ef-57c3-8a76-dde56cc48ce6/454e79ed-e4ef-57c3-8a76-dde56cc48ce6_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 580360,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd9/550a805a5c44465fb82fa126ddcf4bc6/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_454e79ed-e4ef-57c3-8a76-dde56cc48ce6/454e79ed-e4ef-57c3-8a76-dde56cc48ce6_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 726467,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd9/550a805a5c44465fb82fa126ddcf4bc6/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_454e79ed-e4ef-57c3-8a76-dde56cc48ce6/454e79ed-e4ef-57c3-8a76-dde56cc48ce6_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 536336,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd9/550a805a5c44465fb82fa126ddcf4bc6/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_454e79ed-e4ef-57c3-8a76-dde56cc48ce6/454e79ed-e4ef-57c3-8a76-dde56cc48ce6_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 576165,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd9/550a805a5c44465fb82fa126ddcf4bc6/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_454e79ed-e4ef-57c3-8a76-dde56cc48ce6/454e79ed-e4ef-57c3-8a76-dde56cc48ce6_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 671390,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd9/550a805a5c44465fb82fa126ddcf4bc6/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_454e79ed-e4ef-57c3-8a76-dde56cc48ce6/454e79ed-e4ef-57c3-8a76-dde56cc48ce6_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 579687,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd9/550a805a5c44465fb82fa126ddcf4bc6/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_454e79ed-e4ef-57c3-8a76-dde56cc48ce6/454e79ed-e4ef-57c3-8a76-dde56cc48ce6_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 695767,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd9/550a805a5c44465fb82fa126ddcf4bc6/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_454e79ed-e4ef-57c3-8a76-dde56cc48ce6/454e79ed-e4ef-57c3-8a76-dde56cc48ce6_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 555322,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd9/550a805a5c44465fb82fa126ddcf4bc6/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-12-02',
'seats_number': 5,
'seller_name': None,
'title': 'FORD FORD PUMA 1.0 Ecoboost 125CV Titanium Auto Sport utility '
'vehicle 5-door (Euro 6.2) -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2020}
2026-03-25 16:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983624%27 HTTP/1.1" 200 None
2026-03-25 16:33:30 [ayvens.it] INFO: Saving data for 1983624: {'created_time': 1774456410.190702, 'last_price_update_time': 1774456410.190713, 'auction_closing_time': 1774603800.0}
2026-03-25 16:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1983624') HTTP/1.1" 204 0
2026-03-25 16:33:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs9/18426bbc778648bd901230c8baae5eff/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:30 [ayvens.it] INFO: Found listing with ID: 1983628
2026-03-25 16:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983628%27 HTTP/1.1" 200 None
2026-03-25 16:33:30 [ayvens.it] INFO: Scrape type for 1983628: 1
2026-03-25 16:33:30 [ayvens.it] INFO: Extracting data for car ID: 1983628
2026-03-25 16:33:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 768842fb-9be4-5959-9a92-2aa6e3018e75 with identifier: 1983628
2026-03-25 16:33:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 768842fb-9be4-5959-9a92-2aa6e3018e75 with scrape type 1
2026-03-25 16:33:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 768842fb-9be4-5959-9a92-2aa6e3018e75
2026-03-25 16:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs4%252Ff40c7b979cfc47ffaf217c6d58a47b86%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs4/f40c7b979cfc47ffaf217c6d58a47b86/images/large/1.jpg not downloaded yet
2026-03-25 16:33:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl4/25ae0912f8cd497189bd7ed0ba2ec4ef/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl4/25ae0912f8cd497189bd7ed0ba2ec4ef/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs4%252Ff40c7b979cfc47ffaf217c6d58a47b86%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs4/f40c7b979cfc47ffaf217c6d58a47b86/images/large/2.jpg not downloaded yet
2026-03-25 16:33:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs9/18426bbc778648bd901230c8baae5eff/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl4/25ae0912f8cd497189bd7ed0ba2ec4ef/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl4/25ae0912f8cd497189bd7ed0ba2ec4ef/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs4%252Ff40c7b979cfc47ffaf217c6d58a47b86%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs4/f40c7b979cfc47ffaf217c6d58a47b86/images/large/3.jpg not downloaded yet
2026-03-25 16:33:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs9/18426bbc778648bd901230c8baae5eff/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs4%252Ff40c7b979cfc47ffaf217c6d58a47b86%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs4/f40c7b979cfc47ffaf217c6d58a47b86/images/large/4.jpg not downloaded yet
2026-03-25 16:33:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcadbb10>
2026-03-25 16:33:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f546f75c-0089-5ab2-8797-45d810f1df9d/f546f75c-0089-5ab2-8797-45d810f1df9d_image_1.jpg HTTP/1.1" 201 0
2026-03-25 16:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs9%252F18426bbc778648bd901230c8baae5eff%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs9/18426bbc778648bd901230c8baae5eff/images/large/2.jpg saved to cache
2026-03-25 16:33:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f546f75c-0089-5ab2-8797-45d810f1df9d
2026-03-25 16:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs4%252Ff40c7b979cfc47ffaf217c6d58a47b86%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs4/f40c7b979cfc47ffaf217c6d58a47b86/images/large/5.jpg not downloaded yet
2026-03-25 16:33:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs9/18426bbc778648bd901230c8baae5eff/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs4%252Ff40c7b979cfc47ffaf217c6d58a47b86%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs4/f40c7b979cfc47ffaf217c6d58a47b86/images/large/6.jpg not downloaded yet
2026-03-25 16:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs4%252Ff40c7b979cfc47ffaf217c6d58a47b86%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs4/f40c7b979cfc47ffaf217c6d58a47b86/images/large/7.jpg not downloaded yet
2026-03-25 16:33:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc60fed0>
2026-03-25 16:33:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e2d6e5b-fb6b-559f-81a9-c47f5fb5a609/8e2d6e5b-fb6b-559f-81a9-c47f5fb5a609_image_9.jpg HTTP/1.1" 201 0
2026-03-25 16:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl4%252F25ae0912f8cd497189bd7ed0ba2ec4ef%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl4/25ae0912f8cd497189bd7ed0ba2ec4ef/images/large/10.jpg saved to cache
2026-03-25 16:33:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8e2d6e5b-fb6b-559f-81a9-c47f5fb5a609
2026-03-25 16:33:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcb9a3d0>
2026-03-25 16:33:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e2d6e5b-fb6b-559f-81a9-c47f5fb5a609/8e2d6e5b-fb6b-559f-81a9-c47f5fb5a609_image_8.jpg HTTP/1.1" 201 0
2026-03-25 16:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl4%252F25ae0912f8cd497189bd7ed0ba2ec4ef%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl4/25ae0912f8cd497189bd7ed0ba2ec4ef/images/large/9.jpg saved to cache
2026-03-25 16:33:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8e2d6e5b-fb6b-559f-81a9-c47f5fb5a609
2026-03-25 16:33:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dca8ba90>
2026-03-25 16:33:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f546f75c-0089-5ab2-8797-45d810f1df9d/f546f75c-0089-5ab2-8797-45d810f1df9d_image_2.jpg HTTP/1.1" 201 0
2026-03-25 16:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs9%252F18426bbc778648bd901230c8baae5eff%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs9/18426bbc778648bd901230c8baae5eff/images/large/3.jpg saved to cache
2026-03-25 16:33:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f546f75c-0089-5ab2-8797-45d810f1df9d
2026-03-25 16:33:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcae8190>
2026-03-25 16:33:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e2d6e5b-fb6b-559f-81a9-c47f5fb5a609/8e2d6e5b-fb6b-559f-81a9-c47f5fb5a609_image_5.jpg HTTP/1.1" 201 0
2026-03-25 16:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl4%252F25ae0912f8cd497189bd7ed0ba2ec4ef%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl4/25ae0912f8cd497189bd7ed0ba2ec4ef/images/large/6.jpg saved to cache
2026-03-25 16:33:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8e2d6e5b-fb6b-559f-81a9-c47f5fb5a609
2026-03-25 16:33:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34de4583d0>
2026-03-25 16:33:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e2d6e5b-fb6b-559f-81a9-c47f5fb5a609/8e2d6e5b-fb6b-559f-81a9-c47f5fb5a609_image_7.jpg HTTP/1.1" 201 0
2026-03-25 16:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl4%252F25ae0912f8cd497189bd7ed0ba2ec4ef%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl4/25ae0912f8cd497189bd7ed0ba2ec4ef/images/large/8.jpg saved to cache
2026-03-25 16:33:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8e2d6e5b-fb6b-559f-81a9-c47f5fb5a609
2026-03-25 16:33:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dca24690>
2026-03-25 16:33:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f546f75c-0089-5ab2-8797-45d810f1df9d/f546f75c-0089-5ab2-8797-45d810f1df9d_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs9%252F18426bbc778648bd901230c8baae5eff%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs9/18426bbc778648bd901230c8baae5eff/images/large/1.jpg saved to cache
2026-03-25 16:33:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f546f75c-0089-5ab2-8797-45d810f1df9d
2026-03-25 16:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs4%252Ff40c7b979cfc47ffaf217c6d58a47b86%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs4/f40c7b979cfc47ffaf217c6d58a47b86/images/large/8.jpg not downloaded yet
2026-03-25 16:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs4%252Ff40c7b979cfc47ffaf217c6d58a47b86%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs4/f40c7b979cfc47ffaf217c6d58a47b86/images/large/9.jpg not downloaded yet
2026-03-25 16:33:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc326450>
2026-03-25 16:33:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f546f75c-0089-5ab2-8797-45d810f1df9d/f546f75c-0089-5ab2-8797-45d810f1df9d_image_8.jpg HTTP/1.1" 201 0
2026-03-25 16:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs9%252F18426bbc778648bd901230c8baae5eff%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs9/18426bbc778648bd901230c8baae5eff/images/large/9.jpg saved to cache
2026-03-25 16:33:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f546f75c-0089-5ab2-8797-45d810f1df9d
2026-03-25 16:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs4%252Ff40c7b979cfc47ffaf217c6d58a47b86%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs4/f40c7b979cfc47ffaf217c6d58a47b86/images/large/10.jpg not downloaded yet
2026-03-25 16:33:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm2/baf415c092c24cd79c96f548a2af1c5e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs9/18426bbc778648bd901230c8baae5eff/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:31 [ayvens.it] INFO: Found listing with ID: 1983629
2026-03-25 16:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983629%27 HTTP/1.1" 200 None
2026-03-25 16:33:31 [ayvens.it] INFO: Scrape type for 1983629: 1
2026-03-25 16:33:31 [ayvens.it] INFO: Extracting data for car ID: 1983629
2026-03-25 16:33:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5ed1d76a-8bb0-5206-94a2-60a4233c82b7 with identifier: 1983629
2026-03-25 16:33:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5ed1d76a-8bb0-5206-94a2-60a4233c82b7 with scrape type 1
2026-03-25 16:33:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5ed1d76a-8bb0-5206-94a2-60a4233c82b7
2026-03-25 16:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs5%252Feeeb82b554b24c3691af86eeac4b977c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs5/eeeb82b554b24c3691af86eeac4b977c/images/large/1.jpg not downloaded yet
2026-03-25 16:33:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm2/baf415c092c24cd79c96f548a2af1c5e/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm2/baf415c092c24cd79c96f548a2af1c5e/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs9/18426bbc778648bd901230c8baae5eff/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm2/baf415c092c24cd79c96f548a2af1c5e/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs9/18426bbc778648bd901230c8baae5eff/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs5%252Feeeb82b554b24c3691af86eeac4b977c%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs5/eeeb82b554b24c3691af86eeac4b977c/images/large/2.jpg not downloaded yet
2026-03-25 16:33:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm2/baf415c092c24cd79c96f548a2af1c5e/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs5%252Feeeb82b554b24c3691af86eeac4b977c%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs5/eeeb82b554b24c3691af86eeac4b977c/images/large/3.jpg not downloaded yet
2026-03-25 16:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs5%252Feeeb82b554b24c3691af86eeac4b977c%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs5/eeeb82b554b24c3691af86eeac4b977c/images/large/4.jpg not downloaded yet
2026-03-25 16:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs5%252Feeeb82b554b24c3691af86eeac4b977c%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs5/eeeb82b554b24c3691af86eeac4b977c/images/large/5.jpg not downloaded yet
2026-03-25 16:33:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc990350>
2026-03-25 16:33:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe7a7a81-f812-55d1-b287-e9ac51e6562b/fe7a7a81-f812-55d1-b287-e9ac51e6562b_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm2%252Fbaf415c092c24cd79c96f548a2af1c5e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm2/baf415c092c24cd79c96f548a2af1c5e/images/large/1.jpg saved to cache
2026-03-25 16:33:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fe7a7a81-f812-55d1-b287-e9ac51e6562b
2026-03-25 16:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs5%252Feeeb82b554b24c3691af86eeac4b977c%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs5/eeeb82b554b24c3691af86eeac4b977c/images/large/6.jpg not downloaded yet
2026-03-25 16:33:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc58a4d0>
2026-03-25 16:33:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f546f75c-0089-5ab2-8797-45d810f1df9d/f546f75c-0089-5ab2-8797-45d810f1df9d_image_6.jpg HTTP/1.1" 201 0
2026-03-25 16:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs9%252F18426bbc778648bd901230c8baae5eff%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs9/18426bbc778648bd901230c8baae5eff/images/large/7.jpg saved to cache
2026-03-25 16:33:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f546f75c-0089-5ab2-8797-45d810f1df9d
2026-03-25 16:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs5%252Feeeb82b554b24c3691af86eeac4b977c%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs5/eeeb82b554b24c3691af86eeac4b977c/images/large/7.jpg not downloaded yet
2026-03-25 16:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs5%252Feeeb82b554b24c3691af86eeac4b977c%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs5/eeeb82b554b24c3691af86eeac4b977c/images/large/8.jpg not downloaded yet
2026-03-25 16:33:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcaea1d0>
2026-03-25 16:33:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe7a7a81-f812-55d1-b287-e9ac51e6562b/fe7a7a81-f812-55d1-b287-e9ac51e6562b_image_2.jpg HTTP/1.1" 201 0
2026-03-25 16:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm2%252Fbaf415c092c24cd79c96f548a2af1c5e%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm2/baf415c092c24cd79c96f548a2af1c5e/images/large/3.jpg saved to cache
2026-03-25 16:33:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item fe7a7a81-f812-55d1-b287-e9ac51e6562b
2026-03-25 16:33:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc58afd0>
2026-03-25 16:33:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe7a7a81-f812-55d1-b287-e9ac51e6562b/fe7a7a81-f812-55d1-b287-e9ac51e6562b_image_1.jpg HTTP/1.1" 201 0
2026-03-25 16:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm2%252Fbaf415c092c24cd79c96f548a2af1c5e%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm2/baf415c092c24cd79c96f548a2af1c5e/images/large/2.jpg saved to cache
2026-03-25 16:33:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item fe7a7a81-f812-55d1-b287-e9ac51e6562b
2026-03-25 16:33:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc9e45d0>
2026-03-25 16:33:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f546f75c-0089-5ab2-8797-45d810f1df9d/f546f75c-0089-5ab2-8797-45d810f1df9d_image_9.jpg HTTP/1.1" 201 0
2026-03-25 16:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs9%252F18426bbc778648bd901230c8baae5eff%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs9/18426bbc778648bd901230c8baae5eff/images/large/10.jpg saved to cache
2026-03-25 16:33:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f546f75c-0089-5ab2-8797-45d810f1df9d
2026-03-25 16:33:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dca270d0>
2026-03-25 16:33:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe7a7a81-f812-55d1-b287-e9ac51e6562b/fe7a7a81-f812-55d1-b287-e9ac51e6562b_image_7.jpg HTTP/1.1" 201 0
2026-03-25 16:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm2%252Fbaf415c092c24cd79c96f548a2af1c5e%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm2/baf415c092c24cd79c96f548a2af1c5e/images/large/8.jpg saved to cache
2026-03-25 16:33:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item fe7a7a81-f812-55d1-b287-e9ac51e6562b
2026-03-25 16:33:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc8e0e50>
2026-03-25 16:33:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f546f75c-0089-5ab2-8797-45d810f1df9d/f546f75c-0089-5ab2-8797-45d810f1df9d_image_7.jpg HTTP/1.1" 201 0
2026-03-25 16:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs9%252F18426bbc778648bd901230c8baae5eff%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs9/18426bbc778648bd901230c8baae5eff/images/large/8.jpg saved to cache
2026-03-25 16:33:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f546f75c-0089-5ab2-8797-45d810f1df9d
2026-03-25 16:33:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc9e6f50>
2026-03-25 16:33:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe7a7a81-f812-55d1-b287-e9ac51e6562b/fe7a7a81-f812-55d1-b287-e9ac51e6562b_image_6.jpg HTTP/1.1" 201 0
2026-03-25 16:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm2%252Fbaf415c092c24cd79c96f548a2af1c5e%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm2/baf415c092c24cd79c96f548a2af1c5e/images/large/7.jpg saved to cache
2026-03-25 16:33:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item fe7a7a81-f812-55d1-b287-e9ac51e6562b
2026-03-25 16:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs5%252Feeeb82b554b24c3691af86eeac4b977c%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs5/eeeb82b554b24c3691af86eeac4b977c/images/large/9.jpg not downloaded yet
2026-03-25 16:33:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm2/baf415c092c24cd79c96f548a2af1c5e/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs4/f40c7b979cfc47ffaf217c6d58a47b86/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs5%252Feeeb82b554b24c3691af86eeac4b977c%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs5/eeeb82b554b24c3691af86eeac4b977c/images/large/10.jpg not downloaded yet
2026-03-25 16:33:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm2/baf415c092c24cd79c96f548a2af1c5e/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm2/baf415c092c24cd79c96f548a2af1c5e/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:32 [ayvens.it] INFO: Found listing with ID: 1983630
2026-03-25 16:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983630%27 HTTP/1.1" 200 None
2026-03-25 16:33:32 [ayvens.it] INFO: Scrape type for 1983630: 1
2026-03-25 16:33:32 [ayvens.it] INFO: Extracting data for car ID: 1983630
2026-03-25 16:33:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fa2c755b-217a-5154-a960-5e9c4c269e9a with identifier: 1983630
2026-03-25 16:33:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fa2c755b-217a-5154-a960-5e9c4c269e9a with scrape type 1
2026-03-25 16:33:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item fa2c755b-217a-5154-a960-5e9c4c269e9a
2026-03-25 16:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg2%252Ff0c285cd3fa94d7695fccf20a97bd509%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg2/f0c285cd3fa94d7695fccf20a97bd509/images/large/1.jpg not downloaded yet
2026-03-25 16:33:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs4/f40c7b979cfc47ffaf217c6d58a47b86/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs4/f40c7b979cfc47ffaf217c6d58a47b86/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs4/f40c7b979cfc47ffaf217c6d58a47b86/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg2%252Ff0c285cd3fa94d7695fccf20a97bd509%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg2/f0c285cd3fa94d7695fccf20a97bd509/images/large/2.jpg not downloaded yet
2026-03-25 16:33:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm2/baf415c092c24cd79c96f548a2af1c5e/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg2%252Ff0c285cd3fa94d7695fccf20a97bd509%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg2/f0c285cd3fa94d7695fccf20a97bd509/images/large/3.jpg not downloaded yet
2026-03-25 16:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg2%252Ff0c285cd3fa94d7695fccf20a97bd509%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg2/f0c285cd3fa94d7695fccf20a97bd509/images/large/4.jpg not downloaded yet
2026-03-25 16:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg2%252Ff0c285cd3fa94d7695fccf20a97bd509%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg2/f0c285cd3fa94d7695fccf20a97bd509/images/large/5.jpg not downloaded yet
2026-03-25 16:33:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34d7442710>
2026-03-25 16:33:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe7a7a81-f812-55d1-b287-e9ac51e6562b/fe7a7a81-f812-55d1-b287-e9ac51e6562b_image_9.jpg HTTP/1.1" 201 0
2026-03-25 16:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm2%252Fbaf415c092c24cd79c96f548a2af1c5e%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm2/baf415c092c24cd79c96f548a2af1c5e/images/large/10.jpg saved to cache
2026-03-25 16:33:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item fe7a7a81-f812-55d1-b287-e9ac51e6562b
2026-03-25 16:33:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc553cd0>
2026-03-25 16:33:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_768842fb-9be4-5959-9a92-2aa6e3018e75/768842fb-9be4-5959-9a92-2aa6e3018e75_image_3.jpg HTTP/1.1" 201 0
2026-03-25 16:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs4%252Ff40c7b979cfc47ffaf217c6d58a47b86%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs4/f40c7b979cfc47ffaf217c6d58a47b86/images/large/4.jpg saved to cache
2026-03-25 16:33:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 768842fb-9be4-5959-9a92-2aa6e3018e75
2026-03-25 16:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg2%252Ff0c285cd3fa94d7695fccf20a97bd509%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg2/f0c285cd3fa94d7695fccf20a97bd509/images/large/6.jpg not downloaded yet
2026-03-25 16:33:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34d7441a90>
2026-03-25 16:33:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe7a7a81-f812-55d1-b287-e9ac51e6562b/fe7a7a81-f812-55d1-b287-e9ac51e6562b_image_4.jpg HTTP/1.1" 201 0
2026-03-25 16:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm2%252Fbaf415c092c24cd79c96f548a2af1c5e%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm2/baf415c092c24cd79c96f548a2af1c5e/images/large/5.jpg saved to cache
2026-03-25 16:33:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item fe7a7a81-f812-55d1-b287-e9ac51e6562b
2026-03-25 16:33:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34d6b48ed0>
2026-03-25 16:33:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe7a7a81-f812-55d1-b287-e9ac51e6562b/fe7a7a81-f812-55d1-b287-e9ac51e6562b_image_5.jpg HTTP/1.1" 201 0
2026-03-25 16:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm2%252Fbaf415c092c24cd79c96f548a2af1c5e%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm2/baf415c092c24cd79c96f548a2af1c5e/images/large/6.jpg saved to cache
2026-03-25 16:33:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item fe7a7a81-f812-55d1-b287-e9ac51e6562b
2026-03-25 16:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg2%252Ff0c285cd3fa94d7695fccf20a97bd509%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg2/f0c285cd3fa94d7695fccf20a97bd509/images/large/7.jpg not downloaded yet
2026-03-25 16:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg2%252Ff0c285cd3fa94d7695fccf20a97bd509%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg2/f0c285cd3fa94d7695fccf20a97bd509/images/large/8.jpg not downloaded yet
2026-03-25 16:33:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc2fca50>
2026-03-25 16:33:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_768842fb-9be4-5959-9a92-2aa6e3018e75/768842fb-9be4-5959-9a92-2aa6e3018e75_image_2.jpg HTTP/1.1" 201 0
2026-03-25 16:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs4%252Ff40c7b979cfc47ffaf217c6d58a47b86%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs4/f40c7b979cfc47ffaf217c6d58a47b86/images/large/3.jpg saved to cache
2026-03-25 16:33:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 768842fb-9be4-5959-9a92-2aa6e3018e75
2026-03-25 16:33:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc7f9c50>
2026-03-25 16:33:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_768842fb-9be4-5959-9a92-2aa6e3018e75/768842fb-9be4-5959-9a92-2aa6e3018e75_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs4%252Ff40c7b979cfc47ffaf217c6d58a47b86%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs4/f40c7b979cfc47ffaf217c6d58a47b86/images/large/1.jpg saved to cache
2026-03-25 16:33:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 768842fb-9be4-5959-9a92-2aa6e3018e75
2026-03-25 16:33:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc75a850>
2026-03-25 16:33:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_768842fb-9be4-5959-9a92-2aa6e3018e75/768842fb-9be4-5959-9a92-2aa6e3018e75_image_1.jpg HTTP/1.1" 201 0
2026-03-25 16:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs4%252Ff40c7b979cfc47ffaf217c6d58a47b86%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs4/f40c7b979cfc47ffaf217c6d58a47b86/images/large/2.jpg saved to cache
2026-03-25 16:33:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 768842fb-9be4-5959-9a92-2aa6e3018e75
2026-03-25 16:33:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc7f86d0>
2026-03-25 16:33:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe7a7a81-f812-55d1-b287-e9ac51e6562b/fe7a7a81-f812-55d1-b287-e9ac51e6562b_image_8.jpg HTTP/1.1" 201 0
2026-03-25 16:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm2%252Fbaf415c092c24cd79c96f548a2af1c5e%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm2/baf415c092c24cd79c96f548a2af1c5e/images/large/9.jpg saved to cache
2026-03-25 16:33:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item fe7a7a81-f812-55d1-b287-e9ac51e6562b
2026-03-25 16:33:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs4/f40c7b979cfc47ffaf217c6d58a47b86/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg2%252Ff0c285cd3fa94d7695fccf20a97bd509%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg2/f0c285cd3fa94d7695fccf20a97bd509/images/large/9.jpg not downloaded yet
2026-03-25 16:33:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs4/f40c7b979cfc47ffaf217c6d58a47b86/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg2%252Ff0c285cd3fa94d7695fccf20a97bd509%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg2/f0c285cd3fa94d7695fccf20a97bd509/images/large/10.jpg not downloaded yet
2026-03-25 16:33:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs4/f40c7b979cfc47ffaf217c6d58a47b86/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:33 [ayvens.it] INFO: Found listing with ID: 1983631
2026-03-25 16:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983631%27 HTTP/1.1" 200 None
2026-03-25 16:33:33 [ayvens.it] INFO: Scrape type for 1983631: 1
2026-03-25 16:33:33 [ayvens.it] INFO: Extracting data for car ID: 1983631
2026-03-25 16:33:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8742a68b-6978-5b8c-888b-c27c18056674 with identifier: 1983631
2026-03-25 16:33:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8742a68b-6978-5b8c-888b-c27c18056674 with scrape type 1
2026-03-25 16:33:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8742a68b-6978-5b8c-888b-c27c18056674
2026-03-25 16:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn6%252F3eeb8698be3c4dde9f0c9ebc26a8ee94%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn6/3eeb8698be3c4dde9f0c9ebc26a8ee94/images/large/1.jpg not downloaded yet
2026-03-25 16:33:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs5/eeeb82b554b24c3691af86eeac4b977c/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs4/f40c7b979cfc47ffaf217c6d58a47b86/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs4/f40c7b979cfc47ffaf217c6d58a47b86/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs4/f40c7b979cfc47ffaf217c6d58a47b86/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs5/eeeb82b554b24c3691af86eeac4b977c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn6%252F3eeb8698be3c4dde9f0c9ebc26a8ee94%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn6/3eeb8698be3c4dde9f0c9ebc26a8ee94/images/large/2.jpg not downloaded yet
2026-03-25 16:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn6%252F3eeb8698be3c4dde9f0c9ebc26a8ee94%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn6/3eeb8698be3c4dde9f0c9ebc26a8ee94/images/large/3.jpg not downloaded yet
2026-03-25 16:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn6%252F3eeb8698be3c4dde9f0c9ebc26a8ee94%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn6/3eeb8698be3c4dde9f0c9ebc26a8ee94/images/large/4.jpg not downloaded yet
2026-03-25 16:33:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcad9e50>
2026-03-25 16:33:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_768842fb-9be4-5959-9a92-2aa6e3018e75/768842fb-9be4-5959-9a92-2aa6e3018e75_image_8.jpg HTTP/1.1" 201 0
2026-03-25 16:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs4%252Ff40c7b979cfc47ffaf217c6d58a47b86%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs4/f40c7b979cfc47ffaf217c6d58a47b86/images/large/9.jpg saved to cache
2026-03-25 16:33:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 768842fb-9be4-5959-9a92-2aa6e3018e75
2026-03-25 16:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn6%252F3eeb8698be3c4dde9f0c9ebc26a8ee94%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn6/3eeb8698be3c4dde9f0c9ebc26a8ee94/images/large/5.jpg not downloaded yet
2026-03-25 16:33:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc57ba90>
2026-03-25 16:33:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_768842fb-9be4-5959-9a92-2aa6e3018e75/768842fb-9be4-5959-9a92-2aa6e3018e75_image_5.jpg HTTP/1.1" 201 0
2026-03-25 16:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs4%252Ff40c7b979cfc47ffaf217c6d58a47b86%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs4/f40c7b979cfc47ffaf217c6d58a47b86/images/large/6.jpg saved to cache
2026-03-25 16:33:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 768842fb-9be4-5959-9a92-2aa6e3018e75
2026-03-25 16:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn6%252F3eeb8698be3c4dde9f0c9ebc26a8ee94%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn6/3eeb8698be3c4dde9f0c9ebc26a8ee94/images/large/6.jpg not downloaded yet
2026-03-25 16:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn6%252F3eeb8698be3c4dde9f0c9ebc26a8ee94%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn6/3eeb8698be3c4dde9f0c9ebc26a8ee94/images/large/7.jpg not downloaded yet
2026-03-25 16:33:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc82e610>
2026-03-25 16:33:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_768842fb-9be4-5959-9a92-2aa6e3018e75/768842fb-9be4-5959-9a92-2aa6e3018e75_image_4.jpg HTTP/1.1" 201 0
2026-03-25 16:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs4%252Ff40c7b979cfc47ffaf217c6d58a47b86%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs4/f40c7b979cfc47ffaf217c6d58a47b86/images/large/5.jpg saved to cache
2026-03-25 16:33:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 768842fb-9be4-5959-9a92-2aa6e3018e75
2026-03-25 16:33:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc578ed0>
2026-03-25 16:33:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5ed1d76a-8bb0-5206-94a2-60a4233c82b7/5ed1d76a-8bb0-5206-94a2-60a4233c82b7_image_5.jpg HTTP/1.1" 201 0
2026-03-25 16:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs5%252Feeeb82b554b24c3691af86eeac4b977c%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs5/eeeb82b554b24c3691af86eeac4b977c/images/large/6.jpg saved to cache
2026-03-25 16:33:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5ed1d76a-8bb0-5206-94a2-60a4233c82b7
2026-03-25 16:33:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc54fc50>
2026-03-25 16:33:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_768842fb-9be4-5959-9a92-2aa6e3018e75/768842fb-9be4-5959-9a92-2aa6e3018e75_image_6.jpg HTTP/1.1" 201 0
2026-03-25 16:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs4%252Ff40c7b979cfc47ffaf217c6d58a47b86%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs4/f40c7b979cfc47ffaf217c6d58a47b86/images/large/7.jpg saved to cache
2026-03-25 16:33:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 768842fb-9be4-5959-9a92-2aa6e3018e75
2026-03-25 16:33:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcb1eb90>
2026-03-25 16:33:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_768842fb-9be4-5959-9a92-2aa6e3018e75/768842fb-9be4-5959-9a92-2aa6e3018e75_image_7.jpg HTTP/1.1" 201 0
2026-03-25 16:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs4%252Ff40c7b979cfc47ffaf217c6d58a47b86%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs4/f40c7b979cfc47ffaf217c6d58a47b86/images/large/8.jpg saved to cache
2026-03-25 16:33:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 768842fb-9be4-5959-9a92-2aa6e3018e75
2026-03-25 16:33:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc7f9150>
2026-03-25 16:33:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_768842fb-9be4-5959-9a92-2aa6e3018e75/768842fb-9be4-5959-9a92-2aa6e3018e75_image_9.jpg HTTP/1.1" 201 0
2026-03-25 16:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs4%252Ff40c7b979cfc47ffaf217c6d58a47b86%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs4/f40c7b979cfc47ffaf217c6d58a47b86/images/large/10.jpg saved to cache
2026-03-25 16:33:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 768842fb-9be4-5959-9a92-2aa6e3018e75
2026-03-25 16:33:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 768842fb-9be4-5959-9a92-2aa6e3018e75, skipping ID generation
2026-03-25 16:33:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 768842fb-9be4-5959-9a92-2aa6e3018e75 with scrape type 1
2026-03-25 16:33:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 768842fb-9be4-5959-9a92-2aa6e3018e75 sending to next pipeline
2026-03-25 16:33:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 768842fb-9be4-5959-9a92-2aa6e3018e75, identifier: 1983628
2026-03-25 16:33:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcaa9e10>
2026-03-25 16:33:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5ed1d76a-8bb0-5206-94a2-60a4233c82b7/5ed1d76a-8bb0-5206-94a2-60a4233c82b7_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs5%252Feeeb82b554b24c3691af86eeac4b977c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs5/eeeb82b554b24c3691af86eeac4b977c/images/large/1.jpg saved to cache
2026-03-25 16:33:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5ed1d76a-8bb0-5206-94a2-60a4233c82b7
2026-03-25 16:33:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 768842fb-9be4-5959-9a92-2aa6e3018e75 with identifier: 1983628
2026-03-25 16:33:34 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:33:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 768842fb-9be4-5959-9a92-2aa6e3018e75 with identifier: 1983628
2026-03-25 16:33:34 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 768842fb-9be4-5959-9a92-2aa6e3018e75 with identifier: 1983628 to the API
2026-03-25 16:33:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:33:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:33:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gs4/f40c7b979cfc47ffaf217c6d58a47b86/images/large/10.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'DIGITAL WHITE METALLIC',
'currency': 'EUR',
'doors_number': 5,
'engine': '',
'expiration_date': '2026-03-27T09:30:00Z',
'fuel_type': 'electric',
'id': '768842fb-9be4-5959-9a92-2aa6e3018e75',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41025',
'listing': 'auction',
'location': None,
'make': 'SMART',
'model': 'SMART #1 66 kWh Premium Sport utility vehicle 5-door',
'odometer': 19859,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_768842fb-9be4-5959-9a92-2aa6e3018e75/768842fb-9be4-5959-9a92-2aa6e3018e75_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 694439,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs4/f40c7b979cfc47ffaf217c6d58a47b86/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_768842fb-9be4-5959-9a92-2aa6e3018e75/768842fb-9be4-5959-9a92-2aa6e3018e75_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 694439,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs4/f40c7b979cfc47ffaf217c6d58a47b86/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_768842fb-9be4-5959-9a92-2aa6e3018e75/768842fb-9be4-5959-9a92-2aa6e3018e75_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 768107,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs4/f40c7b979cfc47ffaf217c6d58a47b86/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_768842fb-9be4-5959-9a92-2aa6e3018e75/768842fb-9be4-5959-9a92-2aa6e3018e75_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 292591,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs4/f40c7b979cfc47ffaf217c6d58a47b86/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_768842fb-9be4-5959-9a92-2aa6e3018e75/768842fb-9be4-5959-9a92-2aa6e3018e75_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 634427,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs4/f40c7b979cfc47ffaf217c6d58a47b86/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_768842fb-9be4-5959-9a92-2aa6e3018e75/768842fb-9be4-5959-9a92-2aa6e3018e75_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 437477,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs4/f40c7b979cfc47ffaf217c6d58a47b86/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_768842fb-9be4-5959-9a92-2aa6e3018e75/768842fb-9be4-5959-9a92-2aa6e3018e75_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 704215,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs4/f40c7b979cfc47ffaf217c6d58a47b86/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_768842fb-9be4-5959-9a92-2aa6e3018e75/768842fb-9be4-5959-9a92-2aa6e3018e75_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 713363,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs4/f40c7b979cfc47ffaf217c6d58a47b86/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_768842fb-9be4-5959-9a92-2aa6e3018e75/768842fb-9be4-5959-9a92-2aa6e3018e75_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 370607,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs4/f40c7b979cfc47ffaf217c6d58a47b86/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_768842fb-9be4-5959-9a92-2aa6e3018e75/768842fb-9be4-5959-9a92-2aa6e3018e75_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 700160,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs4/f40c7b979cfc47ffaf217c6d58a47b86/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-11-13',
'seats_number': 5,
'seller_name': None,
'title': 'SMART SMART #1 66 kWh Premium Sport utility vehicle 5-door -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2023}
2026-03-25 16:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983628%27 HTTP/1.1" 200 None
2026-03-25 16:33:34 [ayvens.it] INFO: Saving data for 1983628: {'created_time': 1774456414.599701, 'last_price_update_time': 1774456414.59971, 'auction_closing_time': 1774603800.0}
2026-03-25 16:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1983628') HTTP/1.1" 204 0
2026-03-25 16:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn6%252F3eeb8698be3c4dde9f0c9ebc26a8ee94%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn6/3eeb8698be3c4dde9f0c9ebc26a8ee94/images/large/8.jpg not downloaded yet
2026-03-25 16:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn6%252F3eeb8698be3c4dde9f0c9ebc26a8ee94%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn6/3eeb8698be3c4dde9f0c9ebc26a8ee94/images/large/9.jpg not downloaded yet
2026-03-25 16:33:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs5/eeeb82b554b24c3691af86eeac4b977c/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg2/f0c285cd3fa94d7695fccf20a97bd509/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs5/eeeb82b554b24c3691af86eeac4b977c/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn6%252F3eeb8698be3c4dde9f0c9ebc26a8ee94%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn6/3eeb8698be3c4dde9f0c9ebc26a8ee94/images/large/10.jpg not downloaded yet
2026-03-25 16:33:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs5/eeeb82b554b24c3691af86eeac4b977c/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg2/f0c285cd3fa94d7695fccf20a97bd509/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs5/eeeb82b554b24c3691af86eeac4b977c/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:34 [ayvens.it] INFO: Found listing with ID: 1983632
2026-03-25 16:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983632%27 HTTP/1.1" 200 None
2026-03-25 16:33:34 [ayvens.it] INFO: Scrape type for 1983632: 1
2026-03-25 16:33:34 [ayvens.it] INFO: Extracting data for car ID: 1983632
2026-03-25 16:33:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e68fe672-5693-5f9d-80bd-54c0e8bc5ea8 with identifier: 1983632
2026-03-25 16:33:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e68fe672-5693-5f9d-80bd-54c0e8bc5ea8 with scrape type 1
2026-03-25 16:33:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e68fe672-5693-5f9d-80bd-54c0e8bc5ea8
2026-03-25 16:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr9%252F37c82360341040d198a24c54756d4934%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr9/37c82360341040d198a24c54756d4934/images/large/1.jpg not downloaded yet
2026-03-25 16:33:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg2/f0c285cd3fa94d7695fccf20a97bd509/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg2/f0c285cd3fa94d7695fccf20a97bd509/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr9%252F37c82360341040d198a24c54756d4934%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr9/37c82360341040d198a24c54756d4934/images/large/2.jpg not downloaded yet
2026-03-25 16:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr9%252F37c82360341040d198a24c54756d4934%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr9/37c82360341040d198a24c54756d4934/images/large/3.jpg not downloaded yet
2026-03-25 16:33:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34de568790>
2026-03-25 16:33:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5ed1d76a-8bb0-5206-94a2-60a4233c82b7/5ed1d76a-8bb0-5206-94a2-60a4233c82b7_image_6.jpg HTTP/1.1" 201 0
2026-03-25 16:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs5%252Feeeb82b554b24c3691af86eeac4b977c%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs5/eeeb82b554b24c3691af86eeac4b977c/images/large/7.jpg saved to cache
2026-03-25 16:33:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5ed1d76a-8bb0-5206-94a2-60a4233c82b7
2026-03-25 16:33:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc3679d0>
2026-03-25 16:33:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa2c755b-217a-5154-a960-5e9c4c269e9a/fa2c755b-217a-5154-a960-5e9c4c269e9a_image_5.jpg HTTP/1.1" 201 0
2026-03-25 16:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg2%252Ff0c285cd3fa94d7695fccf20a97bd509%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg2/f0c285cd3fa94d7695fccf20a97bd509/images/large/6.jpg saved to cache
2026-03-25 16:33:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item fa2c755b-217a-5154-a960-5e9c4c269e9a
2026-03-25 16:33:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc5bd3d0>
2026-03-25 16:33:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5ed1d76a-8bb0-5206-94a2-60a4233c82b7/5ed1d76a-8bb0-5206-94a2-60a4233c82b7_image_8.jpg HTTP/1.1" 201 0
2026-03-25 16:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs5%252Feeeb82b554b24c3691af86eeac4b977c%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs5/eeeb82b554b24c3691af86eeac4b977c/images/large/9.jpg saved to cache
2026-03-25 16:33:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5ed1d76a-8bb0-5206-94a2-60a4233c82b7
2026-03-25 16:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr9%252F37c82360341040d198a24c54756d4934%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr9/37c82360341040d198a24c54756d4934/images/large/4.jpg not downloaded yet
2026-03-25 16:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr9%252F37c82360341040d198a24c54756d4934%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr9/37c82360341040d198a24c54756d4934/images/large/5.jpg not downloaded yet
2026-03-25 16:33:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc89fbd0>
2026-03-25 16:33:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5ed1d76a-8bb0-5206-94a2-60a4233c82b7/5ed1d76a-8bb0-5206-94a2-60a4233c82b7_image_9.jpg HTTP/1.1" 201 0
2026-03-25 16:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs5%252Feeeb82b554b24c3691af86eeac4b977c%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs5/eeeb82b554b24c3691af86eeac4b977c/images/large/10.jpg saved to cache
2026-03-25 16:33:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5ed1d76a-8bb0-5206-94a2-60a4233c82b7
2026-03-25 16:33:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dca1a710>
2026-03-25 16:33:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa2c755b-217a-5154-a960-5e9c4c269e9a/fa2c755b-217a-5154-a960-5e9c4c269e9a_image_2.jpg HTTP/1.1" 201 0
2026-03-25 16:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg2%252Ff0c285cd3fa94d7695fccf20a97bd509%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg2/f0c285cd3fa94d7695fccf20a97bd509/images/large/3.jpg saved to cache
2026-03-25 16:33:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item fa2c755b-217a-5154-a960-5e9c4c269e9a
2026-03-25 16:33:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc5fa450>
2026-03-25 16:33:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5ed1d76a-8bb0-5206-94a2-60a4233c82b7/5ed1d76a-8bb0-5206-94a2-60a4233c82b7_image_7.jpg HTTP/1.1" 201 0
2026-03-25 16:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs5%252Feeeb82b554b24c3691af86eeac4b977c%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs5/eeeb82b554b24c3691af86eeac4b977c/images/large/8.jpg saved to cache
2026-03-25 16:33:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5ed1d76a-8bb0-5206-94a2-60a4233c82b7
2026-03-25 16:33:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc8e0490>
2026-03-25 16:33:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa2c755b-217a-5154-a960-5e9c4c269e9a/fa2c755b-217a-5154-a960-5e9c4c269e9a_image_4.jpg HTTP/1.1" 201 0
2026-03-25 16:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg2%252Ff0c285cd3fa94d7695fccf20a97bd509%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg2/f0c285cd3fa94d7695fccf20a97bd509/images/large/5.jpg saved to cache
2026-03-25 16:33:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item fa2c755b-217a-5154-a960-5e9c4c269e9a
2026-03-25 16:33:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcc4e990>
2026-03-25 16:33:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa2c755b-217a-5154-a960-5e9c4c269e9a/fa2c755b-217a-5154-a960-5e9c4c269e9a_image_3.jpg HTTP/1.1" 201 0
2026-03-25 16:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg2%252Ff0c285cd3fa94d7695fccf20a97bd509%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg2/f0c285cd3fa94d7695fccf20a97bd509/images/large/4.jpg saved to cache
2026-03-25 16:33:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item fa2c755b-217a-5154-a960-5e9c4c269e9a
2026-03-25 16:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr9%252F37c82360341040d198a24c54756d4934%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr9/37c82360341040d198a24c54756d4934/images/large/6.jpg not downloaded yet
2026-03-25 16:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr9%252F37c82360341040d198a24c54756d4934%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr9/37c82360341040d198a24c54756d4934/images/large/7.jpg not downloaded yet
2026-03-25 16:33:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg2/f0c285cd3fa94d7695fccf20a97bd509/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg2/f0c285cd3fa94d7695fccf20a97bd509/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr9%252F37c82360341040d198a24c54756d4934%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr9/37c82360341040d198a24c54756d4934/images/large/8.jpg not downloaded yet
2026-03-25 16:33:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg2/f0c285cd3fa94d7695fccf20a97bd509/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg2/f0c285cd3fa94d7695fccf20a97bd509/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg2/f0c285cd3fa94d7695fccf20a97bd509/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn6/3eeb8698be3c4dde9f0c9ebc26a8ee94/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr9%252F37c82360341040d198a24c54756d4934%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr9/37c82360341040d198a24c54756d4934/images/large/9.jpg not downloaded yet
2026-03-25 16:33:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs5/eeeb82b554b24c3691af86eeac4b977c/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr9%252F37c82360341040d198a24c54756d4934%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr9/37c82360341040d198a24c54756d4934/images/large/10.jpg not downloaded yet
2026-03-25 16:33:35 [ayvens.it] INFO: Found listing with ID: 1983633
2026-03-25 16:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983633%27 HTTP/1.1" 200 None
2026-03-25 16:33:35 [ayvens.it] INFO: Scrape type for 1983633: 1
2026-03-25 16:33:35 [ayvens.it] INFO: Extracting data for car ID: 1983633
2026-03-25 16:33:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3a43d942-4d10-51a6-9866-9b082716ddab with identifier: 1983633
2026-03-25 16:33:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3a43d942-4d10-51a6-9866-9b082716ddab with scrape type 1
2026-03-25 16:33:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3a43d942-4d10-51a6-9866-9b082716ddab
2026-03-25 16:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg9%252Fd8534b8fc04342059354f23e83e89d39%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg9/d8534b8fc04342059354f23e83e89d39/images/large/1.jpg not downloaded yet
2026-03-25 16:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg9%252Fd8534b8fc04342059354f23e83e89d39%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg9/d8534b8fc04342059354f23e83e89d39/images/large/2.jpg not downloaded yet
2026-03-25 16:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg9%252Fd8534b8fc04342059354f23e83e89d39%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg9/d8534b8fc04342059354f23e83e89d39/images/large/3.jpg not downloaded yet
2026-03-25 16:33:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dca76410>
2026-03-25 16:33:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa2c755b-217a-5154-a960-5e9c4c269e9a/fa2c755b-217a-5154-a960-5e9c4c269e9a_image_6.jpg HTTP/1.1" 201 0
2026-03-25 16:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg2%252Ff0c285cd3fa94d7695fccf20a97bd509%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg2/f0c285cd3fa94d7695fccf20a97bd509/images/large/7.jpg saved to cache
2026-03-25 16:33:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item fa2c755b-217a-5154-a960-5e9c4c269e9a
2026-03-25 16:33:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcbb6ed0>
2026-03-25 16:33:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa2c755b-217a-5154-a960-5e9c4c269e9a/fa2c755b-217a-5154-a960-5e9c4c269e9a_image_8.jpg HTTP/1.1" 201 0
2026-03-25 16:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg2%252Ff0c285cd3fa94d7695fccf20a97bd509%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg2/f0c285cd3fa94d7695fccf20a97bd509/images/large/9.jpg saved to cache
2026-03-25 16:33:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item fa2c755b-217a-5154-a960-5e9c4c269e9a
2026-03-25 16:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg9%252Fd8534b8fc04342059354f23e83e89d39%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg9/d8534b8fc04342059354f23e83e89d39/images/large/4.jpg not downloaded yet
2026-03-25 16:33:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34de45b610>
2026-03-25 16:33:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa2c755b-217a-5154-a960-5e9c4c269e9a/fa2c755b-217a-5154-a960-5e9c4c269e9a_image_1.jpg HTTP/1.1" 201 0
2026-03-25 16:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg2%252Ff0c285cd3fa94d7695fccf20a97bd509%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg2/f0c285cd3fa94d7695fccf20a97bd509/images/large/2.jpg saved to cache
2026-03-25 16:33:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item fa2c755b-217a-5154-a960-5e9c4c269e9a
2026-03-25 16:33:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dca18910>
2026-03-25 16:33:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa2c755b-217a-5154-a960-5e9c4c269e9a/fa2c755b-217a-5154-a960-5e9c4c269e9a_image_9.jpg HTTP/1.1" 201 0
2026-03-25 16:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg2%252Ff0c285cd3fa94d7695fccf20a97bd509%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg2/f0c285cd3fa94d7695fccf20a97bd509/images/large/10.jpg saved to cache
2026-03-25 16:33:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item fa2c755b-217a-5154-a960-5e9c4c269e9a
2026-03-25 16:33:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34d745b210>
2026-03-25 16:33:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa2c755b-217a-5154-a960-5e9c4c269e9a/fa2c755b-217a-5154-a960-5e9c4c269e9a_image_7.jpg HTTP/1.1" 201 0
2026-03-25 16:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg2%252Ff0c285cd3fa94d7695fccf20a97bd509%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg2/f0c285cd3fa94d7695fccf20a97bd509/images/large/8.jpg saved to cache
2026-03-25 16:33:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item fa2c755b-217a-5154-a960-5e9c4c269e9a
2026-03-25 16:33:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg2/f0c285cd3fa94d7695fccf20a97bd509/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg9%252Fd8534b8fc04342059354f23e83e89d39%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg9/d8534b8fc04342059354f23e83e89d39/images/large/5.jpg not downloaded yet
2026-03-25 16:33:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34d6b5b050>
2026-03-25 16:33:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8742a68b-6978-5b8c-888b-c27c18056674/8742a68b-6978-5b8c-888b-c27c18056674_image_5.jpg HTTP/1.1" 201 0
2026-03-25 16:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn6%252F3eeb8698be3c4dde9f0c9ebc26a8ee94%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn6/3eeb8698be3c4dde9f0c9ebc26a8ee94/images/large/6.jpg saved to cache
2026-03-25 16:33:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8742a68b-6978-5b8c-888b-c27c18056674
2026-03-25 16:33:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc5add10>
2026-03-25 16:33:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5ed1d76a-8bb0-5206-94a2-60a4233c82b7/5ed1d76a-8bb0-5206-94a2-60a4233c82b7_image_4.jpg HTTP/1.1" 201 0
2026-03-25 16:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs5%252Feeeb82b554b24c3691af86eeac4b977c%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs5/eeeb82b554b24c3691af86eeac4b977c/images/large/5.jpg saved to cache
2026-03-25 16:33:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5ed1d76a-8bb0-5206-94a2-60a4233c82b7
2026-03-25 16:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg9%252Fd8534b8fc04342059354f23e83e89d39%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg9/d8534b8fc04342059354f23e83e89d39/images/large/6.jpg not downloaded yet
2026-03-25 16:33:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn6/3eeb8698be3c4dde9f0c9ebc26a8ee94/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg9%252Fd8534b8fc04342059354f23e83e89d39%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg9/d8534b8fc04342059354f23e83e89d39/images/large/7.jpg not downloaded yet
2026-03-25 16:33:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34de5688d0>
2026-03-25 16:33:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa2c755b-217a-5154-a960-5e9c4c269e9a/fa2c755b-217a-5154-a960-5e9c4c269e9a_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg2%252Ff0c285cd3fa94d7695fccf20a97bd509%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg2/f0c285cd3fa94d7695fccf20a97bd509/images/large/1.jpg saved to cache
2026-03-25 16:33:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fa2c755b-217a-5154-a960-5e9c4c269e9a
2026-03-25 16:33:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fa2c755b-217a-5154-a960-5e9c4c269e9a, skipping ID generation
2026-03-25 16:33:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fa2c755b-217a-5154-a960-5e9c4c269e9a with scrape type 1
2026-03-25 16:33:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fa2c755b-217a-5154-a960-5e9c4c269e9a sending to next pipeline
2026-03-25 16:33:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: fa2c755b-217a-5154-a960-5e9c4c269e9a, identifier: 1983630
2026-03-25 16:33:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn6/3eeb8698be3c4dde9f0c9ebc26a8ee94/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn6/3eeb8698be3c4dde9f0c9ebc26a8ee94/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: fa2c755b-217a-5154-a960-5e9c4c269e9a with identifier: 1983630
2026-03-25 16:33:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: fa2c755b-217a-5154-a960-5e9c4c269e9a with identifier: 1983630
2026-03-25 16:33:36 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: fa2c755b-217a-5154-a960-5e9c4c269e9a with identifier: 1983630 to the API
2026-03-25 16:33:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:33:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:33:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gg2/f0c285cd3fa94d7695fccf20a97bd509/images/large/1.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'NERO PERLA MTZ',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-27T09:30:00Z',
'fuel_type': 'diesel',
'id': 'fa2c755b-217a-5154-a960-5e9c4c269e9a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41025',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': 'PEUGEOT 208 ACTIVE PACK BLUEHDI 100 S/S FP',
'odometer': 103425,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 28,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa2c755b-217a-5154-a960-5e9c4c269e9a/fa2c755b-217a-5154-a960-5e9c4c269e9a_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 902558,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg2/f0c285cd3fa94d7695fccf20a97bd509/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa2c755b-217a-5154-a960-5e9c4c269e9a/fa2c755b-217a-5154-a960-5e9c4c269e9a_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 720439,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg2/f0c285cd3fa94d7695fccf20a97bd509/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa2c755b-217a-5154-a960-5e9c4c269e9a/fa2c755b-217a-5154-a960-5e9c4c269e9a_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 587731,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg2/f0c285cd3fa94d7695fccf20a97bd509/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa2c755b-217a-5154-a960-5e9c4c269e9a/fa2c755b-217a-5154-a960-5e9c4c269e9a_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 615044,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg2/f0c285cd3fa94d7695fccf20a97bd509/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa2c755b-217a-5154-a960-5e9c4c269e9a/fa2c755b-217a-5154-a960-5e9c4c269e9a_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 590926,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg2/f0c285cd3fa94d7695fccf20a97bd509/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa2c755b-217a-5154-a960-5e9c4c269e9a/fa2c755b-217a-5154-a960-5e9c4c269e9a_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 696016,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg2/f0c285cd3fa94d7695fccf20a97bd509/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa2c755b-217a-5154-a960-5e9c4c269e9a/fa2c755b-217a-5154-a960-5e9c4c269e9a_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 621360,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg2/f0c285cd3fa94d7695fccf20a97bd509/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa2c755b-217a-5154-a960-5e9c4c269e9a/fa2c755b-217a-5154-a960-5e9c4c269e9a_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 615055,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg2/f0c285cd3fa94d7695fccf20a97bd509/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa2c755b-217a-5154-a960-5e9c4c269e9a/fa2c755b-217a-5154-a960-5e9c4c269e9a_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 567437,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg2/f0c285cd3fa94d7695fccf20a97bd509/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa2c755b-217a-5154-a960-5e9c4c269e9a/fa2c755b-217a-5154-a960-5e9c4c269e9a_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 734264,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg2/f0c285cd3fa94d7695fccf20a97bd509/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-09-30',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT PEUGEOT 208 ACTIVE PACK BLUEHDI 100 S/S FP -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2021}
2026-03-25 16:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983630%27 HTTP/1.1" 200 None
2026-03-25 16:33:37 [ayvens.it] INFO: Saving data for 1983630: {'created_time': 1774456417.132428, 'last_price_update_time': 1774456417.132438, 'auction_closing_time': 1774603800.0}
2026-03-25 16:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1983630') HTTP/1.1" 204 0
2026-03-25 16:33:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn6/3eeb8698be3c4dde9f0c9ebc26a8ee94/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg9%252Fd8534b8fc04342059354f23e83e89d39%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg9/d8534b8fc04342059354f23e83e89d39/images/large/8.jpg not downloaded yet
2026-03-25 16:33:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn6/3eeb8698be3c4dde9f0c9ebc26a8ee94/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg9%252Fd8534b8fc04342059354f23e83e89d39%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg9/d8534b8fc04342059354f23e83e89d39/images/large/9.jpg not downloaded yet
2026-03-25 16:33:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34d6b4a550>
2026-03-25 16:33:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8742a68b-6978-5b8c-888b-c27c18056674/8742a68b-6978-5b8c-888b-c27c18056674_image_6.jpg HTTP/1.1" 201 0
2026-03-25 16:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn6%252F3eeb8698be3c4dde9f0c9ebc26a8ee94%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn6/3eeb8698be3c4dde9f0c9ebc26a8ee94/images/large/7.jpg saved to cache
2026-03-25 16:33:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8742a68b-6978-5b8c-888b-c27c18056674
2026-03-25 16:33:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc91d090>
2026-03-25 16:33:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8742a68b-6978-5b8c-888b-c27c18056674/8742a68b-6978-5b8c-888b-c27c18056674_image_3.jpg HTTP/1.1" 201 0
2026-03-25 16:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn6%252F3eeb8698be3c4dde9f0c9ebc26a8ee94%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn6/3eeb8698be3c4dde9f0c9ebc26a8ee94/images/large/4.jpg saved to cache
2026-03-25 16:33:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8742a68b-6978-5b8c-888b-c27c18056674
2026-03-25 16:33:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcb9ad90>
2026-03-25 16:33:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8742a68b-6978-5b8c-888b-c27c18056674/8742a68b-6978-5b8c-888b-c27c18056674_image_7.jpg HTTP/1.1" 201 0
2026-03-25 16:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn6%252F3eeb8698be3c4dde9f0c9ebc26a8ee94%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn6/3eeb8698be3c4dde9f0c9ebc26a8ee94/images/large/8.jpg saved to cache
2026-03-25 16:33:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8742a68b-6978-5b8c-888b-c27c18056674
2026-03-25 16:33:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn6/3eeb8698be3c4dde9f0c9ebc26a8ee94/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn6/3eeb8698be3c4dde9f0c9ebc26a8ee94/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg9%252Fd8534b8fc04342059354f23e83e89d39%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg9/d8534b8fc04342059354f23e83e89d39/images/large/10.jpg not downloaded yet
2026-03-25 16:33:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc648850>
2026-03-25 16:33:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8742a68b-6978-5b8c-888b-c27c18056674/8742a68b-6978-5b8c-888b-c27c18056674_image_8.jpg HTTP/1.1" 201 0
2026-03-25 16:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn6%252F3eeb8698be3c4dde9f0c9ebc26a8ee94%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn6/3eeb8698be3c4dde9f0c9ebc26a8ee94/images/large/9.jpg saved to cache
2026-03-25 16:33:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8742a68b-6978-5b8c-888b-c27c18056674
2026-03-25 16:33:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc713e10>
2026-03-25 16:33:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8742a68b-6978-5b8c-888b-c27c18056674/8742a68b-6978-5b8c-888b-c27c18056674_image_9.jpg HTTP/1.1" 201 0
2026-03-25 16:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn6%252F3eeb8698be3c4dde9f0c9ebc26a8ee94%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn6/3eeb8698be3c4dde9f0c9ebc26a8ee94/images/large/10.jpg saved to cache
2026-03-25 16:33:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8742a68b-6978-5b8c-888b-c27c18056674
2026-03-25 16:33:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr9/37c82360341040d198a24c54756d4934/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:37 [ayvens.it] INFO: Found listing with ID: 1983634
2026-03-25 16:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983634%27 HTTP/1.1" 200 None
2026-03-25 16:33:37 [ayvens.it] INFO: Scrape type for 1983634: 1
2026-03-25 16:33:37 [ayvens.it] INFO: Extracting data for car ID: 1983634
2026-03-25 16:33:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5c3e135f-8623-51eb-8da5-dd70dfc2e54e with identifier: 1983634
2026-03-25 16:33:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5c3e135f-8623-51eb-8da5-dd70dfc2e54e with scrape type 1
2026-03-25 16:33:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5c3e135f-8623-51eb-8da5-dd70dfc2e54e
2026-03-25 16:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk2%252F041471b9ca2b4709a92efe080010e369%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk2/041471b9ca2b4709a92efe080010e369/images/large/1.jpg not downloaded yet
2026-03-25 16:33:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr9/37c82360341040d198a24c54756d4934/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk2%252F041471b9ca2b4709a92efe080010e369%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk2/041471b9ca2b4709a92efe080010e369/images/large/2.jpg not downloaded yet
2026-03-25 16:33:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc37dbd0>
2026-03-25 16:33:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8742a68b-6978-5b8c-888b-c27c18056674/8742a68b-6978-5b8c-888b-c27c18056674_image_4.jpg HTTP/1.1" 201 0
2026-03-25 16:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn6%252F3eeb8698be3c4dde9f0c9ebc26a8ee94%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn6/3eeb8698be3c4dde9f0c9ebc26a8ee94/images/large/5.jpg saved to cache
2026-03-25 16:33:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8742a68b-6978-5b8c-888b-c27c18056674
2026-03-25 16:33:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcb16490>
2026-03-25 16:33:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8742a68b-6978-5b8c-888b-c27c18056674/8742a68b-6978-5b8c-888b-c27c18056674_image_2.jpg HTTP/1.1" 201 0
2026-03-25 16:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn6%252F3eeb8698be3c4dde9f0c9ebc26a8ee94%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn6/3eeb8698be3c4dde9f0c9ebc26a8ee94/images/large/3.jpg saved to cache
2026-03-25 16:33:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8742a68b-6978-5b8c-888b-c27c18056674
2026-03-25 16:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk2%252F041471b9ca2b4709a92efe080010e369%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk2/041471b9ca2b4709a92efe080010e369/images/large/3.jpg not downloaded yet
2026-03-25 16:33:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr9/37c82360341040d198a24c54756d4934/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr9/37c82360341040d198a24c54756d4934/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk2%252F041471b9ca2b4709a92efe080010e369%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk2/041471b9ca2b4709a92efe080010e369/images/large/4.jpg not downloaded yet
2026-03-25 16:33:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr9/37c82360341040d198a24c54756d4934/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcba9510>
2026-03-25 16:33:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e68fe672-5693-5f9d-80bd-54c0e8bc5ea8/e68fe672-5693-5f9d-80bd-54c0e8bc5ea8_image_3.jpg HTTP/1.1" 201 0
2026-03-25 16:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr9%252F37c82360341040d198a24c54756d4934%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr9/37c82360341040d198a24c54756d4934/images/large/4.jpg saved to cache
2026-03-25 16:33:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e68fe672-5693-5f9d-80bd-54c0e8bc5ea8
2026-03-25 16:33:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34d7441810>
2026-03-25 16:33:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e68fe672-5693-5f9d-80bd-54c0e8bc5ea8/e68fe672-5693-5f9d-80bd-54c0e8bc5ea8_image_5.jpg HTTP/1.1" 201 0
2026-03-25 16:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr9%252F37c82360341040d198a24c54756d4934%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr9/37c82360341040d198a24c54756d4934/images/large/6.jpg saved to cache
2026-03-25 16:33:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e68fe672-5693-5f9d-80bd-54c0e8bc5ea8
2026-03-25 16:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk2%252F041471b9ca2b4709a92efe080010e369%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk2/041471b9ca2b4709a92efe080010e369/images/large/5.jpg not downloaded yet
2026-03-25 16:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk2%252F041471b9ca2b4709a92efe080010e369%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk2/041471b9ca2b4709a92efe080010e369/images/large/6.jpg not downloaded yet
2026-03-25 16:33:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr9/37c82360341040d198a24c54756d4934/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr9/37c82360341040d198a24c54756d4934/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk2%252F041471b9ca2b4709a92efe080010e369%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk2/041471b9ca2b4709a92efe080010e369/images/large/7.jpg not downloaded yet
2026-03-25 16:33:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc34ff50>
2026-03-25 16:33:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e68fe672-5693-5f9d-80bd-54c0e8bc5ea8/e68fe672-5693-5f9d-80bd-54c0e8bc5ea8_image_6.jpg HTTP/1.1" 201 0
2026-03-25 16:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr9%252F37c82360341040d198a24c54756d4934%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr9/37c82360341040d198a24c54756d4934/images/large/7.jpg saved to cache
2026-03-25 16:33:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e68fe672-5693-5f9d-80bd-54c0e8bc5ea8
2026-03-25 16:33:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcb9b090>
2026-03-25 16:33:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e68fe672-5693-5f9d-80bd-54c0e8bc5ea8/e68fe672-5693-5f9d-80bd-54c0e8bc5ea8_image_4.jpg HTTP/1.1" 201 0
2026-03-25 16:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr9%252F37c82360341040d198a24c54756d4934%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr9/37c82360341040d198a24c54756d4934/images/large/5.jpg saved to cache
2026-03-25 16:33:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e68fe672-5693-5f9d-80bd-54c0e8bc5ea8
2026-03-25 16:33:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc586a50>
2026-03-25 16:33:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e68fe672-5693-5f9d-80bd-54c0e8bc5ea8/e68fe672-5693-5f9d-80bd-54c0e8bc5ea8_image_2.jpg HTTP/1.1" 201 0
2026-03-25 16:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr9%252F37c82360341040d198a24c54756d4934%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr9/37c82360341040d198a24c54756d4934/images/large/3.jpg saved to cache
2026-03-25 16:33:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e68fe672-5693-5f9d-80bd-54c0e8bc5ea8
2026-03-25 16:33:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr9/37c82360341040d198a24c54756d4934/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk2%252F041471b9ca2b4709a92efe080010e369%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk2/041471b9ca2b4709a92efe080010e369/images/large/8.jpg not downloaded yet
2026-03-25 16:33:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg9/d8534b8fc04342059354f23e83e89d39/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk2%252F041471b9ca2b4709a92efe080010e369%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk2/041471b9ca2b4709a92efe080010e369/images/large/9.jpg not downloaded yet
2026-03-25 16:33:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc5cc7d0>
2026-03-25 16:33:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e68fe672-5693-5f9d-80bd-54c0e8bc5ea8/e68fe672-5693-5f9d-80bd-54c0e8bc5ea8_image_7.jpg HTTP/1.1" 201 0
2026-03-25 16:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr9%252F37c82360341040d198a24c54756d4934%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr9/37c82360341040d198a24c54756d4934/images/large/8.jpg saved to cache
2026-03-25 16:33:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e68fe672-5693-5f9d-80bd-54c0e8bc5ea8
2026-03-25 16:33:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc7de010>
2026-03-25 16:33:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e68fe672-5693-5f9d-80bd-54c0e8bc5ea8/e68fe672-5693-5f9d-80bd-54c0e8bc5ea8_image_8.jpg HTTP/1.1" 201 0
2026-03-25 16:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr9%252F37c82360341040d198a24c54756d4934%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr9/37c82360341040d198a24c54756d4934/images/large/9.jpg saved to cache
2026-03-25 16:33:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e68fe672-5693-5f9d-80bd-54c0e8bc5ea8
2026-03-25 16:33:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg9/d8534b8fc04342059354f23e83e89d39/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk2%252F041471b9ca2b4709a92efe080010e369%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk2/041471b9ca2b4709a92efe080010e369/images/large/10.jpg not downloaded yet
2026-03-25 16:33:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg9/d8534b8fc04342059354f23e83e89d39/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:38 [ayvens.it] INFO: Found listing with ID: 1983635
2026-03-25 16:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983635%27 HTTP/1.1" 200 None
2026-03-25 16:33:38 [ayvens.it] INFO: Scrape type for 1983635: 1
2026-03-25 16:33:38 [ayvens.it] INFO: Extracting data for car ID: 1983635
2026-03-25 16:33:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: faa8b061-2b73-5840-a0c7-43cded9d1c96 with identifier: 1983635
2026-03-25 16:33:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item faa8b061-2b73-5840-a0c7-43cded9d1c96 with scrape type 1
2026-03-25 16:33:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item faa8b061-2b73-5840-a0c7-43cded9d1c96
2026-03-25 16:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr7%252Fe33ffe2913cb456c939e2bd77d6d2812%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr7/e33ffe2913cb456c939e2bd77d6d2812/images/large/1.jpg not downloaded yet
2026-03-25 16:33:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg9/d8534b8fc04342059354f23e83e89d39/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr7%252Fe33ffe2913cb456c939e2bd77d6d2812%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr7/e33ffe2913cb456c939e2bd77d6d2812/images/large/2.jpg not downloaded yet
2026-03-25 16:33:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc554390>
2026-03-25 16:33:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e68fe672-5693-5f9d-80bd-54c0e8bc5ea8/e68fe672-5693-5f9d-80bd-54c0e8bc5ea8_image_1.jpg HTTP/1.1" 201 0
2026-03-25 16:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr9%252F37c82360341040d198a24c54756d4934%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr9/37c82360341040d198a24c54756d4934/images/large/2.jpg saved to cache
2026-03-25 16:33:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e68fe672-5693-5f9d-80bd-54c0e8bc5ea8
2026-03-25 16:33:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34d6b496d0>
2026-03-25 16:33:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a43d942-4d10-51a6-9866-9b082716ddab/3a43d942-4d10-51a6-9866-9b082716ddab_image_5.jpg HTTP/1.1" 201 0
2026-03-25 16:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg9%252Fd8534b8fc04342059354f23e83e89d39%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg9/d8534b8fc04342059354f23e83e89d39/images/large/6.jpg saved to cache
2026-03-25 16:33:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3a43d942-4d10-51a6-9866-9b082716ddab
2026-03-25 16:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr7%252Fe33ffe2913cb456c939e2bd77d6d2812%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr7/e33ffe2913cb456c939e2bd77d6d2812/images/large/3.jpg not downloaded yet
2026-03-25 16:33:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg9/d8534b8fc04342059354f23e83e89d39/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg9/d8534b8fc04342059354f23e83e89d39/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr7%252Fe33ffe2913cb456c939e2bd77d6d2812%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr7/e33ffe2913cb456c939e2bd77d6d2812/images/large/4.jpg not downloaded yet
2026-03-25 16:33:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dca21450>
2026-03-25 16:33:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a43d942-4d10-51a6-9866-9b082716ddab/3a43d942-4d10-51a6-9866-9b082716ddab_image_2.jpg HTTP/1.1" 201 0
2026-03-25 16:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg9%252Fd8534b8fc04342059354f23e83e89d39%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg9/d8534b8fc04342059354f23e83e89d39/images/large/3.jpg saved to cache
2026-03-25 16:33:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3a43d942-4d10-51a6-9866-9b082716ddab
2026-03-25 16:33:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc96bdd0>
2026-03-25 16:33:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a43d942-4d10-51a6-9866-9b082716ddab/3a43d942-4d10-51a6-9866-9b082716ddab_image_6.jpg HTTP/1.1" 201 0
2026-03-25 16:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg9%252Fd8534b8fc04342059354f23e83e89d39%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg9/d8534b8fc04342059354f23e83e89d39/images/large/7.jpg saved to cache
2026-03-25 16:33:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3a43d942-4d10-51a6-9866-9b082716ddab
2026-03-25 16:33:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34de16d350>
2026-03-25 16:33:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a43d942-4d10-51a6-9866-9b082716ddab/3a43d942-4d10-51a6-9866-9b082716ddab_image_3.jpg HTTP/1.1" 201 0
2026-03-25 16:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg9%252Fd8534b8fc04342059354f23e83e89d39%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg9/d8534b8fc04342059354f23e83e89d39/images/large/4.jpg saved to cache
2026-03-25 16:33:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3a43d942-4d10-51a6-9866-9b082716ddab
2026-03-25 16:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr7%252Fe33ffe2913cb456c939e2bd77d6d2812%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr7/e33ffe2913cb456c939e2bd77d6d2812/images/large/5.jpg not downloaded yet
2026-03-25 16:33:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg9/d8534b8fc04342059354f23e83e89d39/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk2/041471b9ca2b4709a92efe080010e369/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr7%252Fe33ffe2913cb456c939e2bd77d6d2812%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr7/e33ffe2913cb456c939e2bd77d6d2812/images/large/6.jpg not downloaded yet
2026-03-25 16:33:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg9/d8534b8fc04342059354f23e83e89d39/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr7%252Fe33ffe2913cb456c939e2bd77d6d2812%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr7/e33ffe2913cb456c939e2bd77d6d2812/images/large/7.jpg not downloaded yet
2026-03-25 16:33:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc969ad0>
2026-03-25 16:33:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a43d942-4d10-51a6-9866-9b082716ddab/3a43d942-4d10-51a6-9866-9b082716ddab_image_4.jpg HTTP/1.1" 201 0
2026-03-25 16:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg9%252Fd8534b8fc04342059354f23e83e89d39%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg9/d8534b8fc04342059354f23e83e89d39/images/large/5.jpg saved to cache
2026-03-25 16:33:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3a43d942-4d10-51a6-9866-9b082716ddab
2026-03-25 16:33:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcb1c6d0>
2026-03-25 16:33:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a43d942-4d10-51a6-9866-9b082716ddab/3a43d942-4d10-51a6-9866-9b082716ddab_image_8.jpg HTTP/1.1" 201 0
2026-03-25 16:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg9%252Fd8534b8fc04342059354f23e83e89d39%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg9/d8534b8fc04342059354f23e83e89d39/images/large/9.jpg saved to cache
2026-03-25 16:33:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3a43d942-4d10-51a6-9866-9b082716ddab
2026-03-25 16:33:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg9/d8534b8fc04342059354f23e83e89d39/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk2/041471b9ca2b4709a92efe080010e369/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr7%252Fe33ffe2913cb456c939e2bd77d6d2812%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr7/e33ffe2913cb456c939e2bd77d6d2812/images/large/8.jpg not downloaded yet
2026-03-25 16:33:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk2/041471b9ca2b4709a92efe080010e369/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr7%252Fe33ffe2913cb456c939e2bd77d6d2812%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr7/e33ffe2913cb456c939e2bd77d6d2812/images/large/9.jpg not downloaded yet
2026-03-25 16:33:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc64b250>
2026-03-25 16:33:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a43d942-4d10-51a6-9866-9b082716ddab/3a43d942-4d10-51a6-9866-9b082716ddab_image_1.jpg HTTP/1.1" 201 0
2026-03-25 16:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg9%252Fd8534b8fc04342059354f23e83e89d39%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg9/d8534b8fc04342059354f23e83e89d39/images/large/2.jpg saved to cache
2026-03-25 16:33:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3a43d942-4d10-51a6-9866-9b082716ddab
2026-03-25 16:33:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc38c890>
2026-03-25 16:33:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c3e135f-8623-51eb-8da5-dd70dfc2e54e/5c3e135f-8623-51eb-8da5-dd70dfc2e54e_image_2.jpg HTTP/1.1" 201 0
2026-03-25 16:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk2%252F041471b9ca2b4709a92efe080010e369%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk2/041471b9ca2b4709a92efe080010e369/images/large/3.jpg saved to cache
2026-03-25 16:33:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5c3e135f-8623-51eb-8da5-dd70dfc2e54e
2026-03-25 16:33:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dca74810>
2026-03-25 16:33:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a43d942-4d10-51a6-9866-9b082716ddab/3a43d942-4d10-51a6-9866-9b082716ddab_image_7.jpg HTTP/1.1" 201 0
2026-03-25 16:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg9%252Fd8534b8fc04342059354f23e83e89d39%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg9/d8534b8fc04342059354f23e83e89d39/images/large/8.jpg saved to cache
2026-03-25 16:33:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3a43d942-4d10-51a6-9866-9b082716ddab
2026-03-25 16:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr7%252Fe33ffe2913cb456c939e2bd77d6d2812%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr7/e33ffe2913cb456c939e2bd77d6d2812/images/large/10.jpg not downloaded yet
2026-03-25 16:33:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg9/d8534b8fc04342059354f23e83e89d39/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:39 [ayvens.it] INFO: Found listing with ID: 1983636
2026-03-25 16:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983636%27 HTTP/1.1" 200 None
2026-03-25 16:33:39 [ayvens.it] INFO: Scrape type for 1983636: 1
2026-03-25 16:33:39 [ayvens.it] INFO: Extracting data for car ID: 1983636
2026-03-25 16:33:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 98e56fdd-88b4-5ad9-ba6d-daca2b7599fa with identifier: 1983636
2026-03-25 16:33:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 98e56fdd-88b4-5ad9-ba6d-daca2b7599fa with scrape type 1
2026-03-25 16:33:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 98e56fdd-88b4-5ad9-ba6d-daca2b7599fa
2026-03-25 16:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk2%252F2df5f44c0ebb4f8bbc3e67ca6e4a6b89%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk2/2df5f44c0ebb4f8bbc3e67ca6e4a6b89/images/large/1.jpg not downloaded yet
2026-03-25 16:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk2%252F2df5f44c0ebb4f8bbc3e67ca6e4a6b89%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk2/2df5f44c0ebb4f8bbc3e67ca6e4a6b89/images/large/2.jpg not downloaded yet
2026-03-25 16:33:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc38da10>
2026-03-25 16:33:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a43d942-4d10-51a6-9866-9b082716ddab/3a43d942-4d10-51a6-9866-9b082716ddab_image_9.jpg HTTP/1.1" 201 0
2026-03-25 16:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg9%252Fd8534b8fc04342059354f23e83e89d39%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg9/d8534b8fc04342059354f23e83e89d39/images/large/10.jpg saved to cache
2026-03-25 16:33:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3a43d942-4d10-51a6-9866-9b082716ddab
2026-03-25 16:33:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc89db90>
2026-03-25 16:33:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c3e135f-8623-51eb-8da5-dd70dfc2e54e/5c3e135f-8623-51eb-8da5-dd70dfc2e54e_image_5.jpg HTTP/1.1" 201 0
2026-03-25 16:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk2%252F041471b9ca2b4709a92efe080010e369%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk2/041471b9ca2b4709a92efe080010e369/images/large/6.jpg saved to cache
2026-03-25 16:33:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5c3e135f-8623-51eb-8da5-dd70dfc2e54e
2026-03-25 16:33:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dca07e50>
2026-03-25 16:33:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c3e135f-8623-51eb-8da5-dd70dfc2e54e/5c3e135f-8623-51eb-8da5-dd70dfc2e54e_image_1.jpg HTTP/1.1" 201 0
2026-03-25 16:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk2%252F041471b9ca2b4709a92efe080010e369%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk2/041471b9ca2b4709a92efe080010e369/images/large/2.jpg saved to cache
2026-03-25 16:33:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5c3e135f-8623-51eb-8da5-dd70dfc2e54e
2026-03-25 16:33:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk2/041471b9ca2b4709a92efe080010e369/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk2%252F2df5f44c0ebb4f8bbc3e67ca6e4a6b89%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk2/2df5f44c0ebb4f8bbc3e67ca6e4a6b89/images/large/3.jpg not downloaded yet
2026-03-25 16:33:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk2/041471b9ca2b4709a92efe080010e369/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk2/041471b9ca2b4709a92efe080010e369/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk2/041471b9ca2b4709a92efe080010e369/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk2%252F2df5f44c0ebb4f8bbc3e67ca6e4a6b89%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk2/2df5f44c0ebb4f8bbc3e67ca6e4a6b89/images/large/4.jpg not downloaded yet
2026-03-25 16:33:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc91e510>
2026-03-25 16:33:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a43d942-4d10-51a6-9866-9b082716ddab/3a43d942-4d10-51a6-9866-9b082716ddab_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg9%252Fd8534b8fc04342059354f23e83e89d39%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg9/d8534b8fc04342059354f23e83e89d39/images/large/1.jpg saved to cache
2026-03-25 16:33:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3a43d942-4d10-51a6-9866-9b082716ddab
2026-03-25 16:33:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3a43d942-4d10-51a6-9866-9b082716ddab, skipping ID generation
2026-03-25 16:33:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3a43d942-4d10-51a6-9866-9b082716ddab with scrape type 1
2026-03-25 16:33:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3a43d942-4d10-51a6-9866-9b082716ddab sending to next pipeline
2026-03-25 16:33:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 3a43d942-4d10-51a6-9866-9b082716ddab, identifier: 1983633
2026-03-25 16:33:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 3a43d942-4d10-51a6-9866-9b082716ddab with identifier: 1983633
2026-03-25 16:33:40 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:33:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 3a43d942-4d10-51a6-9866-9b082716ddab with identifier: 1983633
2026-03-25 16:33:40 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 3a43d942-4d10-51a6-9866-9b082716ddab with identifier: 1983633 to the API
2026-03-25 16:33:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:33:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:33:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gg9/d8534b8fc04342059354f23e83e89d39/images/large/1.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Nero Brillante tinta unita',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-27T09:30:00Z',
'fuel_type': 'hybrid',
'id': '3a43d942-4d10-51a6-9866-9b082716ddab',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41025',
'listing': 'auction',
'location': None,
'make': 'AUDI',
'model': 'AUDI A3 35 TFSI S tronic Business S.Back Hatchback 5-door (Euro 6D)',
'odometer': 98856,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 51,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a43d942-4d10-51a6-9866-9b082716ddab/3a43d942-4d10-51a6-9866-9b082716ddab_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 726824,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg9/d8534b8fc04342059354f23e83e89d39/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a43d942-4d10-51a6-9866-9b082716ddab/3a43d942-4d10-51a6-9866-9b082716ddab_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 622429,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg9/d8534b8fc04342059354f23e83e89d39/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a43d942-4d10-51a6-9866-9b082716ddab/3a43d942-4d10-51a6-9866-9b082716ddab_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 368543,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg9/d8534b8fc04342059354f23e83e89d39/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a43d942-4d10-51a6-9866-9b082716ddab/3a43d942-4d10-51a6-9866-9b082716ddab_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 598016,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg9/d8534b8fc04342059354f23e83e89d39/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a43d942-4d10-51a6-9866-9b082716ddab/3a43d942-4d10-51a6-9866-9b082716ddab_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 780756,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg9/d8534b8fc04342059354f23e83e89d39/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a43d942-4d10-51a6-9866-9b082716ddab/3a43d942-4d10-51a6-9866-9b082716ddab_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 334311,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg9/d8534b8fc04342059354f23e83e89d39/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a43d942-4d10-51a6-9866-9b082716ddab/3a43d942-4d10-51a6-9866-9b082716ddab_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 417106,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg9/d8534b8fc04342059354f23e83e89d39/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a43d942-4d10-51a6-9866-9b082716ddab/3a43d942-4d10-51a6-9866-9b082716ddab_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 588602,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg9/d8534b8fc04342059354f23e83e89d39/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a43d942-4d10-51a6-9866-9b082716ddab/3a43d942-4d10-51a6-9866-9b082716ddab_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 401469,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg9/d8534b8fc04342059354f23e83e89d39/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a43d942-4d10-51a6-9866-9b082716ddab/3a43d942-4d10-51a6-9866-9b082716ddab_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 588981,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg9/d8534b8fc04342059354f23e83e89d39/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-06-04',
'seats_number': 5,
'seller_name': None,
'title': 'AUDI AUDI A3 35 TFSI S tronic Business S.Back Hatchback 5-door '
'(Euro 6D) -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2021}
2026-03-25 16:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983633%27 HTTP/1.1" 200 None
2026-03-25 16:33:41 [ayvens.it] INFO: Saving data for 1983633: {'created_time': 1774456421.864901, 'last_price_update_time': 1774456421.864914, 'auction_closing_time': 1774603800.0}
2026-03-25 16:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1983633') HTTP/1.1" 204 0
2026-03-25 16:33:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk2/041471b9ca2b4709a92efe080010e369/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk2/041471b9ca2b4709a92efe080010e369/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk2%252F2df5f44c0ebb4f8bbc3e67ca6e4a6b89%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk2/2df5f44c0ebb4f8bbc3e67ca6e4a6b89/images/large/5.jpg not downloaded yet
2026-03-25 16:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk2%252F2df5f44c0ebb4f8bbc3e67ca6e4a6b89%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk2/2df5f44c0ebb4f8bbc3e67ca6e4a6b89/images/large/6.jpg not downloaded yet
2026-03-25 16:33:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk2/041471b9ca2b4709a92efe080010e369/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dca20550>
2026-03-25 16:33:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c3e135f-8623-51eb-8da5-dd70dfc2e54e/5c3e135f-8623-51eb-8da5-dd70dfc2e54e_image_4.jpg HTTP/1.1" 201 0
2026-03-25 16:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk2%252F041471b9ca2b4709a92efe080010e369%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk2/041471b9ca2b4709a92efe080010e369/images/large/5.jpg saved to cache
2026-03-25 16:33:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5c3e135f-8623-51eb-8da5-dd70dfc2e54e
2026-03-25 16:33:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcba8d90>
2026-03-25 16:33:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c3e135f-8623-51eb-8da5-dd70dfc2e54e/5c3e135f-8623-51eb-8da5-dd70dfc2e54e_image_8.jpg HTTP/1.1" 201 0
2026-03-25 16:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk2%252F041471b9ca2b4709a92efe080010e369%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk2/041471b9ca2b4709a92efe080010e369/images/large/9.jpg saved to cache
2026-03-25 16:33:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5c3e135f-8623-51eb-8da5-dd70dfc2e54e
2026-03-25 16:33:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dca88f90>
2026-03-25 16:33:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c3e135f-8623-51eb-8da5-dd70dfc2e54e/5c3e135f-8623-51eb-8da5-dd70dfc2e54e_image_6.jpg HTTP/1.1" 201 0
2026-03-25 16:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk2%252F041471b9ca2b4709a92efe080010e369%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk2/041471b9ca2b4709a92efe080010e369/images/large/7.jpg saved to cache
2026-03-25 16:33:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5c3e135f-8623-51eb-8da5-dd70dfc2e54e
2026-03-25 16:33:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34de45a350>
2026-03-25 16:33:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c3e135f-8623-51eb-8da5-dd70dfc2e54e/5c3e135f-8623-51eb-8da5-dd70dfc2e54e_image_7.jpg HTTP/1.1" 201 0
2026-03-25 16:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk2%252F041471b9ca2b4709a92efe080010e369%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk2/041471b9ca2b4709a92efe080010e369/images/large/8.jpg saved to cache
2026-03-25 16:33:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5c3e135f-8623-51eb-8da5-dd70dfc2e54e
2026-03-25 16:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk2%252F2df5f44c0ebb4f8bbc3e67ca6e4a6b89%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk2/2df5f44c0ebb4f8bbc3e67ca6e4a6b89/images/large/7.jpg not downloaded yet
2026-03-25 16:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk2%252F2df5f44c0ebb4f8bbc3e67ca6e4a6b89%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk2/2df5f44c0ebb4f8bbc3e67ca6e4a6b89/images/large/8.jpg not downloaded yet
2026-03-25 16:33:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc991a90>
2026-03-25 16:33:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c3e135f-8623-51eb-8da5-dd70dfc2e54e/5c3e135f-8623-51eb-8da5-dd70dfc2e54e_image_9.jpg HTTP/1.1" 201 0
2026-03-25 16:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk2%252F041471b9ca2b4709a92efe080010e369%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk2/041471b9ca2b4709a92efe080010e369/images/large/10.jpg saved to cache
2026-03-25 16:33:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5c3e135f-8623-51eb-8da5-dd70dfc2e54e
2026-03-25 16:33:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc54d250>
2026-03-25 16:33:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c3e135f-8623-51eb-8da5-dd70dfc2e54e/5c3e135f-8623-51eb-8da5-dd70dfc2e54e_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk2%252F041471b9ca2b4709a92efe080010e369%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk2/041471b9ca2b4709a92efe080010e369/images/large/1.jpg saved to cache
2026-03-25 16:33:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5c3e135f-8623-51eb-8da5-dd70dfc2e54e
2026-03-25 16:33:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcb9a790>
2026-03-25 16:33:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c3e135f-8623-51eb-8da5-dd70dfc2e54e/5c3e135f-8623-51eb-8da5-dd70dfc2e54e_image_3.jpg HTTP/1.1" 201 0
2026-03-25 16:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk2%252F041471b9ca2b4709a92efe080010e369%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk2/041471b9ca2b4709a92efe080010e369/images/large/4.jpg saved to cache
2026-03-25 16:33:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5c3e135f-8623-51eb-8da5-dd70dfc2e54e
2026-03-25 16:33:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5c3e135f-8623-51eb-8da5-dd70dfc2e54e, skipping ID generation
2026-03-25 16:33:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5c3e135f-8623-51eb-8da5-dd70dfc2e54e with scrape type 1
2026-03-25 16:33:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5c3e135f-8623-51eb-8da5-dd70dfc2e54e sending to next pipeline
2026-03-25 16:33:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 5c3e135f-8623-51eb-8da5-dd70dfc2e54e, identifier: 1983634
2026-03-25 16:33:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 5c3e135f-8623-51eb-8da5-dd70dfc2e54e with identifier: 1983634
2026-03-25 16:33:42 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:33:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 5c3e135f-8623-51eb-8da5-dd70dfc2e54e with identifier: 1983634
2026-03-25 16:33:42 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 5c3e135f-8623-51eb-8da5-dd70dfc2e54e with identifier: 1983634 to the API
2026-03-25 16:33:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:33:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:33:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gk2/041471b9ca2b4709a92efe080010e369/images/large/4.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'KARBON BLACK METALLIZZATO',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-27T09:30:00Z',
'fuel_type': 'diesel',
'id': '5c3e135f-8623-51eb-8da5-dd70dfc2e54e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41025',
'listing': 'auction',
'location': None,
'make': 'OPEL',
'model': 'OPEL GRANDLAND 1.5 130CV AT8 BUSINESS ELEGANCE FP',
'odometer': 168972,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 45,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c3e135f-8623-51eb-8da5-dd70dfc2e54e/5c3e135f-8623-51eb-8da5-dd70dfc2e54e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 723689,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk2/041471b9ca2b4709a92efe080010e369/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c3e135f-8623-51eb-8da5-dd70dfc2e54e/5c3e135f-8623-51eb-8da5-dd70dfc2e54e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 473315,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk2/041471b9ca2b4709a92efe080010e369/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c3e135f-8623-51eb-8da5-dd70dfc2e54e/5c3e135f-8623-51eb-8da5-dd70dfc2e54e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 362257,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk2/041471b9ca2b4709a92efe080010e369/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c3e135f-8623-51eb-8da5-dd70dfc2e54e/5c3e135f-8623-51eb-8da5-dd70dfc2e54e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 224806,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk2/041471b9ca2b4709a92efe080010e369/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c3e135f-8623-51eb-8da5-dd70dfc2e54e/5c3e135f-8623-51eb-8da5-dd70dfc2e54e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 502451,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk2/041471b9ca2b4709a92efe080010e369/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c3e135f-8623-51eb-8da5-dd70dfc2e54e/5c3e135f-8623-51eb-8da5-dd70dfc2e54e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 369317,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk2/041471b9ca2b4709a92efe080010e369/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c3e135f-8623-51eb-8da5-dd70dfc2e54e/5c3e135f-8623-51eb-8da5-dd70dfc2e54e_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 755046,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk2/041471b9ca2b4709a92efe080010e369/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c3e135f-8623-51eb-8da5-dd70dfc2e54e/5c3e135f-8623-51eb-8da5-dd70dfc2e54e_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 416669,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk2/041471b9ca2b4709a92efe080010e369/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c3e135f-8623-51eb-8da5-dd70dfc2e54e/5c3e135f-8623-51eb-8da5-dd70dfc2e54e_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 401357,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk2/041471b9ca2b4709a92efe080010e369/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c3e135f-8623-51eb-8da5-dd70dfc2e54e/5c3e135f-8623-51eb-8da5-dd70dfc2e54e_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 485711,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk2/041471b9ca2b4709a92efe080010e369/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-06-29',
'seats_number': 5,
'seller_name': None,
'title': 'OPEL OPEL GRANDLAND 1.5 130CV AT8 BUSINESS ELEGANCE FP -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-25 16:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983634%27 HTTP/1.1" 200 None
2026-03-25 16:33:43 [ayvens.it] INFO: Saving data for 1983634: {'created_time': 1774456423.087331, 'last_price_update_time': 1774456423.087342, 'auction_closing_time': 1774603800.0}
2026-03-25 16:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1983634') HTTP/1.1" 204 0
2026-03-25 16:33:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr7/e33ffe2913cb456c939e2bd77d6d2812/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr7/e33ffe2913cb456c939e2bd77d6d2812/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk2%252F2df5f44c0ebb4f8bbc3e67ca6e4a6b89%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk2/2df5f44c0ebb4f8bbc3e67ca6e4a6b89/images/large/9.jpg not downloaded yet
2026-03-25 16:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk2%252F2df5f44c0ebb4f8bbc3e67ca6e4a6b89%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk2/2df5f44c0ebb4f8bbc3e67ca6e4a6b89/images/large/10.jpg not downloaded yet
2026-03-25 16:33:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr7/e33ffe2913cb456c939e2bd77d6d2812/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr7/e33ffe2913cb456c939e2bd77d6d2812/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr7/e33ffe2913cb456c939e2bd77d6d2812/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:43 [ayvens.it] INFO: Found listing with ID: 1983637
2026-03-25 16:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983637%27 HTTP/1.1" 200 None
2026-03-25 16:33:43 [ayvens.it] INFO: Scrape type for 1983637: 1
2026-03-25 16:33:43 [ayvens.it] INFO: Extracting data for car ID: 1983637
2026-03-25 16:33:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b234bb2b-57d8-595b-9c7a-24a43c2514d8 with identifier: 1983637
2026-03-25 16:33:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b234bb2b-57d8-595b-9c7a-24a43c2514d8 with scrape type 1
2026-03-25 16:33:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b234bb2b-57d8-595b-9c7a-24a43c2514d8
2026-03-25 16:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf1%252F72735d23802c4b129e349963a3383e21%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf1/72735d23802c4b129e349963a3383e21/images/large/1.jpg not downloaded yet
2026-03-25 16:33:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr7/e33ffe2913cb456c939e2bd77d6d2812/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf1%252F72735d23802c4b129e349963a3383e21%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf1/72735d23802c4b129e349963a3383e21/images/large/2.jpg not downloaded yet
2026-03-25 16:33:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr7/e33ffe2913cb456c939e2bd77d6d2812/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr7/e33ffe2913cb456c939e2bd77d6d2812/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf1%252F72735d23802c4b129e349963a3383e21%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf1/72735d23802c4b129e349963a3383e21/images/large/3.jpg not downloaded yet
2026-03-25 16:33:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc5b62d0>
2026-03-25 16:33:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_faa8b061-2b73-5840-a0c7-43cded9d1c96/faa8b061-2b73-5840-a0c7-43cded9d1c96_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr7%252Fe33ffe2913cb456c939e2bd77d6d2812%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr7/e33ffe2913cb456c939e2bd77d6d2812/images/large/1.jpg saved to cache
2026-03-25 16:33:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item faa8b061-2b73-5840-a0c7-43cded9d1c96
2026-03-25 16:33:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc54a810>
2026-03-25 16:33:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_faa8b061-2b73-5840-a0c7-43cded9d1c96/faa8b061-2b73-5840-a0c7-43cded9d1c96_image_1.jpg HTTP/1.1" 201 0
2026-03-25 16:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr7%252Fe33ffe2913cb456c939e2bd77d6d2812%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr7/e33ffe2913cb456c939e2bd77d6d2812/images/large/2.jpg saved to cache
2026-03-25 16:33:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item faa8b061-2b73-5840-a0c7-43cded9d1c96
2026-03-25 16:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf1%252F72735d23802c4b129e349963a3383e21%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf1/72735d23802c4b129e349963a3383e21/images/large/4.jpg not downloaded yet
2026-03-25 16:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf1%252F72735d23802c4b129e349963a3383e21%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf1/72735d23802c4b129e349963a3383e21/images/large/5.jpg not downloaded yet
2026-03-25 16:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf1%252F72735d23802c4b129e349963a3383e21%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf1/72735d23802c4b129e349963a3383e21/images/large/6.jpg not downloaded yet
2026-03-25 16:33:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc5e83d0>
2026-03-25 16:33:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_faa8b061-2b73-5840-a0c7-43cded9d1c96/faa8b061-2b73-5840-a0c7-43cded9d1c96_image_5.jpg HTTP/1.1" 201 0
2026-03-25 16:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr7%252Fe33ffe2913cb456c939e2bd77d6d2812%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr7/e33ffe2913cb456c939e2bd77d6d2812/images/large/6.jpg saved to cache
2026-03-25 16:33:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item faa8b061-2b73-5840-a0c7-43cded9d1c96
2026-03-25 16:33:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc87b610>
2026-03-25 16:33:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_faa8b061-2b73-5840-a0c7-43cded9d1c96/faa8b061-2b73-5840-a0c7-43cded9d1c96_image_4.jpg HTTP/1.1" 201 0
2026-03-25 16:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr7%252Fe33ffe2913cb456c939e2bd77d6d2812%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr7/e33ffe2913cb456c939e2bd77d6d2812/images/large/5.jpg saved to cache
2026-03-25 16:33:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item faa8b061-2b73-5840-a0c7-43cded9d1c96
2026-03-25 16:33:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc589a90>
2026-03-25 16:33:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_faa8b061-2b73-5840-a0c7-43cded9d1c96/faa8b061-2b73-5840-a0c7-43cded9d1c96_image_3.jpg HTTP/1.1" 201 0
2026-03-25 16:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr7%252Fe33ffe2913cb456c939e2bd77d6d2812%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr7/e33ffe2913cb456c939e2bd77d6d2812/images/large/4.jpg saved to cache
2026-03-25 16:33:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item faa8b061-2b73-5840-a0c7-43cded9d1c96
2026-03-25 16:33:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc878d50>
2026-03-25 16:33:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_faa8b061-2b73-5840-a0c7-43cded9d1c96/faa8b061-2b73-5840-a0c7-43cded9d1c96_image_6.jpg HTTP/1.1" 201 0
2026-03-25 16:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr7%252Fe33ffe2913cb456c939e2bd77d6d2812%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr7/e33ffe2913cb456c939e2bd77d6d2812/images/large/7.jpg saved to cache
2026-03-25 16:33:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item faa8b061-2b73-5840-a0c7-43cded9d1c96
2026-03-25 16:33:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34d7d62d50>
2026-03-25 16:33:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_faa8b061-2b73-5840-a0c7-43cded9d1c96/faa8b061-2b73-5840-a0c7-43cded9d1c96_image_2.jpg HTTP/1.1" 201 0
2026-03-25 16:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr7%252Fe33ffe2913cb456c939e2bd77d6d2812%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr7/e33ffe2913cb456c939e2bd77d6d2812/images/large/3.jpg saved to cache
2026-03-25 16:33:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item faa8b061-2b73-5840-a0c7-43cded9d1c96
2026-03-25 16:33:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc87be90>
2026-03-25 16:33:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_faa8b061-2b73-5840-a0c7-43cded9d1c96/faa8b061-2b73-5840-a0c7-43cded9d1c96_image_7.jpg HTTP/1.1" 201 0
2026-03-25 16:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr7%252Fe33ffe2913cb456c939e2bd77d6d2812%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr7/e33ffe2913cb456c939e2bd77d6d2812/images/large/8.jpg saved to cache
2026-03-25 16:33:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item faa8b061-2b73-5840-a0c7-43cded9d1c96
2026-03-25 16:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf1%252F72735d23802c4b129e349963a3383e21%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf1/72735d23802c4b129e349963a3383e21/images/large/7.jpg not downloaded yet
2026-03-25 16:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf1%252F72735d23802c4b129e349963a3383e21%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf1/72735d23802c4b129e349963a3383e21/images/large/8.jpg not downloaded yet
2026-03-25 16:33:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk2/2df5f44c0ebb4f8bbc3e67ca6e4a6b89/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf1%252F72735d23802c4b129e349963a3383e21%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf1/72735d23802c4b129e349963a3383e21/images/large/9.jpg not downloaded yet
2026-03-25 16:33:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr7/e33ffe2913cb456c939e2bd77d6d2812/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr7/e33ffe2913cb456c939e2bd77d6d2812/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf1%252F72735d23802c4b129e349963a3383e21%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf1/72735d23802c4b129e349963a3383e21/images/large/10.jpg not downloaded yet
2026-03-25 16:33:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk2/2df5f44c0ebb4f8bbc3e67ca6e4a6b89/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk2/2df5f44c0ebb4f8bbc3e67ca6e4a6b89/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk2/2df5f44c0ebb4f8bbc3e67ca6e4a6b89/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:44 [ayvens.it] INFO: Found listing with ID: 1983638
2026-03-25 16:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983638%27 HTTP/1.1" 200 None
2026-03-25 16:33:44 [ayvens.it] INFO: Scrape type for 1983638: 1
2026-03-25 16:33:44 [ayvens.it] INFO: Extracting data for car ID: 1983638
2026-03-25 16:33:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 31980461-b272-54f2-9fec-4761f502b635 with identifier: 1983638
2026-03-25 16:33:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 31980461-b272-54f2-9fec-4761f502b635 with scrape type 1
2026-03-25 16:33:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 31980461-b272-54f2-9fec-4761f502b635
2026-03-25 16:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl1%252F873b413c4a314f4297dcc1c18fae0e31%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl1/873b413c4a314f4297dcc1c18fae0e31/images/large/1.jpg not downloaded yet
2026-03-25 16:33:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk2/2df5f44c0ebb4f8bbc3e67ca6e4a6b89/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl1%252F873b413c4a314f4297dcc1c18fae0e31%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl1/873b413c4a314f4297dcc1c18fae0e31/images/large/2.jpg not downloaded yet
2026-03-25 16:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl1%252F873b413c4a314f4297dcc1c18fae0e31%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl1/873b413c4a314f4297dcc1c18fae0e31/images/large/3.jpg not downloaded yet
2026-03-25 16:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl1%252F873b413c4a314f4297dcc1c18fae0e31%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl1/873b413c4a314f4297dcc1c18fae0e31/images/large/4.jpg not downloaded yet
2026-03-25 16:33:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcbb6d50>
2026-03-25 16:33:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98e56fdd-88b4-5ad9-ba6d-daca2b7599fa/98e56fdd-88b4-5ad9-ba6d-daca2b7599fa_image_2.jpg HTTP/1.1" 201 0
2026-03-25 16:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk2%252F2df5f44c0ebb4f8bbc3e67ca6e4a6b89%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk2/2df5f44c0ebb4f8bbc3e67ca6e4a6b89/images/large/3.jpg saved to cache
2026-03-25 16:33:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 98e56fdd-88b4-5ad9-ba6d-daca2b7599fa
2026-03-25 16:33:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr9/37c82360341040d198a24c54756d4934/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl1%252F873b413c4a314f4297dcc1c18fae0e31%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl1/873b413c4a314f4297dcc1c18fae0e31/images/large/5.jpg not downloaded yet
2026-03-25 16:33:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dce2d210>
2026-03-25 16:33:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_faa8b061-2b73-5840-a0c7-43cded9d1c96/faa8b061-2b73-5840-a0c7-43cded9d1c96_image_9.jpg HTTP/1.1" 201 0
2026-03-25 16:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr7%252Fe33ffe2913cb456c939e2bd77d6d2812%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr7/e33ffe2913cb456c939e2bd77d6d2812/images/large/10.jpg saved to cache
2026-03-25 16:33:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item faa8b061-2b73-5840-a0c7-43cded9d1c96
2026-03-25 16:33:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dca1b5d0>
2026-03-25 16:33:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_faa8b061-2b73-5840-a0c7-43cded9d1c96/faa8b061-2b73-5840-a0c7-43cded9d1c96_image_8.jpg HTTP/1.1" 201 0
2026-03-25 16:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr7%252Fe33ffe2913cb456c939e2bd77d6d2812%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr7/e33ffe2913cb456c939e2bd77d6d2812/images/large/9.jpg saved to cache
2026-03-25 16:33:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item faa8b061-2b73-5840-a0c7-43cded9d1c96
2026-03-25 16:33:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: faa8b061-2b73-5840-a0c7-43cded9d1c96, skipping ID generation
2026-03-25 16:33:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item faa8b061-2b73-5840-a0c7-43cded9d1c96 with scrape type 1
2026-03-25 16:33:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item faa8b061-2b73-5840-a0c7-43cded9d1c96 sending to next pipeline
2026-03-25 16:33:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: faa8b061-2b73-5840-a0c7-43cded9d1c96, identifier: 1983635
2026-03-25 16:33:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcaea150>
2026-03-25 16:33:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98e56fdd-88b4-5ad9-ba6d-daca2b7599fa/98e56fdd-88b4-5ad9-ba6d-daca2b7599fa_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk2%252F2df5f44c0ebb4f8bbc3e67ca6e4a6b89%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk2/2df5f44c0ebb4f8bbc3e67ca6e4a6b89/images/large/1.jpg saved to cache
2026-03-25 16:33:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 98e56fdd-88b4-5ad9-ba6d-daca2b7599fa
2026-03-25 16:33:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc802950>
2026-03-25 16:33:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98e56fdd-88b4-5ad9-ba6d-daca2b7599fa/98e56fdd-88b4-5ad9-ba6d-daca2b7599fa_image_3.jpg HTTP/1.1" 201 0
2026-03-25 16:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk2%252F2df5f44c0ebb4f8bbc3e67ca6e4a6b89%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk2/2df5f44c0ebb4f8bbc3e67ca6e4a6b89/images/large/4.jpg saved to cache
2026-03-25 16:33:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 98e56fdd-88b4-5ad9-ba6d-daca2b7599fa
2026-03-25 16:33:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc64b790>
2026-03-25 16:33:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98e56fdd-88b4-5ad9-ba6d-daca2b7599fa/98e56fdd-88b4-5ad9-ba6d-daca2b7599fa_image_1.jpg HTTP/1.1" 201 0
2026-03-25 16:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk2%252F2df5f44c0ebb4f8bbc3e67ca6e4a6b89%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk2/2df5f44c0ebb4f8bbc3e67ca6e4a6b89/images/large/2.jpg saved to cache
2026-03-25 16:33:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 98e56fdd-88b4-5ad9-ba6d-daca2b7599fa
2026-03-25 16:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl1%252F873b413c4a314f4297dcc1c18fae0e31%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl1/873b413c4a314f4297dcc1c18fae0e31/images/large/6.jpg not downloaded yet
2026-03-25 16:33:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: faa8b061-2b73-5840-a0c7-43cded9d1c96 with identifier: 1983635
2026-03-25 16:33:44 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:33:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: faa8b061-2b73-5840-a0c7-43cded9d1c96 with identifier: 1983635
2026-03-25 16:33:44 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: faa8b061-2b73-5840-a0c7-43cded9d1c96 with identifier: 1983635 to the API
2026-03-25 16:33:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:33:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:33:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gr7/e33ffe2913cb456c939e2bd77d6d2812/images/large/9.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'META BLACK METALLIC',
'currency': 'EUR',
'doors_number': 5,
'engine': '',
'expiration_date': '2026-03-27T09:30:00Z',
'fuel_type': 'electric',
'id': 'faa8b061-2b73-5840-a0c7-43cded9d1c96',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41025',
'listing': 'auction',
'location': None,
'make': 'SMART',
'model': 'SMART #1 66 kWh Pro+ Sport utility vehicle 5-door',
'odometer': 23014,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 14,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_faa8b061-2b73-5840-a0c7-43cded9d1c96/faa8b061-2b73-5840-a0c7-43cded9d1c96_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 841732,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr7/e33ffe2913cb456c939e2bd77d6d2812/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_faa8b061-2b73-5840-a0c7-43cded9d1c96/faa8b061-2b73-5840-a0c7-43cded9d1c96_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 841732,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr7/e33ffe2913cb456c939e2bd77d6d2812/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_faa8b061-2b73-5840-a0c7-43cded9d1c96/faa8b061-2b73-5840-a0c7-43cded9d1c96_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 728816,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr7/e33ffe2913cb456c939e2bd77d6d2812/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_faa8b061-2b73-5840-a0c7-43cded9d1c96/faa8b061-2b73-5840-a0c7-43cded9d1c96_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 827619,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr7/e33ffe2913cb456c939e2bd77d6d2812/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_faa8b061-2b73-5840-a0c7-43cded9d1c96/faa8b061-2b73-5840-a0c7-43cded9d1c96_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 701930,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr7/e33ffe2913cb456c939e2bd77d6d2812/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_faa8b061-2b73-5840-a0c7-43cded9d1c96/faa8b061-2b73-5840-a0c7-43cded9d1c96_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 666251,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr7/e33ffe2913cb456c939e2bd77d6d2812/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_faa8b061-2b73-5840-a0c7-43cded9d1c96/faa8b061-2b73-5840-a0c7-43cded9d1c96_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 637753,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr7/e33ffe2913cb456c939e2bd77d6d2812/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_faa8b061-2b73-5840-a0c7-43cded9d1c96/faa8b061-2b73-5840-a0c7-43cded9d1c96_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 528007,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr7/e33ffe2913cb456c939e2bd77d6d2812/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_faa8b061-2b73-5840-a0c7-43cded9d1c96/faa8b061-2b73-5840-a0c7-43cded9d1c96_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 671702,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr7/e33ffe2913cb456c939e2bd77d6d2812/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_faa8b061-2b73-5840-a0c7-43cded9d1c96/faa8b061-2b73-5840-a0c7-43cded9d1c96_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 630863,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr7/e33ffe2913cb456c939e2bd77d6d2812/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-09-13',
'seats_number': 5,
'seller_name': None,
'title': 'SMART SMART #1 66 kWh Pro+ Sport utility vehicle 5-door -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2023}
2026-03-25 16:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983635%27 HTTP/1.1" 200 None
2026-03-25 16:33:45 [ayvens.it] INFO: Saving data for 1983635: {'created_time': 1774456425.358065, 'last_price_update_time': 1774456425.358077, 'auction_closing_time': 1774603800.0}
2026-03-25 16:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1983635') HTTP/1.1" 204 0
2026-03-25 16:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl1%252F873b413c4a314f4297dcc1c18fae0e31%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl1/873b413c4a314f4297dcc1c18fae0e31/images/large/7.jpg not downloaded yet
2026-03-25 16:33:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34d7dafc10>
2026-03-25 16:33:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98e56fdd-88b4-5ad9-ba6d-daca2b7599fa/98e56fdd-88b4-5ad9-ba6d-daca2b7599fa_image_4.jpg HTTP/1.1" 201 0
2026-03-25 16:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk2%252F2df5f44c0ebb4f8bbc3e67ca6e4a6b89%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk2/2df5f44c0ebb4f8bbc3e67ca6e4a6b89/images/large/5.jpg saved to cache
2026-03-25 16:33:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 98e56fdd-88b4-5ad9-ba6d-daca2b7599fa
2026-03-25 16:33:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc2fc6d0>
2026-03-25 16:33:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e68fe672-5693-5f9d-80bd-54c0e8bc5ea8/e68fe672-5693-5f9d-80bd-54c0e8bc5ea8_image_9.jpg HTTP/1.1" 201 0
2026-03-25 16:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr9%252F37c82360341040d198a24c54756d4934%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr9/37c82360341040d198a24c54756d4934/images/large/10.jpg saved to cache
2026-03-25 16:33:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e68fe672-5693-5f9d-80bd-54c0e8bc5ea8
2026-03-25 16:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl1%252F873b413c4a314f4297dcc1c18fae0e31%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl1/873b413c4a314f4297dcc1c18fae0e31/images/large/8.jpg not downloaded yet
2026-03-25 16:33:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk2/2df5f44c0ebb4f8bbc3e67ca6e4a6b89/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf1/72735d23802c4b129e349963a3383e21/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl1%252F873b413c4a314f4297dcc1c18fae0e31%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl1/873b413c4a314f4297dcc1c18fae0e31/images/large/9.jpg not downloaded yet
2026-03-25 16:33:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk2/2df5f44c0ebb4f8bbc3e67ca6e4a6b89/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk2/2df5f44c0ebb4f8bbc3e67ca6e4a6b89/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk2/2df5f44c0ebb4f8bbc3e67ca6e4a6b89/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk2/2df5f44c0ebb4f8bbc3e67ca6e4a6b89/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf1/72735d23802c4b129e349963a3383e21/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl1%252F873b413c4a314f4297dcc1c18fae0e31%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl1/873b413c4a314f4297dcc1c18fae0e31/images/large/10.jpg not downloaded yet
2026-03-25 16:33:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf1/72735d23802c4b129e349963a3383e21/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:45 [ayvens.it] INFO: Found listing with ID: 1983639
2026-03-25 16:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983639%27 HTTP/1.1" 200 None
2026-03-25 16:33:45 [ayvens.it] INFO: Scrape type for 1983639: 1
2026-03-25 16:33:45 [ayvens.it] INFO: Extracting data for car ID: 1983639
2026-03-25 16:33:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3f26b538-3014-5b45-9cbe-c0d8ec7dfd01 with identifier: 1983639
2026-03-25 16:33:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3f26b538-3014-5b45-9cbe-c0d8ec7dfd01 with scrape type 1
2026-03-25 16:33:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3f26b538-3014-5b45-9cbe-c0d8ec7dfd01
2026-03-25 16:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj2%252F9baa31c9d2274d90b97e2b17ddbe9e4d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj2/9baa31c9d2274d90b97e2b17ddbe9e4d/images/large/1.jpg not downloaded yet
2026-03-25 16:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj2%252F9baa31c9d2274d90b97e2b17ddbe9e4d%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj2/9baa31c9d2274d90b97e2b17ddbe9e4d/images/large/2.jpg not downloaded yet
2026-03-25 16:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj2%252F9baa31c9d2274d90b97e2b17ddbe9e4d%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj2/9baa31c9d2274d90b97e2b17ddbe9e4d/images/large/3.jpg not downloaded yet
2026-03-25 16:33:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc5bc9d0>
2026-03-25 16:33:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98e56fdd-88b4-5ad9-ba6d-daca2b7599fa/98e56fdd-88b4-5ad9-ba6d-daca2b7599fa_image_7.jpg HTTP/1.1" 201 0
2026-03-25 16:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk2%252F2df5f44c0ebb4f8bbc3e67ca6e4a6b89%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk2/2df5f44c0ebb4f8bbc3e67ca6e4a6b89/images/large/8.jpg saved to cache
2026-03-25 16:33:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 98e56fdd-88b4-5ad9-ba6d-daca2b7599fa
2026-03-25 16:33:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dca63dd0>
2026-03-25 16:33:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b234bb2b-57d8-595b-9c7a-24a43c2514d8/b234bb2b-57d8-595b-9c7a-24a43c2514d8_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf1%252F72735d23802c4b129e349963a3383e21%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf1/72735d23802c4b129e349963a3383e21/images/large/1.jpg saved to cache
2026-03-25 16:33:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b234bb2b-57d8-595b-9c7a-24a43c2514d8
2026-03-25 16:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj2%252F9baa31c9d2274d90b97e2b17ddbe9e4d%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj2/9baa31c9d2274d90b97e2b17ddbe9e4d/images/large/4.jpg not downloaded yet
2026-03-25 16:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj2%252F9baa31c9d2274d90b97e2b17ddbe9e4d%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj2/9baa31c9d2274d90b97e2b17ddbe9e4d/images/large/5.jpg not downloaded yet
2026-03-25 16:33:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34d7441810>
2026-03-25 16:33:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98e56fdd-88b4-5ad9-ba6d-daca2b7599fa/98e56fdd-88b4-5ad9-ba6d-daca2b7599fa_image_5.jpg HTTP/1.1" 201 0
2026-03-25 16:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk2%252F2df5f44c0ebb4f8bbc3e67ca6e4a6b89%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk2/2df5f44c0ebb4f8bbc3e67ca6e4a6b89/images/large/6.jpg saved to cache
2026-03-25 16:33:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 98e56fdd-88b4-5ad9-ba6d-daca2b7599fa
2026-03-25 16:33:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc942d90>
2026-03-25 16:33:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98e56fdd-88b4-5ad9-ba6d-daca2b7599fa/98e56fdd-88b4-5ad9-ba6d-daca2b7599fa_image_6.jpg HTTP/1.1" 201 0
2026-03-25 16:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk2%252F2df5f44c0ebb4f8bbc3e67ca6e4a6b89%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk2/2df5f44c0ebb4f8bbc3e67ca6e4a6b89/images/large/7.jpg saved to cache
2026-03-25 16:33:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 98e56fdd-88b4-5ad9-ba6d-daca2b7599fa
2026-03-25 16:33:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc92a6d0>
2026-03-25 16:33:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98e56fdd-88b4-5ad9-ba6d-daca2b7599fa/98e56fdd-88b4-5ad9-ba6d-daca2b7599fa_image_9.jpg HTTP/1.1" 201 0
2026-03-25 16:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk2%252F2df5f44c0ebb4f8bbc3e67ca6e4a6b89%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk2/2df5f44c0ebb4f8bbc3e67ca6e4a6b89/images/large/10.jpg saved to cache
2026-03-25 16:33:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 98e56fdd-88b4-5ad9-ba6d-daca2b7599fa
2026-03-25 16:33:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc928290>
2026-03-25 16:33:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98e56fdd-88b4-5ad9-ba6d-daca2b7599fa/98e56fdd-88b4-5ad9-ba6d-daca2b7599fa_image_8.jpg HTTP/1.1" 201 0
2026-03-25 16:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk2%252F2df5f44c0ebb4f8bbc3e67ca6e4a6b89%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk2/2df5f44c0ebb4f8bbc3e67ca6e4a6b89/images/large/9.jpg saved to cache
2026-03-25 16:33:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 98e56fdd-88b4-5ad9-ba6d-daca2b7599fa
2026-03-25 16:33:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 98e56fdd-88b4-5ad9-ba6d-daca2b7599fa, skipping ID generation
2026-03-25 16:33:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 98e56fdd-88b4-5ad9-ba6d-daca2b7599fa with scrape type 1
2026-03-25 16:33:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 98e56fdd-88b4-5ad9-ba6d-daca2b7599fa sending to next pipeline
2026-03-25 16:33:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 98e56fdd-88b4-5ad9-ba6d-daca2b7599fa, identifier: 1983636
2026-03-25 16:33:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dea7f090>
2026-03-25 16:33:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b234bb2b-57d8-595b-9c7a-24a43c2514d8/b234bb2b-57d8-595b-9c7a-24a43c2514d8_image_3.jpg HTTP/1.1" 201 0
2026-03-25 16:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf1%252F72735d23802c4b129e349963a3383e21%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf1/72735d23802c4b129e349963a3383e21/images/large/4.jpg saved to cache
2026-03-25 16:33:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b234bb2b-57d8-595b-9c7a-24a43c2514d8
2026-03-25 16:33:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc943550>
2026-03-25 16:33:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b234bb2b-57d8-595b-9c7a-24a43c2514d8/b234bb2b-57d8-595b-9c7a-24a43c2514d8_image_2.jpg HTTP/1.1" 201 0
2026-03-25 16:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf1%252F72735d23802c4b129e349963a3383e21%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf1/72735d23802c4b129e349963a3383e21/images/large/3.jpg saved to cache
2026-03-25 16:33:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b234bb2b-57d8-595b-9c7a-24a43c2514d8
2026-03-25 16:33:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 98e56fdd-88b4-5ad9-ba6d-daca2b7599fa with identifier: 1983636
2026-03-25 16:33:46 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:33:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 98e56fdd-88b4-5ad9-ba6d-daca2b7599fa with identifier: 1983636
2026-03-25 16:33:46 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 98e56fdd-88b4-5ad9-ba6d-daca2b7599fa with identifier: 1983636 to the API
2026-03-25 16:33:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:33:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:33:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gk2/2df5f44c0ebb4f8bbc3e67ca6e4a6b89/images/large/9.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'GRIGIO MAGNETICO METALLIZZATO',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-27T09:30:00Z',
'fuel_type': 'hybrid',
'id': '98e56fdd-88b4-5ad9-ba6d-daca2b7599fa',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41025',
'listing': 'auction',
'location': None,
'make': 'SEAT',
'model': 'SEAT LEON SW 1.5 ETSI 110KW BUSINESS DSG FP',
'odometer': 153927,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 30,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98e56fdd-88b4-5ad9-ba6d-daca2b7599fa/98e56fdd-88b4-5ad9-ba6d-daca2b7599fa_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 750735,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk2/2df5f44c0ebb4f8bbc3e67ca6e4a6b89/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98e56fdd-88b4-5ad9-ba6d-daca2b7599fa/98e56fdd-88b4-5ad9-ba6d-daca2b7599fa_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 750735,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk2/2df5f44c0ebb4f8bbc3e67ca6e4a6b89/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98e56fdd-88b4-5ad9-ba6d-daca2b7599fa/98e56fdd-88b4-5ad9-ba6d-daca2b7599fa_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 711890,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk2/2df5f44c0ebb4f8bbc3e67ca6e4a6b89/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98e56fdd-88b4-5ad9-ba6d-daca2b7599fa/98e56fdd-88b4-5ad9-ba6d-daca2b7599fa_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 717337,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk2/2df5f44c0ebb4f8bbc3e67ca6e4a6b89/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98e56fdd-88b4-5ad9-ba6d-daca2b7599fa/98e56fdd-88b4-5ad9-ba6d-daca2b7599fa_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 744668,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk2/2df5f44c0ebb4f8bbc3e67ca6e4a6b89/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98e56fdd-88b4-5ad9-ba6d-daca2b7599fa/98e56fdd-88b4-5ad9-ba6d-daca2b7599fa_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 638091,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk2/2df5f44c0ebb4f8bbc3e67ca6e4a6b89/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98e56fdd-88b4-5ad9-ba6d-daca2b7599fa/98e56fdd-88b4-5ad9-ba6d-daca2b7599fa_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 546962,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk2/2df5f44c0ebb4f8bbc3e67ca6e4a6b89/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98e56fdd-88b4-5ad9-ba6d-daca2b7599fa/98e56fdd-88b4-5ad9-ba6d-daca2b7599fa_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 546962,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk2/2df5f44c0ebb4f8bbc3e67ca6e4a6b89/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98e56fdd-88b4-5ad9-ba6d-daca2b7599fa/98e56fdd-88b4-5ad9-ba6d-daca2b7599fa_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 660187,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk2/2df5f44c0ebb4f8bbc3e67ca6e4a6b89/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98e56fdd-88b4-5ad9-ba6d-daca2b7599fa/98e56fdd-88b4-5ad9-ba6d-daca2b7599fa_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 566990,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk2/2df5f44c0ebb4f8bbc3e67ca6e4a6b89/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-06-14',
'seats_number': 5,
'seller_name': None,
'title': 'SEAT SEAT LEON SW 1.5 ETSI 110KW BUSINESS DSG FP -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-25 16:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983636%27 HTTP/1.1" 200 None
2026-03-25 16:33:47 [ayvens.it] INFO: Saving data for 1983636: {'created_time': 1774456427.058732, 'last_price_update_time': 1774456427.058745, 'auction_closing_time': 1774603800.0}
2026-03-25 16:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1983636') HTTP/1.1" 204 0
2026-03-25 16:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj2%252F9baa31c9d2274d90b97e2b17ddbe9e4d%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj2/9baa31c9d2274d90b97e2b17ddbe9e4d/images/large/6.jpg not downloaded yet
2026-03-25 16:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj2%252F9baa31c9d2274d90b97e2b17ddbe9e4d%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj2/9baa31c9d2274d90b97e2b17ddbe9e4d/images/large/7.jpg not downloaded yet
2026-03-25 16:33:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf1/72735d23802c4b129e349963a3383e21/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf1/72735d23802c4b129e349963a3383e21/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf1/72735d23802c4b129e349963a3383e21/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf1/72735d23802c4b129e349963a3383e21/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf1/72735d23802c4b129e349963a3383e21/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf1/72735d23802c4b129e349963a3383e21/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj2%252F9baa31c9d2274d90b97e2b17ddbe9e4d%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj2/9baa31c9d2274d90b97e2b17ddbe9e4d/images/large/8.jpg not downloaded yet
2026-03-25 16:33:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl1/873b413c4a314f4297dcc1c18fae0e31/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj2%252F9baa31c9d2274d90b97e2b17ddbe9e4d%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj2/9baa31c9d2274d90b97e2b17ddbe9e4d/images/large/9.jpg not downloaded yet
2026-03-25 16:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj2%252F9baa31c9d2274d90b97e2b17ddbe9e4d%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj2/9baa31c9d2274d90b97e2b17ddbe9e4d/images/large/10.jpg not downloaded yet
2026-03-25 16:33:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl1/873b413c4a314f4297dcc1c18fae0e31/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:47 [ayvens.it] INFO: Found listing with ID: 1983640
2026-03-25 16:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983640%27 HTTP/1.1" 200 None
2026-03-25 16:33:47 [ayvens.it] INFO: Scrape type for 1983640: 1
2026-03-25 16:33:47 [ayvens.it] INFO: Extracting data for car ID: 1983640
2026-03-25 16:33:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 084155de-6d5a-5744-82b0-8a6ba2c2d6c2 with identifier: 1983640
2026-03-25 16:33:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 084155de-6d5a-5744-82b0-8a6ba2c2d6c2 with scrape type 1
2026-03-25 16:33:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 084155de-6d5a-5744-82b0-8a6ba2c2d6c2
2026-03-25 16:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg0%252F32846e25335d48619c285a6b7891011f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg0/32846e25335d48619c285a6b7891011f/images/large/1.jpg not downloaded yet
2026-03-25 16:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg0%252F32846e25335d48619c285a6b7891011f%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg0/32846e25335d48619c285a6b7891011f/images/large/2.jpg not downloaded yet
2026-03-25 16:33:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34d7d5b150>
2026-03-25 16:33:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b234bb2b-57d8-595b-9c7a-24a43c2514d8/b234bb2b-57d8-595b-9c7a-24a43c2514d8_image_4.jpg HTTP/1.1" 201 0
2026-03-25 16:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf1%252F72735d23802c4b129e349963a3383e21%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf1/72735d23802c4b129e349963a3383e21/images/large/5.jpg saved to cache
2026-03-25 16:33:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b234bb2b-57d8-595b-9c7a-24a43c2514d8
2026-03-25 16:33:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34de160a90>
2026-03-25 16:33:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b234bb2b-57d8-595b-9c7a-24a43c2514d8/b234bb2b-57d8-595b-9c7a-24a43c2514d8_image_6.jpg HTTP/1.1" 201 0
2026-03-25 16:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf1%252F72735d23802c4b129e349963a3383e21%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf1/72735d23802c4b129e349963a3383e21/images/large/7.jpg saved to cache
2026-03-25 16:33:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b234bb2b-57d8-595b-9c7a-24a43c2514d8
2026-03-25 16:33:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcc18c10>
2026-03-25 16:33:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b234bb2b-57d8-595b-9c7a-24a43c2514d8/b234bb2b-57d8-595b-9c7a-24a43c2514d8_image_8.jpg HTTP/1.1" 201 0
2026-03-25 16:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf1%252F72735d23802c4b129e349963a3383e21%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf1/72735d23802c4b129e349963a3383e21/images/large/9.jpg saved to cache
2026-03-25 16:33:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b234bb2b-57d8-595b-9c7a-24a43c2514d8
2026-03-25 16:33:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcbb7850>
2026-03-25 16:33:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b234bb2b-57d8-595b-9c7a-24a43c2514d8/b234bb2b-57d8-595b-9c7a-24a43c2514d8_image_9.jpg HTTP/1.1" 201 0
2026-03-25 16:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf1%252F72735d23802c4b129e349963a3383e21%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf1/72735d23802c4b129e349963a3383e21/images/large/10.jpg saved to cache
2026-03-25 16:33:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b234bb2b-57d8-595b-9c7a-24a43c2514d8
2026-03-25 16:33:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc546ed0>
2026-03-25 16:33:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b234bb2b-57d8-595b-9c7a-24a43c2514d8/b234bb2b-57d8-595b-9c7a-24a43c2514d8_image_5.jpg HTTP/1.1" 201 0
2026-03-25 16:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf1%252F72735d23802c4b129e349963a3383e21%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf1/72735d23802c4b129e349963a3383e21/images/large/6.jpg saved to cache
2026-03-25 16:33:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b234bb2b-57d8-595b-9c7a-24a43c2514d8
2026-03-25 16:33:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc9e5090>
2026-03-25 16:33:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b234bb2b-57d8-595b-9c7a-24a43c2514d8/b234bb2b-57d8-595b-9c7a-24a43c2514d8_image_7.jpg HTTP/1.1" 201 0
2026-03-25 16:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf1%252F72735d23802c4b129e349963a3383e21%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf1/72735d23802c4b129e349963a3383e21/images/large/8.jpg saved to cache
2026-03-25 16:33:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b234bb2b-57d8-595b-9c7a-24a43c2514d8
2026-03-25 16:33:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcc1acd0>
2026-03-25 16:33:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31980461-b272-54f2-9fec-4761f502b635/31980461-b272-54f2-9fec-4761f502b635_image_5.jpg HTTP/1.1" 201 0
2026-03-25 16:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl1%252F873b413c4a314f4297dcc1c18fae0e31%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl1/873b413c4a314f4297dcc1c18fae0e31/images/large/6.jpg saved to cache
2026-03-25 16:33:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 31980461-b272-54f2-9fec-4761f502b635
2026-03-25 16:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg0%252F32846e25335d48619c285a6b7891011f%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg0/32846e25335d48619c285a6b7891011f/images/large/3.jpg not downloaded yet
2026-03-25 16:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg0%252F32846e25335d48619c285a6b7891011f%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg0/32846e25335d48619c285a6b7891011f/images/large/4.jpg not downloaded yet
2026-03-25 16:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg0%252F32846e25335d48619c285a6b7891011f%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg0/32846e25335d48619c285a6b7891011f/images/large/5.jpg not downloaded yet
2026-03-25 16:33:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34de564490>
2026-03-25 16:33:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31980461-b272-54f2-9fec-4761f502b635/31980461-b272-54f2-9fec-4761f502b635_image_4.jpg HTTP/1.1" 201 0
2026-03-25 16:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl1%252F873b413c4a314f4297dcc1c18fae0e31%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl1/873b413c4a314f4297dcc1c18fae0e31/images/large/5.jpg saved to cache
2026-03-25 16:33:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 31980461-b272-54f2-9fec-4761f502b635
2026-03-25 16:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg0%252F32846e25335d48619c285a6b7891011f%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg0/32846e25335d48619c285a6b7891011f/images/large/6.jpg not downloaded yet
2026-03-25 16:33:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl1/873b413c4a314f4297dcc1c18fae0e31/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl1/873b413c4a314f4297dcc1c18fae0e31/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl1/873b413c4a314f4297dcc1c18fae0e31/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf1/72735d23802c4b129e349963a3383e21/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg0%252F32846e25335d48619c285a6b7891011f%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg0/32846e25335d48619c285a6b7891011f/images/large/7.jpg not downloaded yet
2026-03-25 16:33:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl1/873b413c4a314f4297dcc1c18fae0e31/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg0%252F32846e25335d48619c285a6b7891011f%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg0/32846e25335d48619c285a6b7891011f/images/large/8.jpg not downloaded yet
2026-03-25 16:33:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl1/873b413c4a314f4297dcc1c18fae0e31/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl1/873b413c4a314f4297dcc1c18fae0e31/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg0%252F32846e25335d48619c285a6b7891011f%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg0/32846e25335d48619c285a6b7891011f/images/large/9.jpg not downloaded yet
2026-03-25 16:33:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl1/873b413c4a314f4297dcc1c18fae0e31/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg0%252F32846e25335d48619c285a6b7891011f%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg0/32846e25335d48619c285a6b7891011f/images/large/10.jpg not downloaded yet
2026-03-25 16:33:48 [ayvens.it] INFO: Found listing with ID: 1983641
2026-03-25 16:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983641%27 HTTP/1.1" 200 None
2026-03-25 16:33:48 [ayvens.it] INFO: Scrape type for 1983641: 1
2026-03-25 16:33:48 [ayvens.it] INFO: Extracting data for car ID: 1983641
2026-03-25 16:33:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: af60076f-7b2a-5ee2-aa7f-31347f615641 with identifier: 1983641
2026-03-25 16:33:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item af60076f-7b2a-5ee2-aa7f-31347f615641 with scrape type 1
2026-03-25 16:33:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item af60076f-7b2a-5ee2-aa7f-31347f615641
2026-03-25 16:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh5%252Fdca8761aaa804fd884980603c51c3179%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh5/dca8761aaa804fd884980603c51c3179/images/large/1.jpg not downloaded yet
2026-03-25 16:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh5%252Fdca8761aaa804fd884980603c51c3179%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh5/dca8761aaa804fd884980603c51c3179/images/large/2.jpg not downloaded yet
2026-03-25 16:33:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcc1b750>
2026-03-25 16:33:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31980461-b272-54f2-9fec-4761f502b635/31980461-b272-54f2-9fec-4761f502b635_image_8.jpg HTTP/1.1" 201 0
2026-03-25 16:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl1%252F873b413c4a314f4297dcc1c18fae0e31%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl1/873b413c4a314f4297dcc1c18fae0e31/images/large/9.jpg saved to cache
2026-03-25 16:33:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 31980461-b272-54f2-9fec-4761f502b635
2026-03-25 16:33:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dca19490>
2026-03-25 16:33:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31980461-b272-54f2-9fec-4761f502b635/31980461-b272-54f2-9fec-4761f502b635_image_6.jpg HTTP/1.1" 201 0
2026-03-25 16:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl1%252F873b413c4a314f4297dcc1c18fae0e31%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl1/873b413c4a314f4297dcc1c18fae0e31/images/large/7.jpg saved to cache
2026-03-25 16:33:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 31980461-b272-54f2-9fec-4761f502b635
2026-03-25 16:33:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc309390>
2026-03-25 16:33:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31980461-b272-54f2-9fec-4761f502b635/31980461-b272-54f2-9fec-4761f502b635_image_7.jpg HTTP/1.1" 201 0
2026-03-25 16:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl1%252F873b413c4a314f4297dcc1c18fae0e31%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl1/873b413c4a314f4297dcc1c18fae0e31/images/large/8.jpg saved to cache
2026-03-25 16:33:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 31980461-b272-54f2-9fec-4761f502b635
2026-03-25 16:33:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc64ae10>
2026-03-25 16:33:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b234bb2b-57d8-595b-9c7a-24a43c2514d8/b234bb2b-57d8-595b-9c7a-24a43c2514d8_image_1.jpg HTTP/1.1" 201 0
2026-03-25 16:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf1%252F72735d23802c4b129e349963a3383e21%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf1/72735d23802c4b129e349963a3383e21/images/large/2.jpg saved to cache
2026-03-25 16:33:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b234bb2b-57d8-595b-9c7a-24a43c2514d8
2026-03-25 16:33:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b234bb2b-57d8-595b-9c7a-24a43c2514d8, skipping ID generation
2026-03-25 16:33:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b234bb2b-57d8-595b-9c7a-24a43c2514d8 with scrape type 1
2026-03-25 16:33:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b234bb2b-57d8-595b-9c7a-24a43c2514d8 sending to next pipeline
2026-03-25 16:33:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: b234bb2b-57d8-595b-9c7a-24a43c2514d8, identifier: 1983637
2026-03-25 16:33:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc62acd0>
2026-03-25 16:33:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31980461-b272-54f2-9fec-4761f502b635/31980461-b272-54f2-9fec-4761f502b635_image_3.jpg HTTP/1.1" 201 0
2026-03-25 16:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl1%252F873b413c4a314f4297dcc1c18fae0e31%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl1/873b413c4a314f4297dcc1c18fae0e31/images/large/4.jpg saved to cache
2026-03-25 16:33:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 31980461-b272-54f2-9fec-4761f502b635
2026-03-25 16:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh5%252Fdca8761aaa804fd884980603c51c3179%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh5/dca8761aaa804fd884980603c51c3179/images/large/3.jpg not downloaded yet
2026-03-25 16:33:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: b234bb2b-57d8-595b-9c7a-24a43c2514d8 with identifier: 1983637
2026-03-25 16:33:48 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:33:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: b234bb2b-57d8-595b-9c7a-24a43c2514d8 with identifier: 1983637
2026-03-25 16:33:48 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: b234bb2b-57d8-595b-9c7a-24a43c2514d8 with identifier: 1983637 to the API
2026-03-25 16:33:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:33:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:33:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gf1/72735d23802c4b129e349963a3383e21/images/large/2.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'BIANCO BANQUISE PASTELLO',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-27T09:30:00Z',
'fuel_type': 'diesel',
'id': 'b234bb2b-57d8-595b-9c7a-24a43c2514d8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41025',
'listing': 'auction',
'location': None,
'make': 'CITROËN',
'model': 'CITROEN C3 BLUEHDI 100 S&S FEEL VAN FP',
'odometer': 140048,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 18,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b234bb2b-57d8-595b-9c7a-24a43c2514d8/b234bb2b-57d8-595b-9c7a-24a43c2514d8_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 480867,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf1/72735d23802c4b129e349963a3383e21/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b234bb2b-57d8-595b-9c7a-24a43c2514d8/b234bb2b-57d8-595b-9c7a-24a43c2514d8_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 477549,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf1/72735d23802c4b129e349963a3383e21/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b234bb2b-57d8-595b-9c7a-24a43c2514d8/b234bb2b-57d8-595b-9c7a-24a43c2514d8_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 480867,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf1/72735d23802c4b129e349963a3383e21/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b234bb2b-57d8-595b-9c7a-24a43c2514d8/b234bb2b-57d8-595b-9c7a-24a43c2514d8_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 592160,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf1/72735d23802c4b129e349963a3383e21/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b234bb2b-57d8-595b-9c7a-24a43c2514d8/b234bb2b-57d8-595b-9c7a-24a43c2514d8_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 508026,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf1/72735d23802c4b129e349963a3383e21/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b234bb2b-57d8-595b-9c7a-24a43c2514d8/b234bb2b-57d8-595b-9c7a-24a43c2514d8_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 539023,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf1/72735d23802c4b129e349963a3383e21/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b234bb2b-57d8-595b-9c7a-24a43c2514d8/b234bb2b-57d8-595b-9c7a-24a43c2514d8_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 522461,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf1/72735d23802c4b129e349963a3383e21/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b234bb2b-57d8-595b-9c7a-24a43c2514d8/b234bb2b-57d8-595b-9c7a-24a43c2514d8_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 543196,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf1/72735d23802c4b129e349963a3383e21/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b234bb2b-57d8-595b-9c7a-24a43c2514d8/b234bb2b-57d8-595b-9c7a-24a43c2514d8_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 505410,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf1/72735d23802c4b129e349963a3383e21/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b234bb2b-57d8-595b-9c7a-24a43c2514d8/b234bb2b-57d8-595b-9c7a-24a43c2514d8_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 436499,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf1/72735d23802c4b129e349963a3383e21/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-04-21',
'seats_number': 5,
'seller_name': None,
'title': 'CITROËN CITROEN C3 BLUEHDI 100 S&S FEEL VAN FP -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2021}
2026-03-25 16:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983637%27 HTTP/1.1" 200 None
2026-03-25 16:33:49 [ayvens.it] INFO: Saving data for 1983637: {'created_time': 1774456429.198794, 'last_price_update_time': 1774456429.198804, 'auction_closing_time': 1774603800.0}
2026-03-25 16:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1983637') HTTP/1.1" 204 0
2026-03-25 16:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh5%252Fdca8761aaa804fd884980603c51c3179%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh5/dca8761aaa804fd884980603c51c3179/images/large/4.jpg not downloaded yet
2026-03-25 16:33:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcadbfd0>
2026-03-25 16:33:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31980461-b272-54f2-9fec-4761f502b635/31980461-b272-54f2-9fec-4761f502b635_image_1.jpg HTTP/1.1" 201 0
2026-03-25 16:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl1%252F873b413c4a314f4297dcc1c18fae0e31%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl1/873b413c4a314f4297dcc1c18fae0e31/images/large/2.jpg saved to cache
2026-03-25 16:33:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 31980461-b272-54f2-9fec-4761f502b635
2026-03-25 16:33:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc637b10>
2026-03-25 16:33:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31980461-b272-54f2-9fec-4761f502b635/31980461-b272-54f2-9fec-4761f502b635_image_2.jpg HTTP/1.1" 201 0
2026-03-25 16:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl1%252F873b413c4a314f4297dcc1c18fae0e31%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl1/873b413c4a314f4297dcc1c18fae0e31/images/large/3.jpg saved to cache
2026-03-25 16:33:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 31980461-b272-54f2-9fec-4761f502b635
2026-03-25 16:33:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcde2290>
2026-03-25 16:33:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31980461-b272-54f2-9fec-4761f502b635/31980461-b272-54f2-9fec-4761f502b635_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl1%252F873b413c4a314f4297dcc1c18fae0e31%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl1/873b413c4a314f4297dcc1c18fae0e31/images/large/1.jpg saved to cache
2026-03-25 16:33:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 31980461-b272-54f2-9fec-4761f502b635
2026-03-25 16:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh5%252Fdca8761aaa804fd884980603c51c3179%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh5/dca8761aaa804fd884980603c51c3179/images/large/5.jpg not downloaded yet
2026-03-25 16:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh5%252Fdca8761aaa804fd884980603c51c3179%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh5/dca8761aaa804fd884980603c51c3179/images/large/6.jpg not downloaded yet
2026-03-25 16:33:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj2/9baa31c9d2274d90b97e2b17ddbe9e4d/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh5%252Fdca8761aaa804fd884980603c51c3179%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh5/dca8761aaa804fd884980603c51c3179/images/large/7.jpg not downloaded yet
2026-03-25 16:33:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj2/9baa31c9d2274d90b97e2b17ddbe9e4d/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj2/9baa31c9d2274d90b97e2b17ddbe9e4d/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj2/9baa31c9d2274d90b97e2b17ddbe9e4d/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj2/9baa31c9d2274d90b97e2b17ddbe9e4d/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh5%252Fdca8761aaa804fd884980603c51c3179%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh5/dca8761aaa804fd884980603c51c3179/images/large/8.jpg not downloaded yet
2026-03-25 16:33:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj2/9baa31c9d2274d90b97e2b17ddbe9e4d/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj2/9baa31c9d2274d90b97e2b17ddbe9e4d/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj2/9baa31c9d2274d90b97e2b17ddbe9e4d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh5%252Fdca8761aaa804fd884980603c51c3179%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh5/dca8761aaa804fd884980603c51c3179/images/large/9.jpg not downloaded yet
2026-03-25 16:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh5%252Fdca8761aaa804fd884980603c51c3179%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh5/dca8761aaa804fd884980603c51c3179/images/large/10.jpg not downloaded yet
2026-03-25 16:33:49 [ayvens.it] INFO: Found listing with ID: 1983642
2026-03-25 16:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983642%27 HTTP/1.1" 200 None
2026-03-25 16:33:49 [ayvens.it] INFO: Scrape type for 1983642: 1
2026-03-25 16:33:49 [ayvens.it] INFO: Extracting data for car ID: 1983642
2026-03-25 16:33:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0ed70d07-7f53-519a-9c6e-07489eefec7f with identifier: 1983642
2026-03-25 16:33:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0ed70d07-7f53-519a-9c6e-07489eefec7f with scrape type 1
2026-03-25 16:33:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0ed70d07-7f53-519a-9c6e-07489eefec7f
2026-03-25 16:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw3%252Fa0424e9d06554414a7e17901fa142b75%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw3/a0424e9d06554414a7e17901fa142b75/images/large/1.jpg not downloaded yet
2026-03-25 16:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw3%252Fa0424e9d06554414a7e17901fa142b75%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw3/a0424e9d06554414a7e17901fa142b75/images/large/2.jpg not downloaded yet
2026-03-25 16:33:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc76c390>
2026-03-25 16:33:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f26b538-3014-5b45-9cbe-c0d8ec7dfd01/3f26b538-3014-5b45-9cbe-c0d8ec7dfd01_image_4.jpg HTTP/1.1" 201 0
2026-03-25 16:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj2%252F9baa31c9d2274d90b97e2b17ddbe9e4d%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj2/9baa31c9d2274d90b97e2b17ddbe9e4d/images/large/5.jpg saved to cache
2026-03-25 16:33:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3f26b538-3014-5b45-9cbe-c0d8ec7dfd01
2026-03-25 16:33:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dca44810>
2026-03-25 16:33:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f26b538-3014-5b45-9cbe-c0d8ec7dfd01/3f26b538-3014-5b45-9cbe-c0d8ec7dfd01_image_3.jpg HTTP/1.1" 201 0
2026-03-25 16:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj2%252F9baa31c9d2274d90b97e2b17ddbe9e4d%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj2/9baa31c9d2274d90b97e2b17ddbe9e4d/images/large/4.jpg saved to cache
2026-03-25 16:33:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3f26b538-3014-5b45-9cbe-c0d8ec7dfd01
2026-03-25 16:33:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dccf8490>
2026-03-25 16:33:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f26b538-3014-5b45-9cbe-c0d8ec7dfd01/3f26b538-3014-5b45-9cbe-c0d8ec7dfd01_image_5.jpg HTTP/1.1" 201 0
2026-03-25 16:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj2%252F9baa31c9d2274d90b97e2b17ddbe9e4d%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj2/9baa31c9d2274d90b97e2b17ddbe9e4d/images/large/6.jpg saved to cache
2026-03-25 16:33:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3f26b538-3014-5b45-9cbe-c0d8ec7dfd01
2026-03-25 16:33:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dccfb050>
2026-03-25 16:33:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f26b538-3014-5b45-9cbe-c0d8ec7dfd01/3f26b538-3014-5b45-9cbe-c0d8ec7dfd01_image_6.jpg HTTP/1.1" 201 0
2026-03-25 16:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj2%252F9baa31c9d2274d90b97e2b17ddbe9e4d%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj2/9baa31c9d2274d90b97e2b17ddbe9e4d/images/large/7.jpg saved to cache
2026-03-25 16:33:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3f26b538-3014-5b45-9cbe-c0d8ec7dfd01
2026-03-25 16:33:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dca47f10>
2026-03-25 16:33:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f26b538-3014-5b45-9cbe-c0d8ec7dfd01/3f26b538-3014-5b45-9cbe-c0d8ec7dfd01_image_8.jpg HTTP/1.1" 201 0
2026-03-25 16:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj2%252F9baa31c9d2274d90b97e2b17ddbe9e4d%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj2/9baa31c9d2274d90b97e2b17ddbe9e4d/images/large/9.jpg saved to cache
2026-03-25 16:33:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3f26b538-3014-5b45-9cbe-c0d8ec7dfd01
2026-03-25 16:33:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc94f810>
2026-03-25 16:33:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f26b538-3014-5b45-9cbe-c0d8ec7dfd01/3f26b538-3014-5b45-9cbe-c0d8ec7dfd01_image_1.jpg HTTP/1.1" 201 0
2026-03-25 16:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj2%252F9baa31c9d2274d90b97e2b17ddbe9e4d%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj2/9baa31c9d2274d90b97e2b17ddbe9e4d/images/large/2.jpg saved to cache
2026-03-25 16:33:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3f26b538-3014-5b45-9cbe-c0d8ec7dfd01
2026-03-25 16:33:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc9c9910>
2026-03-25 16:33:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f26b538-3014-5b45-9cbe-c0d8ec7dfd01/3f26b538-3014-5b45-9cbe-c0d8ec7dfd01_image_2.jpg HTTP/1.1" 201 0
2026-03-25 16:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj2%252F9baa31c9d2274d90b97e2b17ddbe9e4d%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj2/9baa31c9d2274d90b97e2b17ddbe9e4d/images/large/3.jpg saved to cache
2026-03-25 16:33:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3f26b538-3014-5b45-9cbe-c0d8ec7dfd01
2026-03-25 16:33:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dca9f690>
2026-03-25 16:33:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f26b538-3014-5b45-9cbe-c0d8ec7dfd01/3f26b538-3014-5b45-9cbe-c0d8ec7dfd01_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj2%252F9baa31c9d2274d90b97e2b17ddbe9e4d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj2/9baa31c9d2274d90b97e2b17ddbe9e4d/images/large/1.jpg saved to cache
2026-03-25 16:33:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3f26b538-3014-5b45-9cbe-c0d8ec7dfd01
2026-03-25 16:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw3%252Fa0424e9d06554414a7e17901fa142b75%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw3/a0424e9d06554414a7e17901fa142b75/images/large/3.jpg not downloaded yet
2026-03-25 16:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw3%252Fa0424e9d06554414a7e17901fa142b75%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw3/a0424e9d06554414a7e17901fa142b75/images/large/4.jpg not downloaded yet
2026-03-25 16:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw3%252Fa0424e9d06554414a7e17901fa142b75%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw3/a0424e9d06554414a7e17901fa142b75/images/large/5.jpg not downloaded yet
2026-03-25 16:33:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg0/32846e25335d48619c285a6b7891011f/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg0/32846e25335d48619c285a6b7891011f/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw3%252Fa0424e9d06554414a7e17901fa142b75%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw3/a0424e9d06554414a7e17901fa142b75/images/large/6.jpg not downloaded yet
2026-03-25 16:33:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg0/32846e25335d48619c285a6b7891011f/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg0/32846e25335d48619c285a6b7891011f/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg0/32846e25335d48619c285a6b7891011f/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh5/dca8761aaa804fd884980603c51c3179/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh5/dca8761aaa804fd884980603c51c3179/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw3%252Fa0424e9d06554414a7e17901fa142b75%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw3/a0424e9d06554414a7e17901fa142b75/images/large/7.jpg not downloaded yet
2026-03-25 16:33:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh5/dca8761aaa804fd884980603c51c3179/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw3%252Fa0424e9d06554414a7e17901fa142b75%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw3/a0424e9d06554414a7e17901fa142b75/images/large/8.jpg not downloaded yet
2026-03-25 16:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw3%252Fa0424e9d06554414a7e17901fa142b75%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw3/a0424e9d06554414a7e17901fa142b75/images/large/9.jpg not downloaded yet
2026-03-25 16:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw3%252Fa0424e9d06554414a7e17901fa142b75%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw3/a0424e9d06554414a7e17901fa142b75/images/large/10.jpg not downloaded yet
2026-03-25 16:33:50 [ayvens.it] INFO: Found listing with ID: 1983643
2026-03-25 16:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983643%27 HTTP/1.1" 200 None
2026-03-25 16:33:50 [ayvens.it] INFO: Scrape type for 1983643: 1
2026-03-25 16:33:50 [ayvens.it] INFO: Extracting data for car ID: 1983643
2026-03-25 16:33:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 529f8bf8-8eca-5cc1-bc57-c32dca723da7 with identifier: 1983643
2026-03-25 16:33:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 529f8bf8-8eca-5cc1-bc57-c32dca723da7 with scrape type 1
2026-03-25 16:33:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 529f8bf8-8eca-5cc1-bc57-c32dca723da7
2026-03-25 16:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw5%252F627e30186c9240ecbd1f1fc8f663932d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw5/627e30186c9240ecbd1f1fc8f663932d/images/large/1.jpg not downloaded yet
2026-03-25 16:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw5%252F627e30186c9240ecbd1f1fc8f663932d%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw5/627e30186c9240ecbd1f1fc8f663932d/images/large/2.jpg not downloaded yet
2026-03-25 16:33:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc9cacd0>
2026-03-25 16:33:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_084155de-6d5a-5744-82b0-8a6ba2c2d6c2/084155de-6d5a-5744-82b0-8a6ba2c2d6c2_image_6.jpg HTTP/1.1" 201 0
2026-03-25 16:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg0%252F32846e25335d48619c285a6b7891011f%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg0/32846e25335d48619c285a6b7891011f/images/large/7.jpg saved to cache
2026-03-25 16:33:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 084155de-6d5a-5744-82b0-8a6ba2c2d6c2
2026-03-25 16:33:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc5540d0>
2026-03-25 16:33:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_084155de-6d5a-5744-82b0-8a6ba2c2d6c2/084155de-6d5a-5744-82b0-8a6ba2c2d6c2_image_5.jpg HTTP/1.1" 201 0
2026-03-25 16:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg0%252F32846e25335d48619c285a6b7891011f%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg0/32846e25335d48619c285a6b7891011f/images/large/6.jpg saved to cache
2026-03-25 16:33:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 084155de-6d5a-5744-82b0-8a6ba2c2d6c2
2026-03-25 16:33:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc5861d0>
2026-03-25 16:33:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_084155de-6d5a-5744-82b0-8a6ba2c2d6c2/084155de-6d5a-5744-82b0-8a6ba2c2d6c2_image_2.jpg HTTP/1.1" 201 0
2026-03-25 16:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg0%252F32846e25335d48619c285a6b7891011f%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg0/32846e25335d48619c285a6b7891011f/images/large/3.jpg saved to cache
2026-03-25 16:33:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 084155de-6d5a-5744-82b0-8a6ba2c2d6c2
2026-03-25 16:33:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcb9a510>
2026-03-25 16:33:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_084155de-6d5a-5744-82b0-8a6ba2c2d6c2/084155de-6d5a-5744-82b0-8a6ba2c2d6c2_image_4.jpg HTTP/1.1" 201 0
2026-03-25 16:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg0%252F32846e25335d48619c285a6b7891011f%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg0/32846e25335d48619c285a6b7891011f/images/large/5.jpg saved to cache
2026-03-25 16:33:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 084155de-6d5a-5744-82b0-8a6ba2c2d6c2
2026-03-25 16:33:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc64bbd0>
2026-03-25 16:33:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_084155de-6d5a-5744-82b0-8a6ba2c2d6c2/084155de-6d5a-5744-82b0-8a6ba2c2d6c2_image_3.jpg HTTP/1.1" 201 0
2026-03-25 16:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg0%252F32846e25335d48619c285a6b7891011f%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg0/32846e25335d48619c285a6b7891011f/images/large/4.jpg saved to cache
2026-03-25 16:33:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 084155de-6d5a-5744-82b0-8a6ba2c2d6c2
2026-03-25 16:33:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc591d50>
2026-03-25 16:33:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af60076f-7b2a-5ee2-aa7f-31347f615641/af60076f-7b2a-5ee2-aa7f-31347f615641_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh5%252Fdca8761aaa804fd884980603c51c3179%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh5/dca8761aaa804fd884980603c51c3179/images/large/1.jpg saved to cache
2026-03-25 16:33:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item af60076f-7b2a-5ee2-aa7f-31347f615641
2026-03-25 16:33:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc649750>
2026-03-25 16:33:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af60076f-7b2a-5ee2-aa7f-31347f615641/af60076f-7b2a-5ee2-aa7f-31347f615641_image_1.jpg HTTP/1.1" 201 0
2026-03-25 16:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh5%252Fdca8761aaa804fd884980603c51c3179%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh5/dca8761aaa804fd884980603c51c3179/images/large/2.jpg saved to cache
2026-03-25 16:33:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item af60076f-7b2a-5ee2-aa7f-31347f615641
2026-03-25 16:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw5%252F627e30186c9240ecbd1f1fc8f663932d%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw5/627e30186c9240ecbd1f1fc8f663932d/images/large/3.jpg not downloaded yet
2026-03-25 16:33:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc824590>
2026-03-25 16:33:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af60076f-7b2a-5ee2-aa7f-31347f615641/af60076f-7b2a-5ee2-aa7f-31347f615641_image_2.jpg HTTP/1.1" 201 0
2026-03-25 16:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh5%252Fdca8761aaa804fd884980603c51c3179%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh5/dca8761aaa804fd884980603c51c3179/images/large/3.jpg saved to cache
2026-03-25 16:33:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item af60076f-7b2a-5ee2-aa7f-31347f615641
2026-03-25 16:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw5%252F627e30186c9240ecbd1f1fc8f663932d%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw5/627e30186c9240ecbd1f1fc8f663932d/images/large/4.jpg not downloaded yet
2026-03-25 16:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw5%252F627e30186c9240ecbd1f1fc8f663932d%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw5/627e30186c9240ecbd1f1fc8f663932d/images/large/5.jpg not downloaded yet
2026-03-25 16:33:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh5/dca8761aaa804fd884980603c51c3179/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw5%252F627e30186c9240ecbd1f1fc8f663932d%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw5/627e30186c9240ecbd1f1fc8f663932d/images/large/6.jpg not downloaded yet
2026-03-25 16:33:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh5/dca8761aaa804fd884980603c51c3179/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fw3/a0424e9d06554414a7e17901fa142b75/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh5/dca8761aaa804fd884980603c51c3179/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw5%252F627e30186c9240ecbd1f1fc8f663932d%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw5/627e30186c9240ecbd1f1fc8f663932d/images/large/7.jpg not downloaded yet
2026-03-25 16:33:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fw3/a0424e9d06554414a7e17901fa142b75/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fw3/a0424e9d06554414a7e17901fa142b75/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh5/dca8761aaa804fd884980603c51c3179/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh5/dca8761aaa804fd884980603c51c3179/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw5%252F627e30186c9240ecbd1f1fc8f663932d%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw5/627e30186c9240ecbd1f1fc8f663932d/images/large/8.jpg not downloaded yet
2026-03-25 16:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw5%252F627e30186c9240ecbd1f1fc8f663932d%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw5/627e30186c9240ecbd1f1fc8f663932d/images/large/9.jpg not downloaded yet
2026-03-25 16:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw5%252F627e30186c9240ecbd1f1fc8f663932d%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw5/627e30186c9240ecbd1f1fc8f663932d/images/large/10.jpg not downloaded yet
2026-03-25 16:33:51 [ayvens.it] INFO: Found listing with ID: 1983644
2026-03-25 16:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983644%27 HTTP/1.1" 200 None
2026-03-25 16:33:51 [ayvens.it] INFO: Scrape type for 1983644: 1
2026-03-25 16:33:51 [ayvens.it] INFO: Extracting data for car ID: 1983644
2026-03-25 16:33:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3e477d17-f202-5848-be6b-361f9695c549 with identifier: 1983644
2026-03-25 16:33:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3e477d17-f202-5848-be6b-361f9695c549 with scrape type 1
2026-03-25 16:33:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3e477d17-f202-5848-be6b-361f9695c549
2026-03-25 16:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl4%252Fdc19e02cca57456caafb51fc8c43034b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl4/dc19e02cca57456caafb51fc8c43034b/images/large/1.jpg not downloaded yet
2026-03-25 16:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl4%252Fdc19e02cca57456caafb51fc8c43034b%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl4/dc19e02cca57456caafb51fc8c43034b/images/large/2.jpg not downloaded yet
2026-03-25 16:33:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc91da90>
2026-03-25 16:33:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af60076f-7b2a-5ee2-aa7f-31347f615641/af60076f-7b2a-5ee2-aa7f-31347f615641_image_7.jpg HTTP/1.1" 201 0
2026-03-25 16:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh5%252Fdca8761aaa804fd884980603c51c3179%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh5/dca8761aaa804fd884980603c51c3179/images/large/8.jpg saved to cache
2026-03-25 16:33:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item af60076f-7b2a-5ee2-aa7f-31347f615641
2026-03-25 16:33:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcde3790>
2026-03-25 16:33:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af60076f-7b2a-5ee2-aa7f-31347f615641/af60076f-7b2a-5ee2-aa7f-31347f615641_image_4.jpg HTTP/1.1" 201 0
2026-03-25 16:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh5%252Fdca8761aaa804fd884980603c51c3179%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh5/dca8761aaa804fd884980603c51c3179/images/large/5.jpg saved to cache
2026-03-25 16:33:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item af60076f-7b2a-5ee2-aa7f-31347f615641
2026-03-25 16:33:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc82dc90>
2026-03-25 16:33:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ed70d07-7f53-519a-9c6e-07489eefec7f/0ed70d07-7f53-519a-9c6e-07489eefec7f_image_1.jpg HTTP/1.1" 201 0
2026-03-25 16:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw3%252Fa0424e9d06554414a7e17901fa142b75%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw3/a0424e9d06554414a7e17901fa142b75/images/large/2.jpg saved to cache
2026-03-25 16:33:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0ed70d07-7f53-519a-9c6e-07489eefec7f
2026-03-25 16:33:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc3828d0>
2026-03-25 16:33:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af60076f-7b2a-5ee2-aa7f-31347f615641/af60076f-7b2a-5ee2-aa7f-31347f615641_image_9.jpg HTTP/1.1" 201 0
2026-03-25 16:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh5%252Fdca8761aaa804fd884980603c51c3179%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh5/dca8761aaa804fd884980603c51c3179/images/large/10.jpg saved to cache
2026-03-25 16:33:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item af60076f-7b2a-5ee2-aa7f-31347f615641
2026-03-25 16:33:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc82e550>
2026-03-25 16:33:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ed70d07-7f53-519a-9c6e-07489eefec7f/0ed70d07-7f53-519a-9c6e-07489eefec7f_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw3%252Fa0424e9d06554414a7e17901fa142b75%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw3/a0424e9d06554414a7e17901fa142b75/images/large/1.jpg saved to cache
2026-03-25 16:33:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0ed70d07-7f53-519a-9c6e-07489eefec7f
2026-03-25 16:33:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc82d310>
2026-03-25 16:33:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ed70d07-7f53-519a-9c6e-07489eefec7f/0ed70d07-7f53-519a-9c6e-07489eefec7f_image_2.jpg HTTP/1.1" 201 0
2026-03-25 16:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw3%252Fa0424e9d06554414a7e17901fa142b75%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw3/a0424e9d06554414a7e17901fa142b75/images/large/3.jpg saved to cache
2026-03-25 16:33:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0ed70d07-7f53-519a-9c6e-07489eefec7f
2026-03-25 16:33:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcd8c310>
2026-03-25 16:33:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af60076f-7b2a-5ee2-aa7f-31347f615641/af60076f-7b2a-5ee2-aa7f-31347f615641_image_5.jpg HTTP/1.1" 201 0
2026-03-25 16:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh5%252Fdca8761aaa804fd884980603c51c3179%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh5/dca8761aaa804fd884980603c51c3179/images/large/6.jpg saved to cache
2026-03-25 16:33:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item af60076f-7b2a-5ee2-aa7f-31347f615641
2026-03-25 16:33:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc8d7310>
2026-03-25 16:33:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af60076f-7b2a-5ee2-aa7f-31347f615641/af60076f-7b2a-5ee2-aa7f-31347f615641_image_8.jpg HTTP/1.1" 201 0
2026-03-25 16:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh5%252Fdca8761aaa804fd884980603c51c3179%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh5/dca8761aaa804fd884980603c51c3179/images/large/9.jpg saved to cache
2026-03-25 16:33:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item af60076f-7b2a-5ee2-aa7f-31347f615641
2026-03-25 16:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl4%252Fdc19e02cca57456caafb51fc8c43034b%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl4/dc19e02cca57456caafb51fc8c43034b/images/large/3.jpg not downloaded yet
2026-03-25 16:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl4%252Fdc19e02cca57456caafb51fc8c43034b%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl4/dc19e02cca57456caafb51fc8c43034b/images/large/4.jpg not downloaded yet
2026-03-25 16:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl4%252Fdc19e02cca57456caafb51fc8c43034b%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl4/dc19e02cca57456caafb51fc8c43034b/images/large/5.jpg not downloaded yet
2026-03-25 16:33:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh5/dca8761aaa804fd884980603c51c3179/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl4%252Fdc19e02cca57456caafb51fc8c43034b%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl4/dc19e02cca57456caafb51fc8c43034b/images/large/6.jpg not downloaded yet
2026-03-25 16:33:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fw3/a0424e9d06554414a7e17901fa142b75/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg0/32846e25335d48619c285a6b7891011f/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg0/32846e25335d48619c285a6b7891011f/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fw3/a0424e9d06554414a7e17901fa142b75/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fw3/a0424e9d06554414a7e17901fa142b75/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl4%252Fdc19e02cca57456caafb51fc8c43034b%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl4/dc19e02cca57456caafb51fc8c43034b/images/large/7.jpg not downloaded yet
2026-03-25 16:33:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg0/32846e25335d48619c285a6b7891011f/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh5/dca8761aaa804fd884980603c51c3179/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl4%252Fdc19e02cca57456caafb51fc8c43034b%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl4/dc19e02cca57456caafb51fc8c43034b/images/large/8.jpg not downloaded yet
2026-03-25 16:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl4%252Fdc19e02cca57456caafb51fc8c43034b%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl4/dc19e02cca57456caafb51fc8c43034b/images/large/9.jpg not downloaded yet
2026-03-25 16:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl4%252Fdc19e02cca57456caafb51fc8c43034b%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl4/dc19e02cca57456caafb51fc8c43034b/images/large/10.jpg not downloaded yet
2026-03-25 16:33:52 [ayvens.it] INFO: Found listing with ID: 1983645
2026-03-25 16:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983645%27 HTTP/1.1" 200 None
2026-03-25 16:33:52 [ayvens.it] INFO: Scrape type for 1983645: 1
2026-03-25 16:33:52 [ayvens.it] INFO: Extracting data for car ID: 1983645
2026-03-25 16:33:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b21c9297-2aab-5439-b236-62e408f17181 with identifier: 1983645
2026-03-25 16:33:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b21c9297-2aab-5439-b236-62e408f17181 with scrape type 1
2026-03-25 16:33:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b21c9297-2aab-5439-b236-62e408f17181
2026-03-25 16:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx6%252Fa1a85cf5a5d24bdba3952fe5e83348af%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx6/a1a85cf5a5d24bdba3952fe5e83348af/images/large/1.jpg not downloaded yet
2026-03-25 16:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx6%252Fa1a85cf5a5d24bdba3952fe5e83348af%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx6/a1a85cf5a5d24bdba3952fe5e83348af/images/large/2.jpg not downloaded yet
2026-03-25 16:33:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcdb9510>
2026-03-25 16:33:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af60076f-7b2a-5ee2-aa7f-31347f615641/af60076f-7b2a-5ee2-aa7f-31347f615641_image_6.jpg HTTP/1.1" 201 0
2026-03-25 16:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh5%252Fdca8761aaa804fd884980603c51c3179%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh5/dca8761aaa804fd884980603c51c3179/images/large/7.jpg saved to cache
2026-03-25 16:33:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item af60076f-7b2a-5ee2-aa7f-31347f615641
2026-03-25 16:33:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34d74956d0>
2026-03-25 16:33:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ed70d07-7f53-519a-9c6e-07489eefec7f/0ed70d07-7f53-519a-9c6e-07489eefec7f_image_3.jpg HTTP/1.1" 201 0
2026-03-25 16:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw3%252Fa0424e9d06554414a7e17901fa142b75%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw3/a0424e9d06554414a7e17901fa142b75/images/large/4.jpg saved to cache
2026-03-25 16:33:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0ed70d07-7f53-519a-9c6e-07489eefec7f
2026-03-25 16:33:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc76ec90>
2026-03-25 16:33:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_084155de-6d5a-5744-82b0-8a6ba2c2d6c2/084155de-6d5a-5744-82b0-8a6ba2c2d6c2_image_9.jpg HTTP/1.1" 201 0
2026-03-25 16:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg0%252F32846e25335d48619c285a6b7891011f%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg0/32846e25335d48619c285a6b7891011f/images/large/10.jpg saved to cache
2026-03-25 16:33:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 084155de-6d5a-5744-82b0-8a6ba2c2d6c2
2026-03-25 16:33:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dca76ed0>
2026-03-25 16:33:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_084155de-6d5a-5744-82b0-8a6ba2c2d6c2/084155de-6d5a-5744-82b0-8a6ba2c2d6c2_image_7.jpg HTTP/1.1" 201 0
2026-03-25 16:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg0%252F32846e25335d48619c285a6b7891011f%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg0/32846e25335d48619c285a6b7891011f/images/large/8.jpg saved to cache
2026-03-25 16:33:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 084155de-6d5a-5744-82b0-8a6ba2c2d6c2
2026-03-25 16:33:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc879a50>
2026-03-25 16:33:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ed70d07-7f53-519a-9c6e-07489eefec7f/0ed70d07-7f53-519a-9c6e-07489eefec7f_image_4.jpg HTTP/1.1" 201 0
2026-03-25 16:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw3%252Fa0424e9d06554414a7e17901fa142b75%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw3/a0424e9d06554414a7e17901fa142b75/images/large/5.jpg saved to cache
2026-03-25 16:33:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0ed70d07-7f53-519a-9c6e-07489eefec7f
2026-03-25 16:33:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcbb6d10>
2026-03-25 16:33:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ed70d07-7f53-519a-9c6e-07489eefec7f/0ed70d07-7f53-519a-9c6e-07489eefec7f_image_5.jpg HTTP/1.1" 201 0
2026-03-25 16:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw3%252Fa0424e9d06554414a7e17901fa142b75%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw3/a0424e9d06554414a7e17901fa142b75/images/large/6.jpg saved to cache
2026-03-25 16:33:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0ed70d07-7f53-519a-9c6e-07489eefec7f
2026-03-25 16:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx6%252Fa1a85cf5a5d24bdba3952fe5e83348af%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx6/a1a85cf5a5d24bdba3952fe5e83348af/images/large/3.jpg not downloaded yet
2026-03-25 16:33:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34d7441a90>
2026-03-25 16:33:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_084155de-6d5a-5744-82b0-8a6ba2c2d6c2/084155de-6d5a-5744-82b0-8a6ba2c2d6c2_image_8.jpg HTTP/1.1" 201 0
2026-03-25 16:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg0%252F32846e25335d48619c285a6b7891011f%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg0/32846e25335d48619c285a6b7891011f/images/large/9.jpg saved to cache
2026-03-25 16:33:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 084155de-6d5a-5744-82b0-8a6ba2c2d6c2
2026-03-25 16:33:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcb16850>
2026-03-25 16:33:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af60076f-7b2a-5ee2-aa7f-31347f615641/af60076f-7b2a-5ee2-aa7f-31347f615641_image_3.jpg HTTP/1.1" 201 0
2026-03-25 16:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh5%252Fdca8761aaa804fd884980603c51c3179%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh5/dca8761aaa804fd884980603c51c3179/images/large/4.jpg saved to cache
2026-03-25 16:33:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item af60076f-7b2a-5ee2-aa7f-31347f615641
2026-03-25 16:33:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: af60076f-7b2a-5ee2-aa7f-31347f615641, skipping ID generation
2026-03-25 16:33:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item af60076f-7b2a-5ee2-aa7f-31347f615641 with scrape type 1
2026-03-25 16:33:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item af60076f-7b2a-5ee2-aa7f-31347f615641 sending to next pipeline
2026-03-25 16:33:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: af60076f-7b2a-5ee2-aa7f-31347f615641, identifier: 1983641
2026-03-25 16:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx6%252Fa1a85cf5a5d24bdba3952fe5e83348af%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx6/a1a85cf5a5d24bdba3952fe5e83348af/images/large/4.jpg not downloaded yet
2026-03-25 16:33:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: af60076f-7b2a-5ee2-aa7f-31347f615641 with identifier: 1983641
2026-03-25 16:33:53 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:33:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: af60076f-7b2a-5ee2-aa7f-31347f615641 with identifier: 1983641
2026-03-25 16:33:54 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: af60076f-7b2a-5ee2-aa7f-31347f615641 with identifier: 1983641 to the API
2026-03-25 16:33:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:33:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:33:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gh5/dca8761aaa804fd884980603c51c3179/images/large/4.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'BIANCO MADREPERLA',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-27T09:30:00Z',
'fuel_type': 'diesel',
'id': 'af60076f-7b2a-5ee2-aa7f-31347f615641',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41025',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': 'PEUGEOT 3008 N1 BLUEHDI 130 S&S ACTIVE BUSINESS FP',
'odometer': 105299,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 18,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af60076f-7b2a-5ee2-aa7f-31347f615641/af60076f-7b2a-5ee2-aa7f-31347f615641_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 548745,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh5/dca8761aaa804fd884980603c51c3179/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af60076f-7b2a-5ee2-aa7f-31347f615641/af60076f-7b2a-5ee2-aa7f-31347f615641_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 548745,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh5/dca8761aaa804fd884980603c51c3179/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af60076f-7b2a-5ee2-aa7f-31347f615641/af60076f-7b2a-5ee2-aa7f-31347f615641_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 524492,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh5/dca8761aaa804fd884980603c51c3179/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af60076f-7b2a-5ee2-aa7f-31347f615641/af60076f-7b2a-5ee2-aa7f-31347f615641_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 599612,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh5/dca8761aaa804fd884980603c51c3179/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af60076f-7b2a-5ee2-aa7f-31347f615641/af60076f-7b2a-5ee2-aa7f-31347f615641_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 604278,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh5/dca8761aaa804fd884980603c51c3179/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af60076f-7b2a-5ee2-aa7f-31347f615641/af60076f-7b2a-5ee2-aa7f-31347f615641_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 555654,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh5/dca8761aaa804fd884980603c51c3179/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af60076f-7b2a-5ee2-aa7f-31347f615641/af60076f-7b2a-5ee2-aa7f-31347f615641_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 527991,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh5/dca8761aaa804fd884980603c51c3179/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af60076f-7b2a-5ee2-aa7f-31347f615641/af60076f-7b2a-5ee2-aa7f-31347f615641_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 572514,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh5/dca8761aaa804fd884980603c51c3179/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af60076f-7b2a-5ee2-aa7f-31347f615641/af60076f-7b2a-5ee2-aa7f-31347f615641_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 556122,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh5/dca8761aaa804fd884980603c51c3179/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af60076f-7b2a-5ee2-aa7f-31347f615641/af60076f-7b2a-5ee2-aa7f-31347f615641_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 470272,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh5/dca8761aaa804fd884980603c51c3179/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-09-02',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT PEUGEOT 3008 N1 BLUEHDI 130 S&S ACTIVE BUSINESS FP -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2021}
2026-03-25 16:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983641%27 HTTP/1.1" 200 None
2026-03-25 16:33:54 [ayvens.it] INFO: Saving data for 1983641: {'created_time': 1774456434.344003, 'last_price_update_time': 1774456434.344014, 'auction_closing_time': 1774603800.0}
2026-03-25 16:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1983641') HTTP/1.1" 204 0
2026-03-25 16:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx6%252Fa1a85cf5a5d24bdba3952fe5e83348af%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx6/a1a85cf5a5d24bdba3952fe5e83348af/images/large/5.jpg not downloaded yet
2026-03-25 16:33:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fw5/627e30186c9240ecbd1f1fc8f663932d/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx6%252Fa1a85cf5a5d24bdba3952fe5e83348af%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx6/a1a85cf5a5d24bdba3952fe5e83348af/images/large/6.jpg not downloaded yet
2026-03-25 16:33:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fw5/627e30186c9240ecbd1f1fc8f663932d/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fw5/627e30186c9240ecbd1f1fc8f663932d/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fw5/627e30186c9240ecbd1f1fc8f663932d/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx6%252Fa1a85cf5a5d24bdba3952fe5e83348af%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx6/a1a85cf5a5d24bdba3952fe5e83348af/images/large/7.jpg not downloaded yet
2026-03-25 16:33:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fl4/dc19e02cca57456caafb51fc8c43034b/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fw5/627e30186c9240ecbd1f1fc8f663932d/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx6%252Fa1a85cf5a5d24bdba3952fe5e83348af%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx6/a1a85cf5a5d24bdba3952fe5e83348af/images/large/8.jpg not downloaded yet
2026-03-25 16:33:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fl4/dc19e02cca57456caafb51fc8c43034b/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fl4/dc19e02cca57456caafb51fc8c43034b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx6%252Fa1a85cf5a5d24bdba3952fe5e83348af%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx6/a1a85cf5a5d24bdba3952fe5e83348af/images/large/9.jpg not downloaded yet
2026-03-25 16:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx6%252Fa1a85cf5a5d24bdba3952fe5e83348af%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx6/a1a85cf5a5d24bdba3952fe5e83348af/images/large/10.jpg not downloaded yet
2026-03-25 16:33:54 [ayvens.it] INFO: Found listing with ID: 1983646
2026-03-25 16:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983646%27 HTTP/1.1" 200 None
2026-03-25 16:33:54 [ayvens.it] INFO: Scrape type for 1983646: 1
2026-03-25 16:33:54 [ayvens.it] INFO: Extracting data for car ID: 1983646
2026-03-25 16:33:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9307fa4f-4aa1-5b76-947b-8451840fae63 with identifier: 1983646
2026-03-25 16:33:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9307fa4f-4aa1-5b76-947b-8451840fae63 with scrape type 1
2026-03-25 16:33:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9307fa4f-4aa1-5b76-947b-8451840fae63
2026-03-25 16:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv5%252Fd9e52072d552428ba13c61575842de28%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv5/d9e52072d552428ba13c61575842de28/images/large/1.jpg not downloaded yet
2026-03-25 16:33:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc8e1ed0>
2026-03-25 16:33:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_529f8bf8-8eca-5cc1-bc57-c32dca723da7/529f8bf8-8eca-5cc1-bc57-c32dca723da7_image_7.jpg HTTP/1.1" 201 0
2026-03-25 16:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw5%252F627e30186c9240ecbd1f1fc8f663932d%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw5/627e30186c9240ecbd1f1fc8f663932d/images/large/8.jpg saved to cache
2026-03-25 16:33:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 529f8bf8-8eca-5cc1-bc57-c32dca723da7
2026-03-25 16:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv5%252Fd9e52072d552428ba13c61575842de28%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv5/d9e52072d552428ba13c61575842de28/images/large/2.jpg not downloaded yet
2026-03-25 16:33:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dca20b90>
2026-03-25 16:33:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_529f8bf8-8eca-5cc1-bc57-c32dca723da7/529f8bf8-8eca-5cc1-bc57-c32dca723da7_image_4.jpg HTTP/1.1" 201 0
2026-03-25 16:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw5%252F627e30186c9240ecbd1f1fc8f663932d%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw5/627e30186c9240ecbd1f1fc8f663932d/images/large/5.jpg saved to cache
2026-03-25 16:33:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 529f8bf8-8eca-5cc1-bc57-c32dca723da7
2026-03-25 16:33:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dca19d50>
2026-03-25 16:33:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_529f8bf8-8eca-5cc1-bc57-c32dca723da7/529f8bf8-8eca-5cc1-bc57-c32dca723da7_image_9.jpg HTTP/1.1" 201 0
2026-03-25 16:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw5%252F627e30186c9240ecbd1f1fc8f663932d%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw5/627e30186c9240ecbd1f1fc8f663932d/images/large/10.jpg saved to cache
2026-03-25 16:33:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 529f8bf8-8eca-5cc1-bc57-c32dca723da7
2026-03-25 16:33:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc60fc90>
2026-03-25 16:33:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_529f8bf8-8eca-5cc1-bc57-c32dca723da7/529f8bf8-8eca-5cc1-bc57-c32dca723da7_image_6.jpg HTTP/1.1" 201 0
2026-03-25 16:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw5%252F627e30186c9240ecbd1f1fc8f663932d%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw5/627e30186c9240ecbd1f1fc8f663932d/images/large/7.jpg saved to cache
2026-03-25 16:33:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 529f8bf8-8eca-5cc1-bc57-c32dca723da7
2026-03-25 16:33:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc5b4150>
2026-03-25 16:33:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3e477d17-f202-5848-be6b-361f9695c549/3e477d17-f202-5848-be6b-361f9695c549_image_2.jpg HTTP/1.1" 201 0
2026-03-25 16:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl4%252Fdc19e02cca57456caafb51fc8c43034b%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl4/dc19e02cca57456caafb51fc8c43034b/images/large/3.jpg saved to cache
2026-03-25 16:33:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3e477d17-f202-5848-be6b-361f9695c549
2026-03-25 16:33:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcaf7bd0>
2026-03-25 16:33:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_529f8bf8-8eca-5cc1-bc57-c32dca723da7/529f8bf8-8eca-5cc1-bc57-c32dca723da7_image_8.jpg HTTP/1.1" 201 0
2026-03-25 16:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw5%252F627e30186c9240ecbd1f1fc8f663932d%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw5/627e30186c9240ecbd1f1fc8f663932d/images/large/9.jpg saved to cache
2026-03-25 16:33:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 529f8bf8-8eca-5cc1-bc57-c32dca723da7
2026-03-25 16:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv5%252Fd9e52072d552428ba13c61575842de28%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv5/d9e52072d552428ba13c61575842de28/images/large/3.jpg not downloaded yet
2026-03-25 16:33:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc89d050>
2026-03-25 16:33:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3e477d17-f202-5848-be6b-361f9695c549/3e477d17-f202-5848-be6b-361f9695c549_image_1.jpg HTTP/1.1" 201 0
2026-03-25 16:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl4%252Fdc19e02cca57456caafb51fc8c43034b%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl4/dc19e02cca57456caafb51fc8c43034b/images/large/2.jpg saved to cache
2026-03-25 16:33:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3e477d17-f202-5848-be6b-361f9695c549
2026-03-25 16:33:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc5fa5d0>
2026-03-25 16:33:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3e477d17-f202-5848-be6b-361f9695c549/3e477d17-f202-5848-be6b-361f9695c549_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl4%252Fdc19e02cca57456caafb51fc8c43034b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl4/dc19e02cca57456caafb51fc8c43034b/images/large/1.jpg saved to cache
2026-03-25 16:33:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3e477d17-f202-5848-be6b-361f9695c549
2026-03-25 16:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv5%252Fd9e52072d552428ba13c61575842de28%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv5/d9e52072d552428ba13c61575842de28/images/large/4.jpg not downloaded yet
2026-03-25 16:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv5%252Fd9e52072d552428ba13c61575842de28%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv5/d9e52072d552428ba13c61575842de28/images/large/5.jpg not downloaded yet
2026-03-25 16:33:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fw5/627e30186c9240ecbd1f1fc8f663932d/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv5%252Fd9e52072d552428ba13c61575842de28%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv5/d9e52072d552428ba13c61575842de28/images/large/6.jpg not downloaded yet
2026-03-25 16:33:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fw5/627e30186c9240ecbd1f1fc8f663932d/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fl4/dc19e02cca57456caafb51fc8c43034b/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fl4/dc19e02cca57456caafb51fc8c43034b/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv5%252Fd9e52072d552428ba13c61575842de28%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv5/d9e52072d552428ba13c61575842de28/images/large/7.jpg not downloaded yet
2026-03-25 16:33:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx6/a1a85cf5a5d24bdba3952fe5e83348af/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fl4/dc19e02cca57456caafb51fc8c43034b/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fw5/627e30186c9240ecbd1f1fc8f663932d/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx6/a1a85cf5a5d24bdba3952fe5e83348af/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv5%252Fd9e52072d552428ba13c61575842de28%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv5/d9e52072d552428ba13c61575842de28/images/large/8.jpg not downloaded yet
2026-03-25 16:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv5%252Fd9e52072d552428ba13c61575842de28%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv5/d9e52072d552428ba13c61575842de28/images/large/9.jpg not downloaded yet
2026-03-25 16:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv5%252Fd9e52072d552428ba13c61575842de28%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv5/d9e52072d552428ba13c61575842de28/images/large/10.jpg not downloaded yet
2026-03-25 16:33:55 [ayvens.it] INFO: Found listing with ID: 1983647
2026-03-25 16:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983647%27 HTTP/1.1" 200 None
2026-03-25 16:33:55 [ayvens.it] INFO: Scrape type for 1983647: 1
2026-03-25 16:33:55 [ayvens.it] INFO: Extracting data for car ID: 1983647
2026-03-25 16:33:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c764cc9d-8f66-5f8f-9060-8bea585111c4 with identifier: 1983647
2026-03-25 16:33:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c764cc9d-8f66-5f8f-9060-8bea585111c4 with scrape type 1
2026-03-25 16:33:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c764cc9d-8f66-5f8f-9060-8bea585111c4
2026-03-25 16:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffg7%252F2adb087522224f36b7aae0fea098daea%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fg7/2adb087522224f36b7aae0fea098daea/images/large/1.jpg not downloaded yet
2026-03-25 16:33:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc5d4410>
2026-03-25 16:33:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_529f8bf8-8eca-5cc1-bc57-c32dca723da7/529f8bf8-8eca-5cc1-bc57-c32dca723da7_image_5.jpg HTTP/1.1" 201 0
2026-03-25 16:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw5%252F627e30186c9240ecbd1f1fc8f663932d%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw5/627e30186c9240ecbd1f1fc8f663932d/images/large/6.jpg saved to cache
2026-03-25 16:33:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 529f8bf8-8eca-5cc1-bc57-c32dca723da7
2026-03-25 16:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffg7%252F2adb087522224f36b7aae0fea098daea%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fg7/2adb087522224f36b7aae0fea098daea/images/large/2.jpg not downloaded yet
2026-03-25 16:33:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc758a90>
2026-03-25 16:33:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_529f8bf8-8eca-5cc1-bc57-c32dca723da7/529f8bf8-8eca-5cc1-bc57-c32dca723da7_image_2.jpg HTTP/1.1" 201 0
2026-03-25 16:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw5%252F627e30186c9240ecbd1f1fc8f663932d%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw5/627e30186c9240ecbd1f1fc8f663932d/images/large/3.jpg saved to cache
2026-03-25 16:33:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 529f8bf8-8eca-5cc1-bc57-c32dca723da7
2026-03-25 16:33:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc7587d0>
2026-03-25 16:33:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3e477d17-f202-5848-be6b-361f9695c549/3e477d17-f202-5848-be6b-361f9695c549_image_5.jpg HTTP/1.1" 201 0
2026-03-25 16:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl4%252Fdc19e02cca57456caafb51fc8c43034b%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl4/dc19e02cca57456caafb51fc8c43034b/images/large/6.jpg saved to cache
2026-03-25 16:33:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3e477d17-f202-5848-be6b-361f9695c549
2026-03-25 16:33:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc9418d0>
2026-03-25 16:33:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3e477d17-f202-5848-be6b-361f9695c549/3e477d17-f202-5848-be6b-361f9695c549_image_4.jpg HTTP/1.1" 201 0
2026-03-25 16:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl4%252Fdc19e02cca57456caafb51fc8c43034b%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl4/dc19e02cca57456caafb51fc8c43034b/images/large/5.jpg saved to cache
2026-03-25 16:33:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3e477d17-f202-5848-be6b-361f9695c549
2026-03-25 16:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffg7%252F2adb087522224f36b7aae0fea098daea%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fg7/2adb087522224f36b7aae0fea098daea/images/large/3.jpg not downloaded yet
2026-03-25 16:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffg7%252F2adb087522224f36b7aae0fea098daea%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fg7/2adb087522224f36b7aae0fea098daea/images/large/4.jpg not downloaded yet
2026-03-25 16:33:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc56ea90>
2026-03-25 16:33:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b21c9297-2aab-5439-b236-62e408f17181/b21c9297-2aab-5439-b236-62e408f17181_image_2.jpg HTTP/1.1" 201 0
2026-03-25 16:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx6%252Fa1a85cf5a5d24bdba3952fe5e83348af%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx6/a1a85cf5a5d24bdba3952fe5e83348af/images/large/3.jpg saved to cache
2026-03-25 16:33:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b21c9297-2aab-5439-b236-62e408f17181
2026-03-25 16:33:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc57bc50>
2026-03-25 16:33:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3e477d17-f202-5848-be6b-361f9695c549/3e477d17-f202-5848-be6b-361f9695c549_image_3.jpg HTTP/1.1" 201 0
2026-03-25 16:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl4%252Fdc19e02cca57456caafb51fc8c43034b%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl4/dc19e02cca57456caafb51fc8c43034b/images/large/4.jpg saved to cache
2026-03-25 16:33:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3e477d17-f202-5848-be6b-361f9695c549
2026-03-25 16:33:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34d7400dd0>
2026-03-25 16:33:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_529f8bf8-8eca-5cc1-bc57-c32dca723da7/529f8bf8-8eca-5cc1-bc57-c32dca723da7_image_3.jpg HTTP/1.1" 201 0
2026-03-25 16:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw5%252F627e30186c9240ecbd1f1fc8f663932d%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw5/627e30186c9240ecbd1f1fc8f663932d/images/large/4.jpg saved to cache
2026-03-25 16:33:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 529f8bf8-8eca-5cc1-bc57-c32dca723da7
2026-03-25 16:33:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcd9c7d0>
2026-03-25 16:33:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b21c9297-2aab-5439-b236-62e408f17181/b21c9297-2aab-5439-b236-62e408f17181_image_1.jpg HTTP/1.1" 201 0
2026-03-25 16:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx6%252Fa1a85cf5a5d24bdba3952fe5e83348af%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx6/a1a85cf5a5d24bdba3952fe5e83348af/images/large/2.jpg saved to cache
2026-03-25 16:33:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b21c9297-2aab-5439-b236-62e408f17181
2026-03-25 16:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffg7%252F2adb087522224f36b7aae0fea098daea%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fg7/2adb087522224f36b7aae0fea098daea/images/large/5.jpg not downloaded yet
2026-03-25 16:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffg7%252F2adb087522224f36b7aae0fea098daea%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fg7/2adb087522224f36b7aae0fea098daea/images/large/6.jpg not downloaded yet
2026-03-25 16:33:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx6/a1a85cf5a5d24bdba3952fe5e83348af/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffg7%252F2adb087522224f36b7aae0fea098daea%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fg7/2adb087522224f36b7aae0fea098daea/images/large/7.jpg not downloaded yet
2026-03-25 16:33:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv5/d9e52072d552428ba13c61575842de28/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx6/a1a85cf5a5d24bdba3952fe5e83348af/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx6/a1a85cf5a5d24bdba3952fe5e83348af/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx6/a1a85cf5a5d24bdba3952fe5e83348af/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv5/d9e52072d552428ba13c61575842de28/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx6/a1a85cf5a5d24bdba3952fe5e83348af/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffg7%252F2adb087522224f36b7aae0fea098daea%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fg7/2adb087522224f36b7aae0fea098daea/images/large/8.jpg not downloaded yet
2026-03-25 16:33:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx6/a1a85cf5a5d24bdba3952fe5e83348af/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffg7%252F2adb087522224f36b7aae0fea098daea%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fg7/2adb087522224f36b7aae0fea098daea/images/large/9.jpg not downloaded yet
2026-03-25 16:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffg7%252F2adb087522224f36b7aae0fea098daea%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fg7/2adb087522224f36b7aae0fea098daea/images/large/10.jpg not downloaded yet
2026-03-25 16:33:56 [ayvens.it] INFO: Found listing with ID: 1983648
2026-03-25 16:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983648%27 HTTP/1.1" 200 None
2026-03-25 16:33:56 [ayvens.it] INFO: Scrape type for 1983648: 1
2026-03-25 16:33:56 [ayvens.it] INFO: Extracting data for car ID: 1983648
2026-03-25 16:33:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c7224100-5392-58cc-a067-1aa8692a6e31 with identifier: 1983648
2026-03-25 16:33:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c7224100-5392-58cc-a067-1aa8692a6e31 with scrape type 1
2026-03-25 16:33:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c7224100-5392-58cc-a067-1aa8692a6e31
2026-03-25 16:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft5%252F875e4a38596447dea1d30b5831669e36%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft5/875e4a38596447dea1d30b5831669e36/images/large/1.jpg not downloaded yet
2026-03-25 16:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft5%252F875e4a38596447dea1d30b5831669e36%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft5/875e4a38596447dea1d30b5831669e36/images/large/2.jpg not downloaded yet
2026-03-25 16:33:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc765f10>
2026-03-25 16:33:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b21c9297-2aab-5439-b236-62e408f17181/b21c9297-2aab-5439-b236-62e408f17181_image_4.jpg HTTP/1.1" 201 0
2026-03-25 16:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx6%252Fa1a85cf5a5d24bdba3952fe5e83348af%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx6/a1a85cf5a5d24bdba3952fe5e83348af/images/large/5.jpg saved to cache
2026-03-25 16:33:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b21c9297-2aab-5439-b236-62e408f17181
2026-03-25 16:33:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcd8ef10>
2026-03-25 16:33:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9307fa4f-4aa1-5b76-947b-8451840fae63/9307fa4f-4aa1-5b76-947b-8451840fae63_image_1.jpg HTTP/1.1" 201 0
2026-03-25 16:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv5%252Fd9e52072d552428ba13c61575842de28%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv5/d9e52072d552428ba13c61575842de28/images/large/2.jpg saved to cache
2026-03-25 16:33:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9307fa4f-4aa1-5b76-947b-8451840fae63
2026-03-25 16:33:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc63d6d0>
2026-03-25 16:33:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b21c9297-2aab-5439-b236-62e408f17181/b21c9297-2aab-5439-b236-62e408f17181_image_5.jpg HTTP/1.1" 201 0
2026-03-25 16:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx6%252Fa1a85cf5a5d24bdba3952fe5e83348af%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx6/a1a85cf5a5d24bdba3952fe5e83348af/images/large/6.jpg saved to cache
2026-03-25 16:33:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b21c9297-2aab-5439-b236-62e408f17181
2026-03-25 16:33:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcd8d7d0>
2026-03-25 16:33:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b21c9297-2aab-5439-b236-62e408f17181/b21c9297-2aab-5439-b236-62e408f17181_image_8.jpg HTTP/1.1" 201 0
2026-03-25 16:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx6%252Fa1a85cf5a5d24bdba3952fe5e83348af%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx6/a1a85cf5a5d24bdba3952fe5e83348af/images/large/9.jpg saved to cache
2026-03-25 16:33:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b21c9297-2aab-5439-b236-62e408f17181
2026-03-25 16:33:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcc0b590>
2026-03-25 16:33:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b21c9297-2aab-5439-b236-62e408f17181/b21c9297-2aab-5439-b236-62e408f17181_image_9.jpg HTTP/1.1" 201 0
2026-03-25 16:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx6%252Fa1a85cf5a5d24bdba3952fe5e83348af%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx6/a1a85cf5a5d24bdba3952fe5e83348af/images/large/10.jpg saved to cache
2026-03-25 16:33:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b21c9297-2aab-5439-b236-62e408f17181
2026-03-25 16:33:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc7faa50>
2026-03-25 16:33:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9307fa4f-4aa1-5b76-947b-8451840fae63/9307fa4f-4aa1-5b76-947b-8451840fae63_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv5%252Fd9e52072d552428ba13c61575842de28%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv5/d9e52072d552428ba13c61575842de28/images/large/1.jpg saved to cache
2026-03-25 16:33:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9307fa4f-4aa1-5b76-947b-8451840fae63
2026-03-25 16:33:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dca04410>
2026-03-25 16:33:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b21c9297-2aab-5439-b236-62e408f17181/b21c9297-2aab-5439-b236-62e408f17181_image_3.jpg HTTP/1.1" 201 0
2026-03-25 16:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx6%252Fa1a85cf5a5d24bdba3952fe5e83348af%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx6/a1a85cf5a5d24bdba3952fe5e83348af/images/large/4.jpg saved to cache
2026-03-25 16:33:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b21c9297-2aab-5439-b236-62e408f17181
2026-03-25 16:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft5%252F875e4a38596447dea1d30b5831669e36%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft5/875e4a38596447dea1d30b5831669e36/images/large/3.jpg not downloaded yet
2026-03-25 16:33:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34de16b590>
2026-03-25 16:33:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b21c9297-2aab-5439-b236-62e408f17181/b21c9297-2aab-5439-b236-62e408f17181_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx6%252Fa1a85cf5a5d24bdba3952fe5e83348af%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx6/a1a85cf5a5d24bdba3952fe5e83348af/images/large/1.jpg saved to cache
2026-03-25 16:33:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b21c9297-2aab-5439-b236-62e408f17181
2026-03-25 16:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft5%252F875e4a38596447dea1d30b5831669e36%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft5/875e4a38596447dea1d30b5831669e36/images/large/4.jpg not downloaded yet
2026-03-25 16:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft5%252F875e4a38596447dea1d30b5831669e36%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft5/875e4a38596447dea1d30b5831669e36/images/large/5.jpg not downloaded yet
2026-03-25 16:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft5%252F875e4a38596447dea1d30b5831669e36%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft5/875e4a38596447dea1d30b5831669e36/images/large/6.jpg not downloaded yet
2026-03-25 16:33:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv5/d9e52072d552428ba13c61575842de28/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fg7/2adb087522224f36b7aae0fea098daea/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft5%252F875e4a38596447dea1d30b5831669e36%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft5/875e4a38596447dea1d30b5831669e36/images/large/7.jpg not downloaded yet
2026-03-25 16:33:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv5/d9e52072d552428ba13c61575842de28/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fg7/2adb087522224f36b7aae0fea098daea/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv5/d9e52072d552428ba13c61575842de28/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fg7/2adb087522224f36b7aae0fea098daea/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv5/d9e52072d552428ba13c61575842de28/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft5%252F875e4a38596447dea1d30b5831669e36%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft5/875e4a38596447dea1d30b5831669e36/images/large/8.jpg not downloaded yet
2026-03-25 16:33:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv5/d9e52072d552428ba13c61575842de28/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft5%252F875e4a38596447dea1d30b5831669e36%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft5/875e4a38596447dea1d30b5831669e36/images/large/9.jpg not downloaded yet
2026-03-25 16:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft5%252F875e4a38596447dea1d30b5831669e36%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft5/875e4a38596447dea1d30b5831669e36/images/large/10.jpg not downloaded yet
2026-03-25 16:33:58 [ayvens.it] INFO: Found listing with ID: 1983649
2026-03-25 16:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983649%27 HTTP/1.1" 200 None
2026-03-25 16:33:58 [ayvens.it] INFO: Scrape type for 1983649: 1
2026-03-25 16:33:58 [ayvens.it] INFO: Extracting data for car ID: 1983649
2026-03-25 16:33:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cde862d8-02a9-52de-961d-e5f81a6da6df with identifier: 1983649
2026-03-25 16:33:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cde862d8-02a9-52de-961d-e5f81a6da6df with scrape type 1
2026-03-25 16:33:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item cde862d8-02a9-52de-961d-e5f81a6da6df
2026-03-25 16:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx7%252F8f177403eb46420099916f8a93ba34e3%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx7/8f177403eb46420099916f8a93ba34e3/images/large/1.jpg not downloaded yet
2026-03-25 16:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx7%252F8f177403eb46420099916f8a93ba34e3%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx7/8f177403eb46420099916f8a93ba34e3/images/large/2.jpg not downloaded yet
2026-03-25 16:33:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcada810>
2026-03-25 16:33:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9307fa4f-4aa1-5b76-947b-8451840fae63/9307fa4f-4aa1-5b76-947b-8451840fae63_image_8.jpg HTTP/1.1" 201 0
2026-03-25 16:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv5%252Fd9e52072d552428ba13c61575842de28%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv5/d9e52072d552428ba13c61575842de28/images/large/9.jpg saved to cache
2026-03-25 16:33:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9307fa4f-4aa1-5b76-947b-8451840fae63
2026-03-25 16:33:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc9c1f50>
2026-03-25 16:33:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c764cc9d-8f66-5f8f-9060-8bea585111c4/c764cc9d-8f66-5f8f-9060-8bea585111c4_image_2.jpg HTTP/1.1" 201 0
2026-03-25 16:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffg7%252F2adb087522224f36b7aae0fea098daea%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fg7/2adb087522224f36b7aae0fea098daea/images/large/3.jpg saved to cache
2026-03-25 16:33:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c764cc9d-8f66-5f8f-9060-8bea585111c4
2026-03-25 16:33:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc7d0b10>
2026-03-25 16:33:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9307fa4f-4aa1-5b76-947b-8451840fae63/9307fa4f-4aa1-5b76-947b-8451840fae63_image_4.jpg HTTP/1.1" 201 0
2026-03-25 16:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv5%252Fd9e52072d552428ba13c61575842de28%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv5/d9e52072d552428ba13c61575842de28/images/large/5.jpg saved to cache
2026-03-25 16:33:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9307fa4f-4aa1-5b76-947b-8451840fae63
2026-03-25 16:33:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc592ed0>
2026-03-25 16:33:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c764cc9d-8f66-5f8f-9060-8bea585111c4/c764cc9d-8f66-5f8f-9060-8bea585111c4_image_1.jpg HTTP/1.1" 201 0
2026-03-25 16:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffg7%252F2adb087522224f36b7aae0fea098daea%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fg7/2adb087522224f36b7aae0fea098daea/images/large/2.jpg saved to cache
2026-03-25 16:33:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c764cc9d-8f66-5f8f-9060-8bea585111c4
2026-03-25 16:33:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc7d3b10>
2026-03-25 16:33:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9307fa4f-4aa1-5b76-947b-8451840fae63/9307fa4f-4aa1-5b76-947b-8451840fae63_image_9.jpg HTTP/1.1" 201 0
2026-03-25 16:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv5%252Fd9e52072d552428ba13c61575842de28%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv5/d9e52072d552428ba13c61575842de28/images/large/10.jpg saved to cache
2026-03-25 16:33:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9307fa4f-4aa1-5b76-947b-8451840fae63
2026-03-25 16:33:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc3823d0>
2026-03-25 16:33:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c764cc9d-8f66-5f8f-9060-8bea585111c4/c764cc9d-8f66-5f8f-9060-8bea585111c4_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffg7%252F2adb087522224f36b7aae0fea098daea%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fg7/2adb087522224f36b7aae0fea098daea/images/large/1.jpg saved to cache
2026-03-25 16:33:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c764cc9d-8f66-5f8f-9060-8bea585111c4
2026-03-25 16:33:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc7dd490>
2026-03-25 16:33:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9307fa4f-4aa1-5b76-947b-8451840fae63/9307fa4f-4aa1-5b76-947b-8451840fae63_image_7.jpg HTTP/1.1" 201 0
2026-03-25 16:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv5%252Fd9e52072d552428ba13c61575842de28%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv5/d9e52072d552428ba13c61575842de28/images/large/8.jpg saved to cache
2026-03-25 16:33:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9307fa4f-4aa1-5b76-947b-8451840fae63
2026-03-25 16:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx7%252F8f177403eb46420099916f8a93ba34e3%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx7/8f177403eb46420099916f8a93ba34e3/images/large/3.jpg not downloaded yet
2026-03-25 16:33:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34d740a650>
2026-03-25 16:33:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9307fa4f-4aa1-5b76-947b-8451840fae63/9307fa4f-4aa1-5b76-947b-8451840fae63_image_6.jpg HTTP/1.1" 201 0
2026-03-25 16:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv5%252Fd9e52072d552428ba13c61575842de28%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv5/d9e52072d552428ba13c61575842de28/images/large/7.jpg saved to cache
2026-03-25 16:33:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9307fa4f-4aa1-5b76-947b-8451840fae63
2026-03-25 16:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx7%252F8f177403eb46420099916f8a93ba34e3%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx7/8f177403eb46420099916f8a93ba34e3/images/large/4.jpg not downloaded yet
2026-03-25 16:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx7%252F8f177403eb46420099916f8a93ba34e3%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx7/8f177403eb46420099916f8a93ba34e3/images/large/5.jpg not downloaded yet
2026-03-25 16:33:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fg7/2adb087522224f36b7aae0fea098daea/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx7%252F8f177403eb46420099916f8a93ba34e3%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx7/8f177403eb46420099916f8a93ba34e3/images/large/6.jpg not downloaded yet
2026-03-25 16:33:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ft5/875e4a38596447dea1d30b5831669e36/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ft5/875e4a38596447dea1d30b5831669e36/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx7%252F8f177403eb46420099916f8a93ba34e3%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx7/8f177403eb46420099916f8a93ba34e3/images/large/7.jpg not downloaded yet
2026-03-25 16:33:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fg7/2adb087522224f36b7aae0fea098daea/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fg7/2adb087522224f36b7aae0fea098daea/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fg7/2adb087522224f36b7aae0fea098daea/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fg7/2adb087522224f36b7aae0fea098daea/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx7%252F8f177403eb46420099916f8a93ba34e3%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx7/8f177403eb46420099916f8a93ba34e3/images/large/8.jpg not downloaded yet
2026-03-25 16:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx7%252F8f177403eb46420099916f8a93ba34e3%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx7/8f177403eb46420099916f8a93ba34e3/images/large/9.jpg not downloaded yet
2026-03-25 16:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx7%252F8f177403eb46420099916f8a93ba34e3%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx7/8f177403eb46420099916f8a93ba34e3/images/large/10.jpg not downloaded yet
2026-03-25 16:33:58 [ayvens.it] INFO: Found listing with ID: 1983650
2026-03-25 16:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983650%27 HTTP/1.1" 200 None
2026-03-25 16:33:58 [ayvens.it] INFO: Scrape type for 1983650: 1
2026-03-25 16:33:58 [ayvens.it] INFO: Extracting data for car ID: 1983650
2026-03-25 16:33:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 95307b2d-f9f0-57f9-9c49-07992223d5a4 with identifier: 1983650
2026-03-25 16:33:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 95307b2d-f9f0-57f9-9c49-07992223d5a4 with scrape type 1
2026-03-25 16:33:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 95307b2d-f9f0-57f9-9c49-07992223d5a4
2026-03-25 16:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz7%252F2acb1646424d47aeb946130fe76ef730%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz7/2acb1646424d47aeb946130fe76ef730/images/large/1.jpg not downloaded yet
2026-03-25 16:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz7%252F2acb1646424d47aeb946130fe76ef730%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz7/2acb1646424d47aeb946130fe76ef730/images/large/2.jpg not downloaded yet
2026-03-25 16:33:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34d740b090>
2026-03-25 16:33:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c764cc9d-8f66-5f8f-9060-8bea585111c4/c764cc9d-8f66-5f8f-9060-8bea585111c4_image_9.jpg HTTP/1.1" 201 0
2026-03-25 16:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffg7%252F2adb087522224f36b7aae0fea098daea%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fg7/2adb087522224f36b7aae0fea098daea/images/large/10.jpg saved to cache
2026-03-25 16:33:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c764cc9d-8f66-5f8f-9060-8bea585111c4
2026-03-25 16:33:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dca12c10>
2026-03-25 16:33:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7224100-5392-58cc-a067-1aa8692a6e31/c7224100-5392-58cc-a067-1aa8692a6e31_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft5%252F875e4a38596447dea1d30b5831669e36%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft5/875e4a38596447dea1d30b5831669e36/images/large/1.jpg saved to cache
2026-03-25 16:33:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c7224100-5392-58cc-a067-1aa8692a6e31
2026-03-25 16:33:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc9c93d0>
2026-03-25 16:33:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7224100-5392-58cc-a067-1aa8692a6e31/c7224100-5392-58cc-a067-1aa8692a6e31_image_1.jpg HTTP/1.1" 201 0
2026-03-25 16:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft5%252F875e4a38596447dea1d30b5831669e36%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft5/875e4a38596447dea1d30b5831669e36/images/large/2.jpg saved to cache
2026-03-25 16:33:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c7224100-5392-58cc-a067-1aa8692a6e31
2026-03-25 16:33:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc9d47d0>
2026-03-25 16:33:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c764cc9d-8f66-5f8f-9060-8bea585111c4/c764cc9d-8f66-5f8f-9060-8bea585111c4_image_7.jpg HTTP/1.1" 201 0
2026-03-25 16:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffg7%252F2adb087522224f36b7aae0fea098daea%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fg7/2adb087522224f36b7aae0fea098daea/images/large/8.jpg saved to cache
2026-03-25 16:33:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c764cc9d-8f66-5f8f-9060-8bea585111c4
2026-03-25 16:33:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc75aed0>
2026-03-25 16:33:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c764cc9d-8f66-5f8f-9060-8bea585111c4/c764cc9d-8f66-5f8f-9060-8bea585111c4_image_8.jpg HTTP/1.1" 201 0
2026-03-25 16:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffg7%252F2adb087522224f36b7aae0fea098daea%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fg7/2adb087522224f36b7aae0fea098daea/images/large/9.jpg saved to cache
2026-03-25 16:33:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c764cc9d-8f66-5f8f-9060-8bea585111c4
2026-03-25 16:33:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc37f0d0>
2026-03-25 16:33:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c764cc9d-8f66-5f8f-9060-8bea585111c4/c764cc9d-8f66-5f8f-9060-8bea585111c4_image_5.jpg HTTP/1.1" 201 0
2026-03-25 16:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffg7%252F2adb087522224f36b7aae0fea098daea%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fg7/2adb087522224f36b7aae0fea098daea/images/large/6.jpg saved to cache
2026-03-25 16:33:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c764cc9d-8f66-5f8f-9060-8bea585111c4
2026-03-25 16:33:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc9d6750>
2026-03-25 16:33:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c764cc9d-8f66-5f8f-9060-8bea585111c4/c764cc9d-8f66-5f8f-9060-8bea585111c4_image_6.jpg HTTP/1.1" 201 0
2026-03-25 16:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffg7%252F2adb087522224f36b7aae0fea098daea%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 16:33:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fg7/2adb087522224f36b7aae0fea098daea/images/large/7.jpg saved to cache
2026-03-25 16:33:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c764cc9d-8f66-5f8f-9060-8bea585111c4
2026-03-25 16:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz7%252F2acb1646424d47aeb946130fe76ef730%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz7/2acb1646424d47aeb946130fe76ef730/images/large/3.jpg not downloaded yet
2026-03-25 16:33:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ft5/875e4a38596447dea1d30b5831669e36/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz7%252F2acb1646424d47aeb946130fe76ef730%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz7/2acb1646424d47aeb946130fe76ef730/images/large/4.jpg not downloaded yet
2026-03-25 16:33:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ft5/875e4a38596447dea1d30b5831669e36/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz7%252F2acb1646424d47aeb946130fe76ef730%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz7/2acb1646424d47aeb946130fe76ef730/images/large/5.jpg not downloaded yet
2026-03-25 16:33:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv5/d9e52072d552428ba13c61575842de28/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fg7/2adb087522224f36b7aae0fea098daea/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz7%252F2acb1646424d47aeb946130fe76ef730%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz7/2acb1646424d47aeb946130fe76ef730/images/large/6.jpg not downloaded yet
2026-03-25 16:33:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ft5/875e4a38596447dea1d30b5831669e36/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz7%252F2acb1646424d47aeb946130fe76ef730%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz7/2acb1646424d47aeb946130fe76ef730/images/large/7.jpg not downloaded yet
2026-03-25 16:33:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx7/8f177403eb46420099916f8a93ba34e3/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fg7/2adb087522224f36b7aae0fea098daea/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz7%252F2acb1646424d47aeb946130fe76ef730%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz7/2acb1646424d47aeb946130fe76ef730/images/large/8.jpg not downloaded yet
2026-03-25 16:33:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ft5/875e4a38596447dea1d30b5831669e36/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz7%252F2acb1646424d47aeb946130fe76ef730%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:33:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz7/2acb1646424d47aeb946130fe76ef730/images/large/9.jpg not downloaded yet
2026-03-25 16:33:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:33:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dca88e10>
2026-03-25 16:33:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:33:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:33:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:33:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7224100-5392-58cc-a067-1aa8692a6e31/c7224100-5392-58cc-a067-1aa8692a6e31_image_2.jpg HTTP/1.1" 201 0
2026-03-25 16:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft5%252F875e4a38596447dea1d30b5831669e36%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft5/875e4a38596447dea1d30b5831669e36/images/large/3.jpg saved to cache
2026-03-25 16:34:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c7224100-5392-58cc-a067-1aa8692a6e31
2026-03-25 16:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz7%252F2acb1646424d47aeb946130fe76ef730%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz7/2acb1646424d47aeb946130fe76ef730/images/large/10.jpg not downloaded yet
2026-03-25 16:34:00 [ayvens.it] INFO: Found listing with ID: 1983651
2026-03-25 16:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983651%27 HTTP/1.1" 200 None
2026-03-25 16:34:00 [ayvens.it] INFO: Scrape type for 1983651: 1
2026-03-25 16:34:00 [ayvens.it] INFO: Extracting data for car ID: 1983651
2026-03-25 16:34:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ebcaa8a4-42c5-54d0-b134-bc5461aab68f with identifier: 1983651
2026-03-25 16:34:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ebcaa8a4-42c5-54d0-b134-bc5461aab68f with scrape type 1
2026-03-25 16:34:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ebcaa8a4-42c5-54d0-b134-bc5461aab68f
2026-03-25 16:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy9%252F3a989ed1aef64201a4b3321a990cbfb1%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy9/3a989ed1aef64201a4b3321a990cbfb1/images/large/1.jpg not downloaded yet
2026-03-25 16:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy9%252F3a989ed1aef64201a4b3321a990cbfb1%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy9/3a989ed1aef64201a4b3321a990cbfb1/images/large/2.jpg not downloaded yet
2026-03-25 16:34:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc356890>
2026-03-25 16:34:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7224100-5392-58cc-a067-1aa8692a6e31/c7224100-5392-58cc-a067-1aa8692a6e31_image_5.jpg HTTP/1.1" 201 0
2026-03-25 16:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft5%252F875e4a38596447dea1d30b5831669e36%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft5/875e4a38596447dea1d30b5831669e36/images/large/6.jpg saved to cache
2026-03-25 16:34:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c7224100-5392-58cc-a067-1aa8692a6e31
2026-03-25 16:34:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc91f010>
2026-03-25 16:34:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9307fa4f-4aa1-5b76-947b-8451840fae63/9307fa4f-4aa1-5b76-947b-8451840fae63_image_5.jpg HTTP/1.1" 201 0
2026-03-25 16:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv5%252Fd9e52072d552428ba13c61575842de28%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv5/d9e52072d552428ba13c61575842de28/images/large/6.jpg saved to cache
2026-03-25 16:34:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9307fa4f-4aa1-5b76-947b-8451840fae63
2026-03-25 16:34:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dca44690>
2026-03-25 16:34:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c764cc9d-8f66-5f8f-9060-8bea585111c4/c764cc9d-8f66-5f8f-9060-8bea585111c4_image_4.jpg HTTP/1.1" 201 0
2026-03-25 16:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffg7%252F2adb087522224f36b7aae0fea098daea%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fg7/2adb087522224f36b7aae0fea098daea/images/large/5.jpg saved to cache
2026-03-25 16:34:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c764cc9d-8f66-5f8f-9060-8bea585111c4
2026-03-25 16:34:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc92b5d0>
2026-03-25 16:34:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7224100-5392-58cc-a067-1aa8692a6e31/c7224100-5392-58cc-a067-1aa8692a6e31_image_3.jpg HTTP/1.1" 201 0
2026-03-25 16:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft5%252F875e4a38596447dea1d30b5831669e36%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft5/875e4a38596447dea1d30b5831669e36/images/large/4.jpg saved to cache
2026-03-25 16:34:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c7224100-5392-58cc-a067-1aa8692a6e31
2026-03-25 16:34:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dca47a50>
2026-03-25 16:34:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cde862d8-02a9-52de-961d-e5f81a6da6df/cde862d8-02a9-52de-961d-e5f81a6da6df_image_2.jpg HTTP/1.1" 201 0
2026-03-25 16:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx7%252F8f177403eb46420099916f8a93ba34e3%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx7/8f177403eb46420099916f8a93ba34e3/images/large/3.jpg saved to cache
2026-03-25 16:34:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item cde862d8-02a9-52de-961d-e5f81a6da6df
2026-03-25 16:34:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc5e85d0>
2026-03-25 16:34:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c764cc9d-8f66-5f8f-9060-8bea585111c4/c764cc9d-8f66-5f8f-9060-8bea585111c4_image_3.jpg HTTP/1.1" 201 0
2026-03-25 16:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffg7%252F2adb087522224f36b7aae0fea098daea%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fg7/2adb087522224f36b7aae0fea098daea/images/large/4.jpg saved to cache
2026-03-25 16:34:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c764cc9d-8f66-5f8f-9060-8bea585111c4
2026-03-25 16:34:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c764cc9d-8f66-5f8f-9060-8bea585111c4, skipping ID generation
2026-03-25 16:34:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c764cc9d-8f66-5f8f-9060-8bea585111c4 with scrape type 1
2026-03-25 16:34:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c764cc9d-8f66-5f8f-9060-8bea585111c4 sending to next pipeline
2026-03-25 16:34:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: c764cc9d-8f66-5f8f-9060-8bea585111c4, identifier: 1983647
2026-03-25 16:34:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc8d7c10>
2026-03-25 16:34:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7224100-5392-58cc-a067-1aa8692a6e31/c7224100-5392-58cc-a067-1aa8692a6e31_image_4.jpg HTTP/1.1" 201 0
2026-03-25 16:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft5%252F875e4a38596447dea1d30b5831669e36%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft5/875e4a38596447dea1d30b5831669e36/images/large/5.jpg saved to cache
2026-03-25 16:34:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c7224100-5392-58cc-a067-1aa8692a6e31
2026-03-25 16:34:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: c764cc9d-8f66-5f8f-9060-8bea585111c4 with identifier: 1983647
2026-03-25 16:34:01 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:34:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: c764cc9d-8f66-5f8f-9060-8bea585111c4 with identifier: 1983647
2026-03-25 16:34:01 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: c764cc9d-8f66-5f8f-9060-8bea585111c4 with identifier: 1983647 to the API
2026-03-25 16:34:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:34:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:34:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fg7/2adb087522224f36b7aae0fea098daea/images/large/4.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Summit white pastello brillant',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-27T09:30:00Z',
'fuel_type': 'diesel',
'id': 'c764cc9d-8f66-5f8f-9060-8bea585111c4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41025',
'listing': 'auction',
'location': None,
'make': 'OPEL',
'model': 'OPEL CORSA 1.3 CDTI n-Joy 75cv Hatchback 5-door',
'odometer': 229667,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 38,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c764cc9d-8f66-5f8f-9060-8bea585111c4/c764cc9d-8f66-5f8f-9060-8bea585111c4_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 548703,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fg7/2adb087522224f36b7aae0fea098daea/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c764cc9d-8f66-5f8f-9060-8bea585111c4/c764cc9d-8f66-5f8f-9060-8bea585111c4_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 548703,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fg7/2adb087522224f36b7aae0fea098daea/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c764cc9d-8f66-5f8f-9060-8bea585111c4/c764cc9d-8f66-5f8f-9060-8bea585111c4_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 595493,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fg7/2adb087522224f36b7aae0fea098daea/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c764cc9d-8f66-5f8f-9060-8bea585111c4/c764cc9d-8f66-5f8f-9060-8bea585111c4_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 674536,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fg7/2adb087522224f36b7aae0fea098daea/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c764cc9d-8f66-5f8f-9060-8bea585111c4/c764cc9d-8f66-5f8f-9060-8bea585111c4_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 585625,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fg7/2adb087522224f36b7aae0fea098daea/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c764cc9d-8f66-5f8f-9060-8bea585111c4/c764cc9d-8f66-5f8f-9060-8bea585111c4_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 575974,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fg7/2adb087522224f36b7aae0fea098daea/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c764cc9d-8f66-5f8f-9060-8bea585111c4/c764cc9d-8f66-5f8f-9060-8bea585111c4_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 597266,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fg7/2adb087522224f36b7aae0fea098daea/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c764cc9d-8f66-5f8f-9060-8bea585111c4/c764cc9d-8f66-5f8f-9060-8bea585111c4_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 633901,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fg7/2adb087522224f36b7aae0fea098daea/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c764cc9d-8f66-5f8f-9060-8bea585111c4/c764cc9d-8f66-5f8f-9060-8bea585111c4_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 523451,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fg7/2adb087522224f36b7aae0fea098daea/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c764cc9d-8f66-5f8f-9060-8bea585111c4/c764cc9d-8f66-5f8f-9060-8bea585111c4_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 477243,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fg7/2adb087522224f36b7aae0fea098daea/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-11-30',
'seats_number': 5,
'seller_name': None,
'title': 'OPEL OPEL CORSA 1.3 CDTI n-Joy 75cv Hatchback 5-door -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2016}
2026-03-25 16:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983647%27 HTTP/1.1" 200 None
2026-03-25 16:34:02 [ayvens.it] INFO: Saving data for 1983647: {'created_time': 1774456442.500819, 'last_price_update_time': 1774456442.500831, 'auction_closing_time': 1774603800.0}
2026-03-25 16:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1983647') HTTP/1.1" 204 0
2026-03-25 16:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy9%252F3a989ed1aef64201a4b3321a990cbfb1%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy9/3a989ed1aef64201a4b3321a990cbfb1/images/large/3.jpg not downloaded yet
2026-03-25 16:34:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx7/8f177403eb46420099916f8a93ba34e3/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy9%252F3a989ed1aef64201a4b3321a990cbfb1%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy9/3a989ed1aef64201a4b3321a990cbfb1/images/large/4.jpg not downloaded yet
2026-03-25 16:34:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx7/8f177403eb46420099916f8a93ba34e3/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy9%252F3a989ed1aef64201a4b3321a990cbfb1%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy9/3a989ed1aef64201a4b3321a990cbfb1/images/large/5.jpg not downloaded yet
2026-03-25 16:34:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx7/8f177403eb46420099916f8a93ba34e3/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ft5/875e4a38596447dea1d30b5831669e36/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx7/8f177403eb46420099916f8a93ba34e3/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx7/8f177403eb46420099916f8a93ba34e3/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy9%252F3a989ed1aef64201a4b3321a990cbfb1%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy9/3a989ed1aef64201a4b3321a990cbfb1/images/large/6.jpg not downloaded yet
2026-03-25 16:34:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ft5/875e4a38596447dea1d30b5831669e36/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy9%252F3a989ed1aef64201a4b3321a990cbfb1%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy9/3a989ed1aef64201a4b3321a990cbfb1/images/large/7.jpg not downloaded yet
2026-03-25 16:34:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx7/8f177403eb46420099916f8a93ba34e3/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy9%252F3a989ed1aef64201a4b3321a990cbfb1%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy9/3a989ed1aef64201a4b3321a990cbfb1/images/large/8.jpg not downloaded yet
2026-03-25 16:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy9%252F3a989ed1aef64201a4b3321a990cbfb1%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy9/3a989ed1aef64201a4b3321a990cbfb1/images/large/9.jpg not downloaded yet
2026-03-25 16:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy9%252F3a989ed1aef64201a4b3321a990cbfb1%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy9/3a989ed1aef64201a4b3321a990cbfb1/images/large/10.jpg not downloaded yet
2026-03-25 16:34:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc63ec90>
2026-03-25 16:34:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cde862d8-02a9-52de-961d-e5f81a6da6df/cde862d8-02a9-52de-961d-e5f81a6da6df_image_4.jpg HTTP/1.1" 201 0
2026-03-25 16:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx7%252F8f177403eb46420099916f8a93ba34e3%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx7/8f177403eb46420099916f8a93ba34e3/images/large/5.jpg saved to cache
2026-03-25 16:34:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item cde862d8-02a9-52de-961d-e5f81a6da6df
2026-03-25 16:34:02 [ayvens.it] INFO: Found listing with ID: 1983652
2026-03-25 16:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983652%27 HTTP/1.1" 200 None
2026-03-25 16:34:02 [ayvens.it] INFO: Scrape type for 1983652: 1
2026-03-25 16:34:02 [ayvens.it] INFO: Extracting data for car ID: 1983652
2026-03-25 16:34:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 54af0571-5b5c-57f4-9f15-e12a257e8528 with identifier: 1983652
2026-03-25 16:34:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 54af0571-5b5c-57f4-9f15-e12a257e8528 with scrape type 1
2026-03-25 16:34:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 54af0571-5b5c-57f4-9f15-e12a257e8528
2026-03-25 16:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga7%252F5eef134e2c3a4be68ac51ea2f852e943%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga7/5eef134e2c3a4be68ac51ea2f852e943/images/large/1.jpg not downloaded yet
2026-03-25 16:34:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcb155d0>
2026-03-25 16:34:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cde862d8-02a9-52de-961d-e5f81a6da6df/cde862d8-02a9-52de-961d-e5f81a6da6df_image_5.jpg HTTP/1.1" 201 0
2026-03-25 16:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx7%252F8f177403eb46420099916f8a93ba34e3%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx7/8f177403eb46420099916f8a93ba34e3/images/large/6.jpg saved to cache
2026-03-25 16:34:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item cde862d8-02a9-52de-961d-e5f81a6da6df
2026-03-25 16:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga7%252F5eef134e2c3a4be68ac51ea2f852e943%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga7/5eef134e2c3a4be68ac51ea2f852e943/images/large/2.jpg not downloaded yet
2026-03-25 16:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga7%252F5eef134e2c3a4be68ac51ea2f852e943%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga7/5eef134e2c3a4be68ac51ea2f852e943/images/large/3.jpg not downloaded yet
2026-03-25 16:34:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcd9dbd0>
2026-03-25 16:34:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cde862d8-02a9-52de-961d-e5f81a6da6df/cde862d8-02a9-52de-961d-e5f81a6da6df_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx7%252F8f177403eb46420099916f8a93ba34e3%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx7/8f177403eb46420099916f8a93ba34e3/images/large/1.jpg saved to cache
2026-03-25 16:34:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cde862d8-02a9-52de-961d-e5f81a6da6df
2026-03-25 16:34:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcc4eb50>
2026-03-25 16:34:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7224100-5392-58cc-a067-1aa8692a6e31/c7224100-5392-58cc-a067-1aa8692a6e31_image_9.jpg HTTP/1.1" 201 0
2026-03-25 16:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft5%252F875e4a38596447dea1d30b5831669e36%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft5/875e4a38596447dea1d30b5831669e36/images/large/10.jpg saved to cache
2026-03-25 16:34:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c7224100-5392-58cc-a067-1aa8692a6e31
2026-03-25 16:34:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc8d5cd0>
2026-03-25 16:34:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cde862d8-02a9-52de-961d-e5f81a6da6df/cde862d8-02a9-52de-961d-e5f81a6da6df_image_6.jpg HTTP/1.1" 201 0
2026-03-25 16:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx7%252F8f177403eb46420099916f8a93ba34e3%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx7/8f177403eb46420099916f8a93ba34e3/images/large/7.jpg saved to cache
2026-03-25 16:34:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item cde862d8-02a9-52de-961d-e5f81a6da6df
2026-03-25 16:34:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcd9efd0>
2026-03-25 16:34:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cde862d8-02a9-52de-961d-e5f81a6da6df/cde862d8-02a9-52de-961d-e5f81a6da6df_image_1.jpg HTTP/1.1" 201 0
2026-03-25 16:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx7%252F8f177403eb46420099916f8a93ba34e3%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx7/8f177403eb46420099916f8a93ba34e3/images/large/2.jpg saved to cache
2026-03-25 16:34:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item cde862d8-02a9-52de-961d-e5f81a6da6df
2026-03-25 16:34:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcbe7690>
2026-03-25 16:34:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7224100-5392-58cc-a067-1aa8692a6e31/c7224100-5392-58cc-a067-1aa8692a6e31_image_8.jpg HTTP/1.1" 201 0
2026-03-25 16:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft5%252F875e4a38596447dea1d30b5831669e36%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft5/875e4a38596447dea1d30b5831669e36/images/large/9.jpg saved to cache
2026-03-25 16:34:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c7224100-5392-58cc-a067-1aa8692a6e31
2026-03-25 16:34:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcb15e90>
2026-03-25 16:34:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cde862d8-02a9-52de-961d-e5f81a6da6df/cde862d8-02a9-52de-961d-e5f81a6da6df_image_3.jpg HTTP/1.1" 201 0
2026-03-25 16:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx7%252F8f177403eb46420099916f8a93ba34e3%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx7/8f177403eb46420099916f8a93ba34e3/images/large/4.jpg saved to cache
2026-03-25 16:34:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item cde862d8-02a9-52de-961d-e5f81a6da6df
2026-03-25 16:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga7%252F5eef134e2c3a4be68ac51ea2f852e943%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga7/5eef134e2c3a4be68ac51ea2f852e943/images/large/4.jpg not downloaded yet
2026-03-25 16:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga7%252F5eef134e2c3a4be68ac51ea2f852e943%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga7/5eef134e2c3a4be68ac51ea2f852e943/images/large/5.jpg not downloaded yet
2026-03-25 16:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga7%252F5eef134e2c3a4be68ac51ea2f852e943%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga7/5eef134e2c3a4be68ac51ea2f852e943/images/large/6.jpg not downloaded yet
2026-03-25 16:34:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz7/2acb1646424d47aeb946130fe76ef730/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz7/2acb1646424d47aeb946130fe76ef730/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz7/2acb1646424d47aeb946130fe76ef730/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga7%252F5eef134e2c3a4be68ac51ea2f852e943%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga7/5eef134e2c3a4be68ac51ea2f852e943/images/large/7.jpg not downloaded yet
2026-03-25 16:34:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz7/2acb1646424d47aeb946130fe76ef730/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz7/2acb1646424d47aeb946130fe76ef730/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz7/2acb1646424d47aeb946130fe76ef730/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga7%252F5eef134e2c3a4be68ac51ea2f852e943%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga7/5eef134e2c3a4be68ac51ea2f852e943/images/large/8.jpg not downloaded yet
2026-03-25 16:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga7%252F5eef134e2c3a4be68ac51ea2f852e943%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga7/5eef134e2c3a4be68ac51ea2f852e943/images/large/9.jpg not downloaded yet
2026-03-25 16:34:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz7/2acb1646424d47aeb946130fe76ef730/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz7/2acb1646424d47aeb946130fe76ef730/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga7%252F5eef134e2c3a4be68ac51ea2f852e943%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga7/5eef134e2c3a4be68ac51ea2f852e943/images/large/10.jpg not downloaded yet
2026-03-25 16:34:03 [ayvens.it] INFO: Found listing with ID: 1983653
2026-03-25 16:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983653%27 HTTP/1.1" 200 None
2026-03-25 16:34:03 [ayvens.it] INFO: Scrape type for 1983653: 1
2026-03-25 16:34:03 [ayvens.it] INFO: Extracting data for car ID: 1983653
2026-03-25 16:34:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 25812a36-404f-5fd2-a60d-14a5f17164c2 with identifier: 1983653
2026-03-25 16:34:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 25812a36-404f-5fd2-a60d-14a5f17164c2 with scrape type 1
2026-03-25 16:34:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 25812a36-404f-5fd2-a60d-14a5f17164c2
2026-03-25 16:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg3%252F512ea53b1dcd45d0af220de05282a961%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg3/512ea53b1dcd45d0af220de05282a961/images/large/1.jpg not downloaded yet
2026-03-25 16:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg3%252F512ea53b1dcd45d0af220de05282a961%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg3/512ea53b1dcd45d0af220de05282a961/images/large/2.jpg not downloaded yet
2026-03-25 16:34:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc7dfed0>
2026-03-25 16:34:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95307b2d-f9f0-57f9-9c49-07992223d5a4/95307b2d-f9f0-57f9-9c49-07992223d5a4_image_2.jpg HTTP/1.1" 201 0
2026-03-25 16:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz7%252F2acb1646424d47aeb946130fe76ef730%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz7/2acb1646424d47aeb946130fe76ef730/images/large/3.jpg saved to cache
2026-03-25 16:34:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 95307b2d-f9f0-57f9-9c49-07992223d5a4
2026-03-25 16:34:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc9f2d50>
2026-03-25 16:34:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95307b2d-f9f0-57f9-9c49-07992223d5a4/95307b2d-f9f0-57f9-9c49-07992223d5a4_image_8.jpg HTTP/1.1" 201 0
2026-03-25 16:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz7%252F2acb1646424d47aeb946130fe76ef730%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz7/2acb1646424d47aeb946130fe76ef730/images/large/9.jpg saved to cache
2026-03-25 16:34:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 95307b2d-f9f0-57f9-9c49-07992223d5a4
2026-03-25 16:34:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc87a190>
2026-03-25 16:34:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95307b2d-f9f0-57f9-9c49-07992223d5a4/95307b2d-f9f0-57f9-9c49-07992223d5a4_image_9.jpg HTTP/1.1" 201 0
2026-03-25 16:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz7%252F2acb1646424d47aeb946130fe76ef730%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz7/2acb1646424d47aeb946130fe76ef730/images/large/10.jpg saved to cache
2026-03-25 16:34:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 95307b2d-f9f0-57f9-9c49-07992223d5a4
2026-03-25 16:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg3%252F512ea53b1dcd45d0af220de05282a961%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg3/512ea53b1dcd45d0af220de05282a961/images/large/3.jpg not downloaded yet
2026-03-25 16:34:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc7deed0>
2026-03-25 16:34:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95307b2d-f9f0-57f9-9c49-07992223d5a4/95307b2d-f9f0-57f9-9c49-07992223d5a4_image_3.jpg HTTP/1.1" 201 0
2026-03-25 16:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz7%252F2acb1646424d47aeb946130fe76ef730%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz7/2acb1646424d47aeb946130fe76ef730/images/large/4.jpg saved to cache
2026-03-25 16:34:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 95307b2d-f9f0-57f9-9c49-07992223d5a4
2026-03-25 16:34:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc35bd90>
2026-03-25 16:34:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95307b2d-f9f0-57f9-9c49-07992223d5a4/95307b2d-f9f0-57f9-9c49-07992223d5a4_image_4.jpg HTTP/1.1" 201 0
2026-03-25 16:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz7%252F2acb1646424d47aeb946130fe76ef730%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz7/2acb1646424d47aeb946130fe76ef730/images/large/5.jpg saved to cache
2026-03-25 16:34:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 95307b2d-f9f0-57f9-9c49-07992223d5a4
2026-03-25 16:34:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34d7459890>
2026-03-25 16:34:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95307b2d-f9f0-57f9-9c49-07992223d5a4/95307b2d-f9f0-57f9-9c49-07992223d5a4_image_5.jpg HTTP/1.1" 201 0
2026-03-25 16:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz7%252F2acb1646424d47aeb946130fe76ef730%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz7/2acb1646424d47aeb946130fe76ef730/images/large/6.jpg saved to cache
2026-03-25 16:34:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 95307b2d-f9f0-57f9-9c49-07992223d5a4
2026-03-25 16:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg3%252F512ea53b1dcd45d0af220de05282a961%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg3/512ea53b1dcd45d0af220de05282a961/images/large/4.jpg not downloaded yet
2026-03-25 16:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg3%252F512ea53b1dcd45d0af220de05282a961%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg3/512ea53b1dcd45d0af220de05282a961/images/large/5.jpg not downloaded yet
2026-03-25 16:34:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc35b010>
2026-03-25 16:34:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95307b2d-f9f0-57f9-9c49-07992223d5a4/95307b2d-f9f0-57f9-9c49-07992223d5a4_image_1.jpg HTTP/1.1" 201 0
2026-03-25 16:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz7%252F2acb1646424d47aeb946130fe76ef730%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz7/2acb1646424d47aeb946130fe76ef730/images/large/2.jpg saved to cache
2026-03-25 16:34:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 95307b2d-f9f0-57f9-9c49-07992223d5a4
2026-03-25 16:34:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc8d4650>
2026-03-25 16:34:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95307b2d-f9f0-57f9-9c49-07992223d5a4/95307b2d-f9f0-57f9-9c49-07992223d5a4_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz7%252F2acb1646424d47aeb946130fe76ef730%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz7/2acb1646424d47aeb946130fe76ef730/images/large/1.jpg saved to cache
2026-03-25 16:34:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 95307b2d-f9f0-57f9-9c49-07992223d5a4
2026-03-25 16:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg3%252F512ea53b1dcd45d0af220de05282a961%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg3/512ea53b1dcd45d0af220de05282a961/images/large/6.jpg not downloaded yet
2026-03-25 16:34:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz7/2acb1646424d47aeb946130fe76ef730/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg3%252F512ea53b1dcd45d0af220de05282a961%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg3/512ea53b1dcd45d0af220de05282a961/images/large/7.jpg not downloaded yet
2026-03-25 16:34:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz7/2acb1646424d47aeb946130fe76ef730/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fy9/3a989ed1aef64201a4b3321a990cbfb1/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fy9/3a989ed1aef64201a4b3321a990cbfb1/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg3%252F512ea53b1dcd45d0af220de05282a961%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg3/512ea53b1dcd45d0af220de05282a961/images/large/8.jpg not downloaded yet
2026-03-25 16:34:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fy9/3a989ed1aef64201a4b3321a990cbfb1/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fy9/3a989ed1aef64201a4b3321a990cbfb1/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg3%252F512ea53b1dcd45d0af220de05282a961%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg3/512ea53b1dcd45d0af220de05282a961/images/large/9.jpg not downloaded yet
2026-03-25 16:34:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fy9/3a989ed1aef64201a4b3321a990cbfb1/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fy9/3a989ed1aef64201a4b3321a990cbfb1/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg3%252F512ea53b1dcd45d0af220de05282a961%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg3/512ea53b1dcd45d0af220de05282a961/images/large/10.jpg not downloaded yet
2026-03-25 16:34:04 [ayvens.it] INFO: Found listing with ID: 1983654
2026-03-25 16:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983654%27 HTTP/1.1" 200 None
2026-03-25 16:34:04 [ayvens.it] INFO: Scrape type for 1983654: 1
2026-03-25 16:34:04 [ayvens.it] INFO: Extracting data for car ID: 1983654
2026-03-25 16:34:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 25ed13e5-aeaa-5bf4-a336-be76cf36f272 with identifier: 1983654
2026-03-25 16:34:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 25ed13e5-aeaa-5bf4-a336-be76cf36f272 with scrape type 1
2026-03-25 16:34:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 25ed13e5-aeaa-5bf4-a336-be76cf36f272
2026-03-25 16:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge1%252Feee8c5d66241403d801d1d1d8535fb6e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge1/eee8c5d66241403d801d1d1d8535fb6e/images/large/1.jpg not downloaded yet
2026-03-25 16:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge1%252Feee8c5d66241403d801d1d1d8535fb6e%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge1/eee8c5d66241403d801d1d1d8535fb6e/images/large/2.jpg not downloaded yet
2026-03-25 16:34:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc9dd890>
2026-03-25 16:34:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95307b2d-f9f0-57f9-9c49-07992223d5a4/95307b2d-f9f0-57f9-9c49-07992223d5a4_image_7.jpg HTTP/1.1" 201 0
2026-03-25 16:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz7%252F2acb1646424d47aeb946130fe76ef730%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz7/2acb1646424d47aeb946130fe76ef730/images/large/8.jpg saved to cache
2026-03-25 16:34:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 95307b2d-f9f0-57f9-9c49-07992223d5a4
2026-03-25 16:34:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcc1b050>
2026-03-25 16:34:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95307b2d-f9f0-57f9-9c49-07992223d5a4/95307b2d-f9f0-57f9-9c49-07992223d5a4_image_6.jpg HTTP/1.1" 201 0
2026-03-25 16:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz7%252F2acb1646424d47aeb946130fe76ef730%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz7/2acb1646424d47aeb946130fe76ef730/images/large/7.jpg saved to cache
2026-03-25 16:34:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 95307b2d-f9f0-57f9-9c49-07992223d5a4
2026-03-25 16:34:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 95307b2d-f9f0-57f9-9c49-07992223d5a4, skipping ID generation
2026-03-25 16:34:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 95307b2d-f9f0-57f9-9c49-07992223d5a4 with scrape type 1
2026-03-25 16:34:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 95307b2d-f9f0-57f9-9c49-07992223d5a4 sending to next pipeline
2026-03-25 16:34:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 95307b2d-f9f0-57f9-9c49-07992223d5a4, identifier: 1983650
2026-03-25 16:34:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc825590>
2026-03-25 16:34:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ebcaa8a4-42c5-54d0-b134-bc5461aab68f/ebcaa8a4-42c5-54d0-b134-bc5461aab68f_image_2.jpg HTTP/1.1" 201 0
2026-03-25 16:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy9%252F3a989ed1aef64201a4b3321a990cbfb1%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy9/3a989ed1aef64201a4b3321a990cbfb1/images/large/3.jpg saved to cache
2026-03-25 16:34:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ebcaa8a4-42c5-54d0-b134-bc5461aab68f
2026-03-25 16:34:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcb17290>
2026-03-25 16:34:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ebcaa8a4-42c5-54d0-b134-bc5461aab68f/ebcaa8a4-42c5-54d0-b134-bc5461aab68f_image_5.jpg HTTP/1.1" 201 0
2026-03-25 16:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy9%252F3a989ed1aef64201a4b3321a990cbfb1%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy9/3a989ed1aef64201a4b3321a990cbfb1/images/large/6.jpg saved to cache
2026-03-25 16:34:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ebcaa8a4-42c5-54d0-b134-bc5461aab68f
2026-03-25 16:34:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc5538d0>
2026-03-25 16:34:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ebcaa8a4-42c5-54d0-b134-bc5461aab68f/ebcaa8a4-42c5-54d0-b134-bc5461aab68f_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy9%252F3a989ed1aef64201a4b3321a990cbfb1%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy9/3a989ed1aef64201a4b3321a990cbfb1/images/large/1.jpg saved to cache
2026-03-25 16:34:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ebcaa8a4-42c5-54d0-b134-bc5461aab68f
2026-03-25 16:34:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc8798d0>
2026-03-25 16:34:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ebcaa8a4-42c5-54d0-b134-bc5461aab68f/ebcaa8a4-42c5-54d0-b134-bc5461aab68f_image_3.jpg HTTP/1.1" 201 0
2026-03-25 16:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy9%252F3a989ed1aef64201a4b3321a990cbfb1%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy9/3a989ed1aef64201a4b3321a990cbfb1/images/large/4.jpg saved to cache
2026-03-25 16:34:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ebcaa8a4-42c5-54d0-b134-bc5461aab68f
2026-03-25 16:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge1%252Feee8c5d66241403d801d1d1d8535fb6e%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge1/eee8c5d66241403d801d1d1d8535fb6e/images/large/3.jpg not downloaded yet
2026-03-25 16:34:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 95307b2d-f9f0-57f9-9c49-07992223d5a4 with identifier: 1983650
2026-03-25 16:34:05 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:34:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 95307b2d-f9f0-57f9-9c49-07992223d5a4 with identifier: 1983650
2026-03-25 16:34:05 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 95307b2d-f9f0-57f9-9c49-07992223d5a4 with identifier: 1983650 to the API
2026-03-25 16:34:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:34:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:34:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fz7/2acb1646424d47aeb946130fe76ef730/images/large/7.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Grigio manhattan metallizzato',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-27T09:30:00Z',
'fuel_type': 'diesel',
'id': '95307b2d-f9f0-57f9-9c49-07992223d5a4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41025',
'listing': 'auction',
'location': None,
'make': 'AUDI',
'model': 'AUDI A4 AVANT 2.0 35 TDI BUSINESS S TRONIC SW 5-door (Euro 6.2) '
'mild hybrid',
'odometer': 187500,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 12,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95307b2d-f9f0-57f9-9c49-07992223d5a4/95307b2d-f9f0-57f9-9c49-07992223d5a4_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 823763,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz7/2acb1646424d47aeb946130fe76ef730/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95307b2d-f9f0-57f9-9c49-07992223d5a4/95307b2d-f9f0-57f9-9c49-07992223d5a4_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 823763,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz7/2acb1646424d47aeb946130fe76ef730/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95307b2d-f9f0-57f9-9c49-07992223d5a4/95307b2d-f9f0-57f9-9c49-07992223d5a4_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 768127,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz7/2acb1646424d47aeb946130fe76ef730/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95307b2d-f9f0-57f9-9c49-07992223d5a4/95307b2d-f9f0-57f9-9c49-07992223d5a4_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 827104,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz7/2acb1646424d47aeb946130fe76ef730/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95307b2d-f9f0-57f9-9c49-07992223d5a4/95307b2d-f9f0-57f9-9c49-07992223d5a4_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 818470,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz7/2acb1646424d47aeb946130fe76ef730/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95307b2d-f9f0-57f9-9c49-07992223d5a4/95307b2d-f9f0-57f9-9c49-07992223d5a4_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 646299,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz7/2acb1646424d47aeb946130fe76ef730/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95307b2d-f9f0-57f9-9c49-07992223d5a4/95307b2d-f9f0-57f9-9c49-07992223d5a4_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 561129,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz7/2acb1646424d47aeb946130fe76ef730/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95307b2d-f9f0-57f9-9c49-07992223d5a4/95307b2d-f9f0-57f9-9c49-07992223d5a4_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 598224,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz7/2acb1646424d47aeb946130fe76ef730/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95307b2d-f9f0-57f9-9c49-07992223d5a4/95307b2d-f9f0-57f9-9c49-07992223d5a4_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 654618,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz7/2acb1646424d47aeb946130fe76ef730/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95307b2d-f9f0-57f9-9c49-07992223d5a4/95307b2d-f9f0-57f9-9c49-07992223d5a4_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 528438,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz7/2acb1646424d47aeb946130fe76ef730/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-12-06',
'seats_number': 5,
'seller_name': None,
'title': 'AUDI AUDI A4 AVANT 2.0 35 TDI BUSINESS S TRONIC SW 5-door (Euro '
'6.2) mild hybrid -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2019}
2026-03-25 16:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983650%27 HTTP/1.1" 200 None
2026-03-25 16:34:05 [ayvens.it] INFO: Saving data for 1983650: {'created_time': 1774456445.744783, 'last_price_update_time': 1774456445.744795, 'auction_closing_time': 1774603800.0}
2026-03-25 16:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1983650') HTTP/1.1" 204 0
2026-03-25 16:34:05 [scrapy.extensions.logstats] INFO: Crawled 15 pages (at 1 pages/min), scraped 82 items (at 20 items/min)
2026-03-25 16:34:05 [scrapy.extensions.memusage] INFO: Peak memory usage is 182MiB
2026-03-25 16:34:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dca24490>
2026-03-25 16:34:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ebcaa8a4-42c5-54d0-b134-bc5461aab68f/ebcaa8a4-42c5-54d0-b134-bc5461aab68f_image_1.jpg HTTP/1.1" 201 0
2026-03-25 16:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy9%252F3a989ed1aef64201a4b3321a990cbfb1%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy9/3a989ed1aef64201a4b3321a990cbfb1/images/large/2.jpg saved to cache
2026-03-25 16:34:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ebcaa8a4-42c5-54d0-b134-bc5461aab68f
2026-03-25 16:34:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcbe4910>
2026-03-25 16:34:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ebcaa8a4-42c5-54d0-b134-bc5461aab68f/ebcaa8a4-42c5-54d0-b134-bc5461aab68f_image_4.jpg HTTP/1.1" 201 0
2026-03-25 16:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy9%252F3a989ed1aef64201a4b3321a990cbfb1%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy9/3a989ed1aef64201a4b3321a990cbfb1/images/large/5.jpg saved to cache
2026-03-25 16:34:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ebcaa8a4-42c5-54d0-b134-bc5461aab68f
2026-03-25 16:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge1%252Feee8c5d66241403d801d1d1d8535fb6e%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge1/eee8c5d66241403d801d1d1d8535fb6e/images/large/4.jpg not downloaded yet
2026-03-25 16:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge1%252Feee8c5d66241403d801d1d1d8535fb6e%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge1/eee8c5d66241403d801d1d1d8535fb6e/images/large/5.jpg not downloaded yet
2026-03-25 16:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge1%252Feee8c5d66241403d801d1d1d8535fb6e%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge1/eee8c5d66241403d801d1d1d8535fb6e/images/large/6.jpg not downloaded yet
2026-03-25 16:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge1%252Feee8c5d66241403d801d1d1d8535fb6e%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge1/eee8c5d66241403d801d1d1d8535fb6e/images/large/7.jpg not downloaded yet
2026-03-25 16:34:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga7/5eef134e2c3a4be68ac51ea2f852e943/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga7/5eef134e2c3a4be68ac51ea2f852e943/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga7/5eef134e2c3a4be68ac51ea2f852e943/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge1%252Feee8c5d66241403d801d1d1d8535fb6e%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge1/eee8c5d66241403d801d1d1d8535fb6e/images/large/8.jpg not downloaded yet
2026-03-25 16:34:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg3/512ea53b1dcd45d0af220de05282a961/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga7/5eef134e2c3a4be68ac51ea2f852e943/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg3/512ea53b1dcd45d0af220de05282a961/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge1%252Feee8c5d66241403d801d1d1d8535fb6e%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge1/eee8c5d66241403d801d1d1d8535fb6e/images/large/9.jpg not downloaded yet
2026-03-25 16:34:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga7/5eef134e2c3a4be68ac51ea2f852e943/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga7/5eef134e2c3a4be68ac51ea2f852e943/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge1%252Feee8c5d66241403d801d1d1d8535fb6e%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge1/eee8c5d66241403d801d1d1d8535fb6e/images/large/10.jpg not downloaded yet
2026-03-25 16:34:06 [ayvens.it] INFO: Found listing with ID: 1983655
2026-03-25 16:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983655%27 HTTP/1.1" 200 None
2026-03-25 16:34:06 [ayvens.it] INFO: Scrape type for 1983655: 1
2026-03-25 16:34:06 [ayvens.it] INFO: Extracting data for car ID: 1983655
2026-03-25 16:34:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7bb69958-3da4-524f-a7f1-87281c287245 with identifier: 1983655
2026-03-25 16:34:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7bb69958-3da4-524f-a7f1-87281c287245 with scrape type 1
2026-03-25 16:34:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7bb69958-3da4-524f-a7f1-87281c287245
2026-03-25 16:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd8%252F1450d957cc27479a9d54cff382252d3f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd8/1450d957cc27479a9d54cff382252d3f/images/large/1.jpg not downloaded yet
2026-03-25 16:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd8%252F1450d957cc27479a9d54cff382252d3f%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd8/1450d957cc27479a9d54cff382252d3f/images/large/2.jpg not downloaded yet
2026-03-25 16:34:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34d7d7f510>
2026-03-25 16:34:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54af0571-5b5c-57f4-9f15-e12a257e8528/54af0571-5b5c-57f4-9f15-e12a257e8528_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga7%252F5eef134e2c3a4be68ac51ea2f852e943%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga7/5eef134e2c3a4be68ac51ea2f852e943/images/large/1.jpg saved to cache
2026-03-25 16:34:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 54af0571-5b5c-57f4-9f15-e12a257e8528
2026-03-25 16:34:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc5f8bd0>
2026-03-25 16:34:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54af0571-5b5c-57f4-9f15-e12a257e8528/54af0571-5b5c-57f4-9f15-e12a257e8528_image_2.jpg HTTP/1.1" 201 0
2026-03-25 16:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga7%252F5eef134e2c3a4be68ac51ea2f852e943%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga7/5eef134e2c3a4be68ac51ea2f852e943/images/large/3.jpg saved to cache
2026-03-25 16:34:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 54af0571-5b5c-57f4-9f15-e12a257e8528
2026-03-25 16:34:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc5ae690>
2026-03-25 16:34:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54af0571-5b5c-57f4-9f15-e12a257e8528/54af0571-5b5c-57f4-9f15-e12a257e8528_image_5.jpg HTTP/1.1" 201 0
2026-03-25 16:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga7%252F5eef134e2c3a4be68ac51ea2f852e943%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga7/5eef134e2c3a4be68ac51ea2f852e943/images/large/6.jpg saved to cache
2026-03-25 16:34:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 54af0571-5b5c-57f4-9f15-e12a257e8528
2026-03-25 16:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd8%252F1450d957cc27479a9d54cff382252d3f%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd8/1450d957cc27479a9d54cff382252d3f/images/large/3.jpg not downloaded yet
2026-03-25 16:34:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcbb6990>
2026-03-25 16:34:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25812a36-404f-5fd2-a60d-14a5f17164c2/25812a36-404f-5fd2-a60d-14a5f17164c2_image_1.jpg HTTP/1.1" 201 0
2026-03-25 16:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg3%252F512ea53b1dcd45d0af220de05282a961%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg3/512ea53b1dcd45d0af220de05282a961/images/large/2.jpg saved to cache
2026-03-25 16:34:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 25812a36-404f-5fd2-a60d-14a5f17164c2
2026-03-25 16:34:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc9b0290>
2026-03-25 16:34:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54af0571-5b5c-57f4-9f15-e12a257e8528/54af0571-5b5c-57f4-9f15-e12a257e8528_image_1.jpg HTTP/1.1" 201 0
2026-03-25 16:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga7%252F5eef134e2c3a4be68ac51ea2f852e943%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga7/5eef134e2c3a4be68ac51ea2f852e943/images/large/2.jpg saved to cache
2026-03-25 16:34:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 54af0571-5b5c-57f4-9f15-e12a257e8528
2026-03-25 16:34:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34de459d90>
2026-03-25 16:34:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25812a36-404f-5fd2-a60d-14a5f17164c2/25812a36-404f-5fd2-a60d-14a5f17164c2_image_2.jpg HTTP/1.1" 201 0
2026-03-25 16:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg3%252F512ea53b1dcd45d0af220de05282a961%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg3/512ea53b1dcd45d0af220de05282a961/images/large/3.jpg saved to cache
2026-03-25 16:34:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 25812a36-404f-5fd2-a60d-14a5f17164c2
2026-03-25 16:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd8%252F1450d957cc27479a9d54cff382252d3f%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd8/1450d957cc27479a9d54cff382252d3f/images/large/4.jpg not downloaded yet
2026-03-25 16:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd8%252F1450d957cc27479a9d54cff382252d3f%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd8/1450d957cc27479a9d54cff382252d3f/images/large/5.jpg not downloaded yet
2026-03-25 16:34:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcaf4d90>
2026-03-25 16:34:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54af0571-5b5c-57f4-9f15-e12a257e8528/54af0571-5b5c-57f4-9f15-e12a257e8528_image_4.jpg HTTP/1.1" 201 0
2026-03-25 16:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga7%252F5eef134e2c3a4be68ac51ea2f852e943%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga7/5eef134e2c3a4be68ac51ea2f852e943/images/large/5.jpg saved to cache
2026-03-25 16:34:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 54af0571-5b5c-57f4-9f15-e12a257e8528
2026-03-25 16:34:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcb2ff50>
2026-03-25 16:34:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54af0571-5b5c-57f4-9f15-e12a257e8528/54af0571-5b5c-57f4-9f15-e12a257e8528_image_3.jpg HTTP/1.1" 201 0
2026-03-25 16:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga7%252F5eef134e2c3a4be68ac51ea2f852e943%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga7/5eef134e2c3a4be68ac51ea2f852e943/images/large/4.jpg saved to cache
2026-03-25 16:34:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 54af0571-5b5c-57f4-9f15-e12a257e8528
2026-03-25 16:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd8%252F1450d957cc27479a9d54cff382252d3f%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd8/1450d957cc27479a9d54cff382252d3f/images/large/6.jpg not downloaded yet
2026-03-25 16:34:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg3/512ea53b1dcd45d0af220de05282a961/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg3/512ea53b1dcd45d0af220de05282a961/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd8%252F1450d957cc27479a9d54cff382252d3f%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd8/1450d957cc27479a9d54cff382252d3f/images/large/7.jpg not downloaded yet
2026-03-25 16:34:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg3/512ea53b1dcd45d0af220de05282a961/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg3/512ea53b1dcd45d0af220de05282a961/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd8%252F1450d957cc27479a9d54cff382252d3f%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd8/1450d957cc27479a9d54cff382252d3f/images/large/8.jpg not downloaded yet
2026-03-25 16:34:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg3/512ea53b1dcd45d0af220de05282a961/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg3/512ea53b1dcd45d0af220de05282a961/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd8%252F1450d957cc27479a9d54cff382252d3f%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd8/1450d957cc27479a9d54cff382252d3f/images/large/9.jpg not downloaded yet
2026-03-25 16:34:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge1/eee8c5d66241403d801d1d1d8535fb6e/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge1/eee8c5d66241403d801d1d1d8535fb6e/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd8%252F1450d957cc27479a9d54cff382252d3f%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd8/1450d957cc27479a9d54cff382252d3f/images/large/10.jpg not downloaded yet
2026-03-25 16:34:07 [ayvens.it] INFO: Found listing with ID: 1983656
2026-03-25 16:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983656%27 HTTP/1.1" 200 None
2026-03-25 16:34:07 [ayvens.it] INFO: Scrape type for 1983656: 1
2026-03-25 16:34:07 [ayvens.it] INFO: Extracting data for car ID: 1983656
2026-03-25 16:34:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dcb399f9-d9cb-5963-880f-81846afd1cae with identifier: 1983656
2026-03-25 16:34:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dcb399f9-d9cb-5963-880f-81846afd1cae with scrape type 1
2026-03-25 16:34:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item dcb399f9-d9cb-5963-880f-81846afd1cae
2026-03-25 16:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb8%252F5e476d0705434205ade88f3826dea59f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb8/5e476d0705434205ade88f3826dea59f/images/large/1.jpg not downloaded yet
2026-03-25 16:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb8%252F5e476d0705434205ade88f3826dea59f%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb8/5e476d0705434205ade88f3826dea59f/images/large/2.jpg not downloaded yet
2026-03-25 16:34:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc9b8c50>
2026-03-25 16:34:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25812a36-404f-5fd2-a60d-14a5f17164c2/25812a36-404f-5fd2-a60d-14a5f17164c2_image_5.jpg HTTP/1.1" 201 0
2026-03-25 16:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg3%252F512ea53b1dcd45d0af220de05282a961%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg3/512ea53b1dcd45d0af220de05282a961/images/large/6.jpg saved to cache
2026-03-25 16:34:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 25812a36-404f-5fd2-a60d-14a5f17164c2
2026-03-25 16:34:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc383a50>
2026-03-25 16:34:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25812a36-404f-5fd2-a60d-14a5f17164c2/25812a36-404f-5fd2-a60d-14a5f17164c2_image_6.jpg HTTP/1.1" 201 0
2026-03-25 16:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg3%252F512ea53b1dcd45d0af220de05282a961%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg3/512ea53b1dcd45d0af220de05282a961/images/large/7.jpg saved to cache
2026-03-25 16:34:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 25812a36-404f-5fd2-a60d-14a5f17164c2
2026-03-25 16:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb8%252F5e476d0705434205ade88f3826dea59f%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb8/5e476d0705434205ade88f3826dea59f/images/large/3.jpg not downloaded yet
2026-03-25 16:34:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc9f1850>
2026-03-25 16:34:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25812a36-404f-5fd2-a60d-14a5f17164c2/25812a36-404f-5fd2-a60d-14a5f17164c2_image_7.jpg HTTP/1.1" 201 0
2026-03-25 16:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg3%252F512ea53b1dcd45d0af220de05282a961%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg3/512ea53b1dcd45d0af220de05282a961/images/large/8.jpg saved to cache
2026-03-25 16:34:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 25812a36-404f-5fd2-a60d-14a5f17164c2
2026-03-25 16:34:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc9f0550>
2026-03-25 16:34:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25812a36-404f-5fd2-a60d-14a5f17164c2/25812a36-404f-5fd2-a60d-14a5f17164c2_image_4.jpg HTTP/1.1" 201 0
2026-03-25 16:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg3%252F512ea53b1dcd45d0af220de05282a961%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg3/512ea53b1dcd45d0af220de05282a961/images/large/5.jpg saved to cache
2026-03-25 16:34:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 25812a36-404f-5fd2-a60d-14a5f17164c2
2026-03-25 16:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb8%252F5e476d0705434205ade88f3826dea59f%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb8/5e476d0705434205ade88f3826dea59f/images/large/4.jpg not downloaded yet
2026-03-25 16:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb8%252F5e476d0705434205ade88f3826dea59f%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb8/5e476d0705434205ade88f3826dea59f/images/large/5.jpg not downloaded yet
2026-03-25 16:34:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc54a5d0>
2026-03-25 16:34:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25812a36-404f-5fd2-a60d-14a5f17164c2/25812a36-404f-5fd2-a60d-14a5f17164c2_image_3.jpg HTTP/1.1" 201 0
2026-03-25 16:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg3%252F512ea53b1dcd45d0af220de05282a961%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg3/512ea53b1dcd45d0af220de05282a961/images/large/4.jpg saved to cache
2026-03-25 16:34:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 25812a36-404f-5fd2-a60d-14a5f17164c2
2026-03-25 16:34:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc9c33d0>
2026-03-25 16:34:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25812a36-404f-5fd2-a60d-14a5f17164c2/25812a36-404f-5fd2-a60d-14a5f17164c2_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg3%252F512ea53b1dcd45d0af220de05282a961%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg3/512ea53b1dcd45d0af220de05282a961/images/large/1.jpg saved to cache
2026-03-25 16:34:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 25812a36-404f-5fd2-a60d-14a5f17164c2
2026-03-25 16:34:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc9d6d90>
2026-03-25 16:34:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25ed13e5-aeaa-5bf4-a336-be76cf36f272/25ed13e5-aeaa-5bf4-a336-be76cf36f272_image_2.jpg HTTP/1.1" 201 0
2026-03-25 16:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge1%252Feee8c5d66241403d801d1d1d8535fb6e%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge1/eee8c5d66241403d801d1d1d8535fb6e/images/large/3.jpg saved to cache
2026-03-25 16:34:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 25ed13e5-aeaa-5bf4-a336-be76cf36f272
2026-03-25 16:34:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc787d50>
2026-03-25 16:34:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25ed13e5-aeaa-5bf4-a336-be76cf36f272/25ed13e5-aeaa-5bf4-a336-be76cf36f272_image_1.jpg HTTP/1.1" 201 0
2026-03-25 16:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge1%252Feee8c5d66241403d801d1d1d8535fb6e%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge1/eee8c5d66241403d801d1d1d8535fb6e/images/large/2.jpg saved to cache
2026-03-25 16:34:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 25ed13e5-aeaa-5bf4-a336-be76cf36f272
2026-03-25 16:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb8%252F5e476d0705434205ade88f3826dea59f%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb8/5e476d0705434205ade88f3826dea59f/images/large/6.jpg not downloaded yet
2026-03-25 16:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb8%252F5e476d0705434205ade88f3826dea59f%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb8/5e476d0705434205ade88f3826dea59f/images/large/7.jpg not downloaded yet
2026-03-25 16:34:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge1/eee8c5d66241403d801d1d1d8535fb6e/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb8%252F5e476d0705434205ade88f3826dea59f%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb8/5e476d0705434205ade88f3826dea59f/images/large/8.jpg not downloaded yet
2026-03-25 16:34:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge1/eee8c5d66241403d801d1d1d8535fb6e/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd8/1450d957cc27479a9d54cff382252d3f/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd8/1450d957cc27479a9d54cff382252d3f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd8/1450d957cc27479a9d54cff382252d3f/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge1/eee8c5d66241403d801d1d1d8535fb6e/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge1/eee8c5d66241403d801d1d1d8535fb6e/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb8%252F5e476d0705434205ade88f3826dea59f%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb8/5e476d0705434205ade88f3826dea59f/images/large/9.jpg not downloaded yet
2026-03-25 16:34:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge1/eee8c5d66241403d801d1d1d8535fb6e/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb8%252F5e476d0705434205ade88f3826dea59f%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb8/5e476d0705434205ade88f3826dea59f/images/large/10.jpg not downloaded yet
2026-03-25 16:34:08 [ayvens.it] INFO: Found listing with ID: 1983657
2026-03-25 16:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983657%27 HTTP/1.1" 200 None
2026-03-25 16:34:08 [ayvens.it] INFO: Scrape type for 1983657: 1
2026-03-25 16:34:08 [ayvens.it] INFO: Extracting data for car ID: 1983657
2026-03-25 16:34:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 05a6e2ea-e98e-5f95-be6b-f6d497a39c9a with identifier: 1983657
2026-03-25 16:34:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 05a6e2ea-e98e-5f95-be6b-f6d497a39c9a with scrape type 1
2026-03-25 16:34:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 05a6e2ea-e98e-5f95-be6b-f6d497a39c9a
2026-03-25 16:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge9%252Fa549559d3f7d4835a3b18a516e67d64a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge9/a549559d3f7d4835a3b18a516e67d64a/images/large/1.jpg not downloaded yet
2026-03-25 16:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge9%252Fa549559d3f7d4835a3b18a516e67d64a%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge9/a549559d3f7d4835a3b18a516e67d64a/images/large/2.jpg not downloaded yet
2026-03-25 16:34:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc75b8d0>
2026-03-25 16:34:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25ed13e5-aeaa-5bf4-a336-be76cf36f272/25ed13e5-aeaa-5bf4-a336-be76cf36f272_image_9.jpg HTTP/1.1" 201 0
2026-03-25 16:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge1%252Feee8c5d66241403d801d1d1d8535fb6e%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge1/eee8c5d66241403d801d1d1d8535fb6e/images/large/10.jpg saved to cache
2026-03-25 16:34:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 25ed13e5-aeaa-5bf4-a336-be76cf36f272
2026-03-25 16:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge9%252Fa549559d3f7d4835a3b18a516e67d64a%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge9/a549559d3f7d4835a3b18a516e67d64a/images/large/3.jpg not downloaded yet
2026-03-25 16:34:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34d6b5b610>
2026-03-25 16:34:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25ed13e5-aeaa-5bf4-a336-be76cf36f272/25ed13e5-aeaa-5bf4-a336-be76cf36f272_image_6.jpg HTTP/1.1" 201 0
2026-03-25 16:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge1%252Feee8c5d66241403d801d1d1d8535fb6e%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge1/eee8c5d66241403d801d1d1d8535fb6e/images/large/7.jpg saved to cache
2026-03-25 16:34:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 25ed13e5-aeaa-5bf4-a336-be76cf36f272
2026-03-25 16:34:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34d7d63e90>
2026-03-25 16:34:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7bb69958-3da4-524f-a7f1-87281c287245/7bb69958-3da4-524f-a7f1-87281c287245_image_1.jpg HTTP/1.1" 201 0
2026-03-25 16:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd8%252F1450d957cc27479a9d54cff382252d3f%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd8/1450d957cc27479a9d54cff382252d3f/images/large/2.jpg saved to cache
2026-03-25 16:34:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7bb69958-3da4-524f-a7f1-87281c287245
2026-03-25 16:34:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc5b4510>
2026-03-25 16:34:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7bb69958-3da4-524f-a7f1-87281c287245/7bb69958-3da4-524f-a7f1-87281c287245_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd8%252F1450d957cc27479a9d54cff382252d3f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd8/1450d957cc27479a9d54cff382252d3f/images/large/1.jpg saved to cache
2026-03-25 16:34:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7bb69958-3da4-524f-a7f1-87281c287245
2026-03-25 16:34:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34d6b3ec50>
2026-03-25 16:34:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7bb69958-3da4-524f-a7f1-87281c287245/7bb69958-3da4-524f-a7f1-87281c287245_image_2.jpg HTTP/1.1" 201 0
2026-03-25 16:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd8%252F1450d957cc27479a9d54cff382252d3f%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd8/1450d957cc27479a9d54cff382252d3f/images/large/3.jpg saved to cache
2026-03-25 16:34:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7bb69958-3da4-524f-a7f1-87281c287245
2026-03-25 16:34:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcc1b9d0>
2026-03-25 16:34:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25ed13e5-aeaa-5bf4-a336-be76cf36f272/25ed13e5-aeaa-5bf4-a336-be76cf36f272_image_4.jpg HTTP/1.1" 201 0
2026-03-25 16:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge1%252Feee8c5d66241403d801d1d1d8535fb6e%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge1/eee8c5d66241403d801d1d1d8535fb6e/images/large/5.jpg saved to cache
2026-03-25 16:34:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 25ed13e5-aeaa-5bf4-a336-be76cf36f272
2026-03-25 16:34:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc63d410>
2026-03-25 16:34:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25ed13e5-aeaa-5bf4-a336-be76cf36f272/25ed13e5-aeaa-5bf4-a336-be76cf36f272_image_5.jpg HTTP/1.1" 201 0
2026-03-25 16:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge1%252Feee8c5d66241403d801d1d1d8535fb6e%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge1/eee8c5d66241403d801d1d1d8535fb6e/images/large/6.jpg saved to cache
2026-03-25 16:34:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 25ed13e5-aeaa-5bf4-a336-be76cf36f272
2026-03-25 16:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge9%252Fa549559d3f7d4835a3b18a516e67d64a%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge9/a549559d3f7d4835a3b18a516e67d64a/images/large/4.jpg not downloaded yet
2026-03-25 16:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge9%252Fa549559d3f7d4835a3b18a516e67d64a%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge9/a549559d3f7d4835a3b18a516e67d64a/images/large/5.jpg not downloaded yet
2026-03-25 16:34:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc381290>
2026-03-25 16:34:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25ed13e5-aeaa-5bf4-a336-be76cf36f272/25ed13e5-aeaa-5bf4-a336-be76cf36f272_image_3.jpg HTTP/1.1" 201 0
2026-03-25 16:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge1%252Feee8c5d66241403d801d1d1d8535fb6e%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge1/eee8c5d66241403d801d1d1d8535fb6e/images/large/4.jpg saved to cache
2026-03-25 16:34:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 25ed13e5-aeaa-5bf4-a336-be76cf36f272
2026-03-25 16:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge9%252Fa549559d3f7d4835a3b18a516e67d64a%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge9/a549559d3f7d4835a3b18a516e67d64a/images/large/6.jpg not downloaded yet
2026-03-25 16:34:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd8/1450d957cc27479a9d54cff382252d3f/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge9%252Fa549559d3f7d4835a3b18a516e67d64a%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge9/a549559d3f7d4835a3b18a516e67d64a/images/large/7.jpg not downloaded yet
2026-03-25 16:34:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb8/5e476d0705434205ade88f3826dea59f/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd8/1450d957cc27479a9d54cff382252d3f/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd8/1450d957cc27479a9d54cff382252d3f/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb8/5e476d0705434205ade88f3826dea59f/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd8/1450d957cc27479a9d54cff382252d3f/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge9%252Fa549559d3f7d4835a3b18a516e67d64a%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge9/a549559d3f7d4835a3b18a516e67d64a/images/large/8.jpg not downloaded yet
2026-03-25 16:34:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge1/eee8c5d66241403d801d1d1d8535fb6e/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb8/5e476d0705434205ade88f3826dea59f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge9%252Fa549559d3f7d4835a3b18a516e67d64a%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge9/a549559d3f7d4835a3b18a516e67d64a/images/large/9.jpg not downloaded yet
2026-03-25 16:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge9%252Fa549559d3f7d4835a3b18a516e67d64a%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge9/a549559d3f7d4835a3b18a516e67d64a/images/large/10.jpg not downloaded yet
2026-03-25 16:34:09 [ayvens.it] INFO: Found listing with ID: 1983658
2026-03-25 16:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983658%27 HTTP/1.1" 200 None
2026-03-25 16:34:09 [ayvens.it] INFO: Scrape type for 1983658: 1
2026-03-25 16:34:09 [ayvens.it] INFO: Extracting data for car ID: 1983658
2026-03-25 16:34:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 95274bde-7267-5245-a4c3-bf013298eef0 with identifier: 1983658
2026-03-25 16:34:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 95274bde-7267-5245-a4c3-bf013298eef0 with scrape type 1
2026-03-25 16:34:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 95274bde-7267-5245-a4c3-bf013298eef0
2026-03-25 16:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs0%252F24a9396a6cf74061abd614e97451ce3e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs0/24a9396a6cf74061abd614e97451ce3e/images/large/1.jpg not downloaded yet
2026-03-25 16:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs0%252F24a9396a6cf74061abd614e97451ce3e%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs0/24a9396a6cf74061abd614e97451ce3e/images/large/2.jpg not downloaded yet
2026-03-25 16:34:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc712810>
2026-03-25 16:34:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7bb69958-3da4-524f-a7f1-87281c287245/7bb69958-3da4-524f-a7f1-87281c287245_image_6.jpg HTTP/1.1" 201 0
2026-03-25 16:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd8%252F1450d957cc27479a9d54cff382252d3f%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd8/1450d957cc27479a9d54cff382252d3f/images/large/7.jpg saved to cache
2026-03-25 16:34:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7bb69958-3da4-524f-a7f1-87281c287245
2026-03-25 16:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs0%252F24a9396a6cf74061abd614e97451ce3e%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs0/24a9396a6cf74061abd614e97451ce3e/images/large/3.jpg not downloaded yet
2026-03-25 16:34:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc82ff50>
2026-03-25 16:34:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dcb399f9-d9cb-5963-880f-81846afd1cae/dcb399f9-d9cb-5963-880f-81846afd1cae_image_2.jpg HTTP/1.1" 201 0
2026-03-25 16:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb8%252F5e476d0705434205ade88f3826dea59f%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb8/5e476d0705434205ade88f3826dea59f/images/large/3.jpg saved to cache
2026-03-25 16:34:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item dcb399f9-d9cb-5963-880f-81846afd1cae
2026-03-25 16:34:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34de1619d0>
2026-03-25 16:34:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7bb69958-3da4-524f-a7f1-87281c287245/7bb69958-3da4-524f-a7f1-87281c287245_image_3.jpg HTTP/1.1" 201 0
2026-03-25 16:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd8%252F1450d957cc27479a9d54cff382252d3f%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd8/1450d957cc27479a9d54cff382252d3f/images/large/4.jpg saved to cache
2026-03-25 16:34:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7bb69958-3da4-524f-a7f1-87281c287245
2026-03-25 16:34:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc7d1690>
2026-03-25 16:34:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7bb69958-3da4-524f-a7f1-87281c287245/7bb69958-3da4-524f-a7f1-87281c287245_image_5.jpg HTTP/1.1" 201 0
2026-03-25 16:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd8%252F1450d957cc27479a9d54cff382252d3f%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd8/1450d957cc27479a9d54cff382252d3f/images/large/6.jpg saved to cache
2026-03-25 16:34:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7bb69958-3da4-524f-a7f1-87281c287245
2026-03-25 16:34:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc7fa5d0>
2026-03-25 16:34:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dcb399f9-d9cb-5963-880f-81846afd1cae/dcb399f9-d9cb-5963-880f-81846afd1cae_image_1.jpg HTTP/1.1" 201 0
2026-03-25 16:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb8%252F5e476d0705434205ade88f3826dea59f%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb8/5e476d0705434205ade88f3826dea59f/images/large/2.jpg saved to cache
2026-03-25 16:34:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item dcb399f9-d9cb-5963-880f-81846afd1cae
2026-03-25 16:34:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc382f50>
2026-03-25 16:34:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7bb69958-3da4-524f-a7f1-87281c287245/7bb69958-3da4-524f-a7f1-87281c287245_image_4.jpg HTTP/1.1" 201 0
2026-03-25 16:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd8%252F1450d957cc27479a9d54cff382252d3f%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd8/1450d957cc27479a9d54cff382252d3f/images/large/5.jpg saved to cache
2026-03-25 16:34:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7bb69958-3da4-524f-a7f1-87281c287245
2026-03-25 16:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs0%252F24a9396a6cf74061abd614e97451ce3e%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs0/24a9396a6cf74061abd614e97451ce3e/images/large/4.jpg not downloaded yet
2026-03-25 16:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs0%252F24a9396a6cf74061abd614e97451ce3e%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs0/24a9396a6cf74061abd614e97451ce3e/images/large/5.jpg not downloaded yet
2026-03-25 16:34:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc7fac90>
2026-03-25 16:34:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25ed13e5-aeaa-5bf4-a336-be76cf36f272/25ed13e5-aeaa-5bf4-a336-be76cf36f272_image_8.jpg HTTP/1.1" 201 0
2026-03-25 16:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge1%252Feee8c5d66241403d801d1d1d8535fb6e%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge1/eee8c5d66241403d801d1d1d8535fb6e/images/large/9.jpg saved to cache
2026-03-25 16:34:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 25ed13e5-aeaa-5bf4-a336-be76cf36f272
2026-03-25 16:34:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcad85d0>
2026-03-25 16:34:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dcb399f9-d9cb-5963-880f-81846afd1cae/dcb399f9-d9cb-5963-880f-81846afd1cae_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb8%252F5e476d0705434205ade88f3826dea59f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb8/5e476d0705434205ade88f3826dea59f/images/large/1.jpg saved to cache
2026-03-25 16:34:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item dcb399f9-d9cb-5963-880f-81846afd1cae
2026-03-25 16:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs0%252F24a9396a6cf74061abd614e97451ce3e%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs0/24a9396a6cf74061abd614e97451ce3e/images/large/6.jpg not downloaded yet
2026-03-25 16:34:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb8/5e476d0705434205ade88f3826dea59f/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd8/1450d957cc27479a9d54cff382252d3f/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs0%252F24a9396a6cf74061abd614e97451ce3e%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs0/24a9396a6cf74061abd614e97451ce3e/images/large/7.jpg not downloaded yet
2026-03-25 16:34:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge9/a549559d3f7d4835a3b18a516e67d64a/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb8/5e476d0705434205ade88f3826dea59f/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs0%252F24a9396a6cf74061abd614e97451ce3e%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs0/24a9396a6cf74061abd614e97451ce3e/images/large/8.jpg not downloaded yet
2026-03-25 16:34:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb8/5e476d0705434205ade88f3826dea59f/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb8/5e476d0705434205ade88f3826dea59f/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge9/a549559d3f7d4835a3b18a516e67d64a/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs0%252F24a9396a6cf74061abd614e97451ce3e%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs0/24a9396a6cf74061abd614e97451ce3e/images/large/9.jpg not downloaded yet
2026-03-25 16:34:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge9/a549559d3f7d4835a3b18a516e67d64a/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs0%252F24a9396a6cf74061abd614e97451ce3e%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs0/24a9396a6cf74061abd614e97451ce3e/images/large/10.jpg not downloaded yet
2026-03-25 16:34:10 [ayvens.it] INFO: Found listing with ID: 1983659
2026-03-25 16:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983659%27 HTTP/1.1" 200 None
2026-03-25 16:34:10 [ayvens.it] INFO: Scrape type for 1983659: 1
2026-03-25 16:34:10 [ayvens.it] INFO: Extracting data for car ID: 1983659
2026-03-25 16:34:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: da9d3664-57b6-5cf4-88fe-e9684b73d775 with identifier: 1983659
2026-03-25 16:34:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item da9d3664-57b6-5cf4-88fe-e9684b73d775 with scrape type 1
2026-03-25 16:34:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item da9d3664-57b6-5cf4-88fe-e9684b73d775
2026-03-25 16:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp4%252Fb020e9d1a0ae432a842d93a69c93af36%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp4/b020e9d1a0ae432a842d93a69c93af36/images/large/1.jpg not downloaded yet
2026-03-25 16:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp4%252Fb020e9d1a0ae432a842d93a69c93af36%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp4/b020e9d1a0ae432a842d93a69c93af36/images/large/2.jpg not downloaded yet
2026-03-25 16:34:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc992b90>
2026-03-25 16:34:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dcb399f9-d9cb-5963-880f-81846afd1cae/dcb399f9-d9cb-5963-880f-81846afd1cae_image_5.jpg HTTP/1.1" 201 0
2026-03-25 16:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb8%252F5e476d0705434205ade88f3826dea59f%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb8/5e476d0705434205ade88f3826dea59f/images/large/6.jpg saved to cache
2026-03-25 16:34:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item dcb399f9-d9cb-5963-880f-81846afd1cae
2026-03-25 16:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp4%252Fb020e9d1a0ae432a842d93a69c93af36%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp4/b020e9d1a0ae432a842d93a69c93af36/images/large/3.jpg not downloaded yet
2026-03-25 16:34:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcaf5710>
2026-03-25 16:34:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7bb69958-3da4-524f-a7f1-87281c287245/7bb69958-3da4-524f-a7f1-87281c287245_image_9.jpg HTTP/1.1" 201 0
2026-03-25 16:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd8%252F1450d957cc27479a9d54cff382252d3f%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd8/1450d957cc27479a9d54cff382252d3f/images/large/10.jpg saved to cache
2026-03-25 16:34:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7bb69958-3da4-524f-a7f1-87281c287245
2026-03-25 16:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp4%252Fb020e9d1a0ae432a842d93a69c93af36%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp4/b020e9d1a0ae432a842d93a69c93af36/images/large/4.jpg not downloaded yet
2026-03-25 16:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp4%252Fb020e9d1a0ae432a842d93a69c93af36%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp4/b020e9d1a0ae432a842d93a69c93af36/images/large/5.jpg not downloaded yet
2026-03-25 16:34:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dca51c90>
2026-03-25 16:34:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05a6e2ea-e98e-5f95-be6b-f6d497a39c9a/05a6e2ea-e98e-5f95-be6b-f6d497a39c9a_image_3.jpg HTTP/1.1" 201 0
2026-03-25 16:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge9%252Fa549559d3f7d4835a3b18a516e67d64a%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge9/a549559d3f7d4835a3b18a516e67d64a/images/large/4.jpg saved to cache
2026-03-25 16:34:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 05a6e2ea-e98e-5f95-be6b-f6d497a39c9a
2026-03-25 16:34:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc992d10>
2026-03-25 16:34:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dcb399f9-d9cb-5963-880f-81846afd1cae/dcb399f9-d9cb-5963-880f-81846afd1cae_image_6.jpg HTTP/1.1" 201 0
2026-03-25 16:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb8%252F5e476d0705434205ade88f3826dea59f%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb8/5e476d0705434205ade88f3826dea59f/images/large/7.jpg saved to cache
2026-03-25 16:34:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item dcb399f9-d9cb-5963-880f-81846afd1cae
2026-03-25 16:34:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dccced10>
2026-03-25 16:34:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dcb399f9-d9cb-5963-880f-81846afd1cae/dcb399f9-d9cb-5963-880f-81846afd1cae_image_3.jpg HTTP/1.1" 201 0
2026-03-25 16:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb8%252F5e476d0705434205ade88f3826dea59f%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb8/5e476d0705434205ade88f3826dea59f/images/large/4.jpg saved to cache
2026-03-25 16:34:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item dcb399f9-d9cb-5963-880f-81846afd1cae
2026-03-25 16:34:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34d6b3f790>
2026-03-25 16:34:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dcb399f9-d9cb-5963-880f-81846afd1cae/dcb399f9-d9cb-5963-880f-81846afd1cae_image_4.jpg HTTP/1.1" 201 0
2026-03-25 16:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb8%252F5e476d0705434205ade88f3826dea59f%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb8/5e476d0705434205ade88f3826dea59f/images/large/5.jpg saved to cache
2026-03-25 16:34:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item dcb399f9-d9cb-5963-880f-81846afd1cae
2026-03-25 16:34:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc56f5d0>
2026-03-25 16:34:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05a6e2ea-e98e-5f95-be6b-f6d497a39c9a/05a6e2ea-e98e-5f95-be6b-f6d497a39c9a_image_2.jpg HTTP/1.1" 201 0
2026-03-25 16:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge9%252Fa549559d3f7d4835a3b18a516e67d64a%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge9/a549559d3f7d4835a3b18a516e67d64a/images/large/3.jpg saved to cache
2026-03-25 16:34:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 05a6e2ea-e98e-5f95-be6b-f6d497a39c9a
2026-03-25 16:34:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc327590>
2026-03-25 16:34:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05a6e2ea-e98e-5f95-be6b-f6d497a39c9a/05a6e2ea-e98e-5f95-be6b-f6d497a39c9a_image_1.jpg HTTP/1.1" 201 0
2026-03-25 16:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge9%252Fa549559d3f7d4835a3b18a516e67d64a%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge9/a549559d3f7d4835a3b18a516e67d64a/images/large/2.jpg saved to cache
2026-03-25 16:34:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 05a6e2ea-e98e-5f95-be6b-f6d497a39c9a
2026-03-25 16:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp4%252Fb020e9d1a0ae432a842d93a69c93af36%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp4/b020e9d1a0ae432a842d93a69c93af36/images/large/6.jpg not downloaded yet
2026-03-25 16:34:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb8/5e476d0705434205ade88f3826dea59f/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge9/a549559d3f7d4835a3b18a516e67d64a/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp4%252Fb020e9d1a0ae432a842d93a69c93af36%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp4/b020e9d1a0ae432a842d93a69c93af36/images/large/7.jpg not downloaded yet
2026-03-25 16:34:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge9/a549559d3f7d4835a3b18a516e67d64a/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge9/a549559d3f7d4835a3b18a516e67d64a/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp4%252Fb020e9d1a0ae432a842d93a69c93af36%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp4/b020e9d1a0ae432a842d93a69c93af36/images/large/8.jpg not downloaded yet
2026-03-25 16:34:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge9/a549559d3f7d4835a3b18a516e67d64a/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb8/5e476d0705434205ade88f3826dea59f/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs0/24a9396a6cf74061abd614e97451ce3e/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp4%252Fb020e9d1a0ae432a842d93a69c93af36%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp4/b020e9d1a0ae432a842d93a69c93af36/images/large/9.jpg not downloaded yet
2026-03-25 16:34:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs0/24a9396a6cf74061abd614e97451ce3e/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp4%252Fb020e9d1a0ae432a842d93a69c93af36%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp4/b020e9d1a0ae432a842d93a69c93af36/images/large/10.jpg not downloaded yet
2026-03-25 16:34:11 [ayvens.it] INFO: Found listing with ID: 1983660
2026-03-25 16:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983660%27 HTTP/1.1" 200 None
2026-03-25 16:34:11 [ayvens.it] INFO: Scrape type for 1983660: 1
2026-03-25 16:34:11 [ayvens.it] INFO: Extracting data for car ID: 1983660
2026-03-25 16:34:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fac2ddc5-df99-556a-929e-2e2894efcd2b with identifier: 1983660
2026-03-25 16:34:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fac2ddc5-df99-556a-929e-2e2894efcd2b with scrape type 1
2026-03-25 16:34:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item fac2ddc5-df99-556a-929e-2e2894efcd2b
2026-03-25 16:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr3%252F9c4eb9c02cac46118c2d831ff87ab008%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr3/9c4eb9c02cac46118c2d831ff87ab008/images/large/1.jpg not downloaded yet
2026-03-25 16:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr3%252F9c4eb9c02cac46118c2d831ff87ab008%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr3/9c4eb9c02cac46118c2d831ff87ab008/images/large/2.jpg not downloaded yet
2026-03-25 16:34:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcb2e150>
2026-03-25 16:34:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dcb399f9-d9cb-5963-880f-81846afd1cae/dcb399f9-d9cb-5963-880f-81846afd1cae_image_9.jpg HTTP/1.1" 201 0
2026-03-25 16:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb8%252F5e476d0705434205ade88f3826dea59f%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb8/5e476d0705434205ade88f3826dea59f/images/large/10.jpg saved to cache
2026-03-25 16:34:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item dcb399f9-d9cb-5963-880f-81846afd1cae
2026-03-25 16:34:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc62a310>
2026-03-25 16:34:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05a6e2ea-e98e-5f95-be6b-f6d497a39c9a/05a6e2ea-e98e-5f95-be6b-f6d497a39c9a_image_5.jpg HTTP/1.1" 201 0
2026-03-25 16:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge9%252Fa549559d3f7d4835a3b18a516e67d64a%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge9/a549559d3f7d4835a3b18a516e67d64a/images/large/6.jpg saved to cache
2026-03-25 16:34:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 05a6e2ea-e98e-5f95-be6b-f6d497a39c9a
2026-03-25 16:34:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc9740d0>
2026-03-25 16:34:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05a6e2ea-e98e-5f95-be6b-f6d497a39c9a/05a6e2ea-e98e-5f95-be6b-f6d497a39c9a_image_6.jpg HTTP/1.1" 201 0
2026-03-25 16:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge9%252Fa549559d3f7d4835a3b18a516e67d64a%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge9/a549559d3f7d4835a3b18a516e67d64a/images/large/7.jpg saved to cache
2026-03-25 16:34:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 05a6e2ea-e98e-5f95-be6b-f6d497a39c9a
2026-03-25 16:34:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dca26350>
2026-03-25 16:34:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05a6e2ea-e98e-5f95-be6b-f6d497a39c9a/05a6e2ea-e98e-5f95-be6b-f6d497a39c9a_image_4.jpg HTTP/1.1" 201 0
2026-03-25 16:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge9%252Fa549559d3f7d4835a3b18a516e67d64a%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge9/a549559d3f7d4835a3b18a516e67d64a/images/large/5.jpg saved to cache
2026-03-25 16:34:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 05a6e2ea-e98e-5f95-be6b-f6d497a39c9a
2026-03-25 16:34:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc629090>
2026-03-25 16:34:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05a6e2ea-e98e-5f95-be6b-f6d497a39c9a/05a6e2ea-e98e-5f95-be6b-f6d497a39c9a_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge9%252Fa549559d3f7d4835a3b18a516e67d64a%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge9/a549559d3f7d4835a3b18a516e67d64a/images/large/1.jpg saved to cache
2026-03-25 16:34:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 05a6e2ea-e98e-5f95-be6b-f6d497a39c9a
2026-03-25 16:34:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcdd2f90>
2026-03-25 16:34:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dcb399f9-d9cb-5963-880f-81846afd1cae/dcb399f9-d9cb-5963-880f-81846afd1cae_image_8.jpg HTTP/1.1" 201 0
2026-03-25 16:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb8%252F5e476d0705434205ade88f3826dea59f%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb8/5e476d0705434205ade88f3826dea59f/images/large/9.jpg saved to cache
2026-03-25 16:34:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item dcb399f9-d9cb-5963-880f-81846afd1cae
2026-03-25 16:34:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc975ad0>
2026-03-25 16:34:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95274bde-7267-5245-a4c3-bf013298eef0/95274bde-7267-5245-a4c3-bf013298eef0_image_2.jpg HTTP/1.1" 201 0
2026-03-25 16:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs0%252F24a9396a6cf74061abd614e97451ce3e%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs0/24a9396a6cf74061abd614e97451ce3e/images/large/3.jpg saved to cache
2026-03-25 16:34:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 95274bde-7267-5245-a4c3-bf013298eef0
2026-03-25 16:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr3%252F9c4eb9c02cac46118c2d831ff87ab008%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr3/9c4eb9c02cac46118c2d831ff87ab008/images/large/3.jpg not downloaded yet
2026-03-25 16:34:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34d7409790>
2026-03-25 16:34:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95274bde-7267-5245-a4c3-bf013298eef0/95274bde-7267-5245-a4c3-bf013298eef0_image_3.jpg HTTP/1.1" 201 0
2026-03-25 16:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs0%252F24a9396a6cf74061abd614e97451ce3e%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs0/24a9396a6cf74061abd614e97451ce3e/images/large/4.jpg saved to cache
2026-03-25 16:34:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 95274bde-7267-5245-a4c3-bf013298eef0
2026-03-25 16:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr3%252F9c4eb9c02cac46118c2d831ff87ab008%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr3/9c4eb9c02cac46118c2d831ff87ab008/images/large/4.jpg not downloaded yet
2026-03-25 16:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr3%252F9c4eb9c02cac46118c2d831ff87ab008%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr3/9c4eb9c02cac46118c2d831ff87ab008/images/large/5.jpg not downloaded yet
2026-03-25 16:34:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs0/24a9396a6cf74061abd614e97451ce3e/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr3%252F9c4eb9c02cac46118c2d831ff87ab008%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr3/9c4eb9c02cac46118c2d831ff87ab008/images/large/6.jpg not downloaded yet
2026-03-25 16:34:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs0/24a9396a6cf74061abd614e97451ce3e/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs0/24a9396a6cf74061abd614e97451ce3e/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs0/24a9396a6cf74061abd614e97451ce3e/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr3%252F9c4eb9c02cac46118c2d831ff87ab008%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr3/9c4eb9c02cac46118c2d831ff87ab008/images/large/7.jpg not downloaded yet
2026-03-25 16:34:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs0/24a9396a6cf74061abd614e97451ce3e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr3%252F9c4eb9c02cac46118c2d831ff87ab008%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr3/9c4eb9c02cac46118c2d831ff87ab008/images/large/8.jpg not downloaded yet
2026-03-25 16:34:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp4/b020e9d1a0ae432a842d93a69c93af36/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr3%252F9c4eb9c02cac46118c2d831ff87ab008%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr3/9c4eb9c02cac46118c2d831ff87ab008/images/large/9.jpg not downloaded yet
2026-03-25 16:34:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp4/b020e9d1a0ae432a842d93a69c93af36/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp4/b020e9d1a0ae432a842d93a69c93af36/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr3%252F9c4eb9c02cac46118c2d831ff87ab008%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr3/9c4eb9c02cac46118c2d831ff87ab008/images/large/10.jpg not downloaded yet
2026-03-25 16:34:12 [ayvens.it] INFO: Found listing with ID: 1983661
2026-03-25 16:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983661%27 HTTP/1.1" 200 None
2026-03-25 16:34:12 [ayvens.it] INFO: Scrape type for 1983661: 1
2026-03-25 16:34:12 [ayvens.it] INFO: Extracting data for car ID: 1983661
2026-03-25 16:34:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f2a39b3e-8857-5c9b-8aaa-ccbdd733cf7b with identifier: 1983661
2026-03-25 16:34:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f2a39b3e-8857-5c9b-8aaa-ccbdd733cf7b with scrape type 1
2026-03-25 16:34:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f2a39b3e-8857-5c9b-8aaa-ccbdd733cf7b
2026-03-25 16:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffp4%252F3d69da056c7c48ca85ba55090740bfe9%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fp4/3d69da056c7c48ca85ba55090740bfe9/images/large/1.jpg not downloaded yet
2026-03-25 16:34:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc80f490>
2026-03-25 16:34:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95274bde-7267-5245-a4c3-bf013298eef0/95274bde-7267-5245-a4c3-bf013298eef0_image_5.jpg HTTP/1.1" 201 0
2026-03-25 16:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs0%252F24a9396a6cf74061abd614e97451ce3e%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs0/24a9396a6cf74061abd614e97451ce3e/images/large/6.jpg saved to cache
2026-03-25 16:34:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 95274bde-7267-5245-a4c3-bf013298eef0
2026-03-25 16:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffp4%252F3d69da056c7c48ca85ba55090740bfe9%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fp4/3d69da056c7c48ca85ba55090740bfe9/images/large/2.jpg not downloaded yet
2026-03-25 16:34:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc578490>
2026-03-25 16:34:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95274bde-7267-5245-a4c3-bf013298eef0/95274bde-7267-5245-a4c3-bf013298eef0_image_1.jpg HTTP/1.1" 201 0
2026-03-25 16:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs0%252F24a9396a6cf74061abd614e97451ce3e%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs0/24a9396a6cf74061abd614e97451ce3e/images/large/2.jpg saved to cache
2026-03-25 16:34:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 95274bde-7267-5245-a4c3-bf013298eef0
2026-03-25 16:34:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc5782d0>
2026-03-25 16:34:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95274bde-7267-5245-a4c3-bf013298eef0/95274bde-7267-5245-a4c3-bf013298eef0_image_6.jpg HTTP/1.1" 201 0
2026-03-25 16:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs0%252F24a9396a6cf74061abd614e97451ce3e%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs0/24a9396a6cf74061abd614e97451ce3e/images/large/7.jpg saved to cache
2026-03-25 16:34:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 95274bde-7267-5245-a4c3-bf013298eef0
2026-03-25 16:34:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcab1110>
2026-03-25 16:34:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95274bde-7267-5245-a4c3-bf013298eef0/95274bde-7267-5245-a4c3-bf013298eef0_image_4.jpg HTTP/1.1" 201 0
2026-03-25 16:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs0%252F24a9396a6cf74061abd614e97451ce3e%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs0/24a9396a6cf74061abd614e97451ce3e/images/large/5.jpg saved to cache
2026-03-25 16:34:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 95274bde-7267-5245-a4c3-bf013298eef0
2026-03-25 16:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffp4%252F3d69da056c7c48ca85ba55090740bfe9%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fp4/3d69da056c7c48ca85ba55090740bfe9/images/large/3.jpg not downloaded yet
2026-03-25 16:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffp4%252F3d69da056c7c48ca85ba55090740bfe9%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fp4/3d69da056c7c48ca85ba55090740bfe9/images/large/4.jpg not downloaded yet
2026-03-25 16:34:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc92e450>
2026-03-25 16:34:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95274bde-7267-5245-a4c3-bf013298eef0/95274bde-7267-5245-a4c3-bf013298eef0_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs0%252F24a9396a6cf74061abd614e97451ce3e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs0/24a9396a6cf74061abd614e97451ce3e/images/large/1.jpg saved to cache
2026-03-25 16:34:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 95274bde-7267-5245-a4c3-bf013298eef0
2026-03-25 16:34:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34d7403390>
2026-03-25 16:34:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da9d3664-57b6-5cf4-88fe-e9684b73d775/da9d3664-57b6-5cf4-88fe-e9684b73d775_image_2.jpg HTTP/1.1" 201 0
2026-03-25 16:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp4%252Fb020e9d1a0ae432a842d93a69c93af36%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp4/b020e9d1a0ae432a842d93a69c93af36/images/large/3.jpg saved to cache
2026-03-25 16:34:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item da9d3664-57b6-5cf4-88fe-e9684b73d775
2026-03-25 16:34:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc5cff10>
2026-03-25 16:34:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da9d3664-57b6-5cf4-88fe-e9684b73d775/da9d3664-57b6-5cf4-88fe-e9684b73d775_image_1.jpg HTTP/1.1" 201 0
2026-03-25 16:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp4%252Fb020e9d1a0ae432a842d93a69c93af36%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp4/b020e9d1a0ae432a842d93a69c93af36/images/large/2.jpg saved to cache
2026-03-25 16:34:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item da9d3664-57b6-5cf4-88fe-e9684b73d775
2026-03-25 16:34:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc990f90>
2026-03-25 16:34:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da9d3664-57b6-5cf4-88fe-e9684b73d775/da9d3664-57b6-5cf4-88fe-e9684b73d775_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp4%252Fb020e9d1a0ae432a842d93a69c93af36%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp4/b020e9d1a0ae432a842d93a69c93af36/images/large/1.jpg saved to cache
2026-03-25 16:34:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item da9d3664-57b6-5cf4-88fe-e9684b73d775
2026-03-25 16:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffp4%252F3d69da056c7c48ca85ba55090740bfe9%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fp4/3d69da056c7c48ca85ba55090740bfe9/images/large/5.jpg not downloaded yet
2026-03-25 16:34:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp4/b020e9d1a0ae432a842d93a69c93af36/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffp4%252F3d69da056c7c48ca85ba55090740bfe9%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fp4/3d69da056c7c48ca85ba55090740bfe9/images/large/6.jpg not downloaded yet
2026-03-25 16:34:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp4/b020e9d1a0ae432a842d93a69c93af36/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs0/24a9396a6cf74061abd614e97451ce3e/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs0/24a9396a6cf74061abd614e97451ce3e/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffp4%252F3d69da056c7c48ca85ba55090740bfe9%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fp4/3d69da056c7c48ca85ba55090740bfe9/images/large/7.jpg not downloaded yet
2026-03-25 16:34:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp4/b020e9d1a0ae432a842d93a69c93af36/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp4/b020e9d1a0ae432a842d93a69c93af36/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffp4%252F3d69da056c7c48ca85ba55090740bfe9%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fp4/3d69da056c7c48ca85ba55090740bfe9/images/large/8.jpg not downloaded yet
2026-03-25 16:34:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr3/9c4eb9c02cac46118c2d831ff87ab008/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr3/9c4eb9c02cac46118c2d831ff87ab008/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffp4%252F3d69da056c7c48ca85ba55090740bfe9%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fp4/3d69da056c7c48ca85ba55090740bfe9/images/large/9.jpg not downloaded yet
2026-03-25 16:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffp4%252F3d69da056c7c48ca85ba55090740bfe9%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fp4/3d69da056c7c48ca85ba55090740bfe9/images/large/10.jpg not downloaded yet
2026-03-25 16:34:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dccf8c50>
2026-03-25 16:34:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da9d3664-57b6-5cf4-88fe-e9684b73d775/da9d3664-57b6-5cf4-88fe-e9684b73d775_image_6.jpg HTTP/1.1" 201 0
2026-03-25 16:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp4%252Fb020e9d1a0ae432a842d93a69c93af36%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp4/b020e9d1a0ae432a842d93a69c93af36/images/large/7.jpg saved to cache
2026-03-25 16:34:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item da9d3664-57b6-5cf4-88fe-e9684b73d775
2026-03-25 16:34:13 [ayvens.it] INFO: Found listing with ID: 1983662
2026-03-25 16:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983662%27 HTTP/1.1" 200 None
2026-03-25 16:34:13 [ayvens.it] INFO: Scrape type for 1983662: 1
2026-03-25 16:34:13 [ayvens.it] INFO: Extracting data for car ID: 1983662
2026-03-25 16:34:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8fa8f5fc-f5d5-5271-95a1-00f9c89f0cd9 with identifier: 1983662
2026-03-25 16:34:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8fa8f5fc-f5d5-5271-95a1-00f9c89f0cd9 with scrape type 1
2026-03-25 16:34:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8fa8f5fc-f5d5-5271-95a1-00f9c89f0cd9
2026-03-25 16:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf2%252Feafd3c03ccc44a7684004a4ea91d1028%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf2/eafd3c03ccc44a7684004a4ea91d1028/images/large/1.jpg not downloaded yet
2026-03-25 16:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf2%252Feafd3c03ccc44a7684004a4ea91d1028%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf2/eafd3c03ccc44a7684004a4ea91d1028/images/large/2.jpg not downloaded yet
2026-03-25 16:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf2%252Feafd3c03ccc44a7684004a4ea91d1028%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf2/eafd3c03ccc44a7684004a4ea91d1028/images/large/3.jpg not downloaded yet
2026-03-25 16:34:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcd9cc10>
2026-03-25 16:34:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da9d3664-57b6-5cf4-88fe-e9684b73d775/da9d3664-57b6-5cf4-88fe-e9684b73d775_image_5.jpg HTTP/1.1" 201 0
2026-03-25 16:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp4%252Fb020e9d1a0ae432a842d93a69c93af36%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp4/b020e9d1a0ae432a842d93a69c93af36/images/large/6.jpg saved to cache
2026-03-25 16:34:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item da9d3664-57b6-5cf4-88fe-e9684b73d775
2026-03-25 16:34:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc53d990>
2026-03-25 16:34:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95274bde-7267-5245-a4c3-bf013298eef0/95274bde-7267-5245-a4c3-bf013298eef0_image_8.jpg HTTP/1.1" 201 0
2026-03-25 16:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs0%252F24a9396a6cf74061abd614e97451ce3e%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs0/24a9396a6cf74061abd614e97451ce3e/images/large/9.jpg saved to cache
2026-03-25 16:34:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 95274bde-7267-5245-a4c3-bf013298eef0
2026-03-25 16:34:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcb862d0>
2026-03-25 16:34:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95274bde-7267-5245-a4c3-bf013298eef0/95274bde-7267-5245-a4c3-bf013298eef0_image_9.jpg HTTP/1.1" 201 0
2026-03-25 16:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs0%252F24a9396a6cf74061abd614e97451ce3e%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs0/24a9396a6cf74061abd614e97451ce3e/images/large/10.jpg saved to cache
2026-03-25 16:34:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 95274bde-7267-5245-a4c3-bf013298eef0
2026-03-25 16:34:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc92db10>
2026-03-25 16:34:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da9d3664-57b6-5cf4-88fe-e9684b73d775/da9d3664-57b6-5cf4-88fe-e9684b73d775_image_4.jpg HTTP/1.1" 201 0
2026-03-25 16:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp4%252Fb020e9d1a0ae432a842d93a69c93af36%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp4/b020e9d1a0ae432a842d93a69c93af36/images/large/5.jpg saved to cache
2026-03-25 16:34:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item da9d3664-57b6-5cf4-88fe-e9684b73d775
2026-03-25 16:34:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc8e37d0>
2026-03-25 16:34:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da9d3664-57b6-5cf4-88fe-e9684b73d775/da9d3664-57b6-5cf4-88fe-e9684b73d775_image_3.jpg HTTP/1.1" 201 0
2026-03-25 16:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp4%252Fb020e9d1a0ae432a842d93a69c93af36%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp4/b020e9d1a0ae432a842d93a69c93af36/images/large/4.jpg saved to cache
2026-03-25 16:34:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item da9d3664-57b6-5cf4-88fe-e9684b73d775
2026-03-25 16:34:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dfc00150>
2026-03-25 16:34:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fac2ddc5-df99-556a-929e-2e2894efcd2b/fac2ddc5-df99-556a-929e-2e2894efcd2b_image_2.jpg HTTP/1.1" 201 0
2026-03-25 16:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr3%252F9c4eb9c02cac46118c2d831ff87ab008%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr3/9c4eb9c02cac46118c2d831ff87ab008/images/large/3.jpg saved to cache
2026-03-25 16:34:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item fac2ddc5-df99-556a-929e-2e2894efcd2b
2026-03-25 16:34:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc54e710>
2026-03-25 16:34:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fac2ddc5-df99-556a-929e-2e2894efcd2b/fac2ddc5-df99-556a-929e-2e2894efcd2b_image_1.jpg HTTP/1.1" 201 0
2026-03-25 16:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr3%252F9c4eb9c02cac46118c2d831ff87ab008%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr3/9c4eb9c02cac46118c2d831ff87ab008/images/large/2.jpg saved to cache
2026-03-25 16:34:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item fac2ddc5-df99-556a-929e-2e2894efcd2b
2026-03-25 16:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf2%252Feafd3c03ccc44a7684004a4ea91d1028%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf2/eafd3c03ccc44a7684004a4ea91d1028/images/large/4.jpg not downloaded yet
2026-03-25 16:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf2%252Feafd3c03ccc44a7684004a4ea91d1028%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf2/eafd3c03ccc44a7684004a4ea91d1028/images/large/5.jpg not downloaded yet
2026-03-25 16:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf2%252Feafd3c03ccc44a7684004a4ea91d1028%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf2/eafd3c03ccc44a7684004a4ea91d1028/images/large/6.jpg not downloaded yet
2026-03-25 16:34:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr3/9c4eb9c02cac46118c2d831ff87ab008/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf2%252Feafd3c03ccc44a7684004a4ea91d1028%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf2/eafd3c03ccc44a7684004a4ea91d1028/images/large/7.jpg not downloaded yet
2026-03-25 16:34:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr3/9c4eb9c02cac46118c2d831ff87ab008/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr3/9c4eb9c02cac46118c2d831ff87ab008/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf2%252Feafd3c03ccc44a7684004a4ea91d1028%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf2/eafd3c03ccc44a7684004a4ea91d1028/images/large/8.jpg not downloaded yet
2026-03-25 16:34:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr3/9c4eb9c02cac46118c2d831ff87ab008/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fp4/3d69da056c7c48ca85ba55090740bfe9/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf2%252Feafd3c03ccc44a7684004a4ea91d1028%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf2/eafd3c03ccc44a7684004a4ea91d1028/images/large/9.jpg not downloaded yet
2026-03-25 16:34:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fp4/3d69da056c7c48ca85ba55090740bfe9/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr3/9c4eb9c02cac46118c2d831ff87ab008/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fp4/3d69da056c7c48ca85ba55090740bfe9/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf2%252Feafd3c03ccc44a7684004a4ea91d1028%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf2/eafd3c03ccc44a7684004a4ea91d1028/images/large/10.jpg not downloaded yet
2026-03-25 16:34:14 [ayvens.it] INFO: Found listing with ID: 1983663
2026-03-25 16:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983663%27 HTTP/1.1" 200 None
2026-03-25 16:34:14 [ayvens.it] INFO: Scrape type for 1983663: 1
2026-03-25 16:34:14 [ayvens.it] INFO: Extracting data for car ID: 1983663
2026-03-25 16:34:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 00b6b2b0-0faf-513d-ba48-4d0d70ea200b with identifier: 1983663
2026-03-25 16:34:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 00b6b2b0-0faf-513d-ba48-4d0d70ea200b with scrape type 1
2026-03-25 16:34:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 00b6b2b0-0faf-513d-ba48-4d0d70ea200b
2026-03-25 16:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg6%252F8c1af20d27d04e6d8afff37792e5f59b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg6/8c1af20d27d04e6d8afff37792e5f59b/images/large/1.jpg not downloaded yet
2026-03-25 16:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg6%252F8c1af20d27d04e6d8afff37792e5f59b%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg6/8c1af20d27d04e6d8afff37792e5f59b/images/large/2.jpg not downloaded yet
2026-03-25 16:34:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34d742c710>
2026-03-25 16:34:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fac2ddc5-df99-556a-929e-2e2894efcd2b/fac2ddc5-df99-556a-929e-2e2894efcd2b_image_6.jpg HTTP/1.1" 201 0
2026-03-25 16:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr3%252F9c4eb9c02cac46118c2d831ff87ab008%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr3/9c4eb9c02cac46118c2d831ff87ab008/images/large/7.jpg saved to cache
2026-03-25 16:34:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item fac2ddc5-df99-556a-929e-2e2894efcd2b
2026-03-25 16:34:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc9ddb10>
2026-03-25 16:34:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fac2ddc5-df99-556a-929e-2e2894efcd2b/fac2ddc5-df99-556a-929e-2e2894efcd2b_image_4.jpg HTTP/1.1" 201 0
2026-03-25 16:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr3%252F9c4eb9c02cac46118c2d831ff87ab008%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr3/9c4eb9c02cac46118c2d831ff87ab008/images/large/5.jpg saved to cache
2026-03-25 16:34:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item fac2ddc5-df99-556a-929e-2e2894efcd2b
2026-03-25 16:34:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc766090>
2026-03-25 16:34:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fac2ddc5-df99-556a-929e-2e2894efcd2b/fac2ddc5-df99-556a-929e-2e2894efcd2b_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr3%252F9c4eb9c02cac46118c2d831ff87ab008%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr3/9c4eb9c02cac46118c2d831ff87ab008/images/large/1.jpg saved to cache
2026-03-25 16:34:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fac2ddc5-df99-556a-929e-2e2894efcd2b
2026-03-25 16:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg6%252F8c1af20d27d04e6d8afff37792e5f59b%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg6/8c1af20d27d04e6d8afff37792e5f59b/images/large/3.jpg not downloaded yet
2026-03-25 16:34:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc9f2b10>
2026-03-25 16:34:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fac2ddc5-df99-556a-929e-2e2894efcd2b/fac2ddc5-df99-556a-929e-2e2894efcd2b_image_3.jpg HTTP/1.1" 201 0
2026-03-25 16:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr3%252F9c4eb9c02cac46118c2d831ff87ab008%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr3/9c4eb9c02cac46118c2d831ff87ab008/images/large/4.jpg saved to cache
2026-03-25 16:34:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item fac2ddc5-df99-556a-929e-2e2894efcd2b
2026-03-25 16:34:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcb1d610>
2026-03-25 16:34:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2a39b3e-8857-5c9b-8aaa-ccbdd733cf7b/f2a39b3e-8857-5c9b-8aaa-ccbdd733cf7b_image_2.jpg HTTP/1.1" 201 0
2026-03-25 16:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffp4%252F3d69da056c7c48ca85ba55090740bfe9%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fp4/3d69da056c7c48ca85ba55090740bfe9/images/large/3.jpg saved to cache
2026-03-25 16:34:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f2a39b3e-8857-5c9b-8aaa-ccbdd733cf7b
2026-03-25 16:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg6%252F8c1af20d27d04e6d8afff37792e5f59b%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg6/8c1af20d27d04e6d8afff37792e5f59b/images/large/4.jpg not downloaded yet
2026-03-25 16:34:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc553950>
2026-03-25 16:34:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2a39b3e-8857-5c9b-8aaa-ccbdd733cf7b/f2a39b3e-8857-5c9b-8aaa-ccbdd733cf7b_image_1.jpg HTTP/1.1" 201 0
2026-03-25 16:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffp4%252F3d69da056c7c48ca85ba55090740bfe9%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fp4/3d69da056c7c48ca85ba55090740bfe9/images/large/2.jpg saved to cache
2026-03-25 16:34:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f2a39b3e-8857-5c9b-8aaa-ccbdd733cf7b
2026-03-25 16:34:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc359790>
2026-03-25 16:34:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fac2ddc5-df99-556a-929e-2e2894efcd2b/fac2ddc5-df99-556a-929e-2e2894efcd2b_image_5.jpg HTTP/1.1" 201 0
2026-03-25 16:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr3%252F9c4eb9c02cac46118c2d831ff87ab008%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr3/9c4eb9c02cac46118c2d831ff87ab008/images/large/6.jpg saved to cache
2026-03-25 16:34:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item fac2ddc5-df99-556a-929e-2e2894efcd2b
2026-03-25 16:34:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc8e3610>
2026-03-25 16:34:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2a39b3e-8857-5c9b-8aaa-ccbdd733cf7b/f2a39b3e-8857-5c9b-8aaa-ccbdd733cf7b_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffp4%252F3d69da056c7c48ca85ba55090740bfe9%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fp4/3d69da056c7c48ca85ba55090740bfe9/images/large/1.jpg saved to cache
2026-03-25 16:34:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f2a39b3e-8857-5c9b-8aaa-ccbdd733cf7b
2026-03-25 16:34:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fp4/3d69da056c7c48ca85ba55090740bfe9/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg6%252F8c1af20d27d04e6d8afff37792e5f59b%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg6/8c1af20d27d04e6d8afff37792e5f59b/images/large/5.jpg not downloaded yet
2026-03-25 16:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg6%252F8c1af20d27d04e6d8afff37792e5f59b%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg6/8c1af20d27d04e6d8afff37792e5f59b/images/large/6.jpg not downloaded yet
2026-03-25 16:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg6%252F8c1af20d27d04e6d8afff37792e5f59b%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg6/8c1af20d27d04e6d8afff37792e5f59b/images/large/7.jpg not downloaded yet
2026-03-25 16:34:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fp4/3d69da056c7c48ca85ba55090740bfe9/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg6%252F8c1af20d27d04e6d8afff37792e5f59b%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg6/8c1af20d27d04e6d8afff37792e5f59b/images/large/8.jpg not downloaded yet
2026-03-25 16:34:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fp4/3d69da056c7c48ca85ba55090740bfe9/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr3/9c4eb9c02cac46118c2d831ff87ab008/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf2/eafd3c03ccc44a7684004a4ea91d1028/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf2/eafd3c03ccc44a7684004a4ea91d1028/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf2/eafd3c03ccc44a7684004a4ea91d1028/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf2/eafd3c03ccc44a7684004a4ea91d1028/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg6%252F8c1af20d27d04e6d8afff37792e5f59b%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg6/8c1af20d27d04e6d8afff37792e5f59b/images/large/9.jpg not downloaded yet
2026-03-25 16:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg6%252F8c1af20d27d04e6d8afff37792e5f59b%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg6/8c1af20d27d04e6d8afff37792e5f59b/images/large/10.jpg not downloaded yet
2026-03-25 16:34:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc635510>
2026-03-25 16:34:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2a39b3e-8857-5c9b-8aaa-ccbdd733cf7b/f2a39b3e-8857-5c9b-8aaa-ccbdd733cf7b_image_5.jpg HTTP/1.1" 201 0
2026-03-25 16:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffp4%252F3d69da056c7c48ca85ba55090740bfe9%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fp4/3d69da056c7c48ca85ba55090740bfe9/images/large/6.jpg saved to cache
2026-03-25 16:34:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f2a39b3e-8857-5c9b-8aaa-ccbdd733cf7b
2026-03-25 16:34:15 [ayvens.it] INFO: Found listing with ID: 1983664
2026-03-25 16:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983664%27 HTTP/1.1" 200 None
2026-03-25 16:34:15 [ayvens.it] INFO: Scrape type for 1983664: 1
2026-03-25 16:34:15 [ayvens.it] INFO: Extracting data for car ID: 1983664
2026-03-25 16:34:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1c64b2b7-3292-556d-b32a-911ae251ed06 with identifier: 1983664
2026-03-25 16:34:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1c64b2b7-3292-556d-b32a-911ae251ed06 with scrape type 1
2026-03-25 16:34:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1c64b2b7-3292-556d-b32a-911ae251ed06
2026-03-25 16:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf4%252F76d54ec0028c4979920c9adf77f12aa4%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf4/76d54ec0028c4979920c9adf77f12aa4/images/large/1.jpg not downloaded yet
2026-03-25 16:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf4%252F76d54ec0028c4979920c9adf77f12aa4%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf4/76d54ec0028c4979920c9adf77f12aa4/images/large/2.jpg not downloaded yet
2026-03-25 16:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf4%252F76d54ec0028c4979920c9adf77f12aa4%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf4/76d54ec0028c4979920c9adf77f12aa4/images/large/3.jpg not downloaded yet
2026-03-25 16:34:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc552b10>
2026-03-25 16:34:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2a39b3e-8857-5c9b-8aaa-ccbdd733cf7b/f2a39b3e-8857-5c9b-8aaa-ccbdd733cf7b_image_4.jpg HTTP/1.1" 201 0
2026-03-25 16:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffp4%252F3d69da056c7c48ca85ba55090740bfe9%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fp4/3d69da056c7c48ca85ba55090740bfe9/images/large/5.jpg saved to cache
2026-03-25 16:34:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f2a39b3e-8857-5c9b-8aaa-ccbdd733cf7b
2026-03-25 16:34:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc5ceed0>
2026-03-25 16:34:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2a39b3e-8857-5c9b-8aaa-ccbdd733cf7b/f2a39b3e-8857-5c9b-8aaa-ccbdd733cf7b_image_3.jpg HTTP/1.1" 201 0
2026-03-25 16:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffp4%252F3d69da056c7c48ca85ba55090740bfe9%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fp4/3d69da056c7c48ca85ba55090740bfe9/images/large/4.jpg saved to cache
2026-03-25 16:34:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f2a39b3e-8857-5c9b-8aaa-ccbdd733cf7b
2026-03-25 16:34:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34d7495810>
2026-03-25 16:34:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fac2ddc5-df99-556a-929e-2e2894efcd2b/fac2ddc5-df99-556a-929e-2e2894efcd2b_image_9.jpg HTTP/1.1" 201 0
2026-03-25 16:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr3%252F9c4eb9c02cac46118c2d831ff87ab008%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr3/9c4eb9c02cac46118c2d831ff87ab008/images/large/10.jpg saved to cache
2026-03-25 16:34:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item fac2ddc5-df99-556a-929e-2e2894efcd2b
2026-03-25 16:34:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dca27810>
2026-03-25 16:34:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8fa8f5fc-f5d5-5271-95a1-00f9c89f0cd9/8fa8f5fc-f5d5-5271-95a1-00f9c89f0cd9_image_1.jpg HTTP/1.1" 201 0
2026-03-25 16:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf2%252Feafd3c03ccc44a7684004a4ea91d1028%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf2/eafd3c03ccc44a7684004a4ea91d1028/images/large/2.jpg saved to cache
2026-03-25 16:34:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8fa8f5fc-f5d5-5271-95a1-00f9c89f0cd9
2026-03-25 16:34:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34d7495490>
2026-03-25 16:34:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8fa8f5fc-f5d5-5271-95a1-00f9c89f0cd9/8fa8f5fc-f5d5-5271-95a1-00f9c89f0cd9_image_2.jpg HTTP/1.1" 201 0
2026-03-25 16:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf2%252Feafd3c03ccc44a7684004a4ea91d1028%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf2/eafd3c03ccc44a7684004a4ea91d1028/images/large/3.jpg saved to cache
2026-03-25 16:34:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8fa8f5fc-f5d5-5271-95a1-00f9c89f0cd9
2026-03-25 16:34:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34d7496450>
2026-03-25 16:34:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8fa8f5fc-f5d5-5271-95a1-00f9c89f0cd9/8fa8f5fc-f5d5-5271-95a1-00f9c89f0cd9_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf2%252Feafd3c03ccc44a7684004a4ea91d1028%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf2/eafd3c03ccc44a7684004a4ea91d1028/images/large/1.jpg saved to cache
2026-03-25 16:34:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8fa8f5fc-f5d5-5271-95a1-00f9c89f0cd9
2026-03-25 16:34:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcdb9910>
2026-03-25 16:34:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8fa8f5fc-f5d5-5271-95a1-00f9c89f0cd9/8fa8f5fc-f5d5-5271-95a1-00f9c89f0cd9_image_3.jpg HTTP/1.1" 201 0
2026-03-25 16:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf2%252Feafd3c03ccc44a7684004a4ea91d1028%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf2/eafd3c03ccc44a7684004a4ea91d1028/images/large/4.jpg saved to cache
2026-03-25 16:34:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8fa8f5fc-f5d5-5271-95a1-00f9c89f0cd9
2026-03-25 16:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf4%252F76d54ec0028c4979920c9adf77f12aa4%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf4/76d54ec0028c4979920c9adf77f12aa4/images/large/4.jpg not downloaded yet
2026-03-25 16:34:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf2/eafd3c03ccc44a7684004a4ea91d1028/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf4%252F76d54ec0028c4979920c9adf77f12aa4%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf4/76d54ec0028c4979920c9adf77f12aa4/images/large/5.jpg not downloaded yet
2026-03-25 16:34:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf2/eafd3c03ccc44a7684004a4ea91d1028/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fp4/3d69da056c7c48ca85ba55090740bfe9/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf2/eafd3c03ccc44a7684004a4ea91d1028/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf4%252F76d54ec0028c4979920c9adf77f12aa4%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf4/76d54ec0028c4979920c9adf77f12aa4/images/large/6.jpg not downloaded yet
2026-03-25 16:34:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf2/eafd3c03ccc44a7684004a4ea91d1028/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf4%252F76d54ec0028c4979920c9adf77f12aa4%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf4/76d54ec0028c4979920c9adf77f12aa4/images/large/7.jpg not downloaded yet
2026-03-25 16:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf4%252F76d54ec0028c4979920c9adf77f12aa4%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf4/76d54ec0028c4979920c9adf77f12aa4/images/large/8.jpg not downloaded yet
2026-03-25 16:34:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg6/8c1af20d27d04e6d8afff37792e5f59b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf4%252F76d54ec0028c4979920c9adf77f12aa4%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf4/76d54ec0028c4979920c9adf77f12aa4/images/large/9.jpg not downloaded yet
2026-03-25 16:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf4%252F76d54ec0028c4979920c9adf77f12aa4%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf4/76d54ec0028c4979920c9adf77f12aa4/images/large/10.jpg not downloaded yet
2026-03-25 16:34:16 [ayvens.it] INFO: Found listing with ID: 1983665
2026-03-25 16:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983665%27 HTTP/1.1" 200 None
2026-03-25 16:34:16 [ayvens.it] INFO: Scrape type for 1983665: 1
2026-03-25 16:34:16 [ayvens.it] INFO: Extracting data for car ID: 1983665
2026-03-25 16:34:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: af67b96c-f057-57c2-9685-820d5458b52f with identifier: 1983665
2026-03-25 16:34:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item af67b96c-f057-57c2-9685-820d5458b52f with scrape type 1
2026-03-25 16:34:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item af67b96c-f057-57c2-9685-820d5458b52f
2026-03-25 16:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf6%252F8ed9c7ac58134b78bc7b5170bc6818cd%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf6/8ed9c7ac58134b78bc7b5170bc6818cd/images/large/1.jpg not downloaded yet
2026-03-25 16:34:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34de16e850>
2026-03-25 16:34:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8fa8f5fc-f5d5-5271-95a1-00f9c89f0cd9/8fa8f5fc-f5d5-5271-95a1-00f9c89f0cd9_image_5.jpg HTTP/1.1" 201 0
2026-03-25 16:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf2%252Feafd3c03ccc44a7684004a4ea91d1028%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf2/eafd3c03ccc44a7684004a4ea91d1028/images/large/6.jpg saved to cache
2026-03-25 16:34:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8fa8f5fc-f5d5-5271-95a1-00f9c89f0cd9
2026-03-25 16:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf6%252F8ed9c7ac58134b78bc7b5170bc6818cd%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf6/8ed9c7ac58134b78bc7b5170bc6818cd/images/large/2.jpg not downloaded yet
2026-03-25 16:34:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dca74b10>
2026-03-25 16:34:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8fa8f5fc-f5d5-5271-95a1-00f9c89f0cd9/8fa8f5fc-f5d5-5271-95a1-00f9c89f0cd9_image_6.jpg HTTP/1.1" 201 0
2026-03-25 16:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf2%252Feafd3c03ccc44a7684004a4ea91d1028%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf2/eafd3c03ccc44a7684004a4ea91d1028/images/large/7.jpg saved to cache
2026-03-25 16:34:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8fa8f5fc-f5d5-5271-95a1-00f9c89f0cd9
2026-03-25 16:34:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dce00d50>
2026-03-25 16:34:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2a39b3e-8857-5c9b-8aaa-ccbdd733cf7b/f2a39b3e-8857-5c9b-8aaa-ccbdd733cf7b_image_9.jpg HTTP/1.1" 201 0
2026-03-25 16:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffp4%252F3d69da056c7c48ca85ba55090740bfe9%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fp4/3d69da056c7c48ca85ba55090740bfe9/images/large/10.jpg saved to cache
2026-03-25 16:34:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f2a39b3e-8857-5c9b-8aaa-ccbdd733cf7b
2026-03-25 16:34:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc5afe90>
2026-03-25 16:34:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8fa8f5fc-f5d5-5271-95a1-00f9c89f0cd9/8fa8f5fc-f5d5-5271-95a1-00f9c89f0cd9_image_9.jpg HTTP/1.1" 201 0
2026-03-25 16:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf2%252Feafd3c03ccc44a7684004a4ea91d1028%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf2/eafd3c03ccc44a7684004a4ea91d1028/images/large/10.jpg saved to cache
2026-03-25 16:34:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8fa8f5fc-f5d5-5271-95a1-00f9c89f0cd9
2026-03-25 16:34:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc800a50>
2026-03-25 16:34:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8fa8f5fc-f5d5-5271-95a1-00f9c89f0cd9/8fa8f5fc-f5d5-5271-95a1-00f9c89f0cd9_image_4.jpg HTTP/1.1" 201 0
2026-03-25 16:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf2%252Feafd3c03ccc44a7684004a4ea91d1028%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf2/eafd3c03ccc44a7684004a4ea91d1028/images/large/5.jpg saved to cache
2026-03-25 16:34:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8fa8f5fc-f5d5-5271-95a1-00f9c89f0cd9
2026-03-25 16:34:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg6/8c1af20d27d04e6d8afff37792e5f59b/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf6%252F8ed9c7ac58134b78bc7b5170bc6818cd%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf6/8ed9c7ac58134b78bc7b5170bc6818cd/images/large/3.jpg not downloaded yet
2026-03-25 16:34:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg6/8c1af20d27d04e6d8afff37792e5f59b/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf6%252F8ed9c7ac58134b78bc7b5170bc6818cd%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf6/8ed9c7ac58134b78bc7b5170bc6818cd/images/large/4.jpg not downloaded yet
2026-03-25 16:34:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34d7d5a5d0>
2026-03-25 16:34:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00b6b2b0-0faf-513d-ba48-4d0d70ea200b/00b6b2b0-0faf-513d-ba48-4d0d70ea200b_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg6%252F8c1af20d27d04e6d8afff37792e5f59b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg6/8c1af20d27d04e6d8afff37792e5f59b/images/large/1.jpg saved to cache
2026-03-25 16:34:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 00b6b2b0-0faf-513d-ba48-4d0d70ea200b
2026-03-25 16:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf6%252F8ed9c7ac58134b78bc7b5170bc6818cd%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf6/8ed9c7ac58134b78bc7b5170bc6818cd/images/large/5.jpg not downloaded yet
2026-03-25 16:34:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg6/8c1af20d27d04e6d8afff37792e5f59b/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf6%252F8ed9c7ac58134b78bc7b5170bc6818cd%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf6/8ed9c7ac58134b78bc7b5170bc6818cd/images/large/6.jpg not downloaded yet
2026-03-25 16:34:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg6/8c1af20d27d04e6d8afff37792e5f59b/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc946c50>
2026-03-25 16:34:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00b6b2b0-0faf-513d-ba48-4d0d70ea200b/00b6b2b0-0faf-513d-ba48-4d0d70ea200b_image_2.jpg HTTP/1.1" 201 0
2026-03-25 16:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg6%252F8c1af20d27d04e6d8afff37792e5f59b%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg6/8c1af20d27d04e6d8afff37792e5f59b/images/large/3.jpg saved to cache
2026-03-25 16:34:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 00b6b2b0-0faf-513d-ba48-4d0d70ea200b
2026-03-25 16:34:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc3701d0>
2026-03-25 16:34:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00b6b2b0-0faf-513d-ba48-4d0d70ea200b/00b6b2b0-0faf-513d-ba48-4d0d70ea200b_image_1.jpg HTTP/1.1" 201 0
2026-03-25 16:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg6%252F8c1af20d27d04e6d8afff37792e5f59b%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg6/8c1af20d27d04e6d8afff37792e5f59b/images/large/2.jpg saved to cache
2026-03-25 16:34:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 00b6b2b0-0faf-513d-ba48-4d0d70ea200b
2026-03-25 16:34:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf2/eafd3c03ccc44a7684004a4ea91d1028/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf6%252F8ed9c7ac58134b78bc7b5170bc6818cd%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf6/8ed9c7ac58134b78bc7b5170bc6818cd/images/large/7.jpg not downloaded yet
2026-03-25 16:34:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg6/8c1af20d27d04e6d8afff37792e5f59b/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg6/8c1af20d27d04e6d8afff37792e5f59b/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf4/76d54ec0028c4979920c9adf77f12aa4/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf6%252F8ed9c7ac58134b78bc7b5170bc6818cd%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf6/8ed9c7ac58134b78bc7b5170bc6818cd/images/large/8.jpg not downloaded yet
2026-03-25 16:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf6%252F8ed9c7ac58134b78bc7b5170bc6818cd%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf6/8ed9c7ac58134b78bc7b5170bc6818cd/images/large/9.jpg not downloaded yet
2026-03-25 16:34:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc54f450>
2026-03-25 16:34:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00b6b2b0-0faf-513d-ba48-4d0d70ea200b/00b6b2b0-0faf-513d-ba48-4d0d70ea200b_image_5.jpg HTTP/1.1" 201 0
2026-03-25 16:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg6%252F8c1af20d27d04e6d8afff37792e5f59b%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg6/8c1af20d27d04e6d8afff37792e5f59b/images/large/6.jpg saved to cache
2026-03-25 16:34:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 00b6b2b0-0faf-513d-ba48-4d0d70ea200b
2026-03-25 16:34:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc54d950>
2026-03-25 16:34:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00b6b2b0-0faf-513d-ba48-4d0d70ea200b/00b6b2b0-0faf-513d-ba48-4d0d70ea200b_image_6.jpg HTTP/1.1" 201 0
2026-03-25 16:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg6%252F8c1af20d27d04e6d8afff37792e5f59b%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg6/8c1af20d27d04e6d8afff37792e5f59b/images/large/7.jpg saved to cache
2026-03-25 16:34:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 00b6b2b0-0faf-513d-ba48-4d0d70ea200b
2026-03-25 16:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf6%252F8ed9c7ac58134b78bc7b5170bc6818cd%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf6/8ed9c7ac58134b78bc7b5170bc6818cd/images/large/10.jpg not downloaded yet
2026-03-25 16:34:17 [ayvens.it] INFO: Found listing with ID: 1983666
2026-03-25 16:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983666%27 HTTP/1.1" 200 None
2026-03-25 16:34:17 [ayvens.it] INFO: Scrape type for 1983666: 1
2026-03-25 16:34:17 [ayvens.it] INFO: Extracting data for car ID: 1983666
2026-03-25 16:34:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 98901852-a29a-5770-89b6-98d8bebfa2d9 with identifier: 1983666
2026-03-25 16:34:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 98901852-a29a-5770-89b6-98d8bebfa2d9 with scrape type 1
2026-03-25 16:34:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 98901852-a29a-5770-89b6-98d8bebfa2d9
2026-03-25 16:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs0%252Fcb1c7ac744f546198ae6809fd01b55c6%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs0/cb1c7ac744f546198ae6809fd01b55c6/images/large/1.jpg not downloaded yet
2026-03-25 16:34:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcb2f210>
2026-03-25 16:34:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8fa8f5fc-f5d5-5271-95a1-00f9c89f0cd9/8fa8f5fc-f5d5-5271-95a1-00f9c89f0cd9_image_8.jpg HTTP/1.1" 201 0
2026-03-25 16:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf2%252Feafd3c03ccc44a7684004a4ea91d1028%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf2/eafd3c03ccc44a7684004a4ea91d1028/images/large/9.jpg saved to cache
2026-03-25 16:34:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8fa8f5fc-f5d5-5271-95a1-00f9c89f0cd9
2026-03-25 16:34:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34d74009d0>
2026-03-25 16:34:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00b6b2b0-0faf-513d-ba48-4d0d70ea200b/00b6b2b0-0faf-513d-ba48-4d0d70ea200b_image_4.jpg HTTP/1.1" 201 0
2026-03-25 16:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg6%252F8c1af20d27d04e6d8afff37792e5f59b%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg6/8c1af20d27d04e6d8afff37792e5f59b/images/large/5.jpg saved to cache
2026-03-25 16:34:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 00b6b2b0-0faf-513d-ba48-4d0d70ea200b
2026-03-25 16:34:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34de1873d0>
2026-03-25 16:34:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00b6b2b0-0faf-513d-ba48-4d0d70ea200b/00b6b2b0-0faf-513d-ba48-4d0d70ea200b_image_3.jpg HTTP/1.1" 201 0
2026-03-25 16:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg6%252F8c1af20d27d04e6d8afff37792e5f59b%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg6/8c1af20d27d04e6d8afff37792e5f59b/images/large/4.jpg saved to cache
2026-03-25 16:34:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 00b6b2b0-0faf-513d-ba48-4d0d70ea200b
2026-03-25 16:34:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc9df910>
2026-03-25 16:34:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1c64b2b7-3292-556d-b32a-911ae251ed06/1c64b2b7-3292-556d-b32a-911ae251ed06_image_3.jpg HTTP/1.1" 201 0
2026-03-25 16:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf4%252F76d54ec0028c4979920c9adf77f12aa4%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf4/76d54ec0028c4979920c9adf77f12aa4/images/large/4.jpg saved to cache
2026-03-25 16:34:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1c64b2b7-3292-556d-b32a-911ae251ed06
2026-03-25 16:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs0%252Fcb1c7ac744f546198ae6809fd01b55c6%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs0/cb1c7ac744f546198ae6809fd01b55c6/images/large/2.jpg not downloaded yet
2026-03-25 16:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs0%252Fcb1c7ac744f546198ae6809fd01b55c6%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs0/cb1c7ac744f546198ae6809fd01b55c6/images/large/3.jpg not downloaded yet
2026-03-25 16:34:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg6/8c1af20d27d04e6d8afff37792e5f59b/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf4/76d54ec0028c4979920c9adf77f12aa4/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf4/76d54ec0028c4979920c9adf77f12aa4/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs0%252Fcb1c7ac744f546198ae6809fd01b55c6%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs0/cb1c7ac744f546198ae6809fd01b55c6/images/large/4.jpg not downloaded yet
2026-03-25 16:34:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf4/76d54ec0028c4979920c9adf77f12aa4/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf4/76d54ec0028c4979920c9adf77f12aa4/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf4/76d54ec0028c4979920c9adf77f12aa4/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs0%252Fcb1c7ac744f546198ae6809fd01b55c6%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs0/cb1c7ac744f546198ae6809fd01b55c6/images/large/5.jpg not downloaded yet
2026-03-25 16:34:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf4/76d54ec0028c4979920c9adf77f12aa4/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg6/8c1af20d27d04e6d8afff37792e5f59b/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs0%252Fcb1c7ac744f546198ae6809fd01b55c6%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs0/cb1c7ac744f546198ae6809fd01b55c6/images/large/6.jpg not downloaded yet
2026-03-25 16:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs0%252Fcb1c7ac744f546198ae6809fd01b55c6%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs0/cb1c7ac744f546198ae6809fd01b55c6/images/large/7.jpg not downloaded yet
2026-03-25 16:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs0%252Fcb1c7ac744f546198ae6809fd01b55c6%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs0/cb1c7ac744f546198ae6809fd01b55c6/images/large/8.jpg not downloaded yet
2026-03-25 16:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs0%252Fcb1c7ac744f546198ae6809fd01b55c6%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs0/cb1c7ac744f546198ae6809fd01b55c6/images/large/9.jpg not downloaded yet
2026-03-25 16:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs0%252Fcb1c7ac744f546198ae6809fd01b55c6%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs0/cb1c7ac744f546198ae6809fd01b55c6/images/large/10.jpg not downloaded yet
2026-03-25 16:34:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcbb5390>
2026-03-25 16:34:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00b6b2b0-0faf-513d-ba48-4d0d70ea200b/00b6b2b0-0faf-513d-ba48-4d0d70ea200b_image_9.jpg HTTP/1.1" 201 0
2026-03-25 16:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg6%252F8c1af20d27d04e6d8afff37792e5f59b%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg6/8c1af20d27d04e6d8afff37792e5f59b/images/large/10.jpg saved to cache
2026-03-25 16:34:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 00b6b2b0-0faf-513d-ba48-4d0d70ea200b
2026-03-25 16:34:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc54e150>
2026-03-25 16:34:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1c64b2b7-3292-556d-b32a-911ae251ed06/1c64b2b7-3292-556d-b32a-911ae251ed06_image_5.jpg HTTP/1.1" 201 0
2026-03-25 16:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf4%252F76d54ec0028c4979920c9adf77f12aa4%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf4/76d54ec0028c4979920c9adf77f12aa4/images/large/6.jpg saved to cache
2026-03-25 16:34:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1c64b2b7-3292-556d-b32a-911ae251ed06
2026-03-25 16:34:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc82c310>
2026-03-25 16:34:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1c64b2b7-3292-556d-b32a-911ae251ed06/1c64b2b7-3292-556d-b32a-911ae251ed06_image_2.jpg HTTP/1.1" 201 0
2026-03-25 16:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf4%252F76d54ec0028c4979920c9adf77f12aa4%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf4/76d54ec0028c4979920c9adf77f12aa4/images/large/3.jpg saved to cache
2026-03-25 16:34:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1c64b2b7-3292-556d-b32a-911ae251ed06
2026-03-25 16:34:18 [ayvens.it] INFO: Found listing with ID: 1983667
2026-03-25 16:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983667%27 HTTP/1.1" 200 None
2026-03-25 16:34:18 [ayvens.it] INFO: Scrape type for 1983667: 1
2026-03-25 16:34:18 [ayvens.it] INFO: Extracting data for car ID: 1983667
2026-03-25 16:34:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 31fda52f-41b5-528c-adac-ee5ddf246cc3 with identifier: 1983667
2026-03-25 16:34:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 31fda52f-41b5-528c-adac-ee5ddf246cc3 with scrape type 1
2026-03-25 16:34:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 31fda52f-41b5-528c-adac-ee5ddf246cc3
2026-03-25 16:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg2%252Fda7950026aec40899c50024af66b03ec%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg2/da7950026aec40899c50024af66b03ec/images/large/1.jpg not downloaded yet
2026-03-25 16:34:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc974050>
2026-03-25 16:34:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1c64b2b7-3292-556d-b32a-911ae251ed06/1c64b2b7-3292-556d-b32a-911ae251ed06_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf4%252F76d54ec0028c4979920c9adf77f12aa4%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf4/76d54ec0028c4979920c9adf77f12aa4/images/large/1.jpg saved to cache
2026-03-25 16:34:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1c64b2b7-3292-556d-b32a-911ae251ed06
2026-03-25 16:34:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc60efd0>
2026-03-25 16:34:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1c64b2b7-3292-556d-b32a-911ae251ed06/1c64b2b7-3292-556d-b32a-911ae251ed06_image_4.jpg HTTP/1.1" 201 0
2026-03-25 16:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf4%252F76d54ec0028c4979920c9adf77f12aa4%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf4/76d54ec0028c4979920c9adf77f12aa4/images/large/5.jpg saved to cache
2026-03-25 16:34:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1c64b2b7-3292-556d-b32a-911ae251ed06
2026-03-25 16:34:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcadaf10>
2026-03-25 16:34:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1c64b2b7-3292-556d-b32a-911ae251ed06/1c64b2b7-3292-556d-b32a-911ae251ed06_image_1.jpg HTTP/1.1" 201 0
2026-03-25 16:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf4%252F76d54ec0028c4979920c9adf77f12aa4%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf4/76d54ec0028c4979920c9adf77f12aa4/images/large/2.jpg saved to cache
2026-03-25 16:34:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1c64b2b7-3292-556d-b32a-911ae251ed06
2026-03-25 16:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg2%252Fda7950026aec40899c50024af66b03ec%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg2/da7950026aec40899c50024af66b03ec/images/large/2.jpg not downloaded yet
2026-03-25 16:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg2%252Fda7950026aec40899c50024af66b03ec%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg2/da7950026aec40899c50024af66b03ec/images/large/3.jpg not downloaded yet
2026-03-25 16:34:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc60d190>
2026-03-25 16:34:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1c64b2b7-3292-556d-b32a-911ae251ed06/1c64b2b7-3292-556d-b32a-911ae251ed06_image_7.jpg HTTP/1.1" 201 0
2026-03-25 16:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf4%252F76d54ec0028c4979920c9adf77f12aa4%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf4/76d54ec0028c4979920c9adf77f12aa4/images/large/8.jpg saved to cache
2026-03-25 16:34:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1c64b2b7-3292-556d-b32a-911ae251ed06
2026-03-25 16:34:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcb16d50>
2026-03-25 16:34:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00b6b2b0-0faf-513d-ba48-4d0d70ea200b/00b6b2b0-0faf-513d-ba48-4d0d70ea200b_image_8.jpg HTTP/1.1" 201 0
2026-03-25 16:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg6%252F8c1af20d27d04e6d8afff37792e5f59b%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg6/8c1af20d27d04e6d8afff37792e5f59b/images/large/9.jpg saved to cache
2026-03-25 16:34:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 00b6b2b0-0faf-513d-ba48-4d0d70ea200b
2026-03-25 16:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg2%252Fda7950026aec40899c50024af66b03ec%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg2/da7950026aec40899c50024af66b03ec/images/large/4.jpg not downloaded yet
2026-03-25 16:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg2%252Fda7950026aec40899c50024af66b03ec%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg2/da7950026aec40899c50024af66b03ec/images/large/5.jpg not downloaded yet
2026-03-25 16:34:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf4/76d54ec0028c4979920c9adf77f12aa4/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf6/8ed9c7ac58134b78bc7b5170bc6818cd/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf6/8ed9c7ac58134b78bc7b5170bc6818cd/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg2%252Fda7950026aec40899c50024af66b03ec%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg2/da7950026aec40899c50024af66b03ec/images/large/6.jpg not downloaded yet
2026-03-25 16:34:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf6/8ed9c7ac58134b78bc7b5170bc6818cd/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg2%252Fda7950026aec40899c50024af66b03ec%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg2/da7950026aec40899c50024af66b03ec/images/large/7.jpg not downloaded yet
2026-03-25 16:34:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf6/8ed9c7ac58134b78bc7b5170bc6818cd/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf6/8ed9c7ac58134b78bc7b5170bc6818cd/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf6/8ed9c7ac58134b78bc7b5170bc6818cd/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg2%252Fda7950026aec40899c50024af66b03ec%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg2/da7950026aec40899c50024af66b03ec/images/large/8.jpg not downloaded yet
2026-03-25 16:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg2%252Fda7950026aec40899c50024af66b03ec%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg2/da7950026aec40899c50024af66b03ec/images/large/9.jpg not downloaded yet
2026-03-25 16:34:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf6/8ed9c7ac58134b78bc7b5170bc6818cd/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg2%252Fda7950026aec40899c50024af66b03ec%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg2/da7950026aec40899c50024af66b03ec/images/large/10.jpg not downloaded yet
2026-03-25 16:34:19 [ayvens.it] INFO: Found listing with ID: 1983668
2026-03-25 16:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983668%27 HTTP/1.1" 200 None
2026-03-25 16:34:19 [ayvens.it] INFO: Scrape type for 1983668: 1
2026-03-25 16:34:19 [ayvens.it] INFO: Extracting data for car ID: 1983668
2026-03-25 16:34:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b8e8e5ae-58c5-56ed-b243-0b0849880e37 with identifier: 1983668
2026-03-25 16:34:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b8e8e5ae-58c5-56ed-b243-0b0849880e37 with scrape type 1
2026-03-25 16:34:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b8e8e5ae-58c5-56ed-b243-0b0849880e37
2026-03-25 16:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg3%252F17d374c5b78f4ca59db1e2322ca2970c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg3/17d374c5b78f4ca59db1e2322ca2970c/images/large/1.jpg not downloaded yet
2026-03-25 16:34:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34d6b35e50>
2026-03-25 16:34:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1c64b2b7-3292-556d-b32a-911ae251ed06/1c64b2b7-3292-556d-b32a-911ae251ed06_image_9.jpg HTTP/1.1" 201 0
2026-03-25 16:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf4%252F76d54ec0028c4979920c9adf77f12aa4%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf4/76d54ec0028c4979920c9adf77f12aa4/images/large/10.jpg saved to cache
2026-03-25 16:34:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1c64b2b7-3292-556d-b32a-911ae251ed06
2026-03-25 16:34:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc947c10>
2026-03-25 16:34:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af67b96c-f057-57c2-9685-820d5458b52f/af67b96c-f057-57c2-9685-820d5458b52f_image_5.jpg HTTP/1.1" 201 0
2026-03-25 16:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf6%252F8ed9c7ac58134b78bc7b5170bc6818cd%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf6/8ed9c7ac58134b78bc7b5170bc6818cd/images/large/6.jpg saved to cache
2026-03-25 16:34:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item af67b96c-f057-57c2-9685-820d5458b52f
2026-03-25 16:34:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc9c0cd0>
2026-03-25 16:34:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af67b96c-f057-57c2-9685-820d5458b52f/af67b96c-f057-57c2-9685-820d5458b52f_image_6.jpg HTTP/1.1" 201 0
2026-03-25 16:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf6%252F8ed9c7ac58134b78bc7b5170bc6818cd%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf6/8ed9c7ac58134b78bc7b5170bc6818cd/images/large/7.jpg saved to cache
2026-03-25 16:34:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item af67b96c-f057-57c2-9685-820d5458b52f
2026-03-25 16:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg3%252F17d374c5b78f4ca59db1e2322ca2970c%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg3/17d374c5b78f4ca59db1e2322ca2970c/images/large/2.jpg not downloaded yet
2026-03-25 16:34:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dca05e10>
2026-03-25 16:34:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af67b96c-f057-57c2-9685-820d5458b52f/af67b96c-f057-57c2-9685-820d5458b52f_image_1.jpg HTTP/1.1" 201 0
2026-03-25 16:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf6%252F8ed9c7ac58134b78bc7b5170bc6818cd%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf6/8ed9c7ac58134b78bc7b5170bc6818cd/images/large/2.jpg saved to cache
2026-03-25 16:34:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item af67b96c-f057-57c2-9685-820d5458b52f
2026-03-25 16:34:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc54a310>
2026-03-25 16:34:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af67b96c-f057-57c2-9685-820d5458b52f/af67b96c-f057-57c2-9685-820d5458b52f_image_2.jpg HTTP/1.1" 201 0
2026-03-25 16:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf6%252F8ed9c7ac58134b78bc7b5170bc6818cd%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf6/8ed9c7ac58134b78bc7b5170bc6818cd/images/large/3.jpg saved to cache
2026-03-25 16:34:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item af67b96c-f057-57c2-9685-820d5458b52f
2026-03-25 16:34:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc8e0ed0>
2026-03-25 16:34:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af67b96c-f057-57c2-9685-820d5458b52f/af67b96c-f057-57c2-9685-820d5458b52f_image_3.jpg HTTP/1.1" 201 0
2026-03-25 16:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf6%252F8ed9c7ac58134b78bc7b5170bc6818cd%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf6/8ed9c7ac58134b78bc7b5170bc6818cd/images/large/4.jpg saved to cache
2026-03-25 16:34:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item af67b96c-f057-57c2-9685-820d5458b52f
2026-03-25 16:34:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dce2f990>
2026-03-25 16:34:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af67b96c-f057-57c2-9685-820d5458b52f/af67b96c-f057-57c2-9685-820d5458b52f_image_4.jpg HTTP/1.1" 201 0
2026-03-25 16:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf6%252F8ed9c7ac58134b78bc7b5170bc6818cd%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf6/8ed9c7ac58134b78bc7b5170bc6818cd/images/large/5.jpg saved to cache
2026-03-25 16:34:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item af67b96c-f057-57c2-9685-820d5458b52f
2026-03-25 16:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg3%252F17d374c5b78f4ca59db1e2322ca2970c%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg3/17d374c5b78f4ca59db1e2322ca2970c/images/large/3.jpg not downloaded yet
2026-03-25 16:34:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34d7459190>
2026-03-25 16:34:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af67b96c-f057-57c2-9685-820d5458b52f/af67b96c-f057-57c2-9685-820d5458b52f_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf6%252F8ed9c7ac58134b78bc7b5170bc6818cd%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf6/8ed9c7ac58134b78bc7b5170bc6818cd/images/large/1.jpg saved to cache
2026-03-25 16:34:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item af67b96c-f057-57c2-9685-820d5458b52f
2026-03-25 16:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg3%252F17d374c5b78f4ca59db1e2322ca2970c%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg3/17d374c5b78f4ca59db1e2322ca2970c/images/large/4.jpg not downloaded yet
2026-03-25 16:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg3%252F17d374c5b78f4ca59db1e2322ca2970c%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg3/17d374c5b78f4ca59db1e2322ca2970c/images/large/5.jpg not downloaded yet
2026-03-25 16:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg3%252F17d374c5b78f4ca59db1e2322ca2970c%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg3/17d374c5b78f4ca59db1e2322ca2970c/images/large/6.jpg not downloaded yet
2026-03-25 16:34:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf6/8ed9c7ac58134b78bc7b5170bc6818cd/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fs0/cb1c7ac744f546198ae6809fd01b55c6/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf6/8ed9c7ac58134b78bc7b5170bc6818cd/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg3%252F17d374c5b78f4ca59db1e2322ca2970c%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg3/17d374c5b78f4ca59db1e2322ca2970c/images/large/7.jpg not downloaded yet
2026-03-25 16:34:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fs0/cb1c7ac744f546198ae6809fd01b55c6/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fs0/cb1c7ac744f546198ae6809fd01b55c6/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fs0/cb1c7ac744f546198ae6809fd01b55c6/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fs0/cb1c7ac744f546198ae6809fd01b55c6/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg2/da7950026aec40899c50024af66b03ec/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg3%252F17d374c5b78f4ca59db1e2322ca2970c%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg3/17d374c5b78f4ca59db1e2322ca2970c/images/large/8.jpg not downloaded yet
2026-03-25 16:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg3%252F17d374c5b78f4ca59db1e2322ca2970c%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg3/17d374c5b78f4ca59db1e2322ca2970c/images/large/9.jpg not downloaded yet
2026-03-25 16:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg3%252F17d374c5b78f4ca59db1e2322ca2970c%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg3/17d374c5b78f4ca59db1e2322ca2970c/images/large/10.jpg not downloaded yet
2026-03-25 16:34:20 [ayvens.it] INFO: Found listing with ID: 1983669
2026-03-25 16:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983669%27 HTTP/1.1" 200 None
2026-03-25 16:34:20 [ayvens.it] INFO: Scrape type for 1983669: 1
2026-03-25 16:34:20 [ayvens.it] INFO: Extracting data for car ID: 1983669
2026-03-25 16:34:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b1df8d54-cdbd-5f69-a039-031b5f633052 with identifier: 1983669
2026-03-25 16:34:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b1df8d54-cdbd-5f69-a039-031b5f633052 with scrape type 1
2026-03-25 16:34:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b1df8d54-cdbd-5f69-a039-031b5f633052
2026-03-25 16:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh2%252F56eeed8b3b9d4a6a8f5c37bca9b77f37%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh2/56eeed8b3b9d4a6a8f5c37bca9b77f37/images/large/1.jpg not downloaded yet
2026-03-25 16:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh2%252F56eeed8b3b9d4a6a8f5c37bca9b77f37%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh2/56eeed8b3b9d4a6a8f5c37bca9b77f37/images/large/2.jpg not downloaded yet
2026-03-25 16:34:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34d7494610>
2026-03-25 16:34:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af67b96c-f057-57c2-9685-820d5458b52f/af67b96c-f057-57c2-9685-820d5458b52f_image_8.jpg HTTP/1.1" 201 0
2026-03-25 16:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf6%252F8ed9c7ac58134b78bc7b5170bc6818cd%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf6/8ed9c7ac58134b78bc7b5170bc6818cd/images/large/9.jpg saved to cache
2026-03-25 16:34:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item af67b96c-f057-57c2-9685-820d5458b52f
2026-03-25 16:34:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc75a9d0>
2026-03-25 16:34:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98901852-a29a-5770-89b6-98d8bebfa2d9/98901852-a29a-5770-89b6-98d8bebfa2d9_image_9.jpg HTTP/1.1" 201 0
2026-03-25 16:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs0%252Fcb1c7ac744f546198ae6809fd01b55c6%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs0/cb1c7ac744f546198ae6809fd01b55c6/images/large/10.jpg saved to cache
2026-03-25 16:34:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 98901852-a29a-5770-89b6-98d8bebfa2d9
2026-03-25 16:34:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dca04410>
2026-03-25 16:34:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af67b96c-f057-57c2-9685-820d5458b52f/af67b96c-f057-57c2-9685-820d5458b52f_image_9.jpg HTTP/1.1" 201 0
2026-03-25 16:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf6%252F8ed9c7ac58134b78bc7b5170bc6818cd%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf6/8ed9c7ac58134b78bc7b5170bc6818cd/images/large/10.jpg saved to cache
2026-03-25 16:34:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item af67b96c-f057-57c2-9685-820d5458b52f
2026-03-25 16:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh2%252F56eeed8b3b9d4a6a8f5c37bca9b77f37%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh2/56eeed8b3b9d4a6a8f5c37bca9b77f37/images/large/3.jpg not downloaded yet
2026-03-25 16:34:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc5e8c10>
2026-03-25 16:34:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98901852-a29a-5770-89b6-98d8bebfa2d9/98901852-a29a-5770-89b6-98d8bebfa2d9_image_2.jpg HTTP/1.1" 201 0
2026-03-25 16:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs0%252Fcb1c7ac744f546198ae6809fd01b55c6%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs0/cb1c7ac744f546198ae6809fd01b55c6/images/large/3.jpg saved to cache
2026-03-25 16:34:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 98901852-a29a-5770-89b6-98d8bebfa2d9
2026-03-25 16:34:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dca88290>
2026-03-25 16:34:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98901852-a29a-5770-89b6-98d8bebfa2d9/98901852-a29a-5770-89b6-98d8bebfa2d9_image_1.jpg HTTP/1.1" 201 0
2026-03-25 16:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs0%252Fcb1c7ac744f546198ae6809fd01b55c6%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs0/cb1c7ac744f546198ae6809fd01b55c6/images/large/2.jpg saved to cache
2026-03-25 16:34:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 98901852-a29a-5770-89b6-98d8bebfa2d9
2026-03-25 16:34:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc969390>
2026-03-25 16:34:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98901852-a29a-5770-89b6-98d8bebfa2d9/98901852-a29a-5770-89b6-98d8bebfa2d9_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs0%252Fcb1c7ac744f546198ae6809fd01b55c6%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs0/cb1c7ac744f546198ae6809fd01b55c6/images/large/1.jpg saved to cache
2026-03-25 16:34:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 98901852-a29a-5770-89b6-98d8bebfa2d9
2026-03-25 16:34:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc91e090>
2026-03-25 16:34:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98901852-a29a-5770-89b6-98d8bebfa2d9/98901852-a29a-5770-89b6-98d8bebfa2d9_image_3.jpg HTTP/1.1" 201 0
2026-03-25 16:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs0%252Fcb1c7ac744f546198ae6809fd01b55c6%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs0/cb1c7ac744f546198ae6809fd01b55c6/images/large/4.jpg saved to cache
2026-03-25 16:34:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 98901852-a29a-5770-89b6-98d8bebfa2d9
2026-03-25 16:34:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dca75910>
2026-03-25 16:34:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31fda52f-41b5-528c-adac-ee5ddf246cc3/31fda52f-41b5-528c-adac-ee5ddf246cc3_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg2%252Fda7950026aec40899c50024af66b03ec%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg2/da7950026aec40899c50024af66b03ec/images/large/1.jpg saved to cache
2026-03-25 16:34:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 31fda52f-41b5-528c-adac-ee5ddf246cc3
2026-03-25 16:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh2%252F56eeed8b3b9d4a6a8f5c37bca9b77f37%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh2/56eeed8b3b9d4a6a8f5c37bca9b77f37/images/large/4.jpg not downloaded yet
2026-03-25 16:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh2%252F56eeed8b3b9d4a6a8f5c37bca9b77f37%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh2/56eeed8b3b9d4a6a8f5c37bca9b77f37/images/large/5.jpg not downloaded yet
2026-03-25 16:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh2%252F56eeed8b3b9d4a6a8f5c37bca9b77f37%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh2/56eeed8b3b9d4a6a8f5c37bca9b77f37/images/large/6.jpg not downloaded yet
2026-03-25 16:34:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg2/da7950026aec40899c50024af66b03ec/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg3/17d374c5b78f4ca59db1e2322ca2970c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg3/17d374c5b78f4ca59db1e2322ca2970c/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh2%252F56eeed8b3b9d4a6a8f5c37bca9b77f37%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh2/56eeed8b3b9d4a6a8f5c37bca9b77f37/images/large/7.jpg not downloaded yet
2026-03-25 16:34:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg2/da7950026aec40899c50024af66b03ec/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg2/da7950026aec40899c50024af66b03ec/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fs0/cb1c7ac744f546198ae6809fd01b55c6/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh2%252F56eeed8b3b9d4a6a8f5c37bca9b77f37%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh2/56eeed8b3b9d4a6a8f5c37bca9b77f37/images/large/8.jpg not downloaded yet
2026-03-25 16:34:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg2/da7950026aec40899c50024af66b03ec/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg2/da7950026aec40899c50024af66b03ec/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh2%252F56eeed8b3b9d4a6a8f5c37bca9b77f37%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh2/56eeed8b3b9d4a6a8f5c37bca9b77f37/images/large/9.jpg not downloaded yet
2026-03-25 16:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh2%252F56eeed8b3b9d4a6a8f5c37bca9b77f37%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh2/56eeed8b3b9d4a6a8f5c37bca9b77f37/images/large/10.jpg not downloaded yet
2026-03-25 16:34:21 [ayvens.it] INFO: Found listing with ID: 1983670
2026-03-25 16:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983670%27 HTTP/1.1" 200 None
2026-03-25 16:34:21 [ayvens.it] INFO: Scrape type for 1983670: 1
2026-03-25 16:34:21 [ayvens.it] INFO: Extracting data for car ID: 1983670
2026-03-25 16:34:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6a3cf1e0-c603-5088-a070-cc10ecd542d6 with identifier: 1983670
2026-03-25 16:34:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6a3cf1e0-c603-5088-a070-cc10ecd542d6 with scrape type 1
2026-03-25 16:34:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6a3cf1e0-c603-5088-a070-cc10ecd542d6
2026-03-25 16:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr3%252Fd72558ea9df14d929ad8c8f59a924428%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr3/d72558ea9df14d929ad8c8f59a924428/images/large/1.jpg not downloaded yet
2026-03-25 16:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr3%252Fd72558ea9df14d929ad8c8f59a924428%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr3/d72558ea9df14d929ad8c8f59a924428/images/large/2.jpg not downloaded yet
2026-03-25 16:34:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc5ce450>
2026-03-25 16:34:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31fda52f-41b5-528c-adac-ee5ddf246cc3/31fda52f-41b5-528c-adac-ee5ddf246cc3_image_4.jpg HTTP/1.1" 201 0
2026-03-25 16:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg2%252Fda7950026aec40899c50024af66b03ec%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg2/da7950026aec40899c50024af66b03ec/images/large/5.jpg saved to cache
2026-03-25 16:34:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 31fda52f-41b5-528c-adac-ee5ddf246cc3
2026-03-25 16:34:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc9b9b50>
2026-03-25 16:34:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8e8e5ae-58c5-56ed-b243-0b0849880e37/b8e8e5ae-58c5-56ed-b243-0b0849880e37_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg3%252F17d374c5b78f4ca59db1e2322ca2970c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg3/17d374c5b78f4ca59db1e2322ca2970c/images/large/1.jpg saved to cache
2026-03-25 16:34:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b8e8e5ae-58c5-56ed-b243-0b0849880e37
2026-03-25 16:34:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34d7d7ecd0>
2026-03-25 16:34:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8e8e5ae-58c5-56ed-b243-0b0849880e37/b8e8e5ae-58c5-56ed-b243-0b0849880e37_image_1.jpg HTTP/1.1" 201 0
2026-03-25 16:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg3%252F17d374c5b78f4ca59db1e2322ca2970c%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg3/17d374c5b78f4ca59db1e2322ca2970c/images/large/2.jpg saved to cache
2026-03-25 16:34:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b8e8e5ae-58c5-56ed-b243-0b0849880e37
2026-03-25 16:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr3%252Fd72558ea9df14d929ad8c8f59a924428%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr3/d72558ea9df14d929ad8c8f59a924428/images/large/3.jpg not downloaded yet
2026-03-25 16:34:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc82e690>
2026-03-25 16:34:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31fda52f-41b5-528c-adac-ee5ddf246cc3/31fda52f-41b5-528c-adac-ee5ddf246cc3_image_2.jpg HTTP/1.1" 201 0
2026-03-25 16:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg2%252Fda7950026aec40899c50024af66b03ec%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg2/da7950026aec40899c50024af66b03ec/images/large/3.jpg saved to cache
2026-03-25 16:34:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 31fda52f-41b5-528c-adac-ee5ddf246cc3
2026-03-25 16:34:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc91e510>
2026-03-25 16:34:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31fda52f-41b5-528c-adac-ee5ddf246cc3/31fda52f-41b5-528c-adac-ee5ddf246cc3_image_5.jpg HTTP/1.1" 201 0
2026-03-25 16:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg2%252Fda7950026aec40899c50024af66b03ec%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg2/da7950026aec40899c50024af66b03ec/images/large/6.jpg saved to cache
2026-03-25 16:34:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 31fda52f-41b5-528c-adac-ee5ddf246cc3
2026-03-25 16:34:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc5be7d0>
2026-03-25 16:34:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98901852-a29a-5770-89b6-98d8bebfa2d9/98901852-a29a-5770-89b6-98d8bebfa2d9_image_8.jpg HTTP/1.1" 201 0
2026-03-25 16:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs0%252Fcb1c7ac744f546198ae6809fd01b55c6%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs0/cb1c7ac744f546198ae6809fd01b55c6/images/large/9.jpg saved to cache
2026-03-25 16:34:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 98901852-a29a-5770-89b6-98d8bebfa2d9
2026-03-25 16:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr3%252Fd72558ea9df14d929ad8c8f59a924428%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr3/d72558ea9df14d929ad8c8f59a924428/images/large/4.jpg not downloaded yet
2026-03-25 16:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr3%252Fd72558ea9df14d929ad8c8f59a924428%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr3/d72558ea9df14d929ad8c8f59a924428/images/large/5.jpg not downloaded yet
2026-03-25 16:34:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc56f390>
2026-03-25 16:34:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31fda52f-41b5-528c-adac-ee5ddf246cc3/31fda52f-41b5-528c-adac-ee5ddf246cc3_image_1.jpg HTTP/1.1" 201 0
2026-03-25 16:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg2%252Fda7950026aec40899c50024af66b03ec%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg2/da7950026aec40899c50024af66b03ec/images/large/2.jpg saved to cache
2026-03-25 16:34:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 31fda52f-41b5-528c-adac-ee5ddf246cc3
2026-03-25 16:34:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcf2e110>
2026-03-25 16:34:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31fda52f-41b5-528c-adac-ee5ddf246cc3/31fda52f-41b5-528c-adac-ee5ddf246cc3_image_3.jpg HTTP/1.1" 201 0
2026-03-25 16:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg2%252Fda7950026aec40899c50024af66b03ec%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg2/da7950026aec40899c50024af66b03ec/images/large/4.jpg saved to cache
2026-03-25 16:34:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 31fda52f-41b5-528c-adac-ee5ddf246cc3
2026-03-25 16:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr3%252Fd72558ea9df14d929ad8c8f59a924428%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr3/d72558ea9df14d929ad8c8f59a924428/images/large/6.jpg not downloaded yet
2026-03-25 16:34:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg2/da7950026aec40899c50024af66b03ec/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg3/17d374c5b78f4ca59db1e2322ca2970c/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg3/17d374c5b78f4ca59db1e2322ca2970c/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr3%252Fd72558ea9df14d929ad8c8f59a924428%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr3/d72558ea9df14d929ad8c8f59a924428/images/large/7.jpg not downloaded yet
2026-03-25 16:34:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg3/17d374c5b78f4ca59db1e2322ca2970c/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg3/17d374c5b78f4ca59db1e2322ca2970c/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr3%252Fd72558ea9df14d929ad8c8f59a924428%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr3/d72558ea9df14d929ad8c8f59a924428/images/large/8.jpg not downloaded yet
2026-03-25 16:34:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg2/da7950026aec40899c50024af66b03ec/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr3%252Fd72558ea9df14d929ad8c8f59a924428%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr3/d72558ea9df14d929ad8c8f59a924428/images/large/9.jpg not downloaded yet
2026-03-25 16:34:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh2/56eeed8b3b9d4a6a8f5c37bca9b77f37/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh2/56eeed8b3b9d4a6a8f5c37bca9b77f37/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr3%252Fd72558ea9df14d929ad8c8f59a924428%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr3/d72558ea9df14d929ad8c8f59a924428/images/large/10.jpg not downloaded yet
2026-03-25 16:34:22 [ayvens.it] INFO: Found listing with ID: 1983671
2026-03-25 16:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983671%27 HTTP/1.1" 200 None
2026-03-25 16:34:22 [ayvens.it] INFO: Scrape type for 1983671: 1
2026-03-25 16:34:22 [ayvens.it] INFO: Extracting data for car ID: 1983671
2026-03-25 16:34:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 97867369-8ed5-5f05-809b-2623e9afae80 with identifier: 1983671
2026-03-25 16:34:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 97867369-8ed5-5f05-809b-2623e9afae80 with scrape type 1
2026-03-25 16:34:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 97867369-8ed5-5f05-809b-2623e9afae80
2026-03-25 16:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv9%252Face7ad8431f64ee494b8e435d3cf2e60%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv9/ace7ad8431f64ee494b8e435d3cf2e60/images/large/1.jpg not downloaded yet
2026-03-25 16:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv9%252Face7ad8431f64ee494b8e435d3cf2e60%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv9/ace7ad8431f64ee494b8e435d3cf2e60/images/large/2.jpg not downloaded yet
2026-03-25 16:34:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34ebe46450>
2026-03-25 16:34:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31fda52f-41b5-528c-adac-ee5ddf246cc3/31fda52f-41b5-528c-adac-ee5ddf246cc3_image_9.jpg HTTP/1.1" 201 0
2026-03-25 16:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg2%252Fda7950026aec40899c50024af66b03ec%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg2/da7950026aec40899c50024af66b03ec/images/large/10.jpg saved to cache
2026-03-25 16:34:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 31fda52f-41b5-528c-adac-ee5ddf246cc3
2026-03-25 16:34:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc8e1350>
2026-03-25 16:34:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8e8e5ae-58c5-56ed-b243-0b0849880e37/b8e8e5ae-58c5-56ed-b243-0b0849880e37_image_5.jpg HTTP/1.1" 201 0
2026-03-25 16:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg3%252F17d374c5b78f4ca59db1e2322ca2970c%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg3/17d374c5b78f4ca59db1e2322ca2970c/images/large/6.jpg saved to cache
2026-03-25 16:34:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b8e8e5ae-58c5-56ed-b243-0b0849880e37
2026-03-25 16:34:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcc4e510>
2026-03-25 16:34:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8e8e5ae-58c5-56ed-b243-0b0849880e37/b8e8e5ae-58c5-56ed-b243-0b0849880e37_image_4.jpg HTTP/1.1" 201 0
2026-03-25 16:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg3%252F17d374c5b78f4ca59db1e2322ca2970c%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg3/17d374c5b78f4ca59db1e2322ca2970c/images/large/5.jpg saved to cache
2026-03-25 16:34:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b8e8e5ae-58c5-56ed-b243-0b0849880e37
2026-03-25 16:34:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc2fd9d0>
2026-03-25 16:34:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8e8e5ae-58c5-56ed-b243-0b0849880e37/b8e8e5ae-58c5-56ed-b243-0b0849880e37_image_2.jpg HTTP/1.1" 201 0
2026-03-25 16:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg3%252F17d374c5b78f4ca59db1e2322ca2970c%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg3/17d374c5b78f4ca59db1e2322ca2970c/images/large/3.jpg saved to cache
2026-03-25 16:34:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b8e8e5ae-58c5-56ed-b243-0b0849880e37
2026-03-25 16:34:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcc4e690>
2026-03-25 16:34:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8e8e5ae-58c5-56ed-b243-0b0849880e37/b8e8e5ae-58c5-56ed-b243-0b0849880e37_image_3.jpg HTTP/1.1" 201 0
2026-03-25 16:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg3%252F17d374c5b78f4ca59db1e2322ca2970c%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg3/17d374c5b78f4ca59db1e2322ca2970c/images/large/4.jpg saved to cache
2026-03-25 16:34:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b8e8e5ae-58c5-56ed-b243-0b0849880e37
2026-03-25 16:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv9%252Face7ad8431f64ee494b8e435d3cf2e60%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv9/ace7ad8431f64ee494b8e435d3cf2e60/images/large/3.jpg not downloaded yet
2026-03-25 16:34:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc89d3d0>
2026-03-25 16:34:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31fda52f-41b5-528c-adac-ee5ddf246cc3/31fda52f-41b5-528c-adac-ee5ddf246cc3_image_8.jpg HTTP/1.1" 201 0
2026-03-25 16:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg2%252Fda7950026aec40899c50024af66b03ec%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg2/da7950026aec40899c50024af66b03ec/images/large/9.jpg saved to cache
2026-03-25 16:34:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 31fda52f-41b5-528c-adac-ee5ddf246cc3
2026-03-25 16:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv9%252Face7ad8431f64ee494b8e435d3cf2e60%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv9/ace7ad8431f64ee494b8e435d3cf2e60/images/large/4.jpg not downloaded yet
2026-03-25 16:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv9%252Face7ad8431f64ee494b8e435d3cf2e60%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv9/ace7ad8431f64ee494b8e435d3cf2e60/images/large/5.jpg not downloaded yet
2026-03-25 16:34:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc89d410>
2026-03-25 16:34:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b1df8d54-cdbd-5f69-a039-031b5f633052/b1df8d54-cdbd-5f69-a039-031b5f633052_image_1.jpg HTTP/1.1" 201 0
2026-03-25 16:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh2%252F56eeed8b3b9d4a6a8f5c37bca9b77f37%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh2/56eeed8b3b9d4a6a8f5c37bca9b77f37/images/large/2.jpg saved to cache
2026-03-25 16:34:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b1df8d54-cdbd-5f69-a039-031b5f633052
2026-03-25 16:34:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc9a7c50>
2026-03-25 16:34:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b1df8d54-cdbd-5f69-a039-031b5f633052/b1df8d54-cdbd-5f69-a039-031b5f633052_image_2.jpg HTTP/1.1" 201 0
2026-03-25 16:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh2%252F56eeed8b3b9d4a6a8f5c37bca9b77f37%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh2/56eeed8b3b9d4a6a8f5c37bca9b77f37/images/large/3.jpg saved to cache
2026-03-25 16:34:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b1df8d54-cdbd-5f69-a039-031b5f633052
2026-03-25 16:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv9%252Face7ad8431f64ee494b8e435d3cf2e60%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv9/ace7ad8431f64ee494b8e435d3cf2e60/images/large/6.jpg not downloaded yet
2026-03-25 16:34:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg3/17d374c5b78f4ca59db1e2322ca2970c/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv9%252Face7ad8431f64ee494b8e435d3cf2e60%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv9/ace7ad8431f64ee494b8e435d3cf2e60/images/large/7.jpg not downloaded yet
2026-03-25 16:34:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh2/56eeed8b3b9d4a6a8f5c37bca9b77f37/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv9%252Face7ad8431f64ee494b8e435d3cf2e60%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv9/ace7ad8431f64ee494b8e435d3cf2e60/images/large/8.jpg not downloaded yet
2026-03-25 16:34:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fr3/d72558ea9df14d929ad8c8f59a924428/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fr3/d72558ea9df14d929ad8c8f59a924428/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fr3/d72558ea9df14d929ad8c8f59a924428/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh2/56eeed8b3b9d4a6a8f5c37bca9b77f37/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh2/56eeed8b3b9d4a6a8f5c37bca9b77f37/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv9%252Face7ad8431f64ee494b8e435d3cf2e60%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv9/ace7ad8431f64ee494b8e435d3cf2e60/images/large/9.jpg not downloaded yet
2026-03-25 16:34:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh2/56eeed8b3b9d4a6a8f5c37bca9b77f37/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv9%252Face7ad8431f64ee494b8e435d3cf2e60%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv9/ace7ad8431f64ee494b8e435d3cf2e60/images/large/10.jpg not downloaded yet
2026-03-25 16:34:23 [ayvens.it] INFO: Found listing with ID: 1983672
2026-03-25 16:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983672%27 HTTP/1.1" 200 None
2026-03-25 16:34:23 [ayvens.it] INFO: Scrape type for 1983672: 1
2026-03-25 16:34:23 [ayvens.it] INFO: Extracting data for car ID: 1983672
2026-03-25 16:34:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d26f9d5a-75eb-57f8-b2eb-bfff14ac360b with identifier: 1983672
2026-03-25 16:34:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d26f9d5a-75eb-57f8-b2eb-bfff14ac360b with scrape type 1
2026-03-25 16:34:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d26f9d5a-75eb-57f8-b2eb-bfff14ac360b
2026-03-25 16:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx7%252Fb0aace74627247a9b5cec65f127241aa%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx7/b0aace74627247a9b5cec65f127241aa/images/large/1.jpg not downloaded yet
2026-03-25 16:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx7%252Fb0aace74627247a9b5cec65f127241aa%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx7/b0aace74627247a9b5cec65f127241aa/images/large/2.jpg not downloaded yet
2026-03-25 16:34:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc89fc90>
2026-03-25 16:34:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8e8e5ae-58c5-56ed-b243-0b0849880e37/b8e8e5ae-58c5-56ed-b243-0b0849880e37_image_9.jpg HTTP/1.1" 201 0
2026-03-25 16:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg3%252F17d374c5b78f4ca59db1e2322ca2970c%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg3/17d374c5b78f4ca59db1e2322ca2970c/images/large/10.jpg saved to cache
2026-03-25 16:34:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b8e8e5ae-58c5-56ed-b243-0b0849880e37
2026-03-25 16:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx7%252Fb0aace74627247a9b5cec65f127241aa%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx7/b0aace74627247a9b5cec65f127241aa/images/large/3.jpg not downloaded yet
2026-03-25 16:34:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcbb73d0>
2026-03-25 16:34:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b1df8d54-cdbd-5f69-a039-031b5f633052/b1df8d54-cdbd-5f69-a039-031b5f633052_image_5.jpg HTTP/1.1" 201 0
2026-03-25 16:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh2%252F56eeed8b3b9d4a6a8f5c37bca9b77f37%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh2/56eeed8b3b9d4a6a8f5c37bca9b77f37/images/large/6.jpg saved to cache
2026-03-25 16:34:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b1df8d54-cdbd-5f69-a039-031b5f633052
2026-03-25 16:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx7%252Fb0aace74627247a9b5cec65f127241aa%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx7/b0aace74627247a9b5cec65f127241aa/images/large/4.jpg not downloaded yet
2026-03-25 16:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx7%252Fb0aace74627247a9b5cec65f127241aa%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx7/b0aace74627247a9b5cec65f127241aa/images/large/5.jpg not downloaded yet
2026-03-25 16:34:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dca9dd10>
2026-03-25 16:34:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a3cf1e0-c603-5088-a070-cc10ecd542d6/6a3cf1e0-c603-5088-a070-cc10ecd542d6_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr3%252Fd72558ea9df14d929ad8c8f59a924428%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr3/d72558ea9df14d929ad8c8f59a924428/images/large/1.jpg saved to cache
2026-03-25 16:34:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6a3cf1e0-c603-5088-a070-cc10ecd542d6
2026-03-25 16:34:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc5d6950>
2026-03-25 16:34:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a3cf1e0-c603-5088-a070-cc10ecd542d6/6a3cf1e0-c603-5088-a070-cc10ecd542d6_image_1.jpg HTTP/1.1" 201 0
2026-03-25 16:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr3%252Fd72558ea9df14d929ad8c8f59a924428%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr3/d72558ea9df14d929ad8c8f59a924428/images/large/2.jpg saved to cache
2026-03-25 16:34:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6a3cf1e0-c603-5088-a070-cc10ecd542d6
2026-03-25 16:34:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcab2150>
2026-03-25 16:34:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a3cf1e0-c603-5088-a070-cc10ecd542d6/6a3cf1e0-c603-5088-a070-cc10ecd542d6_image_2.jpg HTTP/1.1" 201 0
2026-03-25 16:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr3%252Fd72558ea9df14d929ad8c8f59a924428%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr3/d72558ea9df14d929ad8c8f59a924428/images/large/3.jpg saved to cache
2026-03-25 16:34:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6a3cf1e0-c603-5088-a070-cc10ecd542d6
2026-03-25 16:34:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34de990d50>
2026-03-25 16:34:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b1df8d54-cdbd-5f69-a039-031b5f633052/b1df8d54-cdbd-5f69-a039-031b5f633052_image_3.jpg HTTP/1.1" 201 0
2026-03-25 16:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh2%252F56eeed8b3b9d4a6a8f5c37bca9b77f37%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh2/56eeed8b3b9d4a6a8f5c37bca9b77f37/images/large/4.jpg saved to cache
2026-03-25 16:34:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b1df8d54-cdbd-5f69-a039-031b5f633052
2026-03-25 16:34:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34d7d624d0>
2026-03-25 16:34:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b1df8d54-cdbd-5f69-a039-031b5f633052/b1df8d54-cdbd-5f69-a039-031b5f633052_image_4.jpg HTTP/1.1" 201 0
2026-03-25 16:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh2%252F56eeed8b3b9d4a6a8f5c37bca9b77f37%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh2/56eeed8b3b9d4a6a8f5c37bca9b77f37/images/large/5.jpg saved to cache
2026-03-25 16:34:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b1df8d54-cdbd-5f69-a039-031b5f633052
2026-03-25 16:34:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34d6b489d0>
2026-03-25 16:34:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b1df8d54-cdbd-5f69-a039-031b5f633052/b1df8d54-cdbd-5f69-a039-031b5f633052_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh2%252F56eeed8b3b9d4a6a8f5c37bca9b77f37%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh2/56eeed8b3b9d4a6a8f5c37bca9b77f37/images/large/1.jpg saved to cache
2026-03-25 16:34:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b1df8d54-cdbd-5f69-a039-031b5f633052
2026-03-25 16:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx7%252Fb0aace74627247a9b5cec65f127241aa%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx7/b0aace74627247a9b5cec65f127241aa/images/large/6.jpg not downloaded yet
2026-03-25 16:34:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fr3/d72558ea9df14d929ad8c8f59a924428/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fr3/d72558ea9df14d929ad8c8f59a924428/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx7%252Fb0aace74627247a9b5cec65f127241aa%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx7/b0aace74627247a9b5cec65f127241aa/images/large/7.jpg not downloaded yet
2026-03-25 16:34:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fr3/d72558ea9df14d929ad8c8f59a924428/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx7%252Fb0aace74627247a9b5cec65f127241aa%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx7/b0aace74627247a9b5cec65f127241aa/images/large/8.jpg not downloaded yet
2026-03-25 16:34:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fr3/d72558ea9df14d929ad8c8f59a924428/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv9/ace7ad8431f64ee494b8e435d3cf2e60/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv9/ace7ad8431f64ee494b8e435d3cf2e60/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh2/56eeed8b3b9d4a6a8f5c37bca9b77f37/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx7%252Fb0aace74627247a9b5cec65f127241aa%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx7/b0aace74627247a9b5cec65f127241aa/images/large/9.jpg not downloaded yet
2026-03-25 16:34:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fr3/d72558ea9df14d929ad8c8f59a924428/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx7%252Fb0aace74627247a9b5cec65f127241aa%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx7/b0aace74627247a9b5cec65f127241aa/images/large/10.jpg not downloaded yet
2026-03-25 16:34:24 [ayvens.it] INFO: Found listing with ID: 1983673
2026-03-25 16:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983673%27 HTTP/1.1" 200 None
2026-03-25 16:34:24 [ayvens.it] INFO: Scrape type for 1983673: 1
2026-03-25 16:34:24 [ayvens.it] INFO: Extracting data for car ID: 1983673
2026-03-25 16:34:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cec01d4b-149b-5b48-9324-ecc808c1bede with identifier: 1983673
2026-03-25 16:34:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cec01d4b-149b-5b48-9324-ecc808c1bede with scrape type 1
2026-03-25 16:34:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item cec01d4b-149b-5b48-9324-ecc808c1bede
2026-03-25 16:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn6%252F31db21d2003d49349b4d53cfdea0cbfc%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn6/31db21d2003d49349b4d53cfdea0cbfc/images/large/1.jpg not downloaded yet
2026-03-25 16:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn6%252F31db21d2003d49349b4d53cfdea0cbfc%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn6/31db21d2003d49349b4d53cfdea0cbfc/images/large/2.jpg not downloaded yet
2026-03-25 16:34:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc87ad10>
2026-03-25 16:34:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a3cf1e0-c603-5088-a070-cc10ecd542d6/6a3cf1e0-c603-5088-a070-cc10ecd542d6_image_5.jpg HTTP/1.1" 201 0
2026-03-25 16:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr3%252Fd72558ea9df14d929ad8c8f59a924428%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr3/d72558ea9df14d929ad8c8f59a924428/images/large/6.jpg saved to cache
2026-03-25 16:34:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6a3cf1e0-c603-5088-a070-cc10ecd542d6
2026-03-25 16:34:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc556f10>
2026-03-25 16:34:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a3cf1e0-c603-5088-a070-cc10ecd542d6/6a3cf1e0-c603-5088-a070-cc10ecd542d6_image_7.jpg HTTP/1.1" 201 0
2026-03-25 16:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr3%252Fd72558ea9df14d929ad8c8f59a924428%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr3/d72558ea9df14d929ad8c8f59a924428/images/large/8.jpg saved to cache
2026-03-25 16:34:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6a3cf1e0-c603-5088-a070-cc10ecd542d6
2026-03-25 16:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn6%252F31db21d2003d49349b4d53cfdea0cbfc%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn6/31db21d2003d49349b4d53cfdea0cbfc/images/large/3.jpg not downloaded yet
2026-03-25 16:34:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc969f90>
2026-03-25 16:34:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a3cf1e0-c603-5088-a070-cc10ecd542d6/6a3cf1e0-c603-5088-a070-cc10ecd542d6_image_3.jpg HTTP/1.1" 201 0
2026-03-25 16:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr3%252Fd72558ea9df14d929ad8c8f59a924428%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr3/d72558ea9df14d929ad8c8f59a924428/images/large/4.jpg saved to cache
2026-03-25 16:34:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6a3cf1e0-c603-5088-a070-cc10ecd542d6
2026-03-25 16:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn6%252F31db21d2003d49349b4d53cfdea0cbfc%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn6/31db21d2003d49349b4d53cfdea0cbfc/images/large/4.jpg not downloaded yet
2026-03-25 16:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn6%252F31db21d2003d49349b4d53cfdea0cbfc%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn6/31db21d2003d49349b4d53cfdea0cbfc/images/large/5.jpg not downloaded yet
2026-03-25 16:34:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc5926d0>
2026-03-25 16:34:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a3cf1e0-c603-5088-a070-cc10ecd542d6/6a3cf1e0-c603-5088-a070-cc10ecd542d6_image_4.jpg HTTP/1.1" 201 0
2026-03-25 16:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr3%252Fd72558ea9df14d929ad8c8f59a924428%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr3/d72558ea9df14d929ad8c8f59a924428/images/large/5.jpg saved to cache
2026-03-25 16:34:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6a3cf1e0-c603-5088-a070-cc10ecd542d6
2026-03-25 16:34:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc590150>
2026-03-25 16:34:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97867369-8ed5-5f05-809b-2623e9afae80/97867369-8ed5-5f05-809b-2623e9afae80_image_2.jpg HTTP/1.1" 201 0
2026-03-25 16:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv9%252Face7ad8431f64ee494b8e435d3cf2e60%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv9/ace7ad8431f64ee494b8e435d3cf2e60/images/large/3.jpg saved to cache
2026-03-25 16:34:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 97867369-8ed5-5f05-809b-2623e9afae80
2026-03-25 16:34:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dca61250>
2026-03-25 16:34:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97867369-8ed5-5f05-809b-2623e9afae80/97867369-8ed5-5f05-809b-2623e9afae80_image_1.jpg HTTP/1.1" 201 0
2026-03-25 16:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv9%252Face7ad8431f64ee494b8e435d3cf2e60%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv9/ace7ad8431f64ee494b8e435d3cf2e60/images/large/2.jpg saved to cache
2026-03-25 16:34:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 97867369-8ed5-5f05-809b-2623e9afae80
2026-03-25 16:34:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcdd1250>
2026-03-25 16:34:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b1df8d54-cdbd-5f69-a039-031b5f633052/b1df8d54-cdbd-5f69-a039-031b5f633052_image_9.jpg HTTP/1.1" 201 0
2026-03-25 16:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh2%252F56eeed8b3b9d4a6a8f5c37bca9b77f37%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh2/56eeed8b3b9d4a6a8f5c37bca9b77f37/images/large/10.jpg saved to cache
2026-03-25 16:34:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b1df8d54-cdbd-5f69-a039-031b5f633052
2026-03-25 16:34:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc5551d0>
2026-03-25 16:34:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a3cf1e0-c603-5088-a070-cc10ecd542d6/6a3cf1e0-c603-5088-a070-cc10ecd542d6_image_6.jpg HTTP/1.1" 201 0
2026-03-25 16:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr3%252Fd72558ea9df14d929ad8c8f59a924428%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr3/d72558ea9df14d929ad8c8f59a924428/images/large/7.jpg saved to cache
2026-03-25 16:34:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6a3cf1e0-c603-5088-a070-cc10ecd542d6
2026-03-25 16:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn6%252F31db21d2003d49349b4d53cfdea0cbfc%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn6/31db21d2003d49349b4d53cfdea0cbfc/images/large/6.jpg not downloaded yet
2026-03-25 16:34:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv9/ace7ad8431f64ee494b8e435d3cf2e60/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx7/b0aace74627247a9b5cec65f127241aa/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn6%252F31db21d2003d49349b4d53cfdea0cbfc%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn6/31db21d2003d49349b4d53cfdea0cbfc/images/large/7.jpg not downloaded yet
2026-03-25 16:34:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx7/b0aace74627247a9b5cec65f127241aa/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx7/b0aace74627247a9b5cec65f127241aa/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx7/b0aace74627247a9b5cec65f127241aa/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv9/ace7ad8431f64ee494b8e435d3cf2e60/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn6%252F31db21d2003d49349b4d53cfdea0cbfc%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn6/31db21d2003d49349b4d53cfdea0cbfc/images/large/8.jpg not downloaded yet
2026-03-25 16:34:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv9/ace7ad8431f64ee494b8e435d3cf2e60/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv9/ace7ad8431f64ee494b8e435d3cf2e60/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn6%252F31db21d2003d49349b4d53cfdea0cbfc%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn6/31db21d2003d49349b4d53cfdea0cbfc/images/large/9.jpg not downloaded yet
2026-03-25 16:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn6%252F31db21d2003d49349b4d53cfdea0cbfc%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn6/31db21d2003d49349b4d53cfdea0cbfc/images/large/10.jpg not downloaded yet
2026-03-25 16:34:25 [ayvens.it] INFO: Found listing with ID: 1983674
2026-03-25 16:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983674%27 HTTP/1.1" 200 None
2026-03-25 16:34:25 [ayvens.it] INFO: Scrape type for 1983674: 1
2026-03-25 16:34:25 [ayvens.it] INFO: Extracting data for car ID: 1983674
2026-03-25 16:34:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 70d28a39-7d55-5056-a7c7-6b8c7e7f38d2 with identifier: 1983674
2026-03-25 16:34:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 70d28a39-7d55-5056-a7c7-6b8c7e7f38d2 with scrape type 1
2026-03-25 16:34:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 70d28a39-7d55-5056-a7c7-6b8c7e7f38d2
2026-03-25 16:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn7%252F5646918b00554a96af40b450ab9beb84%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn7/5646918b00554a96af40b450ab9beb84/images/large/1.jpg not downloaded yet
2026-03-25 16:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn7%252F5646918b00554a96af40b450ab9beb84%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn7/5646918b00554a96af40b450ab9beb84/images/large/2.jpg not downloaded yet
2026-03-25 16:34:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc60d150>
2026-03-25 16:34:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97867369-8ed5-5f05-809b-2623e9afae80/97867369-8ed5-5f05-809b-2623e9afae80_image_6.jpg HTTP/1.1" 201 0
2026-03-25 16:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv9%252Face7ad8431f64ee494b8e435d3cf2e60%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv9/ace7ad8431f64ee494b8e435d3cf2e60/images/large/7.jpg saved to cache
2026-03-25 16:34:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 97867369-8ed5-5f05-809b-2623e9afae80
2026-03-25 16:34:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc9771d0>
2026-03-25 16:34:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d26f9d5a-75eb-57f8-b2eb-bfff14ac360b/d26f9d5a-75eb-57f8-b2eb-bfff14ac360b_image_3.jpg HTTP/1.1" 201 0
2026-03-25 16:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx7%252Fb0aace74627247a9b5cec65f127241aa%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx7/b0aace74627247a9b5cec65f127241aa/images/large/4.jpg saved to cache
2026-03-25 16:34:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d26f9d5a-75eb-57f8-b2eb-bfff14ac360b
2026-03-25 16:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn7%252F5646918b00554a96af40b450ab9beb84%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn7/5646918b00554a96af40b450ab9beb84/images/large/3.jpg not downloaded yet
2026-03-25 16:34:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc5cd090>
2026-03-25 16:34:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d26f9d5a-75eb-57f8-b2eb-bfff14ac360b/d26f9d5a-75eb-57f8-b2eb-bfff14ac360b_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx7%252Fb0aace74627247a9b5cec65f127241aa%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx7/b0aace74627247a9b5cec65f127241aa/images/large/1.jpg saved to cache
2026-03-25 16:34:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d26f9d5a-75eb-57f8-b2eb-bfff14ac360b
2026-03-25 16:34:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcada990>
2026-03-25 16:34:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d26f9d5a-75eb-57f8-b2eb-bfff14ac360b/d26f9d5a-75eb-57f8-b2eb-bfff14ac360b_image_1.jpg HTTP/1.1" 201 0
2026-03-25 16:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx7%252Fb0aace74627247a9b5cec65f127241aa%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx7/b0aace74627247a9b5cec65f127241aa/images/large/2.jpg saved to cache
2026-03-25 16:34:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d26f9d5a-75eb-57f8-b2eb-bfff14ac360b
2026-03-25 16:34:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc3540d0>
2026-03-25 16:34:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d26f9d5a-75eb-57f8-b2eb-bfff14ac360b/d26f9d5a-75eb-57f8-b2eb-bfff14ac360b_image_2.jpg HTTP/1.1" 201 0
2026-03-25 16:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx7%252Fb0aace74627247a9b5cec65f127241aa%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx7/b0aace74627247a9b5cec65f127241aa/images/large/3.jpg saved to cache
2026-03-25 16:34:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d26f9d5a-75eb-57f8-b2eb-bfff14ac360b
2026-03-25 16:34:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc5befd0>
2026-03-25 16:34:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97867369-8ed5-5f05-809b-2623e9afae80/97867369-8ed5-5f05-809b-2623e9afae80_image_9.jpg HTTP/1.1" 201 0
2026-03-25 16:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv9%252Face7ad8431f64ee494b8e435d3cf2e60%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv9/ace7ad8431f64ee494b8e435d3cf2e60/images/large/10.jpg saved to cache
2026-03-25 16:34:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 97867369-8ed5-5f05-809b-2623e9afae80
2026-03-25 16:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn7%252F5646918b00554a96af40b450ab9beb84%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn7/5646918b00554a96af40b450ab9beb84/images/large/4.jpg not downloaded yet
2026-03-25 16:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn7%252F5646918b00554a96af40b450ab9beb84%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn7/5646918b00554a96af40b450ab9beb84/images/large/5.jpg not downloaded yet
2026-03-25 16:34:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dca221d0>
2026-03-25 16:34:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97867369-8ed5-5f05-809b-2623e9afae80/97867369-8ed5-5f05-809b-2623e9afae80_image_8.jpg HTTP/1.1" 201 0
2026-03-25 16:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv9%252Face7ad8431f64ee494b8e435d3cf2e60%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv9/ace7ad8431f64ee494b8e435d3cf2e60/images/large/9.jpg saved to cache
2026-03-25 16:34:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 97867369-8ed5-5f05-809b-2623e9afae80
2026-03-25 16:34:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcb84ed0>
2026-03-25 16:34:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97867369-8ed5-5f05-809b-2623e9afae80/97867369-8ed5-5f05-809b-2623e9afae80_image_4.jpg HTTP/1.1" 201 0
2026-03-25 16:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv9%252Face7ad8431f64ee494b8e435d3cf2e60%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv9/ace7ad8431f64ee494b8e435d3cf2e60/images/large/5.jpg saved to cache
2026-03-25 16:34:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 97867369-8ed5-5f05-809b-2623e9afae80
2026-03-25 16:34:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx7/b0aace74627247a9b5cec65f127241aa/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx7/b0aace74627247a9b5cec65f127241aa/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn7%252F5646918b00554a96af40b450ab9beb84%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn7/5646918b00554a96af40b450ab9beb84/images/large/6.jpg not downloaded yet
2026-03-25 16:34:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx7/b0aace74627247a9b5cec65f127241aa/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx7/b0aace74627247a9b5cec65f127241aa/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv9/ace7ad8431f64ee494b8e435d3cf2e60/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn7%252F5646918b00554a96af40b450ab9beb84%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn7/5646918b00554a96af40b450ab9beb84/images/large/7.jpg not downloaded yet
2026-03-25 16:34:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn6/31db21d2003d49349b4d53cfdea0cbfc/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn7%252F5646918b00554a96af40b450ab9beb84%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn7/5646918b00554a96af40b450ab9beb84/images/large/8.jpg not downloaded yet
2026-03-25 16:34:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn6/31db21d2003d49349b4d53cfdea0cbfc/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn6/31db21d2003d49349b4d53cfdea0cbfc/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn7%252F5646918b00554a96af40b450ab9beb84%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn7/5646918b00554a96af40b450ab9beb84/images/large/9.jpg not downloaded yet
2026-03-25 16:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn7%252F5646918b00554a96af40b450ab9beb84%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn7/5646918b00554a96af40b450ab9beb84/images/large/10.jpg not downloaded yet
2026-03-25 16:34:26 [ayvens.it] INFO: Found listing with ID: 1983675
2026-03-25 16:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983675%27 HTTP/1.1" 200 None
2026-03-25 16:34:26 [ayvens.it] INFO: Scrape type for 1983675: 1
2026-03-25 16:34:26 [ayvens.it] INFO: Extracting data for car ID: 1983675
2026-03-25 16:34:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e971de7b-28e5-5f28-8084-c0a8925b244d with identifier: 1983675
2026-03-25 16:34:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e971de7b-28e5-5f28-8084-c0a8925b244d with scrape type 1
2026-03-25 16:34:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e971de7b-28e5-5f28-8084-c0a8925b244d
2026-03-25 16:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgv6%252Fe003c200872f41c4b5d813f0e88e3f5f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gv6/e003c200872f41c4b5d813f0e88e3f5f/images/large/1.jpg not downloaded yet
2026-03-25 16:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgv6%252Fe003c200872f41c4b5d813f0e88e3f5f%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gv6/e003c200872f41c4b5d813f0e88e3f5f/images/large/2.jpg not downloaded yet
2026-03-25 16:34:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcc1b890>
2026-03-25 16:34:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d26f9d5a-75eb-57f8-b2eb-bfff14ac360b/d26f9d5a-75eb-57f8-b2eb-bfff14ac360b_image_6.jpg HTTP/1.1" 201 0
2026-03-25 16:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx7%252Fb0aace74627247a9b5cec65f127241aa%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx7/b0aace74627247a9b5cec65f127241aa/images/large/7.jpg saved to cache
2026-03-25 16:34:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d26f9d5a-75eb-57f8-b2eb-bfff14ac360b
2026-03-25 16:34:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcb87310>
2026-03-25 16:34:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d26f9d5a-75eb-57f8-b2eb-bfff14ac360b/d26f9d5a-75eb-57f8-b2eb-bfff14ac360b_image_5.jpg HTTP/1.1" 201 0
2026-03-25 16:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx7%252Fb0aace74627247a9b5cec65f127241aa%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx7/b0aace74627247a9b5cec65f127241aa/images/large/6.jpg saved to cache
2026-03-25 16:34:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d26f9d5a-75eb-57f8-b2eb-bfff14ac360b
2026-03-25 16:34:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34d7dae810>
2026-03-25 16:34:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d26f9d5a-75eb-57f8-b2eb-bfff14ac360b/d26f9d5a-75eb-57f8-b2eb-bfff14ac360b_image_4.jpg HTTP/1.1" 201 0
2026-03-25 16:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx7%252Fb0aace74627247a9b5cec65f127241aa%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx7/b0aace74627247a9b5cec65f127241aa/images/large/5.jpg saved to cache
2026-03-25 16:34:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d26f9d5a-75eb-57f8-b2eb-bfff14ac360b
2026-03-25 16:34:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34d6b37e90>
2026-03-25 16:34:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d26f9d5a-75eb-57f8-b2eb-bfff14ac360b/d26f9d5a-75eb-57f8-b2eb-bfff14ac360b_image_9.jpg HTTP/1.1" 201 0
2026-03-25 16:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx7%252Fb0aace74627247a9b5cec65f127241aa%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx7/b0aace74627247a9b5cec65f127241aa/images/large/10.jpg saved to cache
2026-03-25 16:34:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d26f9d5a-75eb-57f8-b2eb-bfff14ac360b
2026-03-25 16:34:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc711a10>
2026-03-25 16:34:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97867369-8ed5-5f05-809b-2623e9afae80/97867369-8ed5-5f05-809b-2623e9afae80_image_7.jpg HTTP/1.1" 201 0
2026-03-25 16:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv9%252Face7ad8431f64ee494b8e435d3cf2e60%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv9/ace7ad8431f64ee494b8e435d3cf2e60/images/large/8.jpg saved to cache
2026-03-25 16:34:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 97867369-8ed5-5f05-809b-2623e9afae80
2026-03-25 16:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgv6%252Fe003c200872f41c4b5d813f0e88e3f5f%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gv6/e003c200872f41c4b5d813f0e88e3f5f/images/large/3.jpg not downloaded yet
2026-03-25 16:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgv6%252Fe003c200872f41c4b5d813f0e88e3f5f%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gv6/e003c200872f41c4b5d813f0e88e3f5f/images/large/4.jpg not downloaded yet
2026-03-25 16:34:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc648750>
2026-03-25 16:34:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cec01d4b-149b-5b48-9324-ecc808c1bede/cec01d4b-149b-5b48-9324-ecc808c1bede_image_1.jpg HTTP/1.1" 201 0
2026-03-25 16:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn6%252F31db21d2003d49349b4d53cfdea0cbfc%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn6/31db21d2003d49349b4d53cfdea0cbfc/images/large/2.jpg saved to cache
2026-03-25 16:34:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item cec01d4b-149b-5b48-9324-ecc808c1bede
2026-03-25 16:34:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc990090>
2026-03-25 16:34:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cec01d4b-149b-5b48-9324-ecc808c1bede/cec01d4b-149b-5b48-9324-ecc808c1bede_image_2.jpg HTTP/1.1" 201 0
2026-03-25 16:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn6%252F31db21d2003d49349b4d53cfdea0cbfc%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn6/31db21d2003d49349b4d53cfdea0cbfc/images/large/3.jpg saved to cache
2026-03-25 16:34:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item cec01d4b-149b-5b48-9324-ecc808c1bede
2026-03-25 16:34:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dca9c090>
2026-03-25 16:34:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cec01d4b-149b-5b48-9324-ecc808c1bede/cec01d4b-149b-5b48-9324-ecc808c1bede_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn6%252F31db21d2003d49349b4d53cfdea0cbfc%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn6/31db21d2003d49349b4d53cfdea0cbfc/images/large/1.jpg saved to cache
2026-03-25 16:34:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cec01d4b-149b-5b48-9324-ecc808c1bede
2026-03-25 16:34:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn6/31db21d2003d49349b4d53cfdea0cbfc/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgv6%252Fe003c200872f41c4b5d813f0e88e3f5f%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gv6/e003c200872f41c4b5d813f0e88e3f5f/images/large/5.jpg not downloaded yet
2026-03-25 16:34:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx7/b0aace74627247a9b5cec65f127241aa/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgv6%252Fe003c200872f41c4b5d813f0e88e3f5f%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gv6/e003c200872f41c4b5d813f0e88e3f5f/images/large/6.jpg not downloaded yet
2026-03-25 16:34:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn6/31db21d2003d49349b4d53cfdea0cbfc/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn6/31db21d2003d49349b4d53cfdea0cbfc/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx7/b0aace74627247a9b5cec65f127241aa/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgv6%252Fe003c200872f41c4b5d813f0e88e3f5f%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gv6/e003c200872f41c4b5d813f0e88e3f5f/images/large/7.jpg not downloaded yet
2026-03-25 16:34:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn6/31db21d2003d49349b4d53cfdea0cbfc/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgv6%252Fe003c200872f41c4b5d813f0e88e3f5f%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gv6/e003c200872f41c4b5d813f0e88e3f5f/images/large/8.jpg not downloaded yet
2026-03-25 16:34:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv9/ace7ad8431f64ee494b8e435d3cf2e60/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn7/5646918b00554a96af40b450ab9beb84/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgv6%252Fe003c200872f41c4b5d813f0e88e3f5f%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gv6/e003c200872f41c4b5d813f0e88e3f5f/images/large/9.jpg not downloaded yet
2026-03-25 16:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgv6%252Fe003c200872f41c4b5d813f0e88e3f5f%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gv6/e003c200872f41c4b5d813f0e88e3f5f/images/large/10.jpg not downloaded yet
2026-03-25 16:34:27 [ayvens.it] INFO: Found listing with ID: 1983676
2026-03-25 16:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983676%27 HTTP/1.1" 200 None
2026-03-25 16:34:27 [ayvens.it] INFO: Scrape type for 1983676: 1
2026-03-25 16:34:27 [ayvens.it] INFO: Extracting data for car ID: 1983676
2026-03-25 16:34:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dada565b-2f1e-5a24-969f-330837f30f6a with identifier: 1983676
2026-03-25 16:34:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dada565b-2f1e-5a24-969f-330837f30f6a with scrape type 1
2026-03-25 16:34:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item dada565b-2f1e-5a24-969f-330837f30f6a
2026-03-25 16:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx4%252Fcfa1408cec9a434ea6224dff8350e426%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx4/cfa1408cec9a434ea6224dff8350e426/images/large/1.jpg not downloaded yet
2026-03-25 16:34:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dca9fe90>
2026-03-25 16:34:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cec01d4b-149b-5b48-9324-ecc808c1bede/cec01d4b-149b-5b48-9324-ecc808c1bede_image_6.jpg HTTP/1.1" 201 0
2026-03-25 16:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn6%252F31db21d2003d49349b4d53cfdea0cbfc%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn6/31db21d2003d49349b4d53cfdea0cbfc/images/large/7.jpg saved to cache
2026-03-25 16:34:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item cec01d4b-149b-5b48-9324-ecc808c1bede
2026-03-25 16:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx4%252Fcfa1408cec9a434ea6224dff8350e426%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx4/cfa1408cec9a434ea6224dff8350e426/images/large/2.jpg not downloaded yet
2026-03-25 16:34:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc9753d0>
2026-03-25 16:34:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d26f9d5a-75eb-57f8-b2eb-bfff14ac360b/d26f9d5a-75eb-57f8-b2eb-bfff14ac360b_image_8.jpg HTTP/1.1" 201 0
2026-03-25 16:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx7%252Fb0aace74627247a9b5cec65f127241aa%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx7/b0aace74627247a9b5cec65f127241aa/images/large/9.jpg saved to cache
2026-03-25 16:34:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d26f9d5a-75eb-57f8-b2eb-bfff14ac360b
2026-03-25 16:34:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc648290>
2026-03-25 16:34:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cec01d4b-149b-5b48-9324-ecc808c1bede/cec01d4b-149b-5b48-9324-ecc808c1bede_image_5.jpg HTTP/1.1" 201 0
2026-03-25 16:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn6%252F31db21d2003d49349b4d53cfdea0cbfc%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn6/31db21d2003d49349b4d53cfdea0cbfc/images/large/6.jpg saved to cache
2026-03-25 16:34:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item cec01d4b-149b-5b48-9324-ecc808c1bede
2026-03-25 16:34:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dca962d0>
2026-03-25 16:34:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cec01d4b-149b-5b48-9324-ecc808c1bede/cec01d4b-149b-5b48-9324-ecc808c1bede_image_4.jpg HTTP/1.1" 201 0
2026-03-25 16:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn6%252F31db21d2003d49349b4d53cfdea0cbfc%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn6/31db21d2003d49349b4d53cfdea0cbfc/images/large/5.jpg saved to cache
2026-03-25 16:34:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item cec01d4b-149b-5b48-9324-ecc808c1bede
2026-03-25 16:34:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc5ea250>
2026-03-25 16:34:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d26f9d5a-75eb-57f8-b2eb-bfff14ac360b/d26f9d5a-75eb-57f8-b2eb-bfff14ac360b_image_7.jpg HTTP/1.1" 201 0
2026-03-25 16:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx7%252Fb0aace74627247a9b5cec65f127241aa%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx7/b0aace74627247a9b5cec65f127241aa/images/large/8.jpg saved to cache
2026-03-25 16:34:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d26f9d5a-75eb-57f8-b2eb-bfff14ac360b
2026-03-25 16:34:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d26f9d5a-75eb-57f8-b2eb-bfff14ac360b, skipping ID generation
2026-03-25 16:34:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d26f9d5a-75eb-57f8-b2eb-bfff14ac360b with scrape type 1
2026-03-25 16:34:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d26f9d5a-75eb-57f8-b2eb-bfff14ac360b sending to next pipeline
2026-03-25 16:34:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: d26f9d5a-75eb-57f8-b2eb-bfff14ac360b, identifier: 1983672
2026-03-25 16:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx4%252Fcfa1408cec9a434ea6224dff8350e426%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx4/cfa1408cec9a434ea6224dff8350e426/images/large/3.jpg not downloaded yet
2026-03-25 16:34:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: d26f9d5a-75eb-57f8-b2eb-bfff14ac360b with identifier: 1983672
2026-03-25 16:34:28 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:34:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: d26f9d5a-75eb-57f8-b2eb-bfff14ac360b with identifier: 1983672
2026-03-25 16:34:28 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: d26f9d5a-75eb-57f8-b2eb-bfff14ac360b with identifier: 1983672 to the API
2026-03-25 16:34:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:34:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:34:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fx7/b0aace74627247a9b5cec65f127241aa/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Argento Iridio metallizzato',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.1L',
'expiration_date': '2026-03-27T09:30:00Z',
'fuel_type': 'diesel',
'id': 'd26f9d5a-75eb-57f8-b2eb-bfff14ac360b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41025',
'listing': 'auction',
'location': None,
'make': 'MERCEDES-BENZ',
'model': 'MERCEDES-BENZ GLA GLA 200 d Automatic 4MATIC Bus. Extra Cross over '
'5-door (Euro 6.2)',
'odometer': 95846,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 29,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d26f9d5a-75eb-57f8-b2eb-bfff14ac360b/d26f9d5a-75eb-57f8-b2eb-bfff14ac360b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 629071,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx7/b0aace74627247a9b5cec65f127241aa/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d26f9d5a-75eb-57f8-b2eb-bfff14ac360b/d26f9d5a-75eb-57f8-b2eb-bfff14ac360b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 607648,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx7/b0aace74627247a9b5cec65f127241aa/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d26f9d5a-75eb-57f8-b2eb-bfff14ac360b/d26f9d5a-75eb-57f8-b2eb-bfff14ac360b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 629071,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx7/b0aace74627247a9b5cec65f127241aa/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d26f9d5a-75eb-57f8-b2eb-bfff14ac360b/d26f9d5a-75eb-57f8-b2eb-bfff14ac360b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 686046,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx7/b0aace74627247a9b5cec65f127241aa/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d26f9d5a-75eb-57f8-b2eb-bfff14ac360b/d26f9d5a-75eb-57f8-b2eb-bfff14ac360b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 650871,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx7/b0aace74627247a9b5cec65f127241aa/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d26f9d5a-75eb-57f8-b2eb-bfff14ac360b/d26f9d5a-75eb-57f8-b2eb-bfff14ac360b_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 529450,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx7/b0aace74627247a9b5cec65f127241aa/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d26f9d5a-75eb-57f8-b2eb-bfff14ac360b/d26f9d5a-75eb-57f8-b2eb-bfff14ac360b_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 514367,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx7/b0aace74627247a9b5cec65f127241aa/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d26f9d5a-75eb-57f8-b2eb-bfff14ac360b/d26f9d5a-75eb-57f8-b2eb-bfff14ac360b_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 483098,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx7/b0aace74627247a9b5cec65f127241aa/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d26f9d5a-75eb-57f8-b2eb-bfff14ac360b/d26f9d5a-75eb-57f8-b2eb-bfff14ac360b_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 564807,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx7/b0aace74627247a9b5cec65f127241aa/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d26f9d5a-75eb-57f8-b2eb-bfff14ac360b/d26f9d5a-75eb-57f8-b2eb-bfff14ac360b_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 525938,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx7/b0aace74627247a9b5cec65f127241aa/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-05-23',
'seats_number': 5,
'seller_name': None,
'title': 'MERCEDES-BENZ MERCEDES-BENZ GLA GLA 200 d Automatic 4MATIC Bus. '
'Extra Cross over 5-door (Euro 6.2) -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2019}
2026-03-25 16:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983672%27 HTTP/1.1" 200 None
2026-03-25 16:34:28 [ayvens.it] INFO: Saving data for 1983672: {'created_time': 1774456468.832288, 'last_price_update_time': 1774456468.832302, 'auction_closing_time': 1774603800.0}
2026-03-25 16:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1983672') HTTP/1.1" 204 0
2026-03-25 16:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx4%252Fcfa1408cec9a434ea6224dff8350e426%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx4/cfa1408cec9a434ea6224dff8350e426/images/large/4.jpg not downloaded yet
2026-03-25 16:34:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34d7d5b690>
2026-03-25 16:34:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cec01d4b-149b-5b48-9324-ecc808c1bede/cec01d4b-149b-5b48-9324-ecc808c1bede_image_3.jpg HTTP/1.1" 201 0
2026-03-25 16:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn6%252F31db21d2003d49349b4d53cfdea0cbfc%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn6/31db21d2003d49349b4d53cfdea0cbfc/images/large/4.jpg saved to cache
2026-03-25 16:34:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item cec01d4b-149b-5b48-9324-ecc808c1bede
2026-03-25 16:34:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcd8d410>
2026-03-25 16:34:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97867369-8ed5-5f05-809b-2623e9afae80/97867369-8ed5-5f05-809b-2623e9afae80_image_5.jpg HTTP/1.1" 201 0
2026-03-25 16:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv9%252Face7ad8431f64ee494b8e435d3cf2e60%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv9/ace7ad8431f64ee494b8e435d3cf2e60/images/large/6.jpg saved to cache
2026-03-25 16:34:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 97867369-8ed5-5f05-809b-2623e9afae80
2026-03-25 16:34:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc8e0390>
2026-03-25 16:34:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70d28a39-7d55-5056-a7c7-6b8c7e7f38d2/70d28a39-7d55-5056-a7c7-6b8c7e7f38d2_image_2.jpg HTTP/1.1" 201 0
2026-03-25 16:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn7%252F5646918b00554a96af40b450ab9beb84%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn7/5646918b00554a96af40b450ab9beb84/images/large/3.jpg saved to cache
2026-03-25 16:34:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 70d28a39-7d55-5056-a7c7-6b8c7e7f38d2
2026-03-25 16:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx4%252Fcfa1408cec9a434ea6224dff8350e426%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx4/cfa1408cec9a434ea6224dff8350e426/images/large/5.jpg not downloaded yet
2026-03-25 16:34:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn7/5646918b00554a96af40b450ab9beb84/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn7/5646918b00554a96af40b450ab9beb84/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx4%252Fcfa1408cec9a434ea6224dff8350e426%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx4/cfa1408cec9a434ea6224dff8350e426/images/large/6.jpg not downloaded yet
2026-03-25 16:34:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn7/5646918b00554a96af40b450ab9beb84/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn7/5646918b00554a96af40b450ab9beb84/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gv6/e003c200872f41c4b5d813f0e88e3f5f/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn7/5646918b00554a96af40b450ab9beb84/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gv6/e003c200872f41c4b5d813f0e88e3f5f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx4%252Fcfa1408cec9a434ea6224dff8350e426%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx4/cfa1408cec9a434ea6224dff8350e426/images/large/7.jpg not downloaded yet
2026-03-25 16:34:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gv6/e003c200872f41c4b5d813f0e88e3f5f/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx4%252Fcfa1408cec9a434ea6224dff8350e426%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx4/cfa1408cec9a434ea6224dff8350e426/images/large/8.jpg not downloaded yet
2026-03-25 16:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx4%252Fcfa1408cec9a434ea6224dff8350e426%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx4/cfa1408cec9a434ea6224dff8350e426/images/large/9.jpg not downloaded yet
2026-03-25 16:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx4%252Fcfa1408cec9a434ea6224dff8350e426%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx4/cfa1408cec9a434ea6224dff8350e426/images/large/10.jpg not downloaded yet
2026-03-25 16:34:29 [ayvens.it] INFO: Found listing with ID: 1983677
2026-03-25 16:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983677%27 HTTP/1.1" 200 None
2026-03-25 16:34:29 [ayvens.it] INFO: Scrape type for 1983677: 1
2026-03-25 16:34:29 [ayvens.it] INFO: Extracting data for car ID: 1983677
2026-03-25 16:34:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 84d84170-a568-5e07-befa-6786195c8fe0 with identifier: 1983677
2026-03-25 16:34:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 84d84170-a568-5e07-befa-6786195c8fe0 with scrape type 1
2026-03-25 16:34:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 84d84170-a568-5e07-befa-6786195c8fe0
2026-03-25 16:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb1%252F908cc6bf81904813aff5610873463bbe%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb1/908cc6bf81904813aff5610873463bbe/images/large/1.jpg not downloaded yet
2026-03-25 16:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb1%252F908cc6bf81904813aff5610873463bbe%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb1/908cc6bf81904813aff5610873463bbe/images/large/2.jpg not downloaded yet
2026-03-25 16:34:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc63ea50>
2026-03-25 16:34:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70d28a39-7d55-5056-a7c7-6b8c7e7f38d2/70d28a39-7d55-5056-a7c7-6b8c7e7f38d2_image_3.jpg HTTP/1.1" 201 0
2026-03-25 16:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn7%252F5646918b00554a96af40b450ab9beb84%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn7/5646918b00554a96af40b450ab9beb84/images/large/4.jpg saved to cache
2026-03-25 16:34:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 70d28a39-7d55-5056-a7c7-6b8c7e7f38d2
2026-03-25 16:34:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dca21450>
2026-03-25 16:34:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70d28a39-7d55-5056-a7c7-6b8c7e7f38d2/70d28a39-7d55-5056-a7c7-6b8c7e7f38d2_image_4.jpg HTTP/1.1" 201 0
2026-03-25 16:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn7%252F5646918b00554a96af40b450ab9beb84%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn7/5646918b00554a96af40b450ab9beb84/images/large/5.jpg saved to cache
2026-03-25 16:34:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 70d28a39-7d55-5056-a7c7-6b8c7e7f38d2
2026-03-25 16:34:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc325310>
2026-03-25 16:34:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70d28a39-7d55-5056-a7c7-6b8c7e7f38d2/70d28a39-7d55-5056-a7c7-6b8c7e7f38d2_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn7%252F5646918b00554a96af40b450ab9beb84%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn7/5646918b00554a96af40b450ab9beb84/images/large/1.jpg saved to cache
2026-03-25 16:34:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 70d28a39-7d55-5056-a7c7-6b8c7e7f38d2
2026-03-25 16:34:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc355050>
2026-03-25 16:34:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70d28a39-7d55-5056-a7c7-6b8c7e7f38d2/70d28a39-7d55-5056-a7c7-6b8c7e7f38d2_image_1.jpg HTTP/1.1" 201 0
2026-03-25 16:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn7%252F5646918b00554a96af40b450ab9beb84%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn7/5646918b00554a96af40b450ab9beb84/images/large/2.jpg saved to cache
2026-03-25 16:34:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 70d28a39-7d55-5056-a7c7-6b8c7e7f38d2
2026-03-25 16:34:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dce03350>
2026-03-25 16:34:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e971de7b-28e5-5f28-8084-c0a8925b244d/e971de7b-28e5-5f28-8084-c0a8925b244d_image_2.jpg HTTP/1.1" 201 0
2026-03-25 16:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgv6%252Fe003c200872f41c4b5d813f0e88e3f5f%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gv6/e003c200872f41c4b5d813f0e88e3f5f/images/large/3.jpg saved to cache
2026-03-25 16:34:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e971de7b-28e5-5f28-8084-c0a8925b244d
2026-03-25 16:34:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dca221d0>
2026-03-25 16:34:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70d28a39-7d55-5056-a7c7-6b8c7e7f38d2/70d28a39-7d55-5056-a7c7-6b8c7e7f38d2_image_5.jpg HTTP/1.1" 201 0
2026-03-25 16:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn7%252F5646918b00554a96af40b450ab9beb84%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn7/5646918b00554a96af40b450ab9beb84/images/large/6.jpg saved to cache
2026-03-25 16:34:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 70d28a39-7d55-5056-a7c7-6b8c7e7f38d2
2026-03-25 16:34:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc5bfbd0>
2026-03-25 16:34:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e971de7b-28e5-5f28-8084-c0a8925b244d/e971de7b-28e5-5f28-8084-c0a8925b244d_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgv6%252Fe003c200872f41c4b5d813f0e88e3f5f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gv6/e003c200872f41c4b5d813f0e88e3f5f/images/large/1.jpg saved to cache
2026-03-25 16:34:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e971de7b-28e5-5f28-8084-c0a8925b244d
2026-03-25 16:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb1%252F908cc6bf81904813aff5610873463bbe%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb1/908cc6bf81904813aff5610873463bbe/images/large/3.jpg not downloaded yet
2026-03-25 16:34:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc553090>
2026-03-25 16:34:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e971de7b-28e5-5f28-8084-c0a8925b244d/e971de7b-28e5-5f28-8084-c0a8925b244d_image_1.jpg HTTP/1.1" 201 0
2026-03-25 16:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgv6%252Fe003c200872f41c4b5d813f0e88e3f5f%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gv6/e003c200872f41c4b5d813f0e88e3f5f/images/large/2.jpg saved to cache
2026-03-25 16:34:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e971de7b-28e5-5f28-8084-c0a8925b244d
2026-03-25 16:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb1%252F908cc6bf81904813aff5610873463bbe%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb1/908cc6bf81904813aff5610873463bbe/images/large/4.jpg not downloaded yet
2026-03-25 16:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb1%252F908cc6bf81904813aff5610873463bbe%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb1/908cc6bf81904813aff5610873463bbe/images/large/5.jpg not downloaded yet
2026-03-25 16:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb1%252F908cc6bf81904813aff5610873463bbe%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb1/908cc6bf81904813aff5610873463bbe/images/large/6.jpg not downloaded yet
2026-03-25 16:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb1%252F908cc6bf81904813aff5610873463bbe%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb1/908cc6bf81904813aff5610873463bbe/images/large/7.jpg not downloaded yet
2026-03-25 16:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb1%252F908cc6bf81904813aff5610873463bbe%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb1/908cc6bf81904813aff5610873463bbe/images/large/8.jpg not downloaded yet
2026-03-25 16:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb1%252F908cc6bf81904813aff5610873463bbe%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb1/908cc6bf81904813aff5610873463bbe/images/large/9.jpg not downloaded yet
2026-03-25 16:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb1%252F908cc6bf81904813aff5610873463bbe%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb1/908cc6bf81904813aff5610873463bbe/images/large/10.jpg not downloaded yet
2026-03-25 16:34:30 [ayvens.it] INFO: Found listing with ID: 1983678
2026-03-25 16:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983678%27 HTTP/1.1" 200 None
2026-03-25 16:34:30 [ayvens.it] INFO: Scrape type for 1983678: 1
2026-03-25 16:34:30 [ayvens.it] INFO: Extracting data for car ID: 1983678
2026-03-25 16:34:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 82fe07fb-7e5b-595c-b720-1f7b8744488f with identifier: 1983678
2026-03-25 16:34:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 82fe07fb-7e5b-595c-b720-1f7b8744488f with scrape type 1
2026-03-25 16:34:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 82fe07fb-7e5b-595c-b720-1f7b8744488f
2026-03-25 16:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl5%252F9a84125923bb4216877df330ec100588%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl5/9a84125923bb4216877df330ec100588/images/large/1.jpg not downloaded yet
2026-03-25 16:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl5%252F9a84125923bb4216877df330ec100588%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl5/9a84125923bb4216877df330ec100588/images/large/2.jpg not downloaded yet
2026-03-25 16:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl5%252F9a84125923bb4216877df330ec100588%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl5/9a84125923bb4216877df330ec100588/images/large/3.jpg not downloaded yet
2026-03-25 16:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl5%252F9a84125923bb4216877df330ec100588%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl5/9a84125923bb4216877df330ec100588/images/large/4.jpg not downloaded yet
2026-03-25 16:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl5%252F9a84125923bb4216877df330ec100588%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl5/9a84125923bb4216877df330ec100588/images/large/5.jpg not downloaded yet
2026-03-25 16:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl5%252F9a84125923bb4216877df330ec100588%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl5/9a84125923bb4216877df330ec100588/images/large/6.jpg not downloaded yet
2026-03-25 16:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl5%252F9a84125923bb4216877df330ec100588%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl5/9a84125923bb4216877df330ec100588/images/large/7.jpg not downloaded yet
2026-03-25 16:34:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn7/5646918b00554a96af40b450ab9beb84/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gv6/e003c200872f41c4b5d813f0e88e3f5f/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl5%252F9a84125923bb4216877df330ec100588%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl5/9a84125923bb4216877df330ec100588/images/large/8.jpg not downloaded yet
2026-03-25 16:34:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gv6/e003c200872f41c4b5d813f0e88e3f5f/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl5%252F9a84125923bb4216877df330ec100588%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl5/9a84125923bb4216877df330ec100588/images/large/9.jpg not downloaded yet
2026-03-25 16:34:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gv6/e003c200872f41c4b5d813f0e88e3f5f/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl5%252F9a84125923bb4216877df330ec100588%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:34:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl5/9a84125923bb4216877df330ec100588/images/large/10.jpg not downloaded yet
2026-03-25 16:34:30 [ayvens.it] INFO: Found listing with ID: 1979642
2026-03-25 16:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979642%27 HTTP/1.1" 200 None
2026-03-25 16:34:30 [ayvens.it] INFO: Scrape type for 1979642: 2
2026-03-25 16:34:30 [ayvens.it] INFO: Extracting data for car ID: 1979642
2026-03-25 16:34:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7cfb9a29-7722-5363-99f8-7e69bc323dbc with identifier: 1979642
2026-03-25 16:34:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7cfb9a29-7722-5363-99f8-7e69bc323dbc with scrape type 2
2026-03-25 16:34:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7cfb9a29-7722-5363-99f8-7e69bc323dbc with scrape type 2
2026-03-25 16:34:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 7cfb9a29-7722-5363-99f8-7e69bc323dbc, identifier: 1979642
2026-03-25 16:34:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 7cfb9a29-7722-5363-99f8-7e69bc323dbc with identifier: 1979642
2026-03-25 16:34:30 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:34:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 7cfb9a29-7722-5363-99f8-7e69bc323dbc with identifier: 1979642
2026-03-25 16:34:31 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 7cfb9a29-7722-5363-99f8-7e69bc323dbc with identifier: 1979642 to the API
2026-03-25 16:34:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:34:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:34:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'GRIGIO MONTAGNA MTZ',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-26T09:30:00Z',
'fuel_type': 'diesel',
'id': '7cfb9a29-7722-5363-99f8-7e69bc323dbc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40968',
'listing': 'auction',
'location': None,
'make': 'MERCEDES-BENZ',
'model': 'MERCEDES A-CLASS (PC) A 180 D AUTOMATIC BUSINESS EXTRA FP',
'odometer': 99310,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-10-21',
'seats_number': 5,
'seller_name': None,
'title': 'MERCEDES-BENZ MERCEDES A-CLASS (PC) A 180 D AUTOMATIC BUSINESS '
'EXTRA FP -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2020}
2026-03-25 16:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979642%27 HTTP/1.1" 200 None
2026-03-25 16:34:31 [ayvens.it] INFO: Saving data for 1979642: {'auction_closing_time': 1774517400.0, 'created_time': 1774369827.848806, 'last_price_update_time': 1774456471.347614}
2026-03-25 16:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1979642') HTTP/1.1" 204 0
2026-03-25 16:34:31 [ayvens.it] INFO: Found listing with ID: 1979643
2026-03-25 16:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979643%27 HTTP/1.1" 200 None
2026-03-25 16:34:31 [ayvens.it] INFO: Scrape type for 1979643: 2
2026-03-25 16:34:31 [ayvens.it] INFO: Extracting data for car ID: 1979643
2026-03-25 16:34:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 58b455fd-2a1b-5368-9393-c01debc57195 with identifier: 1979643
2026-03-25 16:34:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 58b455fd-2a1b-5368-9393-c01debc57195 with scrape type 2
2026-03-25 16:34:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 58b455fd-2a1b-5368-9393-c01debc57195 with scrape type 2
2026-03-25 16:34:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 58b455fd-2a1b-5368-9393-c01debc57195, identifier: 1979643
2026-03-25 16:34:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn7/5646918b00554a96af40b450ab9beb84/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 58b455fd-2a1b-5368-9393-c01debc57195 with identifier: 1979643
2026-03-25 16:34:31 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:34:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 58b455fd-2a1b-5368-9393-c01debc57195 with identifier: 1979643
2026-03-25 16:34:31 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 58b455fd-2a1b-5368-9393-c01debc57195 with identifier: 1979643 to the API
2026-03-25 16:34:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:34:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:34:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'BIANCO MADREPERLA TETTO NERO',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-26T09:30:00Z',
'fuel_type': 'diesel',
'id': '58b455fd-2a1b-5368-9393-c01debc57195',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40968',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': 'PEUGEOT 2008 (PC) BLUEHDI 130 EAT8 ALLURE PACK S/S AUT. FP',
'odometer': 158770,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-06-30',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT PEUGEOT 2008 (PC) BLUEHDI 130 EAT8 ALLURE PACK S/S AUT. FP '
'-',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2021}
2026-03-25 16:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979643%27 HTTP/1.1" 200 None
2026-03-25 16:34:31 [ayvens.it] INFO: Saving data for 1979643: {'auction_closing_time': 1774517400.0, 'created_time': 1774369837.17694, 'last_price_update_time': 1774456471.861539}
2026-03-25 16:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1979643') HTTP/1.1" 204 0
2026-03-25 16:34:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcaf54d0>
2026-03-25 16:34:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70d28a39-7d55-5056-a7c7-6b8c7e7f38d2/70d28a39-7d55-5056-a7c7-6b8c7e7f38d2_image_9.jpg HTTP/1.1" 201 0
2026-03-25 16:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn7%252F5646918b00554a96af40b450ab9beb84%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn7/5646918b00554a96af40b450ab9beb84/images/large/10.jpg saved to cache
2026-03-25 16:34:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 70d28a39-7d55-5056-a7c7-6b8c7e7f38d2
2026-03-25 16:34:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc946b10>
2026-03-25 16:34:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e971de7b-28e5-5f28-8084-c0a8925b244d/e971de7b-28e5-5f28-8084-c0a8925b244d_image_3.jpg HTTP/1.1" 201 0
2026-03-25 16:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgv6%252Fe003c200872f41c4b5d813f0e88e3f5f%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gv6/e003c200872f41c4b5d813f0e88e3f5f/images/large/4.jpg saved to cache
2026-03-25 16:34:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e971de7b-28e5-5f28-8084-c0a8925b244d
2026-03-25 16:34:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34d740b750>
2026-03-25 16:34:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e971de7b-28e5-5f28-8084-c0a8925b244d/e971de7b-28e5-5f28-8084-c0a8925b244d_image_6.jpg HTTP/1.1" 201 0
2026-03-25 16:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgv6%252Fe003c200872f41c4b5d813f0e88e3f5f%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gv6/e003c200872f41c4b5d813f0e88e3f5f/images/large/7.jpg saved to cache
2026-03-25 16:34:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e971de7b-28e5-5f28-8084-c0a8925b244d
2026-03-25 16:34:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc5bef90>
2026-03-25 16:34:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e971de7b-28e5-5f28-8084-c0a8925b244d/e971de7b-28e5-5f28-8084-c0a8925b244d_image_5.jpg HTTP/1.1" 201 0
2026-03-25 16:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgv6%252Fe003c200872f41c4b5d813f0e88e3f5f%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gv6/e003c200872f41c4b5d813f0e88e3f5f/images/large/6.jpg saved to cache
2026-03-25 16:34:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e971de7b-28e5-5f28-8084-c0a8925b244d
2026-03-25 16:34:32 [ayvens.it] INFO: Found listing with ID: 1979644
2026-03-25 16:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979644%27 HTTP/1.1" 200 None
2026-03-25 16:34:32 [ayvens.it] INFO: Scrape type for 1979644: 2
2026-03-25 16:34:32 [ayvens.it] INFO: Extracting data for car ID: 1979644
2026-03-25 16:34:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 69e2b6a6-62fe-52b3-b3b9-2b724a529bb1 with identifier: 1979644
2026-03-25 16:34:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 69e2b6a6-62fe-52b3-b3b9-2b724a529bb1 with scrape type 2
2026-03-25 16:34:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 69e2b6a6-62fe-52b3-b3b9-2b724a529bb1 with scrape type 2
2026-03-25 16:34:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 69e2b6a6-62fe-52b3-b3b9-2b724a529bb1, identifier: 1979644
2026-03-25 16:34:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 69e2b6a6-62fe-52b3-b3b9-2b724a529bb1 with identifier: 1979644
2026-03-25 16:34:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 69e2b6a6-62fe-52b3-b3b9-2b724a529bb1 with identifier: 1979644
2026-03-25 16:34:32 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 69e2b6a6-62fe-52b3-b3b9-2b724a529bb1 with identifier: 1979644 to the API
2026-03-25 16:34:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:34:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:34:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'BIANCO ICY PASTELLO',
'currency': 'EUR',
'doors_number': 4,
'engine': '2.2L',
'expiration_date': '2026-03-26T09:30:00Z',
'fuel_type': 'diesel',
'id': '69e2b6a6-62fe-52b3-b3b9-2b724a529bb1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40968',
'listing': 'auction',
'location': None,
'make': 'OPEL',
'model': 'OPEL MOVANO FURGONE 30 L1H1 BLUEHDI 120 S&S',
'odometer': 93346,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-11-08',
'seats_number': 5,
'seller_name': None,
'title': 'OPEL OPEL MOVANO FURGONE 30 L1H1 BLUEHDI 120 S&S -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-25 16:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979644%27 HTTP/1.1" 200 None
2026-03-25 16:34:32 [ayvens.it] INFO: Saving data for 1979644: {'auction_closing_time': 1774517400.0, 'created_time': 1774369833.217894, 'last_price_update_time': 1774456472.743626}
2026-03-25 16:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1979644') HTTP/1.1" 204 0
2026-03-25 16:34:32 [ayvens.it] INFO: Found listing with ID: 1979645
2026-03-25 16:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979645%27 HTTP/1.1" 200 None
2026-03-25 16:34:32 [ayvens.it] INFO: Scrape type for 1979645: 2
2026-03-25 16:34:32 [ayvens.it] INFO: Extracting data for car ID: 1979645
2026-03-25 16:34:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4dd6e570-c7c1-5efd-9039-af2f5545760a with identifier: 1979645
2026-03-25 16:34:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4dd6e570-c7c1-5efd-9039-af2f5545760a with scrape type 2
2026-03-25 16:34:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4dd6e570-c7c1-5efd-9039-af2f5545760a with scrape type 2
2026-03-25 16:34:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 4dd6e570-c7c1-5efd-9039-af2f5545760a, identifier: 1979645
2026-03-25 16:34:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 4dd6e570-c7c1-5efd-9039-af2f5545760a with identifier: 1979645
2026-03-25 16:34:33 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:34:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 4dd6e570-c7c1-5efd-9039-af2f5545760a with identifier: 1979645
2026-03-25 16:34:33 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 4dd6e570-c7c1-5efd-9039-af2f5545760a with identifier: 1979645 to the API
2026-03-25 16:34:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:34:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:34:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'GRIGIO SFRENATO MTZ',
'currency': 'EUR',
'doors_number': 3,
'engine': '1.0L',
'expiration_date': '2026-03-26T09:30:00Z',
'fuel_type': 'hybrid',
'id': '4dd6e570-c7c1-5efd-9039-af2f5545760a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40968',
'listing': 'auction',
'location': None,
'make': 'FIAT',
'model': 'FIAT 500 (PC) 1.0 70CV IBRIDO DOLCEVITA FP',
'odometer': 28591,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-08-31',
'seats_number': 5,
'seller_name': None,
'title': 'FIAT FIAT 500 (PC) 1.0 70CV IBRIDO DOLCEVITA FP -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-25 16:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979645%27 HTTP/1.1" 200 None
2026-03-25 16:34:33 [ayvens.it] INFO: Saving data for 1979645: {'auction_closing_time': 1774517400.0, 'created_time': 1774369832.143632, 'last_price_update_time': 1774456473.385347}
2026-03-25 16:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1979645') HTTP/1.1" 204 0
2026-03-25 16:34:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gv6/e003c200872f41c4b5d813f0e88e3f5f/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:33 [ayvens.it] INFO: Found listing with ID: 1979646
2026-03-25 16:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979646%27 HTTP/1.1" 200 None
2026-03-25 16:34:33 [ayvens.it] INFO: Scrape type for 1979646: 2
2026-03-25 16:34:33 [ayvens.it] INFO: Extracting data for car ID: 1979646
2026-03-25 16:34:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 34a38935-f254-5443-a0e7-c3d8d6bedf0c with identifier: 1979646
2026-03-25 16:34:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 34a38935-f254-5443-a0e7-c3d8d6bedf0c with scrape type 2
2026-03-25 16:34:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 34a38935-f254-5443-a0e7-c3d8d6bedf0c with scrape type 2
2026-03-25 16:34:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 34a38935-f254-5443-a0e7-c3d8d6bedf0c, identifier: 1979646
2026-03-25 16:34:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcf2eb50>
2026-03-25 16:34:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70d28a39-7d55-5056-a7c7-6b8c7e7f38d2/70d28a39-7d55-5056-a7c7-6b8c7e7f38d2_image_8.jpg HTTP/1.1" 201 0
2026-03-25 16:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn7%252F5646918b00554a96af40b450ab9beb84%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn7/5646918b00554a96af40b450ab9beb84/images/large/9.jpg saved to cache
2026-03-25 16:34:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 70d28a39-7d55-5056-a7c7-6b8c7e7f38d2
2026-03-25 16:34:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx4/cfa1408cec9a434ea6224dff8350e426/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gv6/e003c200872f41c4b5d813f0e88e3f5f/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 34a38935-f254-5443-a0e7-c3d8d6bedf0c with identifier: 1979646
2026-03-25 16:34:33 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:34:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 34a38935-f254-5443-a0e7-c3d8d6bedf0c with identifier: 1979646
2026-03-25 16:34:33 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 34a38935-f254-5443-a0e7-c3d8d6bedf0c with identifier: 1979646 to the API
2026-03-25 16:34:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:34:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:34:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Solar Silver metallizzato',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-26T09:30:00Z',
'fuel_type': 'hybrid',
'id': '34a38935-f254-5443-a0e7-c3d8d6bedf0c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40968',
'listing': 'auction',
'location': None,
'make': 'FORD',
'model': 'FORD PUMA 1.0 Ecoboost Hybrid 125CV ST-Line Sport utility vehicle '
'5-door (Euro 6.2)',
'odometer': 96648,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-06-10',
'seats_number': 5,
'seller_name': None,
'title': 'FORD FORD PUMA 1.0 Ecoboost Hybrid 125CV ST-Line Sport utility '
'vehicle 5-door (Euro 6.2) -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2021}
2026-03-25 16:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979646%27 HTTP/1.1" 200 None
2026-03-25 16:34:33 [ayvens.it] INFO: Saving data for 1979646: {'auction_closing_time': 1774517400.0, 'created_time': 1774369835.421709, 'last_price_update_time': 1774456473.875674}
2026-03-25 16:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1979646') HTTP/1.1" 204 0
2026-03-25 16:34:33 [ayvens.it] INFO: Found listing with ID: 1979647
2026-03-25 16:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979647%27 HTTP/1.1" 200 None
2026-03-25 16:34:33 [ayvens.it] INFO: Scrape type for 1979647: 2
2026-03-25 16:34:33 [ayvens.it] INFO: Extracting data for car ID: 1979647
2026-03-25 16:34:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d83b057d-db48-5d36-8bdf-76749e4bbead with identifier: 1979647
2026-03-25 16:34:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d83b057d-db48-5d36-8bdf-76749e4bbead with scrape type 2
2026-03-25 16:34:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d83b057d-db48-5d36-8bdf-76749e4bbead with scrape type 2
2026-03-25 16:34:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: d83b057d-db48-5d36-8bdf-76749e4bbead, identifier: 1979647
2026-03-25 16:34:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: d83b057d-db48-5d36-8bdf-76749e4bbead with identifier: 1979647
2026-03-25 16:34:33 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:34:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: d83b057d-db48-5d36-8bdf-76749e4bbead with identifier: 1979647
2026-03-25 16:34:34 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: d83b057d-db48-5d36-8bdf-76749e4bbead with identifier: 1979647 to the API
2026-03-25 16:34:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:34:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:34:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'OXIDE BRONZE MET',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-26T09:30:00Z',
'fuel_type': 'hybrid',
'id': 'd83b057d-db48-5d36-8bdf-76749e4bbead',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40968',
'listing': 'auction',
'location': None,
'make': 'TOYOTA',
'model': 'TOYOTA COROLLA LP TS 2.0 HYBRID LOUNGE FP',
'odometer': 154401,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-06-04',
'seats_number': 5,
'seller_name': None,
'title': 'TOYOTA TOYOTA COROLLA LP TS 2.0 HYBRID LOUNGE FP -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2021}
2026-03-25 16:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979647%27 HTTP/1.1" 200 None
2026-03-25 16:34:34 [ayvens.it] INFO: Saving data for 1979647: {'auction_closing_time': 1774517400.0, 'created_time': 1774369838.083005, 'last_price_update_time': 1774456474.345763}
2026-03-25 16:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1979647') HTTP/1.1" 204 0
2026-03-25 16:34:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx4/cfa1408cec9a434ea6224dff8350e426/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx4/cfa1408cec9a434ea6224dff8350e426/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:34 [ayvens.it] INFO: Found listing with ID: 1979648
2026-03-25 16:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979648%27 HTTP/1.1" 200 None
2026-03-25 16:34:34 [ayvens.it] INFO: Scrape type for 1979648: 2
2026-03-25 16:34:34 [ayvens.it] INFO: Extracting data for car ID: 1979648
2026-03-25 16:34:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 730d6a1e-7ac0-5587-b503-7fa502d52767 with identifier: 1979648
2026-03-25 16:34:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 730d6a1e-7ac0-5587-b503-7fa502d52767 with scrape type 2
2026-03-25 16:34:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 730d6a1e-7ac0-5587-b503-7fa502d52767 with scrape type 2
2026-03-25 16:34:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 730d6a1e-7ac0-5587-b503-7fa502d52767, identifier: 1979648
2026-03-25 16:34:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx4/cfa1408cec9a434ea6224dff8350e426/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx4/cfa1408cec9a434ea6224dff8350e426/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 730d6a1e-7ac0-5587-b503-7fa502d52767 with identifier: 1979648
2026-03-25 16:34:34 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:34:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 730d6a1e-7ac0-5587-b503-7fa502d52767 with identifier: 1979648
2026-03-25 16:34:34 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 730d6a1e-7ac0-5587-b503-7fa502d52767 with identifier: 1979648 to the API
2026-03-25 16:34:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:34:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:34:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'NAUTIK BLUE METALLIZZATO',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-26T09:30:00Z',
'fuel_type': 'petrol',
'id': '730d6a1e-7ac0-5587-b503-7fa502d52767',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40968',
'listing': 'auction',
'location': None,
'make': 'OPEL',
'model': 'OPEL CROSSLAND X (PC 1.2 83CV ADVANCE MT5 FP',
'odometer': 122800,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-11-23',
'seats_number': 5,
'seller_name': None,
'title': 'OPEL OPEL CROSSLAND X (PC 1.2 83CV ADVANCE MT5 FP -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2020}
2026-03-25 16:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979648%27 HTTP/1.1" 200 None
2026-03-25 16:34:34 [ayvens.it] INFO: Saving data for 1979648: {'auction_closing_time': 1774517400.0, 'created_time': 1774369839.675706, 'last_price_update_time': 1774456474.749176}
2026-03-25 16:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1979648') HTTP/1.1" 204 0
2026-03-25 16:34:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcb9a710>
2026-03-25 16:34:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e971de7b-28e5-5f28-8084-c0a8925b244d/e971de7b-28e5-5f28-8084-c0a8925b244d_image_9.jpg HTTP/1.1" 201 0
2026-03-25 16:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgv6%252Fe003c200872f41c4b5d813f0e88e3f5f%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gv6/e003c200872f41c4b5d813f0e88e3f5f/images/large/10.jpg saved to cache
2026-03-25 16:34:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e971de7b-28e5-5f28-8084-c0a8925b244d
2026-03-25 16:34:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc5d6610>
2026-03-25 16:34:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dada565b-2f1e-5a24-969f-330837f30f6a/dada565b-2f1e-5a24-969f-330837f30f6a_image_1.jpg HTTP/1.1" 201 0
2026-03-25 16:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx4%252Fcfa1408cec9a434ea6224dff8350e426%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx4/cfa1408cec9a434ea6224dff8350e426/images/large/2.jpg saved to cache
2026-03-25 16:34:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item dada565b-2f1e-5a24-969f-330837f30f6a
2026-03-25 16:34:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc89d1d0>
2026-03-25 16:34:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e971de7b-28e5-5f28-8084-c0a8925b244d/e971de7b-28e5-5f28-8084-c0a8925b244d_image_4.jpg HTTP/1.1" 201 0
2026-03-25 16:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgv6%252Fe003c200872f41c4b5d813f0e88e3f5f%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gv6/e003c200872f41c4b5d813f0e88e3f5f/images/large/5.jpg saved to cache
2026-03-25 16:34:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e971de7b-28e5-5f28-8084-c0a8925b244d
2026-03-25 16:34:35 [ayvens.it] INFO: Found listing with ID: 1979649
2026-03-25 16:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979649%27 HTTP/1.1" 200 None
2026-03-25 16:34:35 [ayvens.it] INFO: Scrape type for 1979649: 2
2026-03-25 16:34:35 [ayvens.it] INFO: Extracting data for car ID: 1979649
2026-03-25 16:34:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fc3006cc-4148-5081-8ab8-1a3b3fc2920b with identifier: 1979649
2026-03-25 16:34:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fc3006cc-4148-5081-8ab8-1a3b3fc2920b with scrape type 2
2026-03-25 16:34:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fc3006cc-4148-5081-8ab8-1a3b3fc2920b with scrape type 2
2026-03-25 16:34:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: fc3006cc-4148-5081-8ab8-1a3b3fc2920b, identifier: 1979649
2026-03-25 16:34:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: fc3006cc-4148-5081-8ab8-1a3b3fc2920b with identifier: 1979649
2026-03-25 16:34:35 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:34:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: fc3006cc-4148-5081-8ab8-1a3b3fc2920b with identifier: 1979649
2026-03-25 16:34:35 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: fc3006cc-4148-5081-8ab8-1a3b3fc2920b with identifier: 1979649 to the API
2026-03-25 16:34:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:34:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:34:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'BIANCO IBIS PASTELLO',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-26T09:30:00Z',
'fuel_type': 'diesel',
'id': 'fc3006cc-4148-5081-8ab8-1a3b3fc2920b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40968',
'listing': 'auction',
'location': None,
'make': 'AUDI',
'model': 'AUDI A4 SW (PC) 2.0 40 TDI BUSINESS ADVANCED STRONIC FP',
'odometer': 192123,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-09-08',
'seats_number': 5,
'seller_name': None,
'title': 'AUDI AUDI A4 SW (PC) 2.0 40 TDI BUSINESS ADVANCED STRONIC FP -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-25 16:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979649%27 HTTP/1.1" 200 None
2026-03-25 16:34:35 [ayvens.it] INFO: Saving data for 1979649: {'auction_closing_time': 1774517400.0, 'created_time': 1774369841.561134, 'last_price_update_time': 1774456475.460111}
2026-03-25 16:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1979649') HTTP/1.1" 204 0
2026-03-25 16:34:35 [ayvens.it] INFO: Found listing with ID: 1979650
2026-03-25 16:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979650%27 HTTP/1.1" 200 None
2026-03-25 16:34:35 [ayvens.it] INFO: Scrape type for 1979650: 2
2026-03-25 16:34:35 [ayvens.it] INFO: Extracting data for car ID: 1979650
2026-03-25 16:34:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dda5cf27-a595-5e3b-9a7c-4fef70aacd2d with identifier: 1979650
2026-03-25 16:34:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dda5cf27-a595-5e3b-9a7c-4fef70aacd2d with scrape type 2
2026-03-25 16:34:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dda5cf27-a595-5e3b-9a7c-4fef70aacd2d with scrape type 2
2026-03-25 16:34:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: dda5cf27-a595-5e3b-9a7c-4fef70aacd2d, identifier: 1979650
2026-03-25 16:34:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx4/cfa1408cec9a434ea6224dff8350e426/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: dda5cf27-a595-5e3b-9a7c-4fef70aacd2d with identifier: 1979650
2026-03-25 16:34:35 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:34:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: dda5cf27-a595-5e3b-9a7c-4fef70aacd2d with identifier: 1979650
2026-03-25 16:34:35 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: dda5cf27-a595-5e3b-9a7c-4fef70aacd2d with identifier: 1979650 to the API
2026-03-25 16:34:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:34:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:34:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'BLU FUGO',
'currency': 'EUR',
'doors_number': None,
'engine': '0.7L',
'expiration_date': '2026-03-26T09:30:00Z',
'fuel_type': 'petrol',
'id': 'dda5cf27-a595-5e3b-9a7c-4fef70aacd2d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40968',
'listing': 'auction',
'location': None,
'make': 'HONDA',
'model': 'HONDA X-ADV 750 abs DCT MY21 Motociclo (Euro 5)',
'odometer': 1292,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-11-29',
'seats_number': 5,
'seller_name': None,
'title': 'HONDA HONDA X-ADV 750 abs DCT MY21 Motociclo (Euro 5) -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2023}
2026-03-25 16:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979650%27 HTTP/1.1" 200 None
2026-03-25 16:34:36 [ayvens.it] INFO: Saving data for 1979650: {'auction_closing_time': 1774517400.0, 'created_time': 1774369843.845959, 'last_price_update_time': 1774456476.158691}
2026-03-25 16:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1979650') HTTP/1.1" 204 0
2026-03-25 16:34:36 [ayvens.it] INFO: Found listing with ID: 1979651
2026-03-25 16:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979651%27 HTTP/1.1" 200 None
2026-03-25 16:34:36 [ayvens.it] INFO: Scrape type for 1979651: 2
2026-03-25 16:34:36 [ayvens.it] INFO: Extracting data for car ID: 1979651
2026-03-25 16:34:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 56620482-e0fa-52a8-96e8-bde2f13692c7 with identifier: 1979651
2026-03-25 16:34:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 56620482-e0fa-52a8-96e8-bde2f13692c7 with scrape type 2
2026-03-25 16:34:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 56620482-e0fa-52a8-96e8-bde2f13692c7 with scrape type 2
2026-03-25 16:34:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 56620482-e0fa-52a8-96e8-bde2f13692c7, identifier: 1979651
2026-03-25 16:34:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc9baa90>
2026-03-25 16:34:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dada565b-2f1e-5a24-969f-330837f30f6a/dada565b-2f1e-5a24-969f-330837f30f6a_image_2.jpg HTTP/1.1" 201 0
2026-03-25 16:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx4%252Fcfa1408cec9a434ea6224dff8350e426%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx4/cfa1408cec9a434ea6224dff8350e426/images/large/3.jpg saved to cache
2026-03-25 16:34:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item dada565b-2f1e-5a24-969f-330837f30f6a
2026-03-25 16:34:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc82c150>
2026-03-25 16:34:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dada565b-2f1e-5a24-969f-330837f30f6a/dada565b-2f1e-5a24-969f-330837f30f6a_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx4%252Fcfa1408cec9a434ea6224dff8350e426%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx4/cfa1408cec9a434ea6224dff8350e426/images/large/1.jpg saved to cache
2026-03-25 16:34:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item dada565b-2f1e-5a24-969f-330837f30f6a
2026-03-25 16:34:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc5bd150>
2026-03-25 16:34:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dada565b-2f1e-5a24-969f-330837f30f6a/dada565b-2f1e-5a24-969f-330837f30f6a_image_4.jpg HTTP/1.1" 201 0
2026-03-25 16:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx4%252Fcfa1408cec9a434ea6224dff8350e426%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx4/cfa1408cec9a434ea6224dff8350e426/images/large/5.jpg saved to cache
2026-03-25 16:34:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item dada565b-2f1e-5a24-969f-330837f30f6a
2026-03-25 16:34:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcadaa50>
2026-03-25 16:34:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dada565b-2f1e-5a24-969f-330837f30f6a/dada565b-2f1e-5a24-969f-330837f30f6a_image_3.jpg HTTP/1.1" 201 0
2026-03-25 16:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx4%252Fcfa1408cec9a434ea6224dff8350e426%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx4/cfa1408cec9a434ea6224dff8350e426/images/large/4.jpg saved to cache
2026-03-25 16:34:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item dada565b-2f1e-5a24-969f-330837f30f6a
2026-03-25 16:34:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gv6/e003c200872f41c4b5d813f0e88e3f5f/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 56620482-e0fa-52a8-96e8-bde2f13692c7 with identifier: 1979651
2026-03-25 16:34:36 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:34:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 56620482-e0fa-52a8-96e8-bde2f13692c7 with identifier: 1979651
2026-03-25 16:34:36 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 56620482-e0fa-52a8-96e8-bde2f13692c7 with identifier: 1979651 to the API
2026-03-25 16:34:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:34:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:34:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'ATLANTIC BLUE METALLIZZATO',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-26T09:30:00Z',
'fuel_type': 'hybrid',
'id': '56620482-e0fa-52a8-96e8-bde2f13692c7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40968',
'listing': 'auction',
'location': None,
'make': 'VOLKSWAGEN',
'model': 'VOLKSWAGEN GOLF 1.5 ETSI EVO ACT 96KW LIFE DSG FP',
'odometer': 115193,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-04-24',
'seats_number': 5,
'seller_name': None,
'title': 'VOLKSWAGEN VOLKSWAGEN GOLF 1.5 ETSI EVO ACT 96KW LIFE DSG FP -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2023}
2026-03-25 16:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979651%27 HTTP/1.1" 200 None
2026-03-25 16:34:37 [ayvens.it] INFO: Saving data for 1979651: {'auction_closing_time': 1774517400.0, 'created_time': 1774369845.324894, 'last_price_update_time': 1774456477.133373}
2026-03-25 16:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1979651') HTTP/1.1" 204 0
2026-03-25 16:34:37 [ayvens.it] INFO: Found listing with ID: 1979652
2026-03-25 16:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979652%27 HTTP/1.1" 200 None
2026-03-25 16:34:37 [ayvens.it] INFO: Scrape type for 1979652: 2
2026-03-25 16:34:37 [ayvens.it] INFO: Extracting data for car ID: 1979652
2026-03-25 16:34:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 145b9787-7ca8-5539-ad2b-30cc57655b6e with identifier: 1979652
2026-03-25 16:34:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 145b9787-7ca8-5539-ad2b-30cc57655b6e with scrape type 2
2026-03-25 16:34:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 145b9787-7ca8-5539-ad2b-30cc57655b6e with scrape type 2
2026-03-25 16:34:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 145b9787-7ca8-5539-ad2b-30cc57655b6e, identifier: 1979652
2026-03-25 16:34:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dccfa610>
2026-03-25 16:34:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dada565b-2f1e-5a24-969f-330837f30f6a/dada565b-2f1e-5a24-969f-330837f30f6a_image_5.jpg HTTP/1.1" 201 0
2026-03-25 16:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx4%252Fcfa1408cec9a434ea6224dff8350e426%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx4/cfa1408cec9a434ea6224dff8350e426/images/large/6.jpg saved to cache
2026-03-25 16:34:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item dada565b-2f1e-5a24-969f-330837f30f6a
2026-03-25 16:34:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 145b9787-7ca8-5539-ad2b-30cc57655b6e with identifier: 1979652
2026-03-25 16:34:37 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:34:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 145b9787-7ca8-5539-ad2b-30cc57655b6e with identifier: 1979652
2026-03-25 16:34:37 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 145b9787-7ca8-5539-ad2b-30cc57655b6e with identifier: 1979652 to the API
2026-03-25 16:34:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:34:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:34:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Nero Perla metallizzato',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-26T09:30:00Z',
'fuel_type': 'diesel',
'id': '145b9787-7ca8-5539-ad2b-30cc57655b6e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40968',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': 'PEUGEOT 308 SW SW Allure BlueHDi 130 EAT8 S&S aut. SW 5-door (Euro '
'6D)',
'odometer': 190711,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-11-09',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT PEUGEOT 308 SW SW Allure BlueHDi 130 EAT8 S&S aut. SW '
'5-door (Euro 6D) -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-25 16:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979652%27 HTTP/1.1" 200 None
2026-03-25 16:34:37 [ayvens.it] INFO: Saving data for 1979652: {'auction_closing_time': 1774517400.0, 'created_time': 1774369848.326731, 'last_price_update_time': 1774456477.552514}
2026-03-25 16:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1979652') HTTP/1.1" 204 0
2026-03-25 16:34:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gv6/e003c200872f41c4b5d813f0e88e3f5f/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:37 [ayvens.it] INFO: Found listing with ID: 1979653
2026-03-25 16:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979653%27 HTTP/1.1" 200 None
2026-03-25 16:34:37 [ayvens.it] INFO: Scrape type for 1979653: 2
2026-03-25 16:34:37 [ayvens.it] INFO: Extracting data for car ID: 1979653
2026-03-25 16:34:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5d961f76-3f9c-5e91-bbb1-432234a35846 with identifier: 1979653
2026-03-25 16:34:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5d961f76-3f9c-5e91-bbb1-432234a35846 with scrape type 2
2026-03-25 16:34:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5d961f76-3f9c-5e91-bbb1-432234a35846 with scrape type 2
2026-03-25 16:34:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 5d961f76-3f9c-5e91-bbb1-432234a35846, identifier: 1979653
2026-03-25 16:34:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb1/908cc6bf81904813aff5610873463bbe/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 5d961f76-3f9c-5e91-bbb1-432234a35846 with identifier: 1979653
2026-03-25 16:34:37 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:34:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 5d961f76-3f9c-5e91-bbb1-432234a35846 with identifier: 1979653
2026-03-25 16:34:37 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 5d961f76-3f9c-5e91-bbb1-432234a35846 with identifier: 1979653 to the API
2026-03-25 16:34:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:34:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:34:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'DESERT ISLAND BLUE METALLIZZATO',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-26T09:30:00Z',
'fuel_type': 'hybrid',
'id': '5d961f76-3f9c-5e91-bbb1-432234a35846',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40968',
'listing': 'auction',
'location': None,
'make': 'FORD',
'model': 'FORD PUMA (PC) 1.0 ECOBOOST HYBRID 125CV ST-LINE FP',
'odometer': 99886,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-02-19',
'seats_number': 5,
'seller_name': None,
'title': 'FORD FORD PUMA (PC) 1.0 ECOBOOST HYBRID 125CV ST-LINE FP -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2021}
2026-03-25 16:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979653%27 HTTP/1.1" 200 None
2026-03-25 16:34:37 [ayvens.it] INFO: Saving data for 1979653: {'auction_closing_time': 1774517400.0, 'created_time': 1774369849.551804, 'last_price_update_time': 1774456477.912755}
2026-03-25 16:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1979653') HTTP/1.1" 204 0
2026-03-25 16:34:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc589150>
2026-03-25 16:34:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e971de7b-28e5-5f28-8084-c0a8925b244d/e971de7b-28e5-5f28-8084-c0a8925b244d_image_8.jpg HTTP/1.1" 201 0
2026-03-25 16:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgv6%252Fe003c200872f41c4b5d813f0e88e3f5f%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gv6/e003c200872f41c4b5d813f0e88e3f5f/images/large/9.jpg saved to cache
2026-03-25 16:34:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e971de7b-28e5-5f28-8084-c0a8925b244d
2026-03-25 16:34:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl5/9a84125923bb4216877df330ec100588/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:38 [ayvens.it] INFO: Found listing with ID: 1979654
2026-03-25 16:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979654%27 HTTP/1.1" 200 None
2026-03-25 16:34:38 [ayvens.it] INFO: Scrape type for 1979654: 2
2026-03-25 16:34:38 [ayvens.it] INFO: Extracting data for car ID: 1979654
2026-03-25 16:34:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8b76c77a-aaf4-5562-b1c3-7372817cfe63 with identifier: 1979654
2026-03-25 16:34:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8b76c77a-aaf4-5562-b1c3-7372817cfe63 with scrape type 2
2026-03-25 16:34:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8b76c77a-aaf4-5562-b1c3-7372817cfe63 with scrape type 2
2026-03-25 16:34:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 8b76c77a-aaf4-5562-b1c3-7372817cfe63, identifier: 1979654
2026-03-25 16:34:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl5/9a84125923bb4216877df330ec100588/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl5/9a84125923bb4216877df330ec100588/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 8b76c77a-aaf4-5562-b1c3-7372817cfe63 with identifier: 1979654
2026-03-25 16:34:38 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:34:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 8b76c77a-aaf4-5562-b1c3-7372817cfe63 with identifier: 1979654
2026-03-25 16:34:38 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 8b76c77a-aaf4-5562-b1c3-7372817cfe63 with identifier: 1979654 to the API
2026-03-25 16:34:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:34:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:34:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'CASABLANCA WHITE',
'currency': 'EUR',
'doors_number': 3,
'engine': '1.6L',
'expiration_date': '2026-03-26T09:30:00Z',
'fuel_type': 'diesel',
'id': '8b76c77a-aaf4-5562-b1c3-7372817cfe63',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40968',
'listing': 'auction',
'location': None,
'make': 'OPEL',
'model': 'OPEL COMBO (PC) 1.6 DIESEL 100CV S&S L1 650 KG MT5 FP',
'odometer': 180397,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-07-12',
'seats_number': 5,
'seller_name': None,
'title': 'OPEL OPEL COMBO (PC) 1.6 DIESEL 100CV S&S L1 650 KG MT5 FP -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2019}
2026-03-25 16:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979654%27 HTTP/1.1" 200 None
2026-03-25 16:34:38 [ayvens.it] INFO: Saving data for 1979654: {'auction_closing_time': 1774517400.0, 'created_time': 1774369852.721534, 'last_price_update_time': 1774456478.535716}
2026-03-25 16:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1979654') HTTP/1.1" 204 0
2026-03-25 16:34:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl5/9a84125923bb4216877df330ec100588/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:38 [ayvens.it] INFO: Found listing with ID: 1979655
2026-03-25 16:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979655%27 HTTP/1.1" 200 None
2026-03-25 16:34:38 [ayvens.it] INFO: Scrape type for 1979655: 2
2026-03-25 16:34:38 [ayvens.it] INFO: Extracting data for car ID: 1979655
2026-03-25 16:34:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ba84d05d-d06c-5dbd-8de0-47413f22c975 with identifier: 1979655
2026-03-25 16:34:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ba84d05d-d06c-5dbd-8de0-47413f22c975 with scrape type 2
2026-03-25 16:34:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ba84d05d-d06c-5dbd-8de0-47413f22c975 with scrape type 2
2026-03-25 16:34:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: ba84d05d-d06c-5dbd-8de0-47413f22c975, identifier: 1979655
2026-03-25 16:34:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: ba84d05d-d06c-5dbd-8de0-47413f22c975 with identifier: 1979655
2026-03-25 16:34:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: ba84d05d-d06c-5dbd-8de0-47413f22c975 with identifier: 1979655
2026-03-25 16:34:38 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: ba84d05d-d06c-5dbd-8de0-47413f22c975 with identifier: 1979655 to the API
2026-03-25 16:34:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:34:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:34:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'BIANCO GELATO PASTELLO',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-26T09:30:00Z',
'fuel_type': 'hybrid',
'id': 'ba84d05d-d06c-5dbd-8de0-47413f22c975',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40968',
'listing': 'auction',
'location': None,
'make': 'FIAT',
'model': 'FIAT PANDA 1.0 FireFly 70cv S&S Hybrid City Life Hatchback 5-door '
'(Euro 6D)',
'odometer': 83569,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-10-11',
'seats_number': 5,
'seller_name': None,
'title': 'FIAT FIAT PANDA 1.0 FireFly 70cv S&S Hybrid City Life Hatchback '
'5-door (Euro 6D) -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-25 16:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979655%27 HTTP/1.1" 200 None
2026-03-25 16:34:38 [ayvens.it] INFO: Saving data for 1979655: {'auction_closing_time': 1774517400.0, 'created_time': 1774369854.504944, 'last_price_update_time': 1774456478.946868}
2026-03-25 16:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1979655') HTTP/1.1" 204 0
2026-03-25 16:34:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl5/9a84125923bb4216877df330ec100588/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:38 [ayvens.it] INFO: Found listing with ID: 1979656
2026-03-25 16:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979656%27 HTTP/1.1" 200 None
2026-03-25 16:34:38 [ayvens.it] INFO: Scrape type for 1979656: 2
2026-03-25 16:34:38 [ayvens.it] INFO: Extracting data for car ID: 1979656
2026-03-25 16:34:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a3c9b209-b40d-52f6-9c48-dd633707b7f6 with identifier: 1979656
2026-03-25 16:34:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a3c9b209-b40d-52f6-9c48-dd633707b7f6 with scrape type 2
2026-03-25 16:34:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a3c9b209-b40d-52f6-9c48-dd633707b7f6 with scrape type 2
2026-03-25 16:34:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: a3c9b209-b40d-52f6-9c48-dd633707b7f6, identifier: 1979656
2026-03-25 16:34:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc57ab50>
2026-03-25 16:34:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e971de7b-28e5-5f28-8084-c0a8925b244d/e971de7b-28e5-5f28-8084-c0a8925b244d_image_7.jpg HTTP/1.1" 201 0
2026-03-25 16:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgv6%252Fe003c200872f41c4b5d813f0e88e3f5f%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gv6/e003c200872f41c4b5d813f0e88e3f5f/images/large/8.jpg saved to cache
2026-03-25 16:34:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e971de7b-28e5-5f28-8084-c0a8925b244d
2026-03-25 16:34:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e971de7b-28e5-5f28-8084-c0a8925b244d, skipping ID generation
2026-03-25 16:34:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e971de7b-28e5-5f28-8084-c0a8925b244d with scrape type 1
2026-03-25 16:34:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e971de7b-28e5-5f28-8084-c0a8925b244d sending to next pipeline
2026-03-25 16:34:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: e971de7b-28e5-5f28-8084-c0a8925b244d, identifier: 1983675
2026-03-25 16:34:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc764590>
2026-03-25 16:34:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84d84170-a568-5e07-befa-6786195c8fe0/84d84170-a568-5e07-befa-6786195c8fe0_image_2.jpg HTTP/1.1" 201 0
2026-03-25 16:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb1%252F908cc6bf81904813aff5610873463bbe%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb1/908cc6bf81904813aff5610873463bbe/images/large/3.jpg saved to cache
2026-03-25 16:34:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 84d84170-a568-5e07-befa-6786195c8fe0
2026-03-25 16:34:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcc0be50>
2026-03-25 16:34:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82fe07fb-7e5b-595c-b720-1f7b8744488f/82fe07fb-7e5b-595c-b720-1f7b8744488f_image_5.jpg HTTP/1.1" 201 0
2026-03-25 16:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl5%252F9a84125923bb4216877df330ec100588%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl5/9a84125923bb4216877df330ec100588/images/large/6.jpg saved to cache
2026-03-25 16:34:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 82fe07fb-7e5b-595c-b720-1f7b8744488f
2026-03-25 16:34:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34d6b4b1d0>
2026-03-25 16:34:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82fe07fb-7e5b-595c-b720-1f7b8744488f/82fe07fb-7e5b-595c-b720-1f7b8744488f_image_7.jpg HTTP/1.1" 201 0
2026-03-25 16:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl5%252F9a84125923bb4216877df330ec100588%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl5/9a84125923bb4216877df330ec100588/images/large/8.jpg saved to cache
2026-03-25 16:34:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 82fe07fb-7e5b-595c-b720-1f7b8744488f
2026-03-25 16:34:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc92d390>
2026-03-25 16:34:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82fe07fb-7e5b-595c-b720-1f7b8744488f/82fe07fb-7e5b-595c-b720-1f7b8744488f_image_6.jpg HTTP/1.1" 201 0
2026-03-25 16:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl5%252F9a84125923bb4216877df330ec100588%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl5/9a84125923bb4216877df330ec100588/images/large/7.jpg saved to cache
2026-03-25 16:34:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 82fe07fb-7e5b-595c-b720-1f7b8744488f
2026-03-25 16:34:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: a3c9b209-b40d-52f6-9c48-dd633707b7f6 with identifier: 1979656
2026-03-25 16:34:39 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:34:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: a3c9b209-b40d-52f6-9c48-dd633707b7f6 with identifier: 1979656
2026-03-25 16:34:39 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: a3c9b209-b40d-52f6-9c48-dd633707b7f6 with identifier: 1979656 to the API
2026-03-25 16:34:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:34:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:34:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'BIANCO ALFA PASTELLO',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-26T09:30:00Z',
'fuel_type': 'diesel',
'id': 'a3c9b209-b40d-52f6-9c48-dd633707b7f6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40968',
'listing': 'auction',
'location': None,
'make': 'ALFA ROMEO',
'model': 'ALFA ROMEO TONALE 1.6 DIESEL 130CV TCT6 SPRINT FP',
'odometer': 9149,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-12-20',
'seats_number': 5,
'seller_name': None,
'title': 'ALFA ROMEO ALFA ROMEO TONALE 1.6 DIESEL 130CV TCT6 SPRINT FP -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-25 16:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979656%27 HTTP/1.1" 200 None
2026-03-25 16:34:39 [ayvens.it] INFO: Saving data for 1979656: {'auction_closing_time': 1774517400.0, 'created_time': 1774369856.033768, 'last_price_update_time': 1774456479.999103}
2026-03-25 16:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1979656') HTTP/1.1" 204 0
2026-03-25 16:34:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: e971de7b-28e5-5f28-8084-c0a8925b244d with identifier: 1983675
2026-03-25 16:34:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: e971de7b-28e5-5f28-8084-c0a8925b244d with identifier: 1983675
2026-03-25 16:34:40 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: e971de7b-28e5-5f28-8084-c0a8925b244d with identifier: 1983675 to the API
2026-03-25 16:34:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:34:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:34:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gv6/e003c200872f41c4b5d813f0e88e3f5f/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'BIANCO ICY PASTELLO',
'currency': 'EUR',
'doors_number': 4,
'engine': '2.2L',
'expiration_date': '2026-03-27T09:30:00Z',
'fuel_type': 'diesel',
'id': 'e971de7b-28e5-5f28-8084-c0a8925b244d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41025',
'listing': 'auction',
'location': None,
'make': 'OPEL',
'model': 'OPEL MOVANO 2.2 BLUEHDI 140 S&S 33 L2H2 FP',
'odometer': 127826,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 40,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e971de7b-28e5-5f28-8084-c0a8925b244d/e971de7b-28e5-5f28-8084-c0a8925b244d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 537852,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gv6/e003c200872f41c4b5d813f0e88e3f5f/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e971de7b-28e5-5f28-8084-c0a8925b244d/e971de7b-28e5-5f28-8084-c0a8925b244d_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 644940,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gv6/e003c200872f41c4b5d813f0e88e3f5f/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e971de7b-28e5-5f28-8084-c0a8925b244d/e971de7b-28e5-5f28-8084-c0a8925b244d_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 601711,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gv6/e003c200872f41c4b5d813f0e88e3f5f/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e971de7b-28e5-5f28-8084-c0a8925b244d/e971de7b-28e5-5f28-8084-c0a8925b244d_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 457138,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gv6/e003c200872f41c4b5d813f0e88e3f5f/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e971de7b-28e5-5f28-8084-c0a8925b244d/e971de7b-28e5-5f28-8084-c0a8925b244d_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 468914,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gv6/e003c200872f41c4b5d813f0e88e3f5f/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e971de7b-28e5-5f28-8084-c0a8925b244d/e971de7b-28e5-5f28-8084-c0a8925b244d_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 612058,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gv6/e003c200872f41c4b5d813f0e88e3f5f/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e971de7b-28e5-5f28-8084-c0a8925b244d/e971de7b-28e5-5f28-8084-c0a8925b244d_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 514677,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gv6/e003c200872f41c4b5d813f0e88e3f5f/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e971de7b-28e5-5f28-8084-c0a8925b244d/e971de7b-28e5-5f28-8084-c0a8925b244d_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 642343,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gv6/e003c200872f41c4b5d813f0e88e3f5f/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e971de7b-28e5-5f28-8084-c0a8925b244d/e971de7b-28e5-5f28-8084-c0a8925b244d_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 527498,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gv6/e003c200872f41c4b5d813f0e88e3f5f/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e971de7b-28e5-5f28-8084-c0a8925b244d/e971de7b-28e5-5f28-8084-c0a8925b244d_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 410235,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gv6/e003c200872f41c4b5d813f0e88e3f5f/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-05-20',
'seats_number': 5,
'seller_name': None,
'title': 'OPEL OPEL MOVANO 2.2 BLUEHDI 140 S&S 33 L2H2 FP -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2024}
2026-03-25 16:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983675%27 HTTP/1.1" 200 None
2026-03-25 16:34:40 [ayvens.it] INFO: Saving data for 1983675: {'created_time': 1774456480.473025, 'last_price_update_time': 1774456480.473037, 'auction_closing_time': 1774603800.0}
2026-03-25 16:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1983675') HTTP/1.1" 204 0
2026-03-25 16:34:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl5/9a84125923bb4216877df330ec100588/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:40 [ayvens.it] INFO: Found listing with ID: 1979657
2026-03-25 16:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979657%27 HTTP/1.1" 200 None
2026-03-25 16:34:40 [ayvens.it] INFO: Scrape type for 1979657: 2
2026-03-25 16:34:40 [ayvens.it] INFO: Extracting data for car ID: 1979657
2026-03-25 16:34:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b4ed661d-66e3-5790-9d32-8e71cdd80ce9 with identifier: 1979657
2026-03-25 16:34:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b4ed661d-66e3-5790-9d32-8e71cdd80ce9 with scrape type 2
2026-03-25 16:34:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b4ed661d-66e3-5790-9d32-8e71cdd80ce9 with scrape type 2
2026-03-25 16:34:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: b4ed661d-66e3-5790-9d32-8e71cdd80ce9, identifier: 1979657
2026-03-25 16:34:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34d6b48350>
2026-03-25 16:34:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82fe07fb-7e5b-595c-b720-1f7b8744488f/82fe07fb-7e5b-595c-b720-1f7b8744488f_image_4.jpg HTTP/1.1" 201 0
2026-03-25 16:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl5%252F9a84125923bb4216877df330ec100588%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl5/9a84125923bb4216877df330ec100588/images/large/5.jpg saved to cache
2026-03-25 16:34:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 82fe07fb-7e5b-595c-b720-1f7b8744488f
2026-03-25 16:34:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: b4ed661d-66e3-5790-9d32-8e71cdd80ce9 with identifier: 1979657
2026-03-25 16:34:40 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:34:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: b4ed661d-66e3-5790-9d32-8e71cdd80ce9 with identifier: 1979657
2026-03-25 16:34:40 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: b4ed661d-66e3-5790-9d32-8e71cdd80ce9 with identifier: 1979657 to the API
2026-03-25 16:34:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:34:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:34:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'BIANCO PASTELLO',
'currency': 'EUR',
'doors_number': 4,
'engine': '2.0L',
'expiration_date': '2026-03-26T09:30:00Z',
'fuel_type': 'diesel',
'id': 'b4ed661d-66e3-5790-9d32-8e71cdd80ce9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40968',
'listing': 'auction',
'location': None,
'make': 'FIAT',
'model': 'FIAT DUCATO 35 MH1 2.0 Mjet 16V 115CV ALU Dop.Cab. Cassone a sponde '
'abbattibili doppia cabina 4-door',
'odometer': 60020,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-11-03',
'seats_number': 5,
'seller_name': None,
'title': 'FIAT FIAT DUCATO 35 MH1 2.0 Mjet 16V 115CV ALU Dop.Cab. Cassone a '
'sponde abbattibili doppia cabina 4-door -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2017}
2026-03-25 16:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979657%27 HTTP/1.1" 200 None
2026-03-25 16:34:40 [ayvens.it] INFO: Saving data for 1979657: {'auction_closing_time': 1774517400.0, 'created_time': 1774369858.410045, 'last_price_update_time': 1774456480.903429}
2026-03-25 16:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1979657') HTTP/1.1" 204 0
2026-03-25 16:34:40 [ayvens.it] INFO: Found listing with ID: 1979658
2026-03-25 16:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979658%27 HTTP/1.1" 200 None
2026-03-25 16:34:40 [ayvens.it] INFO: Scrape type for 1979658: 2
2026-03-25 16:34:40 [ayvens.it] INFO: Extracting data for car ID: 1979658
2026-03-25 16:34:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ea1ef5dd-18fe-56d9-af05-047f40843f07 with identifier: 1979658
2026-03-25 16:34:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ea1ef5dd-18fe-56d9-af05-047f40843f07 with scrape type 2
2026-03-25 16:34:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ea1ef5dd-18fe-56d9-af05-047f40843f07 with scrape type 2
2026-03-25 16:34:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: ea1ef5dd-18fe-56d9-af05-047f40843f07, identifier: 1979658
2026-03-25 16:34:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc53edd0>
2026-03-25 16:34:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82fe07fb-7e5b-595c-b720-1f7b8744488f/82fe07fb-7e5b-595c-b720-1f7b8744488f_image_9.jpg HTTP/1.1" 201 0
2026-03-25 16:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl5%252F9a84125923bb4216877df330ec100588%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl5/9a84125923bb4216877df330ec100588/images/large/10.jpg saved to cache
2026-03-25 16:34:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 82fe07fb-7e5b-595c-b720-1f7b8744488f
2026-03-25 16:34:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: ea1ef5dd-18fe-56d9-af05-047f40843f07 with identifier: 1979658
2026-03-25 16:34:41 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:34:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: ea1ef5dd-18fe-56d9-af05-047f40843f07 with identifier: 1979658
2026-03-25 16:34:41 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: ea1ef5dd-18fe-56d9-af05-047f40843f07 with identifier: 1979658 to the API
2026-03-25 16:34:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:34:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:34:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'BIANCO LUNA METALLIZZATO',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-26T09:30:00Z',
'fuel_type': 'diesel',
'id': 'ea1ef5dd-18fe-56d9-af05-047f40843f07',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40968',
'listing': 'auction',
'location': None,
'make': 'SKODA',
'model': 'SKODA KODIAQ 2.0 TDI 110KW AMBITION DSG 7P FP',
'odometer': 116954,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-03-10',
'seats_number': 5,
'seller_name': None,
'title': 'SKODA SKODA KODIAQ 2.0 TDI 110KW AMBITION DSG 7P FP -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2023}
2026-03-25 16:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979658%27 HTTP/1.1" 200 None
2026-03-25 16:34:41 [ayvens.it] INFO: Saving data for 1979658: {'auction_closing_time': 1774517400.0, 'created_time': 1774369860.095093, 'last_price_update_time': 1774456481.452831}
2026-03-25 16:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1979658') HTTP/1.1" 204 0
2026-03-25 16:34:41 [ayvens.it] INFO: Found listing with ID: 1979659
2026-03-25 16:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979659%27 HTTP/1.1" 200 None
2026-03-25 16:34:41 [ayvens.it] INFO: Scrape type for 1979659: 2
2026-03-25 16:34:41 [ayvens.it] INFO: Extracting data for car ID: 1979659
2026-03-25 16:34:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ec4e7d0f-5f4a-5069-a8f1-a9dc303dd25a with identifier: 1979659
2026-03-25 16:34:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ec4e7d0f-5f4a-5069-a8f1-a9dc303dd25a with scrape type 2
2026-03-25 16:34:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ec4e7d0f-5f4a-5069-a8f1-a9dc303dd25a with scrape type 2
2026-03-25 16:34:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: ec4e7d0f-5f4a-5069-a8f1-a9dc303dd25a, identifier: 1979659
2026-03-25 16:34:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: ec4e7d0f-5f4a-5069-a8f1-a9dc303dd25a with identifier: 1979659
2026-03-25 16:34:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: ec4e7d0f-5f4a-5069-a8f1-a9dc303dd25a with identifier: 1979659
2026-03-25 16:34:41 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: ec4e7d0f-5f4a-5069-a8f1-a9dc303dd25a with identifier: 1979659 to the API
2026-03-25 16:34:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:34:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:34:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'POLAR WHITE PASTELLO',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-26T09:30:00Z',
'fuel_type': 'diesel',
'id': 'ec4e7d0f-5f4a-5069-a8f1-a9dc303dd25a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40968',
'listing': 'auction',
'location': None,
'make': 'CITROËN',
'model': 'CITROEN C3 (PC) BLUEHDI 100 S&S BUSINESS COMBI FP',
'odometer': 153355,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-01-26',
'seats_number': 5,
'seller_name': None,
'title': 'CITROËN CITROEN C3 (PC) BLUEHDI 100 S&S BUSINESS COMBI FP -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2021}
2026-03-25 16:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979659%27 HTTP/1.1" 200 None
2026-03-25 16:34:41 [ayvens.it] INFO: Saving data for 1979659: {'auction_closing_time': 1774517400.0, 'created_time': 1774369861.906191, 'last_price_update_time': 1774456481.797987}
2026-03-25 16:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1979659') HTTP/1.1" 204 0
2026-03-25 16:34:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc7fb450>
2026-03-25 16:34:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82fe07fb-7e5b-595c-b720-1f7b8744488f/82fe07fb-7e5b-595c-b720-1f7b8744488f_image_8.jpg HTTP/1.1" 201 0
2026-03-25 16:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl5%252F9a84125923bb4216877df330ec100588%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl5/9a84125923bb4216877df330ec100588/images/large/9.jpg saved to cache
2026-03-25 16:34:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 82fe07fb-7e5b-595c-b720-1f7b8744488f
2026-03-25 16:34:41 [ayvens.it] INFO: Found listing with ID: 1979660
2026-03-25 16:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979660%27 HTTP/1.1" 200 None
2026-03-25 16:34:41 [ayvens.it] INFO: Scrape type for 1979660: 2
2026-03-25 16:34:41 [ayvens.it] INFO: Extracting data for car ID: 1979660
2026-03-25 16:34:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 32bc1a2e-ad4b-5daa-9e5d-424413e20485 with identifier: 1979660
2026-03-25 16:34:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 32bc1a2e-ad4b-5daa-9e5d-424413e20485 with scrape type 2
2026-03-25 16:34:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 32bc1a2e-ad4b-5daa-9e5d-424413e20485 with scrape type 2
2026-03-25 16:34:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 32bc1a2e-ad4b-5daa-9e5d-424413e20485, identifier: 1979660
2026-03-25 16:34:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl5/9a84125923bb4216877df330ec100588/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl5/9a84125923bb4216877df330ec100588/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl5/9a84125923bb4216877df330ec100588/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb1/908cc6bf81904813aff5610873463bbe/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 32bc1a2e-ad4b-5daa-9e5d-424413e20485 with identifier: 1979660
2026-03-25 16:34:42 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:34:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 32bc1a2e-ad4b-5daa-9e5d-424413e20485 with identifier: 1979660
2026-03-25 16:34:42 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 32bc1a2e-ad4b-5daa-9e5d-424413e20485 with identifier: 1979660 to the API
2026-03-25 16:34:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:34:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:34:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'BLU VERTIGO',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-26T09:30:00Z',
'fuel_type': 'diesel',
'id': '32bc1a2e-ad4b-5daa-9e5d-424413e20485',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40968',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': 'PEUGEOT 2008 (PC) BLUEHDI 130 EAT8 ALLURE NAVI P. S/S AUT. F FP',
'odometer': 69060,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-11-11',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT PEUGEOT 2008 (PC) BLUEHDI 130 EAT8 ALLURE NAVI P. S/S AUT. '
'F FP -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2020}
2026-03-25 16:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979660%27 HTTP/1.1" 200 None
2026-03-25 16:34:42 [ayvens.it] INFO: Saving data for 1979660: {'auction_closing_time': 1774517400.0, 'created_time': 1774369864.058487, 'last_price_update_time': 1774456482.369187}
2026-03-25 16:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1979660') HTTP/1.1" 204 0
2026-03-25 16:34:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb1/908cc6bf81904813aff5610873463bbe/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:42 [ayvens.it] INFO: Found listing with ID: 1979661
2026-03-25 16:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979661%27 HTTP/1.1" 200 None
2026-03-25 16:34:42 [ayvens.it] INFO: Scrape type for 1979661: 2
2026-03-25 16:34:42 [ayvens.it] INFO: Extracting data for car ID: 1979661
2026-03-25 16:34:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b1084dfb-8c1e-53d7-862e-8c2726cf34b3 with identifier: 1979661
2026-03-25 16:34:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b1084dfb-8c1e-53d7-862e-8c2726cf34b3 with scrape type 2
2026-03-25 16:34:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b1084dfb-8c1e-53d7-862e-8c2726cf34b3 with scrape type 2
2026-03-25 16:34:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: b1084dfb-8c1e-53d7-862e-8c2726cf34b3, identifier: 1979661
2026-03-25 16:34:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: b1084dfb-8c1e-53d7-862e-8c2726cf34b3 with identifier: 1979661
2026-03-25 16:34:42 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:34:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: b1084dfb-8c1e-53d7-862e-8c2726cf34b3 with identifier: 1979661
2026-03-25 16:34:42 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: b1084dfb-8c1e-53d7-862e-8c2726cf34b3 with identifier: 1979661 to the API
2026-03-25 16:34:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:34:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:34:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Argento Riflesso Metall',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-26T09:30:00Z',
'fuel_type': 'diesel',
'id': 'b1084dfb-8c1e-53d7-862e-8c2726cf34b3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40968',
'listing': 'auction',
'location': None,
'make': 'VOLKSWAGEN',
'model': 'VOLKSWAGEN GOLF 2.0 TDI SCR Life DSG Hatchback 5-door (Euro 6.2)',
'odometer': 86563,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-01-27',
'seats_number': 5,
'seller_name': None,
'title': 'VOLKSWAGEN VOLKSWAGEN GOLF 2.0 TDI SCR Life DSG Hatchback 5-door '
'(Euro 6.2) -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2021}
2026-03-25 16:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979661%27 HTTP/1.1" 200 None
2026-03-25 16:34:43 [ayvens.it] INFO: Saving data for 1979661: {'auction_closing_time': 1774517400.0, 'created_time': 1774369865.527851, 'last_price_update_time': 1774456483.1257}
2026-03-25 16:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1979661') HTTP/1.1" 204 0
2026-03-25 16:34:43 [ayvens.it] INFO: Found listing with ID: 1979662
2026-03-25 16:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979662%27 HTTP/1.1" 200 None
2026-03-25 16:34:43 [ayvens.it] INFO: Scrape type for 1979662: 2
2026-03-25 16:34:43 [ayvens.it] INFO: Extracting data for car ID: 1979662
2026-03-25 16:34:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 95d661e6-6fee-570d-a9ad-8bc5b192c7a0 with identifier: 1979662
2026-03-25 16:34:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 95d661e6-6fee-570d-a9ad-8bc5b192c7a0 with scrape type 2
2026-03-25 16:34:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 95d661e6-6fee-570d-a9ad-8bc5b192c7a0 with scrape type 2
2026-03-25 16:34:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 95d661e6-6fee-570d-a9ad-8bc5b192c7a0, identifier: 1979662
2026-03-25 16:34:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34d7d63b90>
2026-03-25 16:34:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82fe07fb-7e5b-595c-b720-1f7b8744488f/82fe07fb-7e5b-595c-b720-1f7b8744488f_image_3.jpg HTTP/1.1" 201 0
2026-03-25 16:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl5%252F9a84125923bb4216877df330ec100588%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl5/9a84125923bb4216877df330ec100588/images/large/4.jpg saved to cache
2026-03-25 16:34:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 82fe07fb-7e5b-595c-b720-1f7b8744488f
2026-03-25 16:34:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcb15e10>
2026-03-25 16:34:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82fe07fb-7e5b-595c-b720-1f7b8744488f/82fe07fb-7e5b-595c-b720-1f7b8744488f_image_2.jpg HTTP/1.1" 201 0
2026-03-25 16:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl5%252F9a84125923bb4216877df330ec100588%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl5/9a84125923bb4216877df330ec100588/images/large/3.jpg saved to cache
2026-03-25 16:34:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 82fe07fb-7e5b-595c-b720-1f7b8744488f
2026-03-25 16:34:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcba80d0>
2026-03-25 16:34:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82fe07fb-7e5b-595c-b720-1f7b8744488f/82fe07fb-7e5b-595c-b720-1f7b8744488f_image_1.jpg HTTP/1.1" 201 0
2026-03-25 16:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl5%252F9a84125923bb4216877df330ec100588%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl5/9a84125923bb4216877df330ec100588/images/large/2.jpg saved to cache
2026-03-25 16:34:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 82fe07fb-7e5b-595c-b720-1f7b8744488f
2026-03-25 16:34:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dca74090>
2026-03-25 16:34:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84d84170-a568-5e07-befa-6786195c8fe0/84d84170-a568-5e07-befa-6786195c8fe0_image_9.jpg HTTP/1.1" 201 0
2026-03-25 16:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb1%252F908cc6bf81904813aff5610873463bbe%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb1/908cc6bf81904813aff5610873463bbe/images/large/10.jpg saved to cache
2026-03-25 16:34:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 84d84170-a568-5e07-befa-6786195c8fe0
2026-03-25 16:34:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl5/9a84125923bb4216877df330ec100588/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 95d661e6-6fee-570d-a9ad-8bc5b192c7a0 with identifier: 1979662
2026-03-25 16:34:43 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:34:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 95d661e6-6fee-570d-a9ad-8bc5b192c7a0 with identifier: 1979662
2026-03-25 16:34:43 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 95d661e6-6fee-570d-a9ad-8bc5b192c7a0 with identifier: 1979662 to the API
2026-03-25 16:34:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:34:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:34:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Unknown',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-26T09:30:00Z',
'fuel_type': 'diesel',
'id': '95d661e6-6fee-570d-a9ad-8bc5b192c7a0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40968',
'listing': 'auction',
'location': None,
'make': 'FORD',
'model': 'FORD KUGA 1.5 EcoBlue 120CV 2WD ST-Line Auto Sport utility vehicle '
'5-door (Euro 6.2)',
'odometer': 109068,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-09-30',
'seats_number': 5,
'seller_name': None,
'title': 'FORD FORD KUGA 1.5 EcoBlue 120CV 2WD ST-Line Auto Sport utility '
'vehicle 5-door (Euro 6.2) -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2021}
2026-03-25 16:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979662%27 HTTP/1.1" 200 None
2026-03-25 16:34:44 [ayvens.it] INFO: Saving data for 1979662: {'auction_closing_time': 1774517400.0, 'created_time': 1774369867.24347, 'last_price_update_time': 1774456484.019316}
2026-03-25 16:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1979662') HTTP/1.1" 204 0
2026-03-25 16:34:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb1/908cc6bf81904813aff5610873463bbe/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:44 [ayvens.it] INFO: Found listing with ID: 1979663
2026-03-25 16:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979663%27 HTTP/1.1" 200 None
2026-03-25 16:34:44 [ayvens.it] INFO: Scrape type for 1979663: 2
2026-03-25 16:34:44 [ayvens.it] INFO: Extracting data for car ID: 1979663
2026-03-25 16:34:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 52fd199d-ff2c-502c-bcdc-d778829960cf with identifier: 1979663
2026-03-25 16:34:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 52fd199d-ff2c-502c-bcdc-d778829960cf with scrape type 2
2026-03-25 16:34:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 52fd199d-ff2c-502c-bcdc-d778829960cf with scrape type 2
2026-03-25 16:34:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 52fd199d-ff2c-502c-bcdc-d778829960cf, identifier: 1979663
2026-03-25 16:34:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc82f910>
2026-03-25 16:34:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84d84170-a568-5e07-befa-6786195c8fe0/84d84170-a568-5e07-befa-6786195c8fe0_image_8.jpg HTTP/1.1" 201 0
2026-03-25 16:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb1%252F908cc6bf81904813aff5610873463bbe%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb1/908cc6bf81904813aff5610873463bbe/images/large/9.jpg saved to cache
2026-03-25 16:34:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 84d84170-a568-5e07-befa-6786195c8fe0
2026-03-25 16:34:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb1/908cc6bf81904813aff5610873463bbe/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 52fd199d-ff2c-502c-bcdc-d778829960cf with identifier: 1979663
2026-03-25 16:34:44 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:34:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 52fd199d-ff2c-502c-bcdc-d778829960cf with identifier: 1979663
2026-03-25 16:34:44 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 52fd199d-ff2c-502c-bcdc-d778829960cf with identifier: 1979663 to the API
2026-03-25 16:34:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:34:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:34:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Nero pastello',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-26T09:30:00Z',
'fuel_type': 'diesel',
'id': '52fd199d-ff2c-502c-bcdc-d778829960cf',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40968',
'listing': 'auction',
'location': None,
'make': 'VOLVO',
'model': 'VOLVO XC60 D4 Geartr. Inscription Sport utility vehicle 5-door '
'(Euro 6.2)',
'odometer': 77135,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-01-23',
'seats_number': 5,
'seller_name': None,
'title': 'VOLVO VOLVO XC60 D4 Geartr. Inscription Sport utility vehicle '
'5-door (Euro 6.2) -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2020}
2026-03-25 16:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979663%27 HTTP/1.1" 200 None
2026-03-25 16:34:44 [ayvens.it] INFO: Saving data for 1979663: {'auction_closing_time': 1774517400.0, 'created_time': 1774369869.475636, 'last_price_update_time': 1774456484.459706}
2026-03-25 16:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1979663') HTTP/1.1" 204 0
2026-03-25 16:34:44 [ayvens.it] INFO: Fetching listings with token: 3b2cc62fd26c4e29a762db3de181266b and skip: 200
2026-03-25 16:34:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34d7d5a550>
2026-03-25 16:34:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82fe07fb-7e5b-595c-b720-1f7b8744488f/82fe07fb-7e5b-595c-b720-1f7b8744488f_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl5%252F9a84125923bb4216877df330ec100588%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl5/9a84125923bb4216877df330ec100588/images/large/1.jpg saved to cache
2026-03-25 16:34:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 82fe07fb-7e5b-595c-b720-1f7b8744488f
2026-03-25 16:34:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 82fe07fb-7e5b-595c-b720-1f7b8744488f, skipping ID generation
2026-03-25 16:34:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 82fe07fb-7e5b-595c-b720-1f7b8744488f with scrape type 1
2026-03-25 16:34:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 82fe07fb-7e5b-595c-b720-1f7b8744488f sending to next pipeline
2026-03-25 16:34:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 82fe07fb-7e5b-595c-b720-1f7b8744488f, identifier: 1983678
2026-03-25 16:34:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc34d550>
2026-03-25 16:34:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84d84170-a568-5e07-befa-6786195c8fe0/84d84170-a568-5e07-befa-6786195c8fe0_image_7.jpg HTTP/1.1" 201 0
2026-03-25 16:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb1%252F908cc6bf81904813aff5610873463bbe%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb1/908cc6bf81904813aff5610873463bbe/images/large/8.jpg saved to cache
2026-03-25 16:34:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 84d84170-a568-5e07-befa-6786195c8fe0
2026-03-25 16:34:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 82fe07fb-7e5b-595c-b720-1f7b8744488f with identifier: 1983678
2026-03-25 16:34:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 82fe07fb-7e5b-595c-b720-1f7b8744488f with identifier: 1983678
2026-03-25 16:34:44 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 82fe07fb-7e5b-595c-b720-1f7b8744488f with identifier: 1983678 to the API
2026-03-25 16:34:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:34:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:34:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gl5/9a84125923bb4216877df330ec100588/images/large/1.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'POLAR WHITE PASTELLO',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-27T09:30:00Z',
'fuel_type': 'diesel',
'id': '82fe07fb-7e5b-595c-b720-1f7b8744488f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41025',
'listing': 'auction',
'location': None,
'make': 'CITROËN',
'model': 'CITROEN C3 (PC) BLUEHDI 100 S&S FEEL PACK FP',
'odometer': 148100,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 82,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82fe07fb-7e5b-595c-b720-1f7b8744488f/82fe07fb-7e5b-595c-b720-1f7b8744488f_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 834120,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl5/9a84125923bb4216877df330ec100588/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82fe07fb-7e5b-595c-b720-1f7b8744488f/82fe07fb-7e5b-595c-b720-1f7b8744488f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 651020,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl5/9a84125923bb4216877df330ec100588/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82fe07fb-7e5b-595c-b720-1f7b8744488f/82fe07fb-7e5b-595c-b720-1f7b8744488f_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 658365,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl5/9a84125923bb4216877df330ec100588/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82fe07fb-7e5b-595c-b720-1f7b8744488f/82fe07fb-7e5b-595c-b720-1f7b8744488f_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 704126,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl5/9a84125923bb4216877df330ec100588/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82fe07fb-7e5b-595c-b720-1f7b8744488f/82fe07fb-7e5b-595c-b720-1f7b8744488f_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 708364,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl5/9a84125923bb4216877df330ec100588/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82fe07fb-7e5b-595c-b720-1f7b8744488f/82fe07fb-7e5b-595c-b720-1f7b8744488f_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 510755,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl5/9a84125923bb4216877df330ec100588/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82fe07fb-7e5b-595c-b720-1f7b8744488f/82fe07fb-7e5b-595c-b720-1f7b8744488f_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 536739,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl5/9a84125923bb4216877df330ec100588/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82fe07fb-7e5b-595c-b720-1f7b8744488f/82fe07fb-7e5b-595c-b720-1f7b8744488f_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 636806,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl5/9a84125923bb4216877df330ec100588/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82fe07fb-7e5b-595c-b720-1f7b8744488f/82fe07fb-7e5b-595c-b720-1f7b8744488f_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 520672,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl5/9a84125923bb4216877df330ec100588/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82fe07fb-7e5b-595c-b720-1f7b8744488f/82fe07fb-7e5b-595c-b720-1f7b8744488f_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 475744,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl5/9a84125923bb4216877df330ec100588/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-10-27',
'seats_number': 5,
'seller_name': None,
'title': 'CITROËN CITROEN C3 (PC) BLUEHDI 100 S&S FEEL PACK FP -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-25 16:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983678%27 HTTP/1.1" 200 None
2026-03-25 16:34:45 [ayvens.it] INFO: Saving data for 1983678: {'created_time': 1774456485.119122, 'last_price_update_time': 1774456485.119134, 'auction_closing_time': 1774603800.0}
2026-03-25 16:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1983678') HTTP/1.1" 204 0
2026-03-25 16:34:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcaf5050>
2026-03-25 16:34:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84d84170-a568-5e07-befa-6786195c8fe0/84d84170-a568-5e07-befa-6786195c8fe0_image_6.jpg HTTP/1.1" 201 0
2026-03-25 16:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb1%252F908cc6bf81904813aff5610873463bbe%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb1/908cc6bf81904813aff5610873463bbe/images/large/7.jpg saved to cache
2026-03-25 16:34:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 84d84170-a568-5e07-befa-6786195c8fe0
2026-03-25 16:34:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb1/908cc6bf81904813aff5610873463bbe/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb1/908cc6bf81904813aff5610873463bbe/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-25 16:34:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb1/908cc6bf81904813aff5610873463bbe/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb1/908cc6bf81904813aff5610873463bbe/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb1/908cc6bf81904813aff5610873463bbe/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx4/cfa1408cec9a434ea6224dff8350e426/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx4/cfa1408cec9a434ea6224dff8350e426/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx4/cfa1408cec9a434ea6224dff8350e426/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dca06550>
2026-03-25 16:34:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84d84170-a568-5e07-befa-6786195c8fe0/84d84170-a568-5e07-befa-6786195c8fe0_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb1%252F908cc6bf81904813aff5610873463bbe%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb1/908cc6bf81904813aff5610873463bbe/images/large/1.jpg saved to cache
2026-03-25 16:34:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 84d84170-a568-5e07-befa-6786195c8fe0
2026-03-25 16:34:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc75ba10>
2026-03-25 16:34:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84d84170-a568-5e07-befa-6786195c8fe0/84d84170-a568-5e07-befa-6786195c8fe0_image_5.jpg HTTP/1.1" 201 0
2026-03-25 16:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb1%252F908cc6bf81904813aff5610873463bbe%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb1/908cc6bf81904813aff5610873463bbe/images/large/6.jpg saved to cache
2026-03-25 16:34:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 84d84170-a568-5e07-befa-6786195c8fe0
2026-03-25 16:34:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn7/5646918b00554a96af40b450ab9beb84/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc89cf10>
2026-03-25 16:34:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84d84170-a568-5e07-befa-6786195c8fe0/84d84170-a568-5e07-befa-6786195c8fe0_image_3.jpg HTTP/1.1" 201 0
2026-03-25 16:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb1%252F908cc6bf81904813aff5610873463bbe%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb1/908cc6bf81904813aff5610873463bbe/images/large/4.jpg saved to cache
2026-03-25 16:34:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 84d84170-a568-5e07-befa-6786195c8fe0
2026-03-25 16:34:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcc4ee50>
2026-03-25 16:34:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84d84170-a568-5e07-befa-6786195c8fe0/84d84170-a568-5e07-befa-6786195c8fe0_image_4.jpg HTTP/1.1" 201 0
2026-03-25 16:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb1%252F908cc6bf81904813aff5610873463bbe%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb1/908cc6bf81904813aff5610873463bbe/images/large/5.jpg saved to cache
2026-03-25 16:34:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 84d84170-a568-5e07-befa-6786195c8fe0
2026-03-25 16:34:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34d6b3d750>
2026-03-25 16:34:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84d84170-a568-5e07-befa-6786195c8fe0/84d84170-a568-5e07-befa-6786195c8fe0_image_1.jpg HTTP/1.1" 201 0
2026-03-25 16:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb1%252F908cc6bf81904813aff5610873463bbe%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb1/908cc6bf81904813aff5610873463bbe/images/large/2.jpg saved to cache
2026-03-25 16:34:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 84d84170-a568-5e07-befa-6786195c8fe0
2026-03-25 16:34:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 84d84170-a568-5e07-befa-6786195c8fe0, skipping ID generation
2026-03-25 16:34:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 84d84170-a568-5e07-befa-6786195c8fe0 with scrape type 1
2026-03-25 16:34:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 84d84170-a568-5e07-befa-6786195c8fe0 sending to next pipeline
2026-03-25 16:34:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 84d84170-a568-5e07-befa-6786195c8fe0, identifier: 1983677
2026-03-25 16:34:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34d74cc950>
2026-03-25 16:34:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dada565b-2f1e-5a24-969f-330837f30f6a/dada565b-2f1e-5a24-969f-330837f30f6a_image_9.jpg HTTP/1.1" 201 0
2026-03-25 16:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx4%252Fcfa1408cec9a434ea6224dff8350e426%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx4/cfa1408cec9a434ea6224dff8350e426/images/large/10.jpg saved to cache
2026-03-25 16:34:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item dada565b-2f1e-5a24-969f-330837f30f6a
2026-03-25 16:34:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcaf47d0>
2026-03-25 16:34:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dada565b-2f1e-5a24-969f-330837f30f6a/dada565b-2f1e-5a24-969f-330837f30f6a_image_8.jpg HTTP/1.1" 201 0
2026-03-25 16:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx4%252Fcfa1408cec9a434ea6224dff8350e426%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx4/cfa1408cec9a434ea6224dff8350e426/images/large/9.jpg saved to cache
2026-03-25 16:34:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item dada565b-2f1e-5a24-969f-330837f30f6a
2026-03-25 16:34:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34d7d5b050>
2026-03-25 16:34:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dada565b-2f1e-5a24-969f-330837f30f6a/dada565b-2f1e-5a24-969f-330837f30f6a_image_7.jpg HTTP/1.1" 201 0
2026-03-25 16:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx4%252Fcfa1408cec9a434ea6224dff8350e426%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx4/cfa1408cec9a434ea6224dff8350e426/images/large/8.jpg saved to cache
2026-03-25 16:34:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item dada565b-2f1e-5a24-969f-330837f30f6a
2026-03-25 16:34:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 84d84170-a568-5e07-befa-6786195c8fe0 with identifier: 1983677
2026-03-25 16:34:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 84d84170-a568-5e07-befa-6786195c8fe0 with identifier: 1983677
2026-03-25 16:34:46 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 84d84170-a568-5e07-befa-6786195c8fe0 with identifier: 1983677 to the API
2026-03-25 16:34:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:34:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:34:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gb1/908cc6bf81904813aff5610873463bbe/images/large/2.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'BIANCO GELATO PASTELLO',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-27T09:30:00Z',
'fuel_type': 'petrol_lpg',
'id': '84d84170-a568-5e07-befa-6786195c8fe0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41025',
'listing': 'auction',
'location': None,
'make': 'FIAT',
'model': 'FIAT PANDA CONSIP14 1.2 69 CV EASYPOWER E6D-TEMP EASY FP',
'odometer': 96065,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 25,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84d84170-a568-5e07-befa-6786195c8fe0/84d84170-a568-5e07-befa-6786195c8fe0_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 684123,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb1/908cc6bf81904813aff5610873463bbe/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84d84170-a568-5e07-befa-6786195c8fe0/84d84170-a568-5e07-befa-6786195c8fe0_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 719632,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb1/908cc6bf81904813aff5610873463bbe/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84d84170-a568-5e07-befa-6786195c8fe0/84d84170-a568-5e07-befa-6786195c8fe0_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 684123,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb1/908cc6bf81904813aff5610873463bbe/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84d84170-a568-5e07-befa-6786195c8fe0/84d84170-a568-5e07-befa-6786195c8fe0_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 753729,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb1/908cc6bf81904813aff5610873463bbe/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84d84170-a568-5e07-befa-6786195c8fe0/84d84170-a568-5e07-befa-6786195c8fe0_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 723618,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb1/908cc6bf81904813aff5610873463bbe/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84d84170-a568-5e07-befa-6786195c8fe0/84d84170-a568-5e07-befa-6786195c8fe0_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 711376,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb1/908cc6bf81904813aff5610873463bbe/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84d84170-a568-5e07-befa-6786195c8fe0/84d84170-a568-5e07-befa-6786195c8fe0_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 669692,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb1/908cc6bf81904813aff5610873463bbe/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84d84170-a568-5e07-befa-6786195c8fe0/84d84170-a568-5e07-befa-6786195c8fe0_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 721037,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb1/908cc6bf81904813aff5610873463bbe/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84d84170-a568-5e07-befa-6786195c8fe0/84d84170-a568-5e07-befa-6786195c8fe0_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 611580,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb1/908cc6bf81904813aff5610873463bbe/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84d84170-a568-5e07-befa-6786195c8fe0/84d84170-a568-5e07-befa-6786195c8fe0_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 579659,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb1/908cc6bf81904813aff5610873463bbe/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-09-24',
'seats_number': 5,
'seller_name': None,
'title': 'FIAT FIAT PANDA CONSIP14 1.2 69 CV EASYPOWER E6D-TEMP EASY FP -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2020}
2026-03-25 16:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983677%27 HTTP/1.1" 200 None
2026-03-25 16:34:46 [ayvens.it] INFO: Saving data for 1983677: {'created_time': 1774456486.512352, 'last_price_update_time': 1774456486.512362, 'auction_closing_time': 1774603800.0}
2026-03-25 16:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1983677') HTTP/1.1" 204 0
2026-03-25 16:34:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc5cced0>
2026-03-25 16:34:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70d28a39-7d55-5056-a7c7-6b8c7e7f38d2/70d28a39-7d55-5056-a7c7-6b8c7e7f38d2_image_6.jpg HTTP/1.1" 201 0
2026-03-25 16:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn7%252F5646918b00554a96af40b450ab9beb84%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn7/5646918b00554a96af40b450ab9beb84/images/large/7.jpg saved to cache
2026-03-25 16:34:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 70d28a39-7d55-5056-a7c7-6b8c7e7f38d2
2026-03-25 16:34:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn6/31db21d2003d49349b4d53cfdea0cbfc/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv9/ace7ad8431f64ee494b8e435d3cf2e60/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn6/31db21d2003d49349b4d53cfdea0cbfc/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn6/31db21d2003d49349b4d53cfdea0cbfc/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx4/cfa1408cec9a434ea6224dff8350e426/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv9/ace7ad8431f64ee494b8e435d3cf2e60/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn7/5646918b00554a96af40b450ab9beb84/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fr3/d72558ea9df14d929ad8c8f59a924428/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dca20310>
2026-03-25 16:34:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cec01d4b-149b-5b48-9324-ecc808c1bede/cec01d4b-149b-5b48-9324-ecc808c1bede_image_7.jpg HTTP/1.1" 201 0
2026-03-25 16:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn6%252F31db21d2003d49349b4d53cfdea0cbfc%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn6/31db21d2003d49349b4d53cfdea0cbfc/images/large/8.jpg saved to cache
2026-03-25 16:34:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item cec01d4b-149b-5b48-9324-ecc808c1bede
2026-03-25 16:34:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg2/da7950026aec40899c50024af66b03ec/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc56e750>
2026-03-25 16:34:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97867369-8ed5-5f05-809b-2623e9afae80/97867369-8ed5-5f05-809b-2623e9afae80_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv9%252Face7ad8431f64ee494b8e435d3cf2e60%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv9/ace7ad8431f64ee494b8e435d3cf2e60/images/large/1.jpg saved to cache
2026-03-25 16:34:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 97867369-8ed5-5f05-809b-2623e9afae80
2026-03-25 16:34:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc301050>
2026-03-25 16:34:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cec01d4b-149b-5b48-9324-ecc808c1bede/cec01d4b-149b-5b48-9324-ecc808c1bede_image_9.jpg HTTP/1.1" 201 0
2026-03-25 16:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn6%252F31db21d2003d49349b4d53cfdea0cbfc%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn6/31db21d2003d49349b4d53cfdea0cbfc/images/large/10.jpg saved to cache
2026-03-25 16:34:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item cec01d4b-149b-5b48-9324-ecc808c1bede
2026-03-25 16:34:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc94dd50>
2026-03-25 16:34:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cec01d4b-149b-5b48-9324-ecc808c1bede/cec01d4b-149b-5b48-9324-ecc808c1bede_image_8.jpg HTTP/1.1" 201 0
2026-03-25 16:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn6%252F31db21d2003d49349b4d53cfdea0cbfc%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn6/31db21d2003d49349b4d53cfdea0cbfc/images/large/9.jpg saved to cache
2026-03-25 16:34:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item cec01d4b-149b-5b48-9324-ecc808c1bede
2026-03-25 16:34:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cec01d4b-149b-5b48-9324-ecc808c1bede, skipping ID generation
2026-03-25 16:34:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cec01d4b-149b-5b48-9324-ecc808c1bede with scrape type 1
2026-03-25 16:34:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cec01d4b-149b-5b48-9324-ecc808c1bede sending to next pipeline
2026-03-25 16:34:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: cec01d4b-149b-5b48-9324-ecc808c1bede, identifier: 1983673
2026-03-25 16:34:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc359910>
2026-03-25 16:34:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dada565b-2f1e-5a24-969f-330837f30f6a/dada565b-2f1e-5a24-969f-330837f30f6a_image_6.jpg HTTP/1.1" 201 0
2026-03-25 16:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx4%252Fcfa1408cec9a434ea6224dff8350e426%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx4/cfa1408cec9a434ea6224dff8350e426/images/large/7.jpg saved to cache
2026-03-25 16:34:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item dada565b-2f1e-5a24-969f-330837f30f6a
2026-03-25 16:34:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: dada565b-2f1e-5a24-969f-330837f30f6a, skipping ID generation
2026-03-25 16:34:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dada565b-2f1e-5a24-969f-330837f30f6a with scrape type 1
2026-03-25 16:34:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item dada565b-2f1e-5a24-969f-330837f30f6a sending to next pipeline
2026-03-25 16:34:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: dada565b-2f1e-5a24-969f-330837f30f6a, identifier: 1983676
2026-03-25 16:34:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34de303490>
2026-03-25 16:34:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97867369-8ed5-5f05-809b-2623e9afae80/97867369-8ed5-5f05-809b-2623e9afae80_image_3.jpg HTTP/1.1" 201 0
2026-03-25 16:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv9%252Face7ad8431f64ee494b8e435d3cf2e60%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv9/ace7ad8431f64ee494b8e435d3cf2e60/images/large/4.jpg saved to cache
2026-03-25 16:34:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 97867369-8ed5-5f05-809b-2623e9afae80
2026-03-25 16:34:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 97867369-8ed5-5f05-809b-2623e9afae80, skipping ID generation
2026-03-25 16:34:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 97867369-8ed5-5f05-809b-2623e9afae80 with scrape type 1
2026-03-25 16:34:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 97867369-8ed5-5f05-809b-2623e9afae80 sending to next pipeline
2026-03-25 16:34:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 97867369-8ed5-5f05-809b-2623e9afae80, identifier: 1983671
2026-03-25 16:34:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc300a90>
2026-03-25 16:34:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70d28a39-7d55-5056-a7c7-6b8c7e7f38d2/70d28a39-7d55-5056-a7c7-6b8c7e7f38d2_image_7.jpg HTTP/1.1" 201 0
2026-03-25 16:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn7%252F5646918b00554a96af40b450ab9beb84%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn7/5646918b00554a96af40b450ab9beb84/images/large/8.jpg saved to cache
2026-03-25 16:34:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 70d28a39-7d55-5056-a7c7-6b8c7e7f38d2
2026-03-25 16:34:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 70d28a39-7d55-5056-a7c7-6b8c7e7f38d2, skipping ID generation
2026-03-25 16:34:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 70d28a39-7d55-5056-a7c7-6b8c7e7f38d2 with scrape type 1
2026-03-25 16:34:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 70d28a39-7d55-5056-a7c7-6b8c7e7f38d2 sending to next pipeline
2026-03-25 16:34:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 70d28a39-7d55-5056-a7c7-6b8c7e7f38d2, identifier: 1983674
2026-03-25 16:34:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc92a2d0>
2026-03-25 16:34:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a3cf1e0-c603-5088-a070-cc10ecd542d6/6a3cf1e0-c603-5088-a070-cc10ecd542d6_image_9.jpg HTTP/1.1" 201 0
2026-03-25 16:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr3%252Fd72558ea9df14d929ad8c8f59a924428%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr3/d72558ea9df14d929ad8c8f59a924428/images/large/10.jpg saved to cache
2026-03-25 16:34:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6a3cf1e0-c603-5088-a070-cc10ecd542d6
2026-03-25 16:34:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: cec01d4b-149b-5b48-9324-ecc808c1bede with identifier: 1983673
2026-03-25 16:34:47 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:34:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: cec01d4b-149b-5b48-9324-ecc808c1bede with identifier: 1983673
2026-03-25 16:34:48 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: cec01d4b-149b-5b48-9324-ecc808c1bede with identifier: 1983673 to the API
2026-03-25 16:34:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:34:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:34:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gn6/31db21d2003d49349b4d53cfdea0cbfc/images/large/9.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'NERO ETOILE',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.3L',
'expiration_date': '2026-03-27T09:30:00Z',
'fuel_type': 'hybrid',
'id': 'cec01d4b-149b-5b48-9324-ecc808c1bede',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41025',
'listing': 'auction',
'location': None,
'make': 'RENAULT',
'model': 'RENAULT AUSTRAL 1.3 MHEV 160 TECHNO AUTO',
'odometer': 59445,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 20,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cec01d4b-149b-5b48-9324-ecc808c1bede/cec01d4b-149b-5b48-9324-ecc808c1bede_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 667440,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn6/31db21d2003d49349b4d53cfdea0cbfc/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cec01d4b-149b-5b48-9324-ecc808c1bede/cec01d4b-149b-5b48-9324-ecc808c1bede_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 613490,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn6/31db21d2003d49349b4d53cfdea0cbfc/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cec01d4b-149b-5b48-9324-ecc808c1bede/cec01d4b-149b-5b48-9324-ecc808c1bede_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 667440,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn6/31db21d2003d49349b4d53cfdea0cbfc/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cec01d4b-149b-5b48-9324-ecc808c1bede/cec01d4b-149b-5b48-9324-ecc808c1bede_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 634575,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn6/31db21d2003d49349b4d53cfdea0cbfc/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cec01d4b-149b-5b48-9324-ecc808c1bede/cec01d4b-149b-5b48-9324-ecc808c1bede_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 685428,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn6/31db21d2003d49349b4d53cfdea0cbfc/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cec01d4b-149b-5b48-9324-ecc808c1bede/cec01d4b-149b-5b48-9324-ecc808c1bede_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 618074,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn6/31db21d2003d49349b4d53cfdea0cbfc/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cec01d4b-149b-5b48-9324-ecc808c1bede/cec01d4b-149b-5b48-9324-ecc808c1bede_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 455294,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn6/31db21d2003d49349b4d53cfdea0cbfc/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cec01d4b-149b-5b48-9324-ecc808c1bede/cec01d4b-149b-5b48-9324-ecc808c1bede_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 428488,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn6/31db21d2003d49349b4d53cfdea0cbfc/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cec01d4b-149b-5b48-9324-ecc808c1bede/cec01d4b-149b-5b48-9324-ecc808c1bede_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 583412,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn6/31db21d2003d49349b4d53cfdea0cbfc/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cec01d4b-149b-5b48-9324-ecc808c1bede/cec01d4b-149b-5b48-9324-ecc808c1bede_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 563147,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn6/31db21d2003d49349b4d53cfdea0cbfc/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-04-07',
'seats_number': 5,
'seller_name': None,
'title': 'RENAULT RENAULT AUSTRAL 1.3 MHEV 160 TECHNO AUTO -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2023}
2026-03-25 16:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983673%27 HTTP/1.1" 200 None
2026-03-25 16:34:48 [ayvens.it] INFO: Saving data for 1983673: {'created_time': 1774456488.436536, 'last_price_update_time': 1774456488.436547, 'auction_closing_time': 1774603800.0}
2026-03-25 16:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1983673') HTTP/1.1" 204 0
2026-03-25 16:34:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: dada565b-2f1e-5a24-969f-330837f30f6a with identifier: 1983676
2026-03-25 16:34:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: dada565b-2f1e-5a24-969f-330837f30f6a with identifier: 1983676
2026-03-25 16:34:48 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: dada565b-2f1e-5a24-969f-330837f30f6a with identifier: 1983676 to the API
2026-03-25 16:34:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:34:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:34:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fx4/cfa1408cec9a434ea6224dff8350e426/images/large/7.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'BIANCO GELATO PASTELLO',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-27T09:30:00Z',
'fuel_type': 'petrol_lpg',
'id': 'dada565b-2f1e-5a24-969f-330837f30f6a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41025',
'listing': 'auction',
'location': None,
'make': 'FIAT',
'model': 'FIAT PANDA CONSIP13 1.2 69 CV EASYPOWER E6D-TEMP LOUNGE FP',
'odometer': 58943,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 20,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dada565b-2f1e-5a24-969f-330837f30f6a/dada565b-2f1e-5a24-969f-330837f30f6a_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 672515,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx4/cfa1408cec9a434ea6224dff8350e426/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dada565b-2f1e-5a24-969f-330837f30f6a/dada565b-2f1e-5a24-969f-330837f30f6a_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 650291,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx4/cfa1408cec9a434ea6224dff8350e426/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dada565b-2f1e-5a24-969f-330837f30f6a/dada565b-2f1e-5a24-969f-330837f30f6a_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 672515,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx4/cfa1408cec9a434ea6224dff8350e426/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dada565b-2f1e-5a24-969f-330837f30f6a/dada565b-2f1e-5a24-969f-330837f30f6a_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 747941,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx4/cfa1408cec9a434ea6224dff8350e426/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dada565b-2f1e-5a24-969f-330837f30f6a/dada565b-2f1e-5a24-969f-330837f30f6a_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 725497,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx4/cfa1408cec9a434ea6224dff8350e426/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dada565b-2f1e-5a24-969f-330837f30f6a/dada565b-2f1e-5a24-969f-330837f30f6a_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 686290,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx4/cfa1408cec9a434ea6224dff8350e426/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dada565b-2f1e-5a24-969f-330837f30f6a/dada565b-2f1e-5a24-969f-330837f30f6a_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 649453,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx4/cfa1408cec9a434ea6224dff8350e426/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dada565b-2f1e-5a24-969f-330837f30f6a/dada565b-2f1e-5a24-969f-330837f30f6a_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 676707,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx4/cfa1408cec9a434ea6224dff8350e426/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dada565b-2f1e-5a24-969f-330837f30f6a/dada565b-2f1e-5a24-969f-330837f30f6a_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 725125,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx4/cfa1408cec9a434ea6224dff8350e426/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dada565b-2f1e-5a24-969f-330837f30f6a/dada565b-2f1e-5a24-969f-330837f30f6a_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 607103,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx4/cfa1408cec9a434ea6224dff8350e426/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-07-29',
'seats_number': 5,
'seller_name': None,
'title': 'FIAT FIAT PANDA CONSIP13 1.2 69 CV EASYPOWER E6D-TEMP LOUNGE FP -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2019}
2026-03-25 16:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983676%27 HTTP/1.1" 200 None
2026-03-25 16:34:49 [ayvens.it] INFO: Saving data for 1983676: {'created_time': 1774456489.057026, 'last_price_update_time': 1774456489.057039, 'auction_closing_time': 1774603800.0}
2026-03-25 16:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1983676') HTTP/1.1" 204 0
2026-03-25 16:34:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 97867369-8ed5-5f05-809b-2623e9afae80 with identifier: 1983671
2026-03-25 16:34:49 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:34:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 97867369-8ed5-5f05-809b-2623e9afae80 with identifier: 1983671
2026-03-25 16:34:49 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 97867369-8ed5-5f05-809b-2623e9afae80 with identifier: 1983671 to the API
2026-03-25 16:34:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:34:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:34:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fv9/ace7ad8431f64ee494b8e435d3cf2e60/images/large/4.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'TUNGSTEN SILVER METALL',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-27T09:30:00Z',
'fuel_type': 'diesel',
'id': '97867369-8ed5-5f05-809b-2623e9afae80',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41025',
'listing': 'auction',
'location': None,
'make': 'VOLKSWAGEN',
'model': 'VOLKSWAGEN GOLF 1.6 TDI Business BMT Hatchback 5-door',
'odometer': 167361,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97867369-8ed5-5f05-809b-2623e9afae80/97867369-8ed5-5f05-809b-2623e9afae80_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 774287,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv9/ace7ad8431f64ee494b8e435d3cf2e60/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97867369-8ed5-5f05-809b-2623e9afae80/97867369-8ed5-5f05-809b-2623e9afae80_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 767234,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv9/ace7ad8431f64ee494b8e435d3cf2e60/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97867369-8ed5-5f05-809b-2623e9afae80/97867369-8ed5-5f05-809b-2623e9afae80_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 774287,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv9/ace7ad8431f64ee494b8e435d3cf2e60/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97867369-8ed5-5f05-809b-2623e9afae80/97867369-8ed5-5f05-809b-2623e9afae80_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 769522,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv9/ace7ad8431f64ee494b8e435d3cf2e60/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97867369-8ed5-5f05-809b-2623e9afae80/97867369-8ed5-5f05-809b-2623e9afae80_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 799125,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv9/ace7ad8431f64ee494b8e435d3cf2e60/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97867369-8ed5-5f05-809b-2623e9afae80/97867369-8ed5-5f05-809b-2623e9afae80_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 686677,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv9/ace7ad8431f64ee494b8e435d3cf2e60/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97867369-8ed5-5f05-809b-2623e9afae80/97867369-8ed5-5f05-809b-2623e9afae80_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 648583,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv9/ace7ad8431f64ee494b8e435d3cf2e60/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97867369-8ed5-5f05-809b-2623e9afae80/97867369-8ed5-5f05-809b-2623e9afae80_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 615169,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv9/ace7ad8431f64ee494b8e435d3cf2e60/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97867369-8ed5-5f05-809b-2623e9afae80/97867369-8ed5-5f05-809b-2623e9afae80_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 667658,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv9/ace7ad8431f64ee494b8e435d3cf2e60/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97867369-8ed5-5f05-809b-2623e9afae80/97867369-8ed5-5f05-809b-2623e9afae80_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 593972,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv9/ace7ad8431f64ee494b8e435d3cf2e60/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-02-15',
'seats_number': 5,
'seller_name': None,
'title': 'VOLKSWAGEN VOLKSWAGEN GOLF 1.6 TDI Business BMT Hatchback 5-door -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2019}
2026-03-25 16:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983671%27 HTTP/1.1" 200 None
2026-03-25 16:34:49 [ayvens.it] INFO: Saving data for 1983671: {'created_time': 1774456489.499284, 'last_price_update_time': 1774456489.499296, 'auction_closing_time': 1774603800.0}
2026-03-25 16:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1983671') HTTP/1.1" 204 0
2026-03-25 16:34:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 70d28a39-7d55-5056-a7c7-6b8c7e7f38d2 with identifier: 1983674
2026-03-25 16:34:49 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:34:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 70d28a39-7d55-5056-a7c7-6b8c7e7f38d2 with identifier: 1983674
2026-03-25 16:34:49 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 70d28a39-7d55-5056-a7c7-6b8c7e7f38d2 with identifier: 1983674 to the API
2026-03-25 16:34:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:34:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:34:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gn7/5646918b00554a96af40b450ab9beb84/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Argento brillante metallizzato',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-27T09:30:00Z',
'fuel_type': 'diesel',
'id': '70d28a39-7d55-5056-a7c7-6b8c7e7f38d2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41025',
'listing': 'auction',
'location': None,
'make': 'SKODA',
'model': 'SKODA OCTAVIA WAGON 2.0 TDI EVO 85KW EXECUTIVE DSG SW 5-door (Euro '
'6D)',
'odometer': 143884,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 12,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70d28a39-7d55-5056-a7c7-6b8c7e7f38d2/70d28a39-7d55-5056-a7c7-6b8c7e7f38d2_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 617858,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn7/5646918b00554a96af40b450ab9beb84/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70d28a39-7d55-5056-a7c7-6b8c7e7f38d2/70d28a39-7d55-5056-a7c7-6b8c7e7f38d2_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 617858,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn7/5646918b00554a96af40b450ab9beb84/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70d28a39-7d55-5056-a7c7-6b8c7e7f38d2/70d28a39-7d55-5056-a7c7-6b8c7e7f38d2_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 690843,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn7/5646918b00554a96af40b450ab9beb84/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70d28a39-7d55-5056-a7c7-6b8c7e7f38d2/70d28a39-7d55-5056-a7c7-6b8c7e7f38d2_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 681605,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn7/5646918b00554a96af40b450ab9beb84/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70d28a39-7d55-5056-a7c7-6b8c7e7f38d2/70d28a39-7d55-5056-a7c7-6b8c7e7f38d2_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 683809,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn7/5646918b00554a96af40b450ab9beb84/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70d28a39-7d55-5056-a7c7-6b8c7e7f38d2/70d28a39-7d55-5056-a7c7-6b8c7e7f38d2_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 603951,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn7/5646918b00554a96af40b450ab9beb84/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70d28a39-7d55-5056-a7c7-6b8c7e7f38d2/70d28a39-7d55-5056-a7c7-6b8c7e7f38d2_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 491611,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn7/5646918b00554a96af40b450ab9beb84/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70d28a39-7d55-5056-a7c7-6b8c7e7f38d2/70d28a39-7d55-5056-a7c7-6b8c7e7f38d2_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 548230,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn7/5646918b00554a96af40b450ab9beb84/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70d28a39-7d55-5056-a7c7-6b8c7e7f38d2/70d28a39-7d55-5056-a7c7-6b8c7e7f38d2_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 599200,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn7/5646918b00554a96af40b450ab9beb84/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70d28a39-7d55-5056-a7c7-6b8c7e7f38d2/70d28a39-7d55-5056-a7c7-6b8c7e7f38d2_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 520408,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn7/5646918b00554a96af40b450ab9beb84/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-04-26',
'seats_number': 5,
'seller_name': None,
'title': 'SKODA SKODA OCTAVIA WAGON 2.0 TDI EVO 85KW EXECUTIVE DSG SW 5-door '
'(Euro 6D) -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2023}
2026-03-25 16:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983674%27 HTTP/1.1" 200 None
2026-03-25 16:34:52 [ayvens.it] INFO: Saving data for 1983674: {'created_time': 1774456492.041047, 'last_price_update_time': 1774456492.041059, 'auction_closing_time': 1774603800.0}
2026-03-25 16:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1983674') HTTP/1.1" 204 0
2026-03-25 16:34:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg3/17d374c5b78f4ca59db1e2322ca2970c/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:52 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.aldcarmarket.com/graphql/saleevents> (referer: https://carmarket.ayvens.com/) ['zyte-api']
2026-03-25 16:34:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34d7408990>
2026-03-25 16:34:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31fda52f-41b5-528c-adac-ee5ddf246cc3/31fda52f-41b5-528c-adac-ee5ddf246cc3_image_7.jpg HTTP/1.1" 201 0
2026-03-25 16:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg2%252Fda7950026aec40899c50024af66b03ec%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg2/da7950026aec40899c50024af66b03ec/images/large/8.jpg saved to cache
2026-03-25 16:34:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 31fda52f-41b5-528c-adac-ee5ddf246cc3
2026-03-25 16:34:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fr3/d72558ea9df14d929ad8c8f59a924428/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg3/17d374c5b78f4ca59db1e2322ca2970c/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg3/17d374c5b78f4ca59db1e2322ca2970c/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcb1f510>
2026-03-25 16:34:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8e8e5ae-58c5-56ed-b243-0b0849880e37/b8e8e5ae-58c5-56ed-b243-0b0849880e37_image_8.jpg HTTP/1.1" 201 0
2026-03-25 16:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg3%252F17d374c5b78f4ca59db1e2322ca2970c%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg3/17d374c5b78f4ca59db1e2322ca2970c/images/large/9.jpg saved to cache
2026-03-25 16:34:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b8e8e5ae-58c5-56ed-b243-0b0849880e37
2026-03-25 16:34:52 [ayvens.it] INFO: Found listing with ID: 1979664
2026-03-25 16:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979664%27 HTTP/1.1" 200 None
2026-03-25 16:34:52 [ayvens.it] INFO: Scrape type for 1979664: 2
2026-03-25 16:34:52 [ayvens.it] INFO: Extracting data for car ID: 1979664
2026-03-25 16:34:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fdd407b6-8e91-5c73-9da7-3cc29a52df4c with identifier: 1979664
2026-03-25 16:34:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fdd407b6-8e91-5c73-9da7-3cc29a52df4c with scrape type 2
2026-03-25 16:34:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fdd407b6-8e91-5c73-9da7-3cc29a52df4c with scrape type 2
2026-03-25 16:34:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: fdd407b6-8e91-5c73-9da7-3cc29a52df4c, identifier: 1979664
2026-03-25 16:34:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh2/56eeed8b3b9d4a6a8f5c37bca9b77f37/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh2/56eeed8b3b9d4a6a8f5c37bca9b77f37/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh2/56eeed8b3b9d4a6a8f5c37bca9b77f37/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg2/da7950026aec40899c50024af66b03ec/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: fdd407b6-8e91-5c73-9da7-3cc29a52df4c with identifier: 1979664
2026-03-25 16:34:52 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:34:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: fdd407b6-8e91-5c73-9da7-3cc29a52df4c with identifier: 1979664
2026-03-25 16:34:52 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: fdd407b6-8e91-5c73-9da7-3cc29a52df4c with identifier: 1979664 to the API
2026-03-25 16:34:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:34:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:34:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Unknown',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-26T09:30:00Z',
'fuel_type': 'diesel',
'id': 'fdd407b6-8e91-5c73-9da7-3cc29a52df4c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40968',
'listing': 'auction',
'location': None,
'make': 'LAND ROVER',
'model': 'LAND ROVER DISCOVERY SPORT 2.0 TD4 163cv S 4WD aut. Sport utility '
'vehicle 5-door (Euro 6D)',
'odometer': 49382,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-02-22',
'seats_number': 5,
'seller_name': None,
'title': 'LAND ROVER LAND ROVER DISCOVERY SPORT 2.0 TD4 163cv S 4WD aut. '
'Sport utility vehicle 5-door (Euro 6D) -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2021}
2026-03-25 16:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979664%27 HTTP/1.1" 200 None
2026-03-25 16:34:52 [ayvens.it] INFO: Saving data for 1979664: {'auction_closing_time': 1774517400.0, 'created_time': 1774369871.419385, 'last_price_update_time': 1774456492.885111}
2026-03-25 16:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1979664') HTTP/1.1" 204 0
2026-03-25 16:34:52 [ayvens.it] INFO: Found listing with ID: 1979665
2026-03-25 16:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979665%27 HTTP/1.1" 200 None
2026-03-25 16:34:52 [ayvens.it] INFO: Scrape type for 1979665: 2
2026-03-25 16:34:52 [ayvens.it] INFO: Extracting data for car ID: 1979665
2026-03-25 16:34:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 46cbf40b-05e5-549a-9854-2629ad765fd1 with identifier: 1979665
2026-03-25 16:34:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 46cbf40b-05e5-549a-9854-2629ad765fd1 with scrape type 2
2026-03-25 16:34:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 46cbf40b-05e5-549a-9854-2629ad765fd1 with scrape type 2
2026-03-25 16:34:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 46cbf40b-05e5-549a-9854-2629ad765fd1, identifier: 1979665
2026-03-25 16:34:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 46cbf40b-05e5-549a-9854-2629ad765fd1 with identifier: 1979665
2026-03-25 16:34:53 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:34:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 46cbf40b-05e5-549a-9854-2629ad765fd1 with identifier: 1979665
2026-03-25 16:34:53 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 46cbf40b-05e5-549a-9854-2629ad765fd1 with identifier: 1979665 to the API
2026-03-25 16:34:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:34:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:34:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'BIANCO FROZEN PASTELLO',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-26T09:30:00Z',
'fuel_type': 'diesel',
'id': '46cbf40b-05e5-549a-9854-2629ad765fd1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40968',
'listing': 'auction',
'location': None,
'make': 'FORD',
'model': 'FORD KUGA 1.5 ECOBLUE 120CV 2WD TITANIUM BUS. AUTO FP',
'odometer': 139421,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-01-12',
'seats_number': 5,
'seller_name': None,
'title': 'FORD FORD KUGA 1.5 ECOBLUE 120CV 2WD TITANIUM BUS. AUTO FP -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-25 16:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979665%27 HTTP/1.1" 200 None
2026-03-25 16:34:53 [ayvens.it] INFO: Saving data for 1979665: {'auction_closing_time': 1774517400.0, 'created_time': 1774369873.597955, 'last_price_update_time': 1774456493.274035}
2026-03-25 16:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1979665') HTTP/1.1" 204 0
2026-03-25 16:34:53 [ayvens.it] INFO: Found listing with ID: 1979666
2026-03-25 16:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979666%27 HTTP/1.1" 200 None
2026-03-25 16:34:53 [ayvens.it] INFO: Scrape type for 1979666: 2
2026-03-25 16:34:53 [ayvens.it] INFO: Extracting data for car ID: 1979666
2026-03-25 16:34:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 523c4658-2ff6-53f3-8e8a-a9a6db1a9018 with identifier: 1979666
2026-03-25 16:34:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 523c4658-2ff6-53f3-8e8a-a9a6db1a9018 with scrape type 2
2026-03-25 16:34:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 523c4658-2ff6-53f3-8e8a-a9a6db1a9018 with scrape type 2
2026-03-25 16:34:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 523c4658-2ff6-53f3-8e8a-a9a6db1a9018, identifier: 1979666
2026-03-25 16:34:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 523c4658-2ff6-53f3-8e8a-a9a6db1a9018 with identifier: 1979666
2026-03-25 16:34:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 523c4658-2ff6-53f3-8e8a-a9a6db1a9018 with identifier: 1979666
2026-03-25 16:34:53 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 523c4658-2ff6-53f3-8e8a-a9a6db1a9018 with identifier: 1979666 to the API
2026-03-25 16:34:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:34:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:34:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'FROZEN WHITE',
'currency': 'EUR',
'doors_number': 2,
'engine': '2.0L',
'expiration_date': '2026-03-26T09:30:00Z',
'fuel_type': 'diesel',
'id': '523c4658-2ff6-53f3-8e8a-a9a6db1a9018',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40968',
'listing': 'auction',
'location': None,
'make': 'FORD',
'model': 'FORD TRANSIT CAB(PC) T/P 350 L3 ENTRY 2.0 ECO HDT 170 CV FP',
'odometer': 69366,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-11-05',
'seats_number': 5,
'seller_name': None,
'title': 'FORD FORD TRANSIT CAB(PC) T/P 350 L3 ENTRY 2.0 ECO HDT 170 CV FP -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2021}
2026-03-25 16:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979666%27 HTTP/1.1" 200 None
2026-03-25 16:34:53 [ayvens.it] INFO: Saving data for 1979666: {'auction_closing_time': 1774517400.0, 'created_time': 1774369874.35207, 'last_price_update_time': 1774456493.627197}
2026-03-25 16:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1979666') HTTP/1.1" 204 0
2026-03-25 16:34:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcab1350>
2026-03-25 16:34:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a3cf1e0-c603-5088-a070-cc10ecd542d6/6a3cf1e0-c603-5088-a070-cc10ecd542d6_image_8.jpg HTTP/1.1" 201 0
2026-03-25 16:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr3%252Fd72558ea9df14d929ad8c8f59a924428%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr3/d72558ea9df14d929ad8c8f59a924428/images/large/9.jpg saved to cache
2026-03-25 16:34:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6a3cf1e0-c603-5088-a070-cc10ecd542d6
2026-03-25 16:34:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6a3cf1e0-c603-5088-a070-cc10ecd542d6, skipping ID generation
2026-03-25 16:34:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6a3cf1e0-c603-5088-a070-cc10ecd542d6 with scrape type 1
2026-03-25 16:34:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6a3cf1e0-c603-5088-a070-cc10ecd542d6 sending to next pipeline
2026-03-25 16:34:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 6a3cf1e0-c603-5088-a070-cc10ecd542d6, identifier: 1983670
2026-03-25 16:34:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc5ce5d0>
2026-03-25 16:34:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8e8e5ae-58c5-56ed-b243-0b0849880e37/b8e8e5ae-58c5-56ed-b243-0b0849880e37_image_6.jpg HTTP/1.1" 201 0
2026-03-25 16:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg3%252F17d374c5b78f4ca59db1e2322ca2970c%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg3/17d374c5b78f4ca59db1e2322ca2970c/images/large/7.jpg saved to cache
2026-03-25 16:34:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b8e8e5ae-58c5-56ed-b243-0b0849880e37
2026-03-25 16:34:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcb85c90>
2026-03-25 16:34:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8e8e5ae-58c5-56ed-b243-0b0849880e37/b8e8e5ae-58c5-56ed-b243-0b0849880e37_image_7.jpg HTTP/1.1" 201 0
2026-03-25 16:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg3%252F17d374c5b78f4ca59db1e2322ca2970c%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg3/17d374c5b78f4ca59db1e2322ca2970c/images/large/8.jpg saved to cache
2026-03-25 16:34:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b8e8e5ae-58c5-56ed-b243-0b0849880e37
2026-03-25 16:34:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b8e8e5ae-58c5-56ed-b243-0b0849880e37, skipping ID generation
2026-03-25 16:34:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b8e8e5ae-58c5-56ed-b243-0b0849880e37 with scrape type 1
2026-03-25 16:34:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b8e8e5ae-58c5-56ed-b243-0b0849880e37 sending to next pipeline
2026-03-25 16:34:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: b8e8e5ae-58c5-56ed-b243-0b0849880e37, identifier: 1983668
2026-03-25 16:34:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34d7d7da90>
2026-03-25 16:34:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b1df8d54-cdbd-5f69-a039-031b5f633052/b1df8d54-cdbd-5f69-a039-031b5f633052_image_8.jpg HTTP/1.1" 201 0
2026-03-25 16:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh2%252F56eeed8b3b9d4a6a8f5c37bca9b77f37%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh2/56eeed8b3b9d4a6a8f5c37bca9b77f37/images/large/9.jpg saved to cache
2026-03-25 16:34:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b1df8d54-cdbd-5f69-a039-031b5f633052
2026-03-25 16:34:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc5ea810>
2026-03-25 16:34:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b1df8d54-cdbd-5f69-a039-031b5f633052/b1df8d54-cdbd-5f69-a039-031b5f633052_image_6.jpg HTTP/1.1" 201 0
2026-03-25 16:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh2%252F56eeed8b3b9d4a6a8f5c37bca9b77f37%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh2/56eeed8b3b9d4a6a8f5c37bca9b77f37/images/large/7.jpg saved to cache
2026-03-25 16:34:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b1df8d54-cdbd-5f69-a039-031b5f633052
2026-03-25 16:34:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc992110>
2026-03-25 16:34:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b1df8d54-cdbd-5f69-a039-031b5f633052/b1df8d54-cdbd-5f69-a039-031b5f633052_image_7.jpg HTTP/1.1" 201 0
2026-03-25 16:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh2%252F56eeed8b3b9d4a6a8f5c37bca9b77f37%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh2/56eeed8b3b9d4a6a8f5c37bca9b77f37/images/large/8.jpg saved to cache
2026-03-25 16:34:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b1df8d54-cdbd-5f69-a039-031b5f633052
2026-03-25 16:34:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b1df8d54-cdbd-5f69-a039-031b5f633052, skipping ID generation
2026-03-25 16:34:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b1df8d54-cdbd-5f69-a039-031b5f633052 with scrape type 1
2026-03-25 16:34:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b1df8d54-cdbd-5f69-a039-031b5f633052 sending to next pipeline
2026-03-25 16:34:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: b1df8d54-cdbd-5f69-a039-031b5f633052, identifier: 1983669
2026-03-25 16:34:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc301910>
2026-03-25 16:34:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31fda52f-41b5-528c-adac-ee5ddf246cc3/31fda52f-41b5-528c-adac-ee5ddf246cc3_image_6.jpg HTTP/1.1" 201 0
2026-03-25 16:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg2%252Fda7950026aec40899c50024af66b03ec%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg2/da7950026aec40899c50024af66b03ec/images/large/7.jpg saved to cache
2026-03-25 16:34:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 31fda52f-41b5-528c-adac-ee5ddf246cc3
2026-03-25 16:34:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 31fda52f-41b5-528c-adac-ee5ddf246cc3, skipping ID generation
2026-03-25 16:34:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 31fda52f-41b5-528c-adac-ee5ddf246cc3 with scrape type 1
2026-03-25 16:34:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 31fda52f-41b5-528c-adac-ee5ddf246cc3 sending to next pipeline
2026-03-25 16:34:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 31fda52f-41b5-528c-adac-ee5ddf246cc3, identifier: 1983667
2026-03-25 16:34:54 [ayvens.it] INFO: Found listing with ID: 1979667
2026-03-25 16:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979667%27 HTTP/1.1" 200 None
2026-03-25 16:34:54 [ayvens.it] INFO: Scrape type for 1979667: 2
2026-03-25 16:34:54 [ayvens.it] INFO: Extracting data for car ID: 1979667
2026-03-25 16:34:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ac951d4a-3e73-5724-a425-274b2b948c8d with identifier: 1979667
2026-03-25 16:34:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ac951d4a-3e73-5724-a425-274b2b948c8d with scrape type 2
2026-03-25 16:34:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ac951d4a-3e73-5724-a425-274b2b948c8d with scrape type 2
2026-03-25 16:34:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: ac951d4a-3e73-5724-a425-274b2b948c8d, identifier: 1979667
2026-03-25 16:34:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 6a3cf1e0-c603-5088-a070-cc10ecd542d6 with identifier: 1983670
2026-03-25 16:34:54 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:34:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 6a3cf1e0-c603-5088-a070-cc10ecd542d6 with identifier: 1983670
2026-03-25 16:34:54 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 6a3cf1e0-c603-5088-a070-cc10ecd542d6 with identifier: 1983670 to the API
2026-03-25 16:34:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:34:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:34:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fr3/d72558ea9df14d929ad8c8f59a924428/images/large/9.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Quantum Gray',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.4L',
'expiration_date': '2026-03-27T09:30:00Z',
'fuel_type': 'petrol_lpg',
'id': '6a3cf1e0-c603-5088-a070-cc10ecd542d6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41025',
'listing': 'auction',
'location': None,
'make': 'OPEL',
'model': 'OPEL MOKKA X 1.4T Advance GPL-Tech 140cv 4x2 MT6 Sport utility '
'vehicle 5-door',
'odometer': 82527,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 52,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a3cf1e0-c603-5088-a070-cc10ecd542d6/6a3cf1e0-c603-5088-a070-cc10ecd542d6_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 658592,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fr3/d72558ea9df14d929ad8c8f59a924428/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a3cf1e0-c603-5088-a070-cc10ecd542d6/6a3cf1e0-c603-5088-a070-cc10ecd542d6_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 681144,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fr3/d72558ea9df14d929ad8c8f59a924428/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a3cf1e0-c603-5088-a070-cc10ecd542d6/6a3cf1e0-c603-5088-a070-cc10ecd542d6_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 658592,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fr3/d72558ea9df14d929ad8c8f59a924428/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a3cf1e0-c603-5088-a070-cc10ecd542d6/6a3cf1e0-c603-5088-a070-cc10ecd542d6_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 671674,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fr3/d72558ea9df14d929ad8c8f59a924428/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a3cf1e0-c603-5088-a070-cc10ecd542d6/6a3cf1e0-c603-5088-a070-cc10ecd542d6_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 716301,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fr3/d72558ea9df14d929ad8c8f59a924428/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a3cf1e0-c603-5088-a070-cc10ecd542d6/6a3cf1e0-c603-5088-a070-cc10ecd542d6_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 580912,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fr3/d72558ea9df14d929ad8c8f59a924428/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a3cf1e0-c603-5088-a070-cc10ecd542d6/6a3cf1e0-c603-5088-a070-cc10ecd542d6_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 513108,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fr3/d72558ea9df14d929ad8c8f59a924428/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a3cf1e0-c603-5088-a070-cc10ecd542d6/6a3cf1e0-c603-5088-a070-cc10ecd542d6_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 500715,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fr3/d72558ea9df14d929ad8c8f59a924428/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a3cf1e0-c603-5088-a070-cc10ecd542d6/6a3cf1e0-c603-5088-a070-cc10ecd542d6_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 629903,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fr3/d72558ea9df14d929ad8c8f59a924428/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a3cf1e0-c603-5088-a070-cc10ecd542d6/6a3cf1e0-c603-5088-a070-cc10ecd542d6_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 592888,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fr3/d72558ea9df14d929ad8c8f59a924428/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-06-29',
'seats_number': 5,
'seller_name': None,
'title': 'OPEL OPEL MOKKA X 1.4T Advance GPL-Tech 140cv 4x2 MT6 Sport utility '
'vehicle 5-door -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2018}
2026-03-25 16:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983670%27 HTTP/1.1" 200 None
2026-03-25 16:34:55 [ayvens.it] INFO: Saving data for 1983670: {'created_time': 1774456495.821402, 'last_price_update_time': 1774456495.821413, 'auction_closing_time': 1774603800.0}
2026-03-25 16:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1983670') HTTP/1.1" 204 0
2026-03-25 16:34:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: b8e8e5ae-58c5-56ed-b243-0b0849880e37 with identifier: 1983668
2026-03-25 16:34:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: b8e8e5ae-58c5-56ed-b243-0b0849880e37 with identifier: 1983668
2026-03-25 16:34:55 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: b8e8e5ae-58c5-56ed-b243-0b0849880e37 with identifier: 1983668 to the API
2026-03-25 16:34:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:34:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:34:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gg3/17d374c5b78f4ca59db1e2322ca2970c/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Bianco Gelato pastello',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.4L',
'expiration_date': '2026-03-27T09:30:00Z',
'fuel_type': 'petrol',
'id': 'b8e8e5ae-58c5-56ed-b243-0b0849880e37',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41025',
'listing': 'auction',
'location': None,
'make': 'FIAT',
'model': 'FIAT 500L 1.4 95cv S&S Cross Mini mpv 5-door (Euro 6D)',
'odometer': 151369,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 49,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8e8e5ae-58c5-56ed-b243-0b0849880e37/b8e8e5ae-58c5-56ed-b243-0b0849880e37_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 561289,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg3/17d374c5b78f4ca59db1e2322ca2970c/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8e8e5ae-58c5-56ed-b243-0b0849880e37/b8e8e5ae-58c5-56ed-b243-0b0849880e37_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 565260,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg3/17d374c5b78f4ca59db1e2322ca2970c/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8e8e5ae-58c5-56ed-b243-0b0849880e37/b8e8e5ae-58c5-56ed-b243-0b0849880e37_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 561289,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg3/17d374c5b78f4ca59db1e2322ca2970c/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8e8e5ae-58c5-56ed-b243-0b0849880e37/b8e8e5ae-58c5-56ed-b243-0b0849880e37_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 650624,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg3/17d374c5b78f4ca59db1e2322ca2970c/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8e8e5ae-58c5-56ed-b243-0b0849880e37/b8e8e5ae-58c5-56ed-b243-0b0849880e37_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 611288,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg3/17d374c5b78f4ca59db1e2322ca2970c/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8e8e5ae-58c5-56ed-b243-0b0849880e37/b8e8e5ae-58c5-56ed-b243-0b0849880e37_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 496553,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg3/17d374c5b78f4ca59db1e2322ca2970c/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8e8e5ae-58c5-56ed-b243-0b0849880e37/b8e8e5ae-58c5-56ed-b243-0b0849880e37_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 425249,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg3/17d374c5b78f4ca59db1e2322ca2970c/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8e8e5ae-58c5-56ed-b243-0b0849880e37/b8e8e5ae-58c5-56ed-b243-0b0849880e37_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 499322,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg3/17d374c5b78f4ca59db1e2322ca2970c/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8e8e5ae-58c5-56ed-b243-0b0849880e37/b8e8e5ae-58c5-56ed-b243-0b0849880e37_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 499109,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg3/17d374c5b78f4ca59db1e2322ca2970c/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8e8e5ae-58c5-56ed-b243-0b0849880e37/b8e8e5ae-58c5-56ed-b243-0b0849880e37_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 397955,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg3/17d374c5b78f4ca59db1e2322ca2970c/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-07-28',
'seats_number': 5,
'seller_name': None,
'title': 'FIAT FIAT 500L 1.4 95cv S&S Cross Mini mpv 5-door (Euro 6D) -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2021}
2026-03-25 16:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983668%27 HTTP/1.1" 200 None
2026-03-25 16:34:56 [ayvens.it] INFO: Saving data for 1983668: {'created_time': 1774456496.172233, 'last_price_update_time': 1774456496.172245, 'auction_closing_time': 1774603800.0}
2026-03-25 16:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1983668') HTTP/1.1" 204 0
2026-03-25 16:34:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: b1df8d54-cdbd-5f69-a039-031b5f633052 with identifier: 1983669
2026-03-25 16:34:56 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:34:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: b1df8d54-cdbd-5f69-a039-031b5f633052 with identifier: 1983669
2026-03-25 16:34:56 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: b1df8d54-cdbd-5f69-a039-031b5f633052 with identifier: 1983669 to the API
2026-03-25 16:34:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:34:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:34:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gh2/56eeed8b3b9d4a6a8f5c37bca9b77f37/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'GRIGIO PLATINUM MTZ',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-27T09:30:00Z',
'fuel_type': 'diesel',
'id': 'b1df8d54-cdbd-5f69-a039-031b5f633052',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41025',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': 'PEUGEOT 2008 (PC) BLUEHDI 130 EAT8 ALLURE PACK S/S AUT. FP',
'odometer': 131178,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 28,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b1df8d54-cdbd-5f69-a039-031b5f633052/b1df8d54-cdbd-5f69-a039-031b5f633052_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 862695,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh2/56eeed8b3b9d4a6a8f5c37bca9b77f37/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b1df8d54-cdbd-5f69-a039-031b5f633052/b1df8d54-cdbd-5f69-a039-031b5f633052_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 816998,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh2/56eeed8b3b9d4a6a8f5c37bca9b77f37/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b1df8d54-cdbd-5f69-a039-031b5f633052/b1df8d54-cdbd-5f69-a039-031b5f633052_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 862695,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh2/56eeed8b3b9d4a6a8f5c37bca9b77f37/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b1df8d54-cdbd-5f69-a039-031b5f633052/b1df8d54-cdbd-5f69-a039-031b5f633052_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 792507,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh2/56eeed8b3b9d4a6a8f5c37bca9b77f37/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b1df8d54-cdbd-5f69-a039-031b5f633052/b1df8d54-cdbd-5f69-a039-031b5f633052_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 811131,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh2/56eeed8b3b9d4a6a8f5c37bca9b77f37/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b1df8d54-cdbd-5f69-a039-031b5f633052/b1df8d54-cdbd-5f69-a039-031b5f633052_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 674540,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh2/56eeed8b3b9d4a6a8f5c37bca9b77f37/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b1df8d54-cdbd-5f69-a039-031b5f633052/b1df8d54-cdbd-5f69-a039-031b5f633052_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 536310,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh2/56eeed8b3b9d4a6a8f5c37bca9b77f37/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b1df8d54-cdbd-5f69-a039-031b5f633052/b1df8d54-cdbd-5f69-a039-031b5f633052_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 560232,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh2/56eeed8b3b9d4a6a8f5c37bca9b77f37/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b1df8d54-cdbd-5f69-a039-031b5f633052/b1df8d54-cdbd-5f69-a039-031b5f633052_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 705693,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh2/56eeed8b3b9d4a6a8f5c37bca9b77f37/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b1df8d54-cdbd-5f69-a039-031b5f633052/b1df8d54-cdbd-5f69-a039-031b5f633052_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 674849,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh2/56eeed8b3b9d4a6a8f5c37bca9b77f37/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-12-28',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT PEUGEOT 2008 (PC) BLUEHDI 130 EAT8 ALLURE PACK S/S AUT. FP '
'-',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2021}
2026-03-25 16:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983669%27 HTTP/1.1" 200 None
2026-03-25 16:34:56 [ayvens.it] INFO: Saving data for 1983669: {'created_time': 1774456496.534379, 'last_price_update_time': 1774456496.53439, 'auction_closing_time': 1774603800.0}
2026-03-25 16:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1983669') HTTP/1.1" 204 0
2026-03-25 16:34:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 31fda52f-41b5-528c-adac-ee5ddf246cc3 with identifier: 1983667
2026-03-25 16:34:56 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:34:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 31fda52f-41b5-528c-adac-ee5ddf246cc3 with identifier: 1983667
2026-03-25 16:34:56 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 31fda52f-41b5-528c-adac-ee5ddf246cc3 with identifier: 1983667 to the API
2026-03-25 16:34:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:34:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:34:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gg2/da7950026aec40899c50024af66b03ec/images/large/7.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Clear White',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-27T09:30:00Z',
'fuel_type': 'petrol',
'id': '31fda52f-41b5-528c-adac-ee5ddf246cc3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41025',
'listing': 'auction',
'location': None,
'make': 'KIA',
'model': 'KIA PICANTO 1.0 STYLE Hatchback 5-door (Euro 6D)',
'odometer': 151609,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 19,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31fda52f-41b5-528c-adac-ee5ddf246cc3/31fda52f-41b5-528c-adac-ee5ddf246cc3_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 741894,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg2/da7950026aec40899c50024af66b03ec/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31fda52f-41b5-528c-adac-ee5ddf246cc3/31fda52f-41b5-528c-adac-ee5ddf246cc3_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 723411,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg2/da7950026aec40899c50024af66b03ec/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31fda52f-41b5-528c-adac-ee5ddf246cc3/31fda52f-41b5-528c-adac-ee5ddf246cc3_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 741894,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg2/da7950026aec40899c50024af66b03ec/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31fda52f-41b5-528c-adac-ee5ddf246cc3/31fda52f-41b5-528c-adac-ee5ddf246cc3_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 742021,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg2/da7950026aec40899c50024af66b03ec/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31fda52f-41b5-528c-adac-ee5ddf246cc3/31fda52f-41b5-528c-adac-ee5ddf246cc3_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 611930,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg2/da7950026aec40899c50024af66b03ec/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31fda52f-41b5-528c-adac-ee5ddf246cc3/31fda52f-41b5-528c-adac-ee5ddf246cc3_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 607123,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg2/da7950026aec40899c50024af66b03ec/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31fda52f-41b5-528c-adac-ee5ddf246cc3/31fda52f-41b5-528c-adac-ee5ddf246cc3_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 509405,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg2/da7950026aec40899c50024af66b03ec/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31fda52f-41b5-528c-adac-ee5ddf246cc3/31fda52f-41b5-528c-adac-ee5ddf246cc3_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 514608,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg2/da7950026aec40899c50024af66b03ec/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31fda52f-41b5-528c-adac-ee5ddf246cc3/31fda52f-41b5-528c-adac-ee5ddf246cc3_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 660151,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg2/da7950026aec40899c50024af66b03ec/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31fda52f-41b5-528c-adac-ee5ddf246cc3/31fda52f-41b5-528c-adac-ee5ddf246cc3_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 562934,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg2/da7950026aec40899c50024af66b03ec/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-08-31',
'seats_number': 5,
'seller_name': None,
'title': 'KIA KIA PICANTO 1.0 STYLE Hatchback 5-door (Euro 6D) -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2021}
2026-03-25 16:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983667%27 HTTP/1.1" 200 None
2026-03-25 16:34:56 [ayvens.it] INFO: Saving data for 1983667: {'created_time': 1774456496.934967, 'last_price_update_time': 1774456496.934978, 'auction_closing_time': 1774603800.0}
2026-03-25 16:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1983667') HTTP/1.1" 204 0
2026-03-25 16:34:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fs0/cb1c7ac744f546198ae6809fd01b55c6/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: ac951d4a-3e73-5724-a425-274b2b948c8d with identifier: 1979667
2026-03-25 16:34:56 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:34:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: ac951d4a-3e73-5724-a425-274b2b948c8d with identifier: 1979667
2026-03-25 16:34:57 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: ac951d4a-3e73-5724-a425-274b2b948c8d with identifier: 1979667 to the API
2026-03-25 16:34:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:34:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:34:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'ORYX WHITE PERLA',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-26T09:30:00Z',
'fuel_type': 'diesel',
'id': 'ac951d4a-3e73-5724-a425-274b2b948c8d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40968',
'listing': 'auction',
'location': None,
'make': 'VOLKSWAGEN',
'model': 'VOLKSWAGEN PASSAT SW VAR. 2.0TDI SCR 147KW 4MOT EXECUTIVE DSG FP',
'odometer': 154742,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-02-16',
'seats_number': 5,
'seller_name': None,
'title': 'VOLKSWAGEN VOLKSWAGEN PASSAT SW VAR. 2.0TDI SCR 147KW 4MOT '
'EXECUTIVE DSG FP -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-25 16:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979667%27 HTTP/1.1" 200 None
2026-03-25 16:34:57 [ayvens.it] INFO: Saving data for 1979667: {'auction_closing_time': 1774517400.0, 'created_time': 1774369876.88547, 'last_price_update_time': 1774456497.540253}
2026-03-25 16:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1979667') HTTP/1.1" 204 0
2026-03-25 16:34:57 [ayvens.it] INFO: Found listing with ID: 1979668
2026-03-25 16:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979668%27 HTTP/1.1" 200 None
2026-03-25 16:34:57 [ayvens.it] INFO: Scrape type for 1979668: 2
2026-03-25 16:34:57 [ayvens.it] INFO: Extracting data for car ID: 1979668
2026-03-25 16:34:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c0ac7eb2-00f9-5086-8d5c-1d2b605b2481 with identifier: 1979668
2026-03-25 16:34:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c0ac7eb2-00f9-5086-8d5c-1d2b605b2481 with scrape type 2
2026-03-25 16:34:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c0ac7eb2-00f9-5086-8d5c-1d2b605b2481 with scrape type 2
2026-03-25 16:34:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: c0ac7eb2-00f9-5086-8d5c-1d2b605b2481, identifier: 1979668
2026-03-25 16:34:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: c0ac7eb2-00f9-5086-8d5c-1d2b605b2481 with identifier: 1979668
2026-03-25 16:34:57 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:34:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: c0ac7eb2-00f9-5086-8d5c-1d2b605b2481 with identifier: 1979668
2026-03-25 16:34:57 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: c0ac7eb2-00f9-5086-8d5c-1d2b605b2481 with identifier: 1979668 to the API
2026-03-25 16:34:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:34:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:34:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Deep Black perla',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-26T09:30:00Z',
'fuel_type': 'diesel',
'id': 'c0ac7eb2-00f9-5086-8d5c-1d2b605b2481',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40968',
'listing': 'auction',
'location': None,
'make': 'VOLKSWAGEN',
'model': 'VOLKSWAGEN TIGUAN 2.0 TDI SCR 110KW R-Line DSG 4MOTION Sport '
'utility vehicle 5-door (Euro 6D)',
'odometer': 100081,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-12-27',
'seats_number': 5,
'seller_name': None,
'title': 'VOLKSWAGEN VOLKSWAGEN TIGUAN 2.0 TDI SCR 110KW R-Line DSG 4MOTION '
'Sport utility vehicle 5-door (Euro 6D) -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2021}
2026-03-25 16:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979668%27 HTTP/1.1" 200 None
2026-03-25 16:34:57 [ayvens.it] INFO: Saving data for 1979668: {'auction_closing_time': 1774517400.0, 'created_time': 1774369878.072454, 'last_price_update_time': 1774456497.901634}
2026-03-25 16:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1979668') HTTP/1.1" 204 0
2026-03-25 16:34:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fs0/cb1c7ac744f546198ae6809fd01b55c6/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:57 [ayvens.it] INFO: Found listing with ID: 1979669
2026-03-25 16:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979669%27 HTTP/1.1" 200 None
2026-03-25 16:34:57 [ayvens.it] INFO: Scrape type for 1979669: 2
2026-03-25 16:34:57 [ayvens.it] INFO: Extracting data for car ID: 1979669
2026-03-25 16:34:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e34919c7-0197-563b-9621-ae140ae57c39 with identifier: 1979669
2026-03-25 16:34:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e34919c7-0197-563b-9621-ae140ae57c39 with scrape type 2
2026-03-25 16:34:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e34919c7-0197-563b-9621-ae140ae57c39 with scrape type 2
2026-03-25 16:34:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: e34919c7-0197-563b-9621-ae140ae57c39, identifier: 1979669
2026-03-25 16:34:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: e34919c7-0197-563b-9621-ae140ae57c39 with identifier: 1979669
2026-03-25 16:34:58 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:34:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: e34919c7-0197-563b-9621-ae140ae57c39 with identifier: 1979669
2026-03-25 16:34:58 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: e34919c7-0197-563b-9621-ae140ae57c39 with identifier: 1979669 to the API
2026-03-25 16:34:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:34:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:34:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Nero metallizzato',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-26T09:30:00Z',
'fuel_type': 'diesel',
'id': 'e34919c7-0197-563b-9621-ae140ae57c39',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40968',
'listing': 'auction',
'location': None,
'make': 'FIAT',
'model': 'FIAT TIPO 1.6 Mjt 130cv S&S Cross Hatchback 5-door (Euro 6D)',
'odometer': 160262,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-06-24',
'seats_number': 5,
'seller_name': None,
'title': 'FIAT FIAT TIPO 1.6 Mjt 130cv S&S Cross Hatchback 5-door (Euro 6D) -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-25 16:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979669%27 HTTP/1.1" 200 None
2026-03-25 16:34:58 [ayvens.it] INFO: Saving data for 1979669: {'auction_closing_time': 1774517400.0, 'created_time': 1774369899.445356, 'last_price_update_time': 1774456498.326812}
2026-03-25 16:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1979669') HTTP/1.1" 204 0
2026-03-25 16:34:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fs0/cb1c7ac744f546198ae6809fd01b55c6/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:58 [ayvens.it] INFO: Found listing with ID: 1979670
2026-03-25 16:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979670%27 HTTP/1.1" 200 None
2026-03-25 16:34:58 [ayvens.it] INFO: Scrape type for 1979670: 2
2026-03-25 16:34:58 [ayvens.it] INFO: Extracting data for car ID: 1979670
2026-03-25 16:34:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 065cc2a8-07b5-5761-87fc-b552e83f406c with identifier: 1979670
2026-03-25 16:34:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 065cc2a8-07b5-5761-87fc-b552e83f406c with scrape type 2
2026-03-25 16:34:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 065cc2a8-07b5-5761-87fc-b552e83f406c with scrape type 2
2026-03-25 16:34:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 065cc2a8-07b5-5761-87fc-b552e83f406c, identifier: 1979670
2026-03-25 16:34:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc802310>
2026-03-25 16:34:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98901852-a29a-5770-89b6-98d8bebfa2d9/98901852-a29a-5770-89b6-98d8bebfa2d9_image_7.jpg HTTP/1.1" 201 0
2026-03-25 16:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs0%252Fcb1c7ac744f546198ae6809fd01b55c6%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs0/cb1c7ac744f546198ae6809fd01b55c6/images/large/8.jpg saved to cache
2026-03-25 16:34:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 98901852-a29a-5770-89b6-98d8bebfa2d9
2026-03-25 16:34:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf4/76d54ec0028c4979920c9adf77f12aa4/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf4/76d54ec0028c4979920c9adf77f12aa4/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg6/8c1af20d27d04e6d8afff37792e5f59b/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 065cc2a8-07b5-5761-87fc-b552e83f406c with identifier: 1979670
2026-03-25 16:34:58 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:34:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 065cc2a8-07b5-5761-87fc-b552e83f406c with identifier: 1979670
2026-03-25 16:34:58 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 065cc2a8-07b5-5761-87fc-b552e83f406c with identifier: 1979670 to the API
2026-03-25 16:34:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:34:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:34:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Smoky Grey Metall',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-26T09:30:00Z',
'fuel_type': 'petrol',
'id': '065cc2a8-07b5-5761-87fc-b552e83f406c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40968',
'listing': 'auction',
'location': None,
'make': 'VOLKSWAGEN',
'model': 'VOLKSWAGEN TAIGO 1.0 TSI 70kW Life Sport utility vehicle 5-door '
'(Euro 6D)',
'odometer': 234209,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-12-15',
'seats_number': 5,
'seller_name': None,
'title': 'VOLKSWAGEN VOLKSWAGEN TAIGO 1.0 TSI 70kW Life Sport utility vehicle '
'5-door (Euro 6D) -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-25 16:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979670%27 HTTP/1.1" 200 None
2026-03-25 16:34:58 [ayvens.it] INFO: Saving data for 1979670: {'auction_closing_time': 1774517400.0, 'created_time': 1774369900.490918, 'last_price_update_time': 1774456498.820186}
2026-03-25 16:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1979670') HTTP/1.1" 204 0
2026-03-25 16:34:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fs0/cb1c7ac744f546198ae6809fd01b55c6/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf6/8ed9c7ac58134b78bc7b5170bc6818cd/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:58 [ayvens.it] INFO: Found listing with ID: 1979671
2026-03-25 16:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979671%27 HTTP/1.1" 200 None
2026-03-25 16:34:58 [ayvens.it] INFO: Scrape type for 1979671: 2
2026-03-25 16:34:58 [ayvens.it] INFO: Extracting data for car ID: 1979671
2026-03-25 16:34:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 21a581e7-7fab-5f7f-a599-c12f52814200 with identifier: 1979671
2026-03-25 16:34:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 21a581e7-7fab-5f7f-a599-c12f52814200 with scrape type 2
2026-03-25 16:34:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 21a581e7-7fab-5f7f-a599-c12f52814200 with scrape type 2
2026-03-25 16:34:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 21a581e7-7fab-5f7f-a599-c12f52814200, identifier: 1979671
2026-03-25 16:34:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:34:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc550310>
2026-03-25 16:34:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:34:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:34:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:34:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98901852-a29a-5770-89b6-98d8bebfa2d9/98901852-a29a-5770-89b6-98d8bebfa2d9_image_6.jpg HTTP/1.1" 201 0
2026-03-25 16:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs0%252Fcb1c7ac744f546198ae6809fd01b55c6%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 16:34:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs0/cb1c7ac744f546198ae6809fd01b55c6/images/large/7.jpg saved to cache
2026-03-25 16:34:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 98901852-a29a-5770-89b6-98d8bebfa2d9
2026-03-25 16:34:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 21a581e7-7fab-5f7f-a599-c12f52814200 with identifier: 1979671
2026-03-25 16:34:59 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:34:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 21a581e7-7fab-5f7f-a599-c12f52814200 with identifier: 1979671
2026-03-25 16:34:59 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 21a581e7-7fab-5f7f-a599-c12f52814200 with identifier: 1979671 to the API
2026-03-25 16:34:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:34:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:34:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'AGATE BLACK METALLIZZATO',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-26T09:30:00Z',
'fuel_type': 'hybrid',
'id': '21a581e7-7fab-5f7f-a599-c12f52814200',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40968',
'listing': 'auction',
'location': None,
'make': 'FORD',
'model': 'FORD FIESTA (PC) 1.0 ECOBOOST HYBRID 125CV S&S TITANIUM FP',
'odometer': 50123,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-11-21',
'seats_number': 5,
'seller_name': None,
'title': 'FORD FORD FIESTA (PC) 1.0 ECOBOOST HYBRID 125CV S&S TITANIUM FP -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-25 16:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979671%27 HTTP/1.1" 200 None
2026-03-25 16:34:59 [ayvens.it] INFO: Saving data for 1979671: {'auction_closing_time': 1774517400.0, 'created_time': 1774369898.640184, 'last_price_update_time': 1774456499.376929}
2026-03-25 16:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1979671') HTTP/1.1" 204 0
2026-03-25 16:34:59 [ayvens.it] INFO: Found listing with ID: 1979672
2026-03-25 16:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979672%27 HTTP/1.1" 200 None
2026-03-25 16:34:59 [ayvens.it] INFO: Scrape type for 1979672: 2
2026-03-25 16:34:59 [ayvens.it] INFO: Extracting data for car ID: 1979672
2026-03-25 16:34:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9698408a-2e6a-58bb-bcd0-59cd4351ecdf with identifier: 1979672
2026-03-25 16:34:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9698408a-2e6a-58bb-bcd0-59cd4351ecdf with scrape type 2
2026-03-25 16:34:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9698408a-2e6a-58bb-bcd0-59cd4351ecdf with scrape type 2
2026-03-25 16:34:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 9698408a-2e6a-58bb-bcd0-59cd4351ecdf, identifier: 1979672
2026-03-25 16:34:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf2/eafd3c03ccc44a7684004a4ea91d1028/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:34:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 9698408a-2e6a-58bb-bcd0-59cd4351ecdf with identifier: 1979672
2026-03-25 16:34:59 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:34:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 9698408a-2e6a-58bb-bcd0-59cd4351ecdf with identifier: 1979672
2026-03-25 16:34:59 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 9698408a-2e6a-58bb-bcd0-59cd4351ecdf with identifier: 1979672 to the API
2026-03-25 16:34:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:35:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:35:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'PEARL BLACK PERLATO',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-26T09:30:00Z',
'fuel_type': 'diesel',
'id': '9698408a-2e6a-58bb-bcd0-59cd4351ecdf',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40968',
'listing': 'auction',
'location': None,
'make': 'CITROËN',
'model': 'CITROEN C5 AIRCROSS PC BLUEHDI 130 S&S BUSINESS EAT8 FP',
'odometer': 141735,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-06-20',
'seats_number': 5,
'seller_name': None,
'title': 'CITROËN CITROEN C5 AIRCROSS PC BLUEHDI 130 S&S BUSINESS EAT8 FP -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-25 16:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979672%27 HTTP/1.1" 200 None
2026-03-25 16:35:00 [ayvens.it] INFO: Saving data for 1979672: {'auction_closing_time': 1774517400.0, 'created_time': 1774369898.014465, 'last_price_update_time': 1774456500.148892}
2026-03-25 16:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1979672') HTTP/1.1" 204 0
2026-03-25 16:35:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:35:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dce2da90>
2026-03-25 16:35:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:35:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:35:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:35:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98901852-a29a-5770-89b6-98d8bebfa2d9/98901852-a29a-5770-89b6-98d8bebfa2d9_image_5.jpg HTTP/1.1" 201 0
2026-03-25 16:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs0%252Fcb1c7ac744f546198ae6809fd01b55c6%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 16:35:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs0/cb1c7ac744f546198ae6809fd01b55c6/images/large/6.jpg saved to cache
2026-03-25 16:35:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 98901852-a29a-5770-89b6-98d8bebfa2d9
2026-03-25 16:35:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:35:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc2fea50>
2026-03-25 16:35:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:35:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:35:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:35:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1c64b2b7-3292-556d-b32a-911ae251ed06/1c64b2b7-3292-556d-b32a-911ae251ed06_image_6.jpg HTTP/1.1" 201 0
2026-03-25 16:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf4%252F76d54ec0028c4979920c9adf77f12aa4%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 16:35:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf4/76d54ec0028c4979920c9adf77f12aa4/images/large/7.jpg saved to cache
2026-03-25 16:35:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1c64b2b7-3292-556d-b32a-911ae251ed06
2026-03-25 16:35:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:35:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcab2810>
2026-03-25 16:35:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:35:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:35:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:35:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1c64b2b7-3292-556d-b32a-911ae251ed06/1c64b2b7-3292-556d-b32a-911ae251ed06_image_8.jpg HTTP/1.1" 201 0
2026-03-25 16:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf4%252F76d54ec0028c4979920c9adf77f12aa4%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 16:35:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf4/76d54ec0028c4979920c9adf77f12aa4/images/large/9.jpg saved to cache
2026-03-25 16:35:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1c64b2b7-3292-556d-b32a-911ae251ed06
2026-03-25 16:35:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1c64b2b7-3292-556d-b32a-911ae251ed06, skipping ID generation
2026-03-25 16:35:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1c64b2b7-3292-556d-b32a-911ae251ed06 with scrape type 1
2026-03-25 16:35:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1c64b2b7-3292-556d-b32a-911ae251ed06 sending to next pipeline
2026-03-25 16:35:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 1c64b2b7-3292-556d-b32a-911ae251ed06, identifier: 1983664
2026-03-25 16:35:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:35:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34d7dac610>
2026-03-25 16:35:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:35:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:35:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:35:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00b6b2b0-0faf-513d-ba48-4d0d70ea200b/00b6b2b0-0faf-513d-ba48-4d0d70ea200b_image_7.jpg HTTP/1.1" 201 0
2026-03-25 16:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg6%252F8c1af20d27d04e6d8afff37792e5f59b%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 16:35:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg6/8c1af20d27d04e6d8afff37792e5f59b/images/large/8.jpg saved to cache
2026-03-25 16:35:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 00b6b2b0-0faf-513d-ba48-4d0d70ea200b
2026-03-25 16:35:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 00b6b2b0-0faf-513d-ba48-4d0d70ea200b, skipping ID generation
2026-03-25 16:35:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 00b6b2b0-0faf-513d-ba48-4d0d70ea200b with scrape type 1
2026-03-25 16:35:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 00b6b2b0-0faf-513d-ba48-4d0d70ea200b sending to next pipeline
2026-03-25 16:35:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 00b6b2b0-0faf-513d-ba48-4d0d70ea200b, identifier: 1983663
2026-03-25 16:35:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:35:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dca8bc50>
2026-03-25 16:35:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:35:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:35:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:35:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98901852-a29a-5770-89b6-98d8bebfa2d9/98901852-a29a-5770-89b6-98d8bebfa2d9_image_4.jpg HTTP/1.1" 201 0
2026-03-25 16:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs0%252Fcb1c7ac744f546198ae6809fd01b55c6%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 16:35:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs0/cb1c7ac744f546198ae6809fd01b55c6/images/large/5.jpg saved to cache
2026-03-25 16:35:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 98901852-a29a-5770-89b6-98d8bebfa2d9
2026-03-25 16:35:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 98901852-a29a-5770-89b6-98d8bebfa2d9, skipping ID generation
2026-03-25 16:35:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 98901852-a29a-5770-89b6-98d8bebfa2d9 with scrape type 1
2026-03-25 16:35:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 98901852-a29a-5770-89b6-98d8bebfa2d9 sending to next pipeline
2026-03-25 16:35:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 98901852-a29a-5770-89b6-98d8bebfa2d9, identifier: 1983666
2026-03-25 16:35:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:35:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dca040d0>
2026-03-25 16:35:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:35:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:35:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:35:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af67b96c-f057-57c2-9685-820d5458b52f/af67b96c-f057-57c2-9685-820d5458b52f_image_7.jpg HTTP/1.1" 201 0
2026-03-25 16:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf6%252F8ed9c7ac58134b78bc7b5170bc6818cd%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 16:35:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf6/8ed9c7ac58134b78bc7b5170bc6818cd/images/large/8.jpg saved to cache
2026-03-25 16:35:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item af67b96c-f057-57c2-9685-820d5458b52f
2026-03-25 16:35:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: af67b96c-f057-57c2-9685-820d5458b52f, skipping ID generation
2026-03-25 16:35:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item af67b96c-f057-57c2-9685-820d5458b52f with scrape type 1
2026-03-25 16:35:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item af67b96c-f057-57c2-9685-820d5458b52f sending to next pipeline
2026-03-25 16:35:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: af67b96c-f057-57c2-9685-820d5458b52f, identifier: 1983665
2026-03-25 16:35:01 [ayvens.it] INFO: Found listing with ID: 1979673
2026-03-25 16:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979673%27 HTTP/1.1" 200 None
2026-03-25 16:35:01 [ayvens.it] INFO: Scrape type for 1979673: 2
2026-03-25 16:35:01 [ayvens.it] INFO: Extracting data for car ID: 1979673
2026-03-25 16:35:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 649461ee-2cfb-5cb6-a868-bd41f4e60383 with identifier: 1979673
2026-03-25 16:35:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 649461ee-2cfb-5cb6-a868-bd41f4e60383 with scrape type 2
2026-03-25 16:35:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 649461ee-2cfb-5cb6-a868-bd41f4e60383 with scrape type 2
2026-03-25 16:35:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 649461ee-2cfb-5cb6-a868-bd41f4e60383, identifier: 1979673
2026-03-25 16:35:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 1c64b2b7-3292-556d-b32a-911ae251ed06 with identifier: 1983664
2026-03-25 16:35:01 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:35:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 1c64b2b7-3292-556d-b32a-911ae251ed06 with identifier: 1983664
2026-03-25 16:35:01 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 1c64b2b7-3292-556d-b32a-911ae251ed06 with identifier: 1983664 to the API
2026-03-25 16:35:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:35:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:35:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gf4/76d54ec0028c4979920c9adf77f12aa4/images/large/9.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'INTERSTELLAR GRAY',
'currency': 'EUR',
'doors_number': 5,
'engine': '',
'expiration_date': '2026-03-27T09:30:00Z',
'fuel_type': 'electric',
'id': '1c64b2b7-3292-556d-b32a-911ae251ed06',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41025',
'listing': 'auction',
'location': None,
'make': 'KIA',
'model': 'KIA NIRO E-NIRO 64 KWH STYLE FP',
'odometer': 87537,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 28,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1c64b2b7-3292-556d-b32a-911ae251ed06/1c64b2b7-3292-556d-b32a-911ae251ed06_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 652457,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf4/76d54ec0028c4979920c9adf77f12aa4/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1c64b2b7-3292-556d-b32a-911ae251ed06/1c64b2b7-3292-556d-b32a-911ae251ed06_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 652457,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf4/76d54ec0028c4979920c9adf77f12aa4/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1c64b2b7-3292-556d-b32a-911ae251ed06/1c64b2b7-3292-556d-b32a-911ae251ed06_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 671261,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf4/76d54ec0028c4979920c9adf77f12aa4/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1c64b2b7-3292-556d-b32a-911ae251ed06/1c64b2b7-3292-556d-b32a-911ae251ed06_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 623535,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf4/76d54ec0028c4979920c9adf77f12aa4/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1c64b2b7-3292-556d-b32a-911ae251ed06/1c64b2b7-3292-556d-b32a-911ae251ed06_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 628472,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf4/76d54ec0028c4979920c9adf77f12aa4/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1c64b2b7-3292-556d-b32a-911ae251ed06/1c64b2b7-3292-556d-b32a-911ae251ed06_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 544222,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf4/76d54ec0028c4979920c9adf77f12aa4/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1c64b2b7-3292-556d-b32a-911ae251ed06/1c64b2b7-3292-556d-b32a-911ae251ed06_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 534122,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf4/76d54ec0028c4979920c9adf77f12aa4/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1c64b2b7-3292-556d-b32a-911ae251ed06/1c64b2b7-3292-556d-b32a-911ae251ed06_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 494131,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf4/76d54ec0028c4979920c9adf77f12aa4/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1c64b2b7-3292-556d-b32a-911ae251ed06/1c64b2b7-3292-556d-b32a-911ae251ed06_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 548430,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf4/76d54ec0028c4979920c9adf77f12aa4/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1c64b2b7-3292-556d-b32a-911ae251ed06/1c64b2b7-3292-556d-b32a-911ae251ed06_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 559651,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf4/76d54ec0028c4979920c9adf77f12aa4/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-04-28',
'seats_number': 5,
'seller_name': None,
'title': 'KIA KIA NIRO E-NIRO 64 KWH STYLE FP -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2021}
2026-03-25 16:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983664%27 HTTP/1.1" 200 None
2026-03-25 16:35:01 [ayvens.it] INFO: Saving data for 1983664: {'created_time': 1774456501.755898, 'last_price_update_time': 1774456501.75591, 'auction_closing_time': 1774603800.0}
2026-03-25 16:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1983664') HTTP/1.1" 204 0
2026-03-25 16:35:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 00b6b2b0-0faf-513d-ba48-4d0d70ea200b with identifier: 1983663
2026-03-25 16:35:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 00b6b2b0-0faf-513d-ba48-4d0d70ea200b with identifier: 1983663
2026-03-25 16:35:01 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 00b6b2b0-0faf-513d-ba48-4d0d70ea200b with identifier: 1983663 to the API
2026-03-25 16:35:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:35:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:35:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gg6/8c1af20d27d04e6d8afff37792e5f59b/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'GRIGIO URANO PASTELLO',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-27T09:30:00Z',
'fuel_type': 'hybrid',
'id': '00b6b2b0-0faf-513d-ba48-4d0d70ea200b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41025',
'listing': 'auction',
'location': None,
'make': 'VOLKSWAGEN',
'model': 'VOLKSWAGEN GOLF 1.5 eTSI EVO ACT 96kW Life DSG Hatchback 5-door '
'(Euro 6.2) mild hybrid',
'odometer': 154403,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 18,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00b6b2b0-0faf-513d-ba48-4d0d70ea200b/00b6b2b0-0faf-513d-ba48-4d0d70ea200b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 824295,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg6/8c1af20d27d04e6d8afff37792e5f59b/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00b6b2b0-0faf-513d-ba48-4d0d70ea200b/00b6b2b0-0faf-513d-ba48-4d0d70ea200b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 713653,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg6/8c1af20d27d04e6d8afff37792e5f59b/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00b6b2b0-0faf-513d-ba48-4d0d70ea200b/00b6b2b0-0faf-513d-ba48-4d0d70ea200b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 824295,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg6/8c1af20d27d04e6d8afff37792e5f59b/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00b6b2b0-0faf-513d-ba48-4d0d70ea200b/00b6b2b0-0faf-513d-ba48-4d0d70ea200b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 776201,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg6/8c1af20d27d04e6d8afff37792e5f59b/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00b6b2b0-0faf-513d-ba48-4d0d70ea200b/00b6b2b0-0faf-513d-ba48-4d0d70ea200b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 773454,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg6/8c1af20d27d04e6d8afff37792e5f59b/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00b6b2b0-0faf-513d-ba48-4d0d70ea200b/00b6b2b0-0faf-513d-ba48-4d0d70ea200b_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 583478,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg6/8c1af20d27d04e6d8afff37792e5f59b/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00b6b2b0-0faf-513d-ba48-4d0d70ea200b/00b6b2b0-0faf-513d-ba48-4d0d70ea200b_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 585958,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg6/8c1af20d27d04e6d8afff37792e5f59b/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00b6b2b0-0faf-513d-ba48-4d0d70ea200b/00b6b2b0-0faf-513d-ba48-4d0d70ea200b_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 543531,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg6/8c1af20d27d04e6d8afff37792e5f59b/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00b6b2b0-0faf-513d-ba48-4d0d70ea200b/00b6b2b0-0faf-513d-ba48-4d0d70ea200b_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 635068,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg6/8c1af20d27d04e6d8afff37792e5f59b/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00b6b2b0-0faf-513d-ba48-4d0d70ea200b/00b6b2b0-0faf-513d-ba48-4d0d70ea200b_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 518659,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg6/8c1af20d27d04e6d8afff37792e5f59b/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-06-03',
'seats_number': 5,
'seller_name': None,
'title': 'VOLKSWAGEN VOLKSWAGEN GOLF 1.5 eTSI EVO ACT 96kW Life DSG Hatchback '
'5-door (Euro 6.2) mild hybrid -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2021}
2026-03-25 16:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983663%27 HTTP/1.1" 200 None
2026-03-25 16:35:02 [ayvens.it] INFO: Saving data for 1983663: {'created_time': 1774456502.150668, 'last_price_update_time': 1774456502.15068, 'auction_closing_time': 1774603800.0}
2026-03-25 16:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1983663') HTTP/1.1" 204 0
2026-03-25 16:35:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 98901852-a29a-5770-89b6-98d8bebfa2d9 with identifier: 1983666
2026-03-25 16:35:02 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:35:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 98901852-a29a-5770-89b6-98d8bebfa2d9 with identifier: 1983666
2026-03-25 16:35:02 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 98901852-a29a-5770-89b6-98d8bebfa2d9 with identifier: 1983666 to the API
2026-03-25 16:35:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:35:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:35:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fs0/cb1c7ac744f546198ae6809fd01b55c6/images/large/5.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Metal Stream Met',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.8L',
'expiration_date': '2026-03-27T09:30:00Z',
'fuel_type': 'hybrid',
'id': '98901852-a29a-5770-89b6-98d8bebfa2d9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41025',
'listing': 'auction',
'location': None,
'make': 'TOYOTA',
'model': 'TOYOTA C-HR 1.8H (122CV) E-CVT Business Sport utility vehicle '
'5-door',
'odometer': 84905,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 43,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98901852-a29a-5770-89b6-98d8bebfa2d9/98901852-a29a-5770-89b6-98d8bebfa2d9_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 780433,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs0/cb1c7ac744f546198ae6809fd01b55c6/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98901852-a29a-5770-89b6-98d8bebfa2d9/98901852-a29a-5770-89b6-98d8bebfa2d9_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 780433,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs0/cb1c7ac744f546198ae6809fd01b55c6/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98901852-a29a-5770-89b6-98d8bebfa2d9/98901852-a29a-5770-89b6-98d8bebfa2d9_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 778880,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs0/cb1c7ac744f546198ae6809fd01b55c6/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98901852-a29a-5770-89b6-98d8bebfa2d9/98901852-a29a-5770-89b6-98d8bebfa2d9_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 775143,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs0/cb1c7ac744f546198ae6809fd01b55c6/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98901852-a29a-5770-89b6-98d8bebfa2d9/98901852-a29a-5770-89b6-98d8bebfa2d9_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 764709,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs0/cb1c7ac744f546198ae6809fd01b55c6/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98901852-a29a-5770-89b6-98d8bebfa2d9/98901852-a29a-5770-89b6-98d8bebfa2d9_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 681693,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs0/cb1c7ac744f546198ae6809fd01b55c6/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98901852-a29a-5770-89b6-98d8bebfa2d9/98901852-a29a-5770-89b6-98d8bebfa2d9_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 571936,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs0/cb1c7ac744f546198ae6809fd01b55c6/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98901852-a29a-5770-89b6-98d8bebfa2d9/98901852-a29a-5770-89b6-98d8bebfa2d9_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 615666,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs0/cb1c7ac744f546198ae6809fd01b55c6/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98901852-a29a-5770-89b6-98d8bebfa2d9/98901852-a29a-5770-89b6-98d8bebfa2d9_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 694942,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs0/cb1c7ac744f546198ae6809fd01b55c6/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98901852-a29a-5770-89b6-98d8bebfa2d9/98901852-a29a-5770-89b6-98d8bebfa2d9_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 549820,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs0/cb1c7ac744f546198ae6809fd01b55c6/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-07-13',
'seats_number': 5,
'seller_name': None,
'title': 'TOYOTA TOYOTA C-HR 1.8H (122CV) E-CVT Business Sport utility '
'vehicle 5-door -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2018}
2026-03-25 16:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983666%27 HTTP/1.1" 200 None
2026-03-25 16:35:02 [ayvens.it] INFO: Saving data for 1983666: {'created_time': 1774456502.505827, 'last_price_update_time': 1774456502.505838, 'auction_closing_time': 1774603800.0}
2026-03-25 16:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1983666') HTTP/1.1" 204 0
2026-03-25 16:35:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: af67b96c-f057-57c2-9685-820d5458b52f with identifier: 1983665
2026-03-25 16:35:02 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:35:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: af67b96c-f057-57c2-9685-820d5458b52f with identifier: 1983665
2026-03-25 16:35:02 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: af67b96c-f057-57c2-9685-820d5458b52f with identifier: 1983665 to the API
2026-03-25 16:35:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:35:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:35:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gf6/8ed9c7ac58134b78bc7b5170bc6818cd/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Grigio Urano pastello',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-27T09:30:00Z',
'fuel_type': 'hybrid',
'id': 'af67b96c-f057-57c2-9685-820d5458b52f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41025',
'listing': 'auction',
'location': None,
'make': 'VOLKSWAGEN',
'model': 'VOLKSWAGEN GOLF VARIANT 1.5 eTSI EVO ACT 96kW Life DSG SW 5-door '
'(Euro 6.2) mild hybrid',
'odometer': 190531,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 26,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af67b96c-f057-57c2-9685-820d5458b52f/af67b96c-f057-57c2-9685-820d5458b52f_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 828220,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf6/8ed9c7ac58134b78bc7b5170bc6818cd/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af67b96c-f057-57c2-9685-820d5458b52f/af67b96c-f057-57c2-9685-820d5458b52f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 828220,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf6/8ed9c7ac58134b78bc7b5170bc6818cd/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af67b96c-f057-57c2-9685-820d5458b52f/af67b96c-f057-57c2-9685-820d5458b52f_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 866139,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf6/8ed9c7ac58134b78bc7b5170bc6818cd/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af67b96c-f057-57c2-9685-820d5458b52f/af67b96c-f057-57c2-9685-820d5458b52f_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 896872,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf6/8ed9c7ac58134b78bc7b5170bc6818cd/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af67b96c-f057-57c2-9685-820d5458b52f/af67b96c-f057-57c2-9685-820d5458b52f_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 861890,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf6/8ed9c7ac58134b78bc7b5170bc6818cd/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af67b96c-f057-57c2-9685-820d5458b52f/af67b96c-f057-57c2-9685-820d5458b52f_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 607436,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf6/8ed9c7ac58134b78bc7b5170bc6818cd/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af67b96c-f057-57c2-9685-820d5458b52f/af67b96c-f057-57c2-9685-820d5458b52f_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 599886,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf6/8ed9c7ac58134b78bc7b5170bc6818cd/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af67b96c-f057-57c2-9685-820d5458b52f/af67b96c-f057-57c2-9685-820d5458b52f_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 620376,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf6/8ed9c7ac58134b78bc7b5170bc6818cd/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af67b96c-f057-57c2-9685-820d5458b52f/af67b96c-f057-57c2-9685-820d5458b52f_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 627890,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf6/8ed9c7ac58134b78bc7b5170bc6818cd/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af67b96c-f057-57c2-9685-820d5458b52f/af67b96c-f057-57c2-9685-820d5458b52f_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 603660,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf6/8ed9c7ac58134b78bc7b5170bc6818cd/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-05-05',
'seats_number': 5,
'seller_name': None,
'title': 'VOLKSWAGEN VOLKSWAGEN GOLF VARIANT 1.5 eTSI EVO ACT 96kW Life DSG '
'SW 5-door (Euro 6.2) mild hybrid -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2021}
2026-03-25 16:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983665%27 HTTP/1.1" 200 None
2026-03-25 16:35:02 [ayvens.it] INFO: Saving data for 1983665: {'created_time': 1774456502.953251, 'last_price_update_time': 1774456502.953263, 'auction_closing_time': 1774603800.0}
2026-03-25 16:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1983665') HTTP/1.1" 204 0
2026-03-25 16:35:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 649461ee-2cfb-5cb6-a868-bd41f4e60383 with identifier: 1979673
2026-03-25 16:35:02 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:35:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 649461ee-2cfb-5cb6-a868-bd41f4e60383 with identifier: 1979673
2026-03-25 16:35:03 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 649461ee-2cfb-5cb6-a868-bd41f4e60383 with identifier: 1979673 to the API
2026-03-25 16:35:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:35:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:35:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'GRIGIO TITANIO METALLIZZATO',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-26T09:30:00Z',
'fuel_type': 'diesel',
'id': '649461ee-2cfb-5cb6-a868-bd41f4e60383',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40968',
'listing': 'auction',
'location': None,
'make': 'RENAULT',
'model': 'RENAULT MEGANE SW (PC) 1.5 DCI 85KW BLUE BUSINESS EDC FP',
'odometer': 168503,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-09-13',
'seats_number': 5,
'seller_name': None,
'title': 'RENAULT RENAULT MEGANE SW (PC) 1.5 DCI 85KW BLUE BUSINESS EDC FP -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-25 16:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979673%27 HTTP/1.1" 200 None
2026-03-25 16:35:03 [ayvens.it] INFO: Saving data for 1979673: {'auction_closing_time': 1774517400.0, 'created_time': 1774369896.221687, 'last_price_update_time': 1774456503.260419}
2026-03-25 16:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1979673') HTTP/1.1" 204 0
2026-03-25 16:35:03 [ayvens.it] INFO: Found listing with ID: 1979674
2026-03-25 16:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979674%27 HTTP/1.1" 200 None
2026-03-25 16:35:03 [ayvens.it] INFO: Scrape type for 1979674: 2
2026-03-25 16:35:03 [ayvens.it] INFO: Extracting data for car ID: 1979674
2026-03-25 16:35:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 107fcdee-cdc7-5ebf-9f87-73779d89e868 with identifier: 1979674
2026-03-25 16:35:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 107fcdee-cdc7-5ebf-9f87-73779d89e868 with scrape type 2
2026-03-25 16:35:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 107fcdee-cdc7-5ebf-9f87-73779d89e868 with scrape type 2
2026-03-25 16:35:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 107fcdee-cdc7-5ebf-9f87-73779d89e868, identifier: 1979674
2026-03-25 16:35:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fp4/3d69da056c7c48ca85ba55090740bfe9/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:35:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 107fcdee-cdc7-5ebf-9f87-73779d89e868 with identifier: 1979674
2026-03-25 16:35:03 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:35:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 107fcdee-cdc7-5ebf-9f87-73779d89e868 with identifier: 1979674
2026-03-25 16:35:03 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 107fcdee-cdc7-5ebf-9f87-73779d89e868 with identifier: 1979674 to the API
2026-03-25 16:35:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:35:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:35:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'PEARL BLACK MTZ',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-26T09:30:00Z',
'fuel_type': 'petrol',
'id': '107fcdee-cdc7-5ebf-9f87-73779d89e868',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40968',
'listing': 'auction',
'location': None,
'make': 'CITROËN',
'model': 'CITROEN C3 AIRCROSS PURETECH 110 S&S SHINE FP',
'odometer': 65380,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-02-06',
'seats_number': 5,
'seller_name': None,
'title': 'CITROËN CITROEN C3 AIRCROSS PURETECH 110 S&S SHINE FP -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2023}
2026-03-25 16:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979674%27 HTTP/1.1" 200 None
2026-03-25 16:35:03 [ayvens.it] INFO: Saving data for 1979674: {'auction_closing_time': 1774517400.0, 'created_time': 1774369890.217266, 'last_price_update_time': 1774456503.610497}
2026-03-25 16:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1979674') HTTP/1.1" 204 0
2026-03-25 16:35:03 [ayvens.it] INFO: Found listing with ID: 1979675
2026-03-25 16:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979675%27 HTTP/1.1" 200 None
2026-03-25 16:35:03 [ayvens.it] INFO: Scrape type for 1979675: 2
2026-03-25 16:35:03 [ayvens.it] INFO: Extracting data for car ID: 1979675
2026-03-25 16:35:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dc34c0ad-936b-5116-87af-c53c39abc0b0 with identifier: 1979675
2026-03-25 16:35:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dc34c0ad-936b-5116-87af-c53c39abc0b0 with scrape type 2
2026-03-25 16:35:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dc34c0ad-936b-5116-87af-c53c39abc0b0 with scrape type 2
2026-03-25 16:35:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: dc34c0ad-936b-5116-87af-c53c39abc0b0, identifier: 1979675
2026-03-25 16:35:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:35:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc63d210>
2026-03-25 16:35:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:35:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:35:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:35:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8fa8f5fc-f5d5-5271-95a1-00f9c89f0cd9/8fa8f5fc-f5d5-5271-95a1-00f9c89f0cd9_image_7.jpg HTTP/1.1" 201 0
2026-03-25 16:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf2%252Feafd3c03ccc44a7684004a4ea91d1028%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 16:35:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf2/eafd3c03ccc44a7684004a4ea91d1028/images/large/8.jpg saved to cache
2026-03-25 16:35:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8fa8f5fc-f5d5-5271-95a1-00f9c89f0cd9
2026-03-25 16:35:03 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8fa8f5fc-f5d5-5271-95a1-00f9c89f0cd9, skipping ID generation
2026-03-25 16:35:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8fa8f5fc-f5d5-5271-95a1-00f9c89f0cd9 with scrape type 1
2026-03-25 16:35:03 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8fa8f5fc-f5d5-5271-95a1-00f9c89f0cd9 sending to next pipeline
2026-03-25 16:35:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 8fa8f5fc-f5d5-5271-95a1-00f9c89f0cd9, identifier: 1983662
2026-03-25 16:35:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fp4/3d69da056c7c48ca85ba55090740bfe9/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:35:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: dc34c0ad-936b-5116-87af-c53c39abc0b0 with identifier: 1979675
2026-03-25 16:35:03 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:35:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: dc34c0ad-936b-5116-87af-c53c39abc0b0 with identifier: 1979675
2026-03-25 16:35:03 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: dc34c0ad-936b-5116-87af-c53c39abc0b0 with identifier: 1979675 to the API
2026-03-25 16:35:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:35:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:35:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Bianco perlato',
'currency': 'EUR',
'doors_number': 5,
'engine': '',
'expiration_date': '2026-03-26T09:30:00Z',
'fuel_type': 'electric',
'id': 'dc34c0ad-936b-5116-87af-c53c39abc0b0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40968',
'listing': 'auction',
'location': None,
'make': 'TESLA',
'model': 'TESLA MODEL Y 75 kWh Dual Motor Long Range 4WD aut. Sport utility '
'vehicle 5-door',
'odometer': 86518,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-09-27',
'seats_number': 5,
'seller_name': None,
'title': 'TESLA TESLA MODEL Y 75 kWh Dual Motor Long Range 4WD aut. Sport '
'utility vehicle 5-door -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2021}
2026-03-25 16:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979675%27 HTTP/1.1" 200 None
2026-03-25 16:35:04 [ayvens.it] INFO: Saving data for 1979675: {'auction_closing_time': 1774517400.0, 'created_time': 1774369888.322545, 'last_price_update_time': 1774456504.117654}
2026-03-25 16:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1979675') HTTP/1.1" 204 0
2026-03-25 16:35:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 8fa8f5fc-f5d5-5271-95a1-00f9c89f0cd9 with identifier: 1983662
2026-03-25 16:35:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 8fa8f5fc-f5d5-5271-95a1-00f9c89f0cd9 with identifier: 1983662
2026-03-25 16:35:04 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 8fa8f5fc-f5d5-5271-95a1-00f9c89f0cd9 with identifier: 1983662 to the API
2026-03-25 16:35:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:35:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:35:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gf2/eafd3c03ccc44a7684004a4ea91d1028/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'MAGNETIC GREY METALLIZZATO',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-27T09:30:00Z',
'fuel_type': 'diesel',
'id': '8fa8f5fc-f5d5-5271-95a1-00f9c89f0cd9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41025',
'listing': 'auction',
'location': None,
'make': 'FORD',
'model': 'FORD FOCUS 1.5 Ecoblue 120cv Business Hatchback 5-door (Euro 6.2)',
'odometer': 161827,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 34,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8fa8f5fc-f5d5-5271-95a1-00f9c89f0cd9/8fa8f5fc-f5d5-5271-95a1-00f9c89f0cd9_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 740079,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf2/eafd3c03ccc44a7684004a4ea91d1028/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8fa8f5fc-f5d5-5271-95a1-00f9c89f0cd9/8fa8f5fc-f5d5-5271-95a1-00f9c89f0cd9_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 701580,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf2/eafd3c03ccc44a7684004a4ea91d1028/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8fa8f5fc-f5d5-5271-95a1-00f9c89f0cd9/8fa8f5fc-f5d5-5271-95a1-00f9c89f0cd9_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 740079,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf2/eafd3c03ccc44a7684004a4ea91d1028/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8fa8f5fc-f5d5-5271-95a1-00f9c89f0cd9/8fa8f5fc-f5d5-5271-95a1-00f9c89f0cd9_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 726730,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf2/eafd3c03ccc44a7684004a4ea91d1028/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8fa8f5fc-f5d5-5271-95a1-00f9c89f0cd9/8fa8f5fc-f5d5-5271-95a1-00f9c89f0cd9_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 695597,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf2/eafd3c03ccc44a7684004a4ea91d1028/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8fa8f5fc-f5d5-5271-95a1-00f9c89f0cd9/8fa8f5fc-f5d5-5271-95a1-00f9c89f0cd9_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 588683,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf2/eafd3c03ccc44a7684004a4ea91d1028/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8fa8f5fc-f5d5-5271-95a1-00f9c89f0cd9/8fa8f5fc-f5d5-5271-95a1-00f9c89f0cd9_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 526014,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf2/eafd3c03ccc44a7684004a4ea91d1028/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8fa8f5fc-f5d5-5271-95a1-00f9c89f0cd9/8fa8f5fc-f5d5-5271-95a1-00f9c89f0cd9_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 461675,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf2/eafd3c03ccc44a7684004a4ea91d1028/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8fa8f5fc-f5d5-5271-95a1-00f9c89f0cd9/8fa8f5fc-f5d5-5271-95a1-00f9c89f0cd9_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 550322,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf2/eafd3c03ccc44a7684004a4ea91d1028/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8fa8f5fc-f5d5-5271-95a1-00f9c89f0cd9/8fa8f5fc-f5d5-5271-95a1-00f9c89f0cd9_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 526762,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf2/eafd3c03ccc44a7684004a4ea91d1028/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-04-20',
'seats_number': 5,
'seller_name': None,
'title': 'FORD FORD FOCUS 1.5 Ecoblue 120cv Business Hatchback 5-door (Euro '
'6.2) -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2021}
2026-03-25 16:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983662%27 HTTP/1.1" 200 None
2026-03-25 16:35:04 [ayvens.it] INFO: Saving data for 1983662: {'created_time': 1774456504.4641, 'last_price_update_time': 1774456504.464112, 'auction_closing_time': 1774603800.0}
2026-03-25 16:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1983662') HTTP/1.1" 204 0
2026-03-25 16:35:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp4/b020e9d1a0ae432a842d93a69c93af36/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:35:04 [ayvens.it] INFO: Found listing with ID: 1979676
2026-03-25 16:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979676%27 HTTP/1.1" 200 None
2026-03-25 16:35:04 [ayvens.it] INFO: Scrape type for 1979676: 2
2026-03-25 16:35:04 [ayvens.it] INFO: Extracting data for car ID: 1979676
2026-03-25 16:35:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b194a529-19a4-5417-8c8e-aff7a006d1ab with identifier: 1979676
2026-03-25 16:35:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b194a529-19a4-5417-8c8e-aff7a006d1ab with scrape type 2
2026-03-25 16:35:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b194a529-19a4-5417-8c8e-aff7a006d1ab with scrape type 2
2026-03-25 16:35:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: b194a529-19a4-5417-8c8e-aff7a006d1ab, identifier: 1979676
2026-03-25 16:35:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:35:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc63d090>
2026-03-25 16:35:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:35:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:35:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:35:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2a39b3e-8857-5c9b-8aaa-ccbdd733cf7b/f2a39b3e-8857-5c9b-8aaa-ccbdd733cf7b_image_8.jpg HTTP/1.1" 201 0
2026-03-25 16:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffp4%252F3d69da056c7c48ca85ba55090740bfe9%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 16:35:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fp4/3d69da056c7c48ca85ba55090740bfe9/images/large/9.jpg saved to cache
2026-03-25 16:35:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f2a39b3e-8857-5c9b-8aaa-ccbdd733cf7b
2026-03-25 16:35:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: b194a529-19a4-5417-8c8e-aff7a006d1ab with identifier: 1979676
2026-03-25 16:35:04 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:35:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: b194a529-19a4-5417-8c8e-aff7a006d1ab with identifier: 1979676
2026-03-25 16:35:04 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: b194a529-19a4-5417-8c8e-aff7a006d1ab with identifier: 1979676 to the API
2026-03-25 16:35:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:35:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:35:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'NERO',
'currency': 'EUR',
'doors_number': 2,
'engine': '0.0L',
'expiration_date': '2026-03-26T09:30:00Z',
'fuel_type': 'electric',
'id': 'b194a529-19a4-5417-8c8e-aff7a006d1ab',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40968',
'listing': 'auction',
'location': None,
'make': 'AIXAM',
'model': 'AIXAM EMOTION e-CITY SPORT Quadriciclo',
'odometer': 26710,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-02-20',
'seats_number': 5,
'seller_name': None,
'title': 'AIXAM AIXAM EMOTION e-CITY SPORT Quadriciclo -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2023}
2026-03-25 16:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979676%27 HTTP/1.1" 200 None
2026-03-25 16:35:05 [ayvens.it] INFO: Saving data for 1979676: {'auction_closing_time': 1774517400.0, 'created_time': 1774369889.885554, 'last_price_update_time': 1774456505.436665}
2026-03-25 16:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1979676') HTTP/1.1" 204 0
2026-03-25 16:35:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fp4/3d69da056c7c48ca85ba55090740bfe9/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:35:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp4/b020e9d1a0ae432a842d93a69c93af36/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:35:05 [scrapy.extensions.logstats] INFO: Crawled 18 pages (at 3 pages/min), scraped 134 items (at 52 items/min)
2026-03-25 16:35:05 [scrapy.extensions.memusage] INFO: Peak memory usage is 182MiB
2026-03-25 16:35:05 [ayvens.it] INFO: Found listing with ID: 1979677
2026-03-25 16:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979677%27 HTTP/1.1" 200 None
2026-03-25 16:35:05 [ayvens.it] INFO: Scrape type for 1979677: 2
2026-03-25 16:35:05 [ayvens.it] INFO: Extracting data for car ID: 1979677
2026-03-25 16:35:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5989c377-5dd8-5bdd-80f9-ef04e929c2d2 with identifier: 1979677
2026-03-25 16:35:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5989c377-5dd8-5bdd-80f9-ef04e929c2d2 with scrape type 2
2026-03-25 16:35:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5989c377-5dd8-5bdd-80f9-ef04e929c2d2 with scrape type 2
2026-03-25 16:35:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 5989c377-5dd8-5bdd-80f9-ef04e929c2d2, identifier: 1979677
2026-03-25 16:35:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:35:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dccc3010>
2026-03-25 16:35:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:35:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:35:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:35:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2a39b3e-8857-5c9b-8aaa-ccbdd733cf7b/f2a39b3e-8857-5c9b-8aaa-ccbdd733cf7b_image_7.jpg HTTP/1.1" 201 0
2026-03-25 16:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffp4%252F3d69da056c7c48ca85ba55090740bfe9%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 16:35:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fp4/3d69da056c7c48ca85ba55090740bfe9/images/large/8.jpg saved to cache
2026-03-25 16:35:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f2a39b3e-8857-5c9b-8aaa-ccbdd733cf7b
2026-03-25 16:35:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr3/9c4eb9c02cac46118c2d831ff87ab008/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:35:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 5989c377-5dd8-5bdd-80f9-ef04e929c2d2 with identifier: 1979677
2026-03-25 16:35:05 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:35:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 5989c377-5dd8-5bdd-80f9-ef04e929c2d2 with identifier: 1979677
2026-03-25 16:35:05 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 5989c377-5dd8-5bdd-80f9-ef04e929c2d2 with identifier: 1979677 to the API
2026-03-25 16:35:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:35:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:35:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'P',
'currency': 'EUR',
'doors_number': 4,
'engine': '1.6L',
'expiration_date': '2026-03-26T09:30:00Z',
'fuel_type': 'diesel',
'id': '5989c377-5dd8-5bdd-80f9-ef04e929c2d2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40968',
'listing': 'auction',
'location': None,
'make': 'CITROËN',
'model': 'CITROËN JUMPY BlueHDi 115 S&S XS Club Furgone 4-door (Euro 6)',
'odometer': 180594,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-03-11',
'seats_number': 5,
'seller_name': None,
'title': 'CITROËN CITROËN JUMPY BlueHDi 115 S&S XS Club Furgone 4-door (Euro '
'6) -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2019}
2026-03-25 16:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979677%27 HTTP/1.1" 200 None
2026-03-25 16:35:05 [ayvens.it] INFO: Saving data for 1979677: {'auction_closing_time': 1774517400.0, 'created_time': 1774369894.047207, 'last_price_update_time': 1774456505.903002}
2026-03-25 16:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1979677') HTTP/1.1" 204 0
2026-03-25 16:35:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp4/b020e9d1a0ae432a842d93a69c93af36/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:35:05 [ayvens.it] INFO: Found listing with ID: 1979678
2026-03-25 16:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979678%27 HTTP/1.1" 200 None
2026-03-25 16:35:05 [ayvens.it] INFO: Scrape type for 1979678: 2
2026-03-25 16:35:05 [ayvens.it] INFO: Extracting data for car ID: 1979678
2026-03-25 16:35:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fdcc137b-4442-54d1-84a2-35be87c441db with identifier: 1979678
2026-03-25 16:35:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fdcc137b-4442-54d1-84a2-35be87c441db with scrape type 2
2026-03-25 16:35:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fdcc137b-4442-54d1-84a2-35be87c441db with scrape type 2
2026-03-25 16:35:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: fdcc137b-4442-54d1-84a2-35be87c441db, identifier: 1979678
2026-03-25 16:35:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:35:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc9e6310>
2026-03-25 16:35:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:35:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:35:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:35:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da9d3664-57b6-5cf4-88fe-e9684b73d775/da9d3664-57b6-5cf4-88fe-e9684b73d775_image_9.jpg HTTP/1.1" 201 0
2026-03-25 16:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp4%252Fb020e9d1a0ae432a842d93a69c93af36%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 16:35:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp4/b020e9d1a0ae432a842d93a69c93af36/images/large/10.jpg saved to cache
2026-03-25 16:35:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item da9d3664-57b6-5cf4-88fe-e9684b73d775
2026-03-25 16:35:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr3/9c4eb9c02cac46118c2d831ff87ab008/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:35:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: fdcc137b-4442-54d1-84a2-35be87c441db with identifier: 1979678
2026-03-25 16:35:06 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:35:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: fdcc137b-4442-54d1-84a2-35be87c441db with identifier: 1979678
2026-03-25 16:35:06 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: fdcc137b-4442-54d1-84a2-35be87c441db with identifier: 1979678 to the API
2026-03-25 16:35:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:35:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:35:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'SOPHISTO GREY BRILLIANT EFFECT',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-26T09:30:00Z',
'fuel_type': 'diesel',
'id': 'fdcc137b-4442-54d1-84a2-35be87c441db',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40968',
'listing': 'auction',
'location': None,
'make': 'BMW',
'model': 'BMW X3 xDrive 20d MH48V Msport Sport utility vehicle 5-door (Euro '
'6D)',
'odometer': 91514,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-07-28',
'seats_number': 5,
'seller_name': None,
'title': 'BMW BMW X3 xDrive 20d MH48V Msport Sport utility vehicle 5-door '
'(Euro 6D) -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2021}
2026-03-25 16:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979678%27 HTTP/1.1" 200 None
2026-03-25 16:35:06 [ayvens.it] INFO: Saving data for 1979678: {'auction_closing_time': 1774517400.0, 'created_time': 1774369893.120128, 'last_price_update_time': 1774456506.374285}
2026-03-25 16:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1979678') HTTP/1.1" 204 0
2026-03-25 16:35:06 [ayvens.it] INFO: Found listing with ID: 1979679
2026-03-25 16:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979679%27 HTTP/1.1" 200 None
2026-03-25 16:35:06 [ayvens.it] INFO: Scrape type for 1979679: 2
2026-03-25 16:35:06 [ayvens.it] INFO: Extracting data for car ID: 1979679
2026-03-25 16:35:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1a561984-b2e5-5048-9cda-d6fb02a3003d with identifier: 1979679
2026-03-25 16:35:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1a561984-b2e5-5048-9cda-d6fb02a3003d with scrape type 2
2026-03-25 16:35:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1a561984-b2e5-5048-9cda-d6fb02a3003d with scrape type 2
2026-03-25 16:35:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 1a561984-b2e5-5048-9cda-d6fb02a3003d, identifier: 1979679
2026-03-25 16:35:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs0/24a9396a6cf74061abd614e97451ce3e/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:35:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 1a561984-b2e5-5048-9cda-d6fb02a3003d with identifier: 1979679
2026-03-25 16:35:06 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:35:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 1a561984-b2e5-5048-9cda-d6fb02a3003d with identifier: 1979679
2026-03-25 16:35:06 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 1a561984-b2e5-5048-9cda-d6fb02a3003d with identifier: 1979679 to the API
2026-03-25 16:35:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:35:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:35:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'BLACK METALLIZZATO',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.8L',
'expiration_date': '2026-03-26T09:30:00Z',
'fuel_type': 'hybrid',
'id': '1a561984-b2e5-5048-9cda-d6fb02a3003d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40968',
'listing': 'auction',
'location': None,
'make': 'TOYOTA',
'model': 'TOYOTA COROLLA SW (PC) TS HYBRID BUSINESS FP',
'odometer': 136865,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-11-12',
'seats_number': 5,
'seller_name': None,
'title': 'TOYOTA TOYOTA COROLLA SW (PC) TS HYBRID BUSINESS FP -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2021}
2026-03-25 16:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979679%27 HTTP/1.1" 200 None
2026-03-25 16:35:06 [ayvens.it] INFO: Saving data for 1979679: {'auction_closing_time': 1774517400.0, 'created_time': 1774369894.758556, 'last_price_update_time': 1774456506.764081}
2026-03-25 16:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1979679') HTTP/1.1" 204 0
2026-03-25 16:35:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:35:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dccc0290>
2026-03-25 16:35:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:35:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:35:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:35:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2a39b3e-8857-5c9b-8aaa-ccbdd733cf7b/f2a39b3e-8857-5c9b-8aaa-ccbdd733cf7b_image_6.jpg HTTP/1.1" 201 0
2026-03-25 16:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffp4%252F3d69da056c7c48ca85ba55090740bfe9%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 16:35:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fp4/3d69da056c7c48ca85ba55090740bfe9/images/large/7.jpg saved to cache
2026-03-25 16:35:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f2a39b3e-8857-5c9b-8aaa-ccbdd733cf7b
2026-03-25 16:35:06 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f2a39b3e-8857-5c9b-8aaa-ccbdd733cf7b, skipping ID generation
2026-03-25 16:35:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f2a39b3e-8857-5c9b-8aaa-ccbdd733cf7b with scrape type 1
2026-03-25 16:35:06 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f2a39b3e-8857-5c9b-8aaa-ccbdd733cf7b sending to next pipeline
2026-03-25 16:35:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: f2a39b3e-8857-5c9b-8aaa-ccbdd733cf7b, identifier: 1983661
2026-03-25 16:35:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:35:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcde2450>
2026-03-25 16:35:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:35:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:35:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:35:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da9d3664-57b6-5cf4-88fe-e9684b73d775/da9d3664-57b6-5cf4-88fe-e9684b73d775_image_8.jpg HTTP/1.1" 201 0
2026-03-25 16:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp4%252Fb020e9d1a0ae432a842d93a69c93af36%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 16:35:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp4/b020e9d1a0ae432a842d93a69c93af36/images/large/9.jpg saved to cache
2026-03-25 16:35:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item da9d3664-57b6-5cf4-88fe-e9684b73d775
2026-03-25 16:35:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:35:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc86a490>
2026-03-25 16:35:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:35:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:35:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:35:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fac2ddc5-df99-556a-929e-2e2894efcd2b/fac2ddc5-df99-556a-929e-2e2894efcd2b_image_7.jpg HTTP/1.1" 201 0
2026-03-25 16:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr3%252F9c4eb9c02cac46118c2d831ff87ab008%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 16:35:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr3/9c4eb9c02cac46118c2d831ff87ab008/images/large/8.jpg saved to cache
2026-03-25 16:35:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item fac2ddc5-df99-556a-929e-2e2894efcd2b
2026-03-25 16:35:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:35:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc63de50>
2026-03-25 16:35:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:35:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:35:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:35:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da9d3664-57b6-5cf4-88fe-e9684b73d775/da9d3664-57b6-5cf4-88fe-e9684b73d775_image_7.jpg HTTP/1.1" 201 0
2026-03-25 16:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp4%252Fb020e9d1a0ae432a842d93a69c93af36%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 16:35:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp4/b020e9d1a0ae432a842d93a69c93af36/images/large/8.jpg saved to cache
2026-03-25 16:35:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item da9d3664-57b6-5cf4-88fe-e9684b73d775
2026-03-25 16:35:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: da9d3664-57b6-5cf4-88fe-e9684b73d775, skipping ID generation
2026-03-25 16:35:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item da9d3664-57b6-5cf4-88fe-e9684b73d775 with scrape type 1
2026-03-25 16:35:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item da9d3664-57b6-5cf4-88fe-e9684b73d775 sending to next pipeline
2026-03-25 16:35:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: da9d3664-57b6-5cf4-88fe-e9684b73d775, identifier: 1983659
2026-03-25 16:35:07 [ayvens.it] INFO: Found listing with ID: 1979680
2026-03-25 16:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979680%27 HTTP/1.1" 200 None
2026-03-25 16:35:07 [ayvens.it] INFO: Scrape type for 1979680: 2
2026-03-25 16:35:07 [ayvens.it] INFO: Extracting data for car ID: 1979680
2026-03-25 16:35:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b226d110-dd4f-5010-bb59-de9248c65304 with identifier: 1979680
2026-03-25 16:35:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b226d110-dd4f-5010-bb59-de9248c65304 with scrape type 2
2026-03-25 16:35:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b226d110-dd4f-5010-bb59-de9248c65304 with scrape type 2
2026-03-25 16:35:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: b226d110-dd4f-5010-bb59-de9248c65304, identifier: 1979680
2026-03-25 16:35:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: f2a39b3e-8857-5c9b-8aaa-ccbdd733cf7b with identifier: 1983661
2026-03-25 16:35:07 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:35:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: f2a39b3e-8857-5c9b-8aaa-ccbdd733cf7b with identifier: 1983661
2026-03-25 16:35:07 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: f2a39b3e-8857-5c9b-8aaa-ccbdd733cf7b with identifier: 1983661 to the API
2026-03-25 16:35:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:35:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:35:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fp4/3d69da056c7c48ca85ba55090740bfe9/images/large/7.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Argento Floret met',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-27T09:30:00Z',
'fuel_type': 'diesel',
'id': 'f2a39b3e-8857-5c9b-8aaa-ccbdd733cf7b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41025',
'listing': 'auction',
'location': None,
'make': 'AUDI',
'model': 'AUDI A3 1.6 TDI Business SB Hatchback 5-door',
'odometer': 198641,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 21,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2a39b3e-8857-5c9b-8aaa-ccbdd733cf7b/f2a39b3e-8857-5c9b-8aaa-ccbdd733cf7b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 799370,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fp4/3d69da056c7c48ca85ba55090740bfe9/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2a39b3e-8857-5c9b-8aaa-ccbdd733cf7b/f2a39b3e-8857-5c9b-8aaa-ccbdd733cf7b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 789781,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fp4/3d69da056c7c48ca85ba55090740bfe9/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2a39b3e-8857-5c9b-8aaa-ccbdd733cf7b/f2a39b3e-8857-5c9b-8aaa-ccbdd733cf7b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 799370,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fp4/3d69da056c7c48ca85ba55090740bfe9/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2a39b3e-8857-5c9b-8aaa-ccbdd733cf7b/f2a39b3e-8857-5c9b-8aaa-ccbdd733cf7b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 823145,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fp4/3d69da056c7c48ca85ba55090740bfe9/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2a39b3e-8857-5c9b-8aaa-ccbdd733cf7b/f2a39b3e-8857-5c9b-8aaa-ccbdd733cf7b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 832738,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fp4/3d69da056c7c48ca85ba55090740bfe9/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2a39b3e-8857-5c9b-8aaa-ccbdd733cf7b/f2a39b3e-8857-5c9b-8aaa-ccbdd733cf7b_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 554176,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fp4/3d69da056c7c48ca85ba55090740bfe9/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2a39b3e-8857-5c9b-8aaa-ccbdd733cf7b/f2a39b3e-8857-5c9b-8aaa-ccbdd733cf7b_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 619569,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fp4/3d69da056c7c48ca85ba55090740bfe9/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2a39b3e-8857-5c9b-8aaa-ccbdd733cf7b/f2a39b3e-8857-5c9b-8aaa-ccbdd733cf7b_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 565107,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fp4/3d69da056c7c48ca85ba55090740bfe9/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2a39b3e-8857-5c9b-8aaa-ccbdd733cf7b/f2a39b3e-8857-5c9b-8aaa-ccbdd733cf7b_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 522814,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fp4/3d69da056c7c48ca85ba55090740bfe9/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2a39b3e-8857-5c9b-8aaa-ccbdd733cf7b/f2a39b3e-8857-5c9b-8aaa-ccbdd733cf7b_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 558951,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fp4/3d69da056c7c48ca85ba55090740bfe9/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-05-07',
'seats_number': 5,
'seller_name': None,
'title': 'AUDI AUDI A3 1.6 TDI Business SB Hatchback 5-door -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2018}
2026-03-25 16:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983661%27 HTTP/1.1" 200 None
2026-03-25 16:35:07 [ayvens.it] INFO: Saving data for 1983661: {'created_time': 1774456507.718116, 'last_price_update_time': 1774456507.718127, 'auction_closing_time': 1774603800.0}
2026-03-25 16:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1983661') HTTP/1.1" 204 0
2026-03-25 16:35:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: da9d3664-57b6-5cf4-88fe-e9684b73d775 with identifier: 1983659
2026-03-25 16:35:07 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:35:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: da9d3664-57b6-5cf4-88fe-e9684b73d775 with identifier: 1983659
2026-03-25 16:35:07 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: da9d3664-57b6-5cf4-88fe-e9684b73d775 with identifier: 1983659 to the API
2026-03-25 16:35:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:35:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:35:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gp4/b020e9d1a0ae432a842d93a69c93af36/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Onyx black metallizzato',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-27T09:30:00Z',
'fuel_type': 'diesel',
'id': 'da9d3664-57b6-5cf4-88fe-e9684b73d775',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41025',
'listing': 'auction',
'location': None,
'make': 'VOLVO',
'model': 'VOLVO XC60 B4 D automatico Core Sport utility vehicle 5-door (Euro '
'6D)',
'odometer': 104974,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 20,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da9d3664-57b6-5cf4-88fe-e9684b73d775/da9d3664-57b6-5cf4-88fe-e9684b73d775_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 803021,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp4/b020e9d1a0ae432a842d93a69c93af36/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da9d3664-57b6-5cf4-88fe-e9684b73d775/da9d3664-57b6-5cf4-88fe-e9684b73d775_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 793503,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp4/b020e9d1a0ae432a842d93a69c93af36/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da9d3664-57b6-5cf4-88fe-e9684b73d775/da9d3664-57b6-5cf4-88fe-e9684b73d775_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 803021,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp4/b020e9d1a0ae432a842d93a69c93af36/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da9d3664-57b6-5cf4-88fe-e9684b73d775/da9d3664-57b6-5cf4-88fe-e9684b73d775_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 821359,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp4/b020e9d1a0ae432a842d93a69c93af36/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da9d3664-57b6-5cf4-88fe-e9684b73d775/da9d3664-57b6-5cf4-88fe-e9684b73d775_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 848124,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp4/b020e9d1a0ae432a842d93a69c93af36/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da9d3664-57b6-5cf4-88fe-e9684b73d775/da9d3664-57b6-5cf4-88fe-e9684b73d775_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 676701,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp4/b020e9d1a0ae432a842d93a69c93af36/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da9d3664-57b6-5cf4-88fe-e9684b73d775/da9d3664-57b6-5cf4-88fe-e9684b73d775_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 503512,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp4/b020e9d1a0ae432a842d93a69c93af36/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da9d3664-57b6-5cf4-88fe-e9684b73d775/da9d3664-57b6-5cf4-88fe-e9684b73d775_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 545228,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp4/b020e9d1a0ae432a842d93a69c93af36/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da9d3664-57b6-5cf4-88fe-e9684b73d775/da9d3664-57b6-5cf4-88fe-e9684b73d775_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 633681,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp4/b020e9d1a0ae432a842d93a69c93af36/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da9d3664-57b6-5cf4-88fe-e9684b73d775/da9d3664-57b6-5cf4-88fe-e9684b73d775_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 496545,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp4/b020e9d1a0ae432a842d93a69c93af36/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-06-12',
'seats_number': 5,
'seller_name': None,
'title': 'VOLVO VOLVO XC60 B4 D automatico Core Sport utility vehicle 5-door '
'(Euro 6D) -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2023}
2026-03-25 16:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983659%27 HTTP/1.1" 200 None
2026-03-25 16:35:08 [ayvens.it] INFO: Saving data for 1983659: {'created_time': 1774456508.869586, 'last_price_update_time': 1774456508.869601, 'auction_closing_time': 1774603800.0}
2026-03-25 16:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1983659') HTTP/1.1" 204 0
2026-03-25 16:35:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: b226d110-dd4f-5010-bb59-de9248c65304 with identifier: 1979680
2026-03-25 16:35:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: b226d110-dd4f-5010-bb59-de9248c65304 with identifier: 1979680
2026-03-25 16:35:08 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: b226d110-dd4f-5010-bb59-de9248c65304 with identifier: 1979680 to the API
2026-03-25 16:35:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:35:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:35:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'FROZEN WHITE',
'currency': 'EUR',
'doors_number': 4,
'engine': '2.0L',
'expiration_date': '2026-03-26T09:30:00Z',
'fuel_type': 'diesel',
'id': 'b226d110-dd4f-5010-bb59-de9248c65304',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40968',
'listing': 'auction',
'location': None,
'make': 'FORD',
'model': 'FORD TRANSIT (PC) 350 L3H2 TREND 2.0 ECO 170 CV',
'odometer': 76314,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-01-12',
'seats_number': 5,
'seller_name': None,
'title': 'FORD FORD TRANSIT (PC) 350 L3H2 TREND 2.0 ECO 170 CV -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2021}
2026-03-25 16:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979680%27 HTTP/1.1" 200 None
2026-03-25 16:35:09 [ayvens.it] INFO: Saving data for 1979680: {'auction_closing_time': 1774517400.0, 'created_time': 1774369897.340859, 'last_price_update_time': 1774456509.173266}
2026-03-25 16:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1979680') HTTP/1.1" 204 0
2026-03-25 16:35:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:35:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34de140cd0>
2026-03-25 16:35:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:35:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:35:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:35:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fac2ddc5-df99-556a-929e-2e2894efcd2b/fac2ddc5-df99-556a-929e-2e2894efcd2b_image_8.jpg HTTP/1.1" 201 0
2026-03-25 16:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr3%252F9c4eb9c02cac46118c2d831ff87ab008%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 16:35:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr3/9c4eb9c02cac46118c2d831ff87ab008/images/large/9.jpg saved to cache
2026-03-25 16:35:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item fac2ddc5-df99-556a-929e-2e2894efcd2b
2026-03-25 16:35:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fac2ddc5-df99-556a-929e-2e2894efcd2b, skipping ID generation
2026-03-25 16:35:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fac2ddc5-df99-556a-929e-2e2894efcd2b with scrape type 1
2026-03-25 16:35:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fac2ddc5-df99-556a-929e-2e2894efcd2b sending to next pipeline
2026-03-25 16:35:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: fac2ddc5-df99-556a-929e-2e2894efcd2b, identifier: 1983660
2026-03-25 16:35:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge9/a549559d3f7d4835a3b18a516e67d64a/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:35:09 [ayvens.it] INFO: Found listing with ID: 1979681
2026-03-25 16:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979681%27 HTTP/1.1" 200 None
2026-03-25 16:35:09 [ayvens.it] INFO: Scrape type for 1979681: 2
2026-03-25 16:35:09 [ayvens.it] INFO: Extracting data for car ID: 1979681
2026-03-25 16:35:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c7471d39-9fe7-5380-b6d2-66f5b1df95c0 with identifier: 1979681
2026-03-25 16:35:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c7471d39-9fe7-5380-b6d2-66f5b1df95c0 with scrape type 2
2026-03-25 16:35:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c7471d39-9fe7-5380-b6d2-66f5b1df95c0 with scrape type 2
2026-03-25 16:35:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: c7471d39-9fe7-5380-b6d2-66f5b1df95c0, identifier: 1979681
2026-03-25 16:35:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: fac2ddc5-df99-556a-929e-2e2894efcd2b with identifier: 1983660
2026-03-25 16:35:09 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:35:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: fac2ddc5-df99-556a-929e-2e2894efcd2b with identifier: 1983660
2026-03-25 16:35:09 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: fac2ddc5-df99-556a-929e-2e2894efcd2b with identifier: 1983660 to the API
2026-03-25 16:35:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:35:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:35:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gr3/9c4eb9c02cac46118c2d831ff87ab008/images/large/9.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'QPA',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-27T09:30:00Z',
'fuel_type': 'hybrid',
'id': 'fac2ddc5-df99-556a-929e-2e2894efcd2b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41025',
'listing': 'auction',
'location': None,
'make': 'RENAULT',
'model': 'RENAULT ARKANA 1.6 Hybrid 105KW E-TECH TECHNO Sport utility vehicle '
'5-door (Euro 6D)',
'odometer': 94623,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 34,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fac2ddc5-df99-556a-929e-2e2894efcd2b/fac2ddc5-df99-556a-929e-2e2894efcd2b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 783298,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr3/9c4eb9c02cac46118c2d831ff87ab008/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fac2ddc5-df99-556a-929e-2e2894efcd2b/fac2ddc5-df99-556a-929e-2e2894efcd2b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 744547,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr3/9c4eb9c02cac46118c2d831ff87ab008/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fac2ddc5-df99-556a-929e-2e2894efcd2b/fac2ddc5-df99-556a-929e-2e2894efcd2b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 783298,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr3/9c4eb9c02cac46118c2d831ff87ab008/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fac2ddc5-df99-556a-929e-2e2894efcd2b/fac2ddc5-df99-556a-929e-2e2894efcd2b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 781107,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr3/9c4eb9c02cac46118c2d831ff87ab008/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fac2ddc5-df99-556a-929e-2e2894efcd2b/fac2ddc5-df99-556a-929e-2e2894efcd2b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 798515,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr3/9c4eb9c02cac46118c2d831ff87ab008/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fac2ddc5-df99-556a-929e-2e2894efcd2b/fac2ddc5-df99-556a-929e-2e2894efcd2b_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 803333,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr3/9c4eb9c02cac46118c2d831ff87ab008/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fac2ddc5-df99-556a-929e-2e2894efcd2b/fac2ddc5-df99-556a-929e-2e2894efcd2b_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 677935,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr3/9c4eb9c02cac46118c2d831ff87ab008/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fac2ddc5-df99-556a-929e-2e2894efcd2b/fac2ddc5-df99-556a-929e-2e2894efcd2b_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 686047,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr3/9c4eb9c02cac46118c2d831ff87ab008/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fac2ddc5-df99-556a-929e-2e2894efcd2b/fac2ddc5-df99-556a-929e-2e2894efcd2b_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 784687,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr3/9c4eb9c02cac46118c2d831ff87ab008/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fac2ddc5-df99-556a-929e-2e2894efcd2b/fac2ddc5-df99-556a-929e-2e2894efcd2b_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 752610,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr3/9c4eb9c02cac46118c2d831ff87ab008/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-09-18',
'seats_number': 5,
'seller_name': None,
'title': 'RENAULT RENAULT ARKANA 1.6 Hybrid 105KW E-TECH TECHNO Sport utility '
'vehicle 5-door (Euro 6D) -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2023}
2026-03-25 16:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983660%27 HTTP/1.1" 200 None
2026-03-25 16:35:09 [ayvens.it] INFO: Saving data for 1983660: {'created_time': 1774456509.791483, 'last_price_update_time': 1774456509.791496, 'auction_closing_time': 1774603800.0}
2026-03-25 16:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1983660') HTTP/1.1" 204 0
2026-03-25 16:35:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge9/a549559d3f7d4835a3b18a516e67d64a/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:35:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: c7471d39-9fe7-5380-b6d2-66f5b1df95c0 with identifier: 1979681
2026-03-25 16:35:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: c7471d39-9fe7-5380-b6d2-66f5b1df95c0 with identifier: 1979681
2026-03-25 16:35:09 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: c7471d39-9fe7-5380-b6d2-66f5b1df95c0 with identifier: 1979681 to the API
2026-03-25 16:35:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:35:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:35:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Frozen White pastello',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-26T09:30:00Z',
'fuel_type': 'petrol',
'id': 'c7471d39-9fe7-5380-b6d2-66f5b1df95c0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40968',
'listing': 'auction',
'location': None,
'make': 'FORD',
'model': 'FORD PUMA 1.0 Ecoboost 125CV Titanium Auto Sport utility vehicle '
'5-door (Euro 6.2)',
'odometer': 121269,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-10-31',
'seats_number': 5,
'seller_name': None,
'title': 'FORD FORD PUMA 1.0 Ecoboost 125CV Titanium Auto Sport utility '
'vehicle 5-door (Euro 6.2) -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-25 16:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979681%27 HTTP/1.1" 200 None
2026-03-25 16:35:10 [ayvens.it] INFO: Saving data for 1979681: {'auction_closing_time': 1774517400.0, 'created_time': 1774369900.876086, 'last_price_update_time': 1774456510.051454}
2026-03-25 16:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1979681') HTTP/1.1" 204 0
2026-03-25 16:35:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb8/5e476d0705434205ade88f3826dea59f/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:35:10 [ayvens.it] INFO: Found listing with ID: 1979682
2026-03-25 16:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979682%27 HTTP/1.1" 200 None
2026-03-25 16:35:10 [ayvens.it] INFO: Scrape type for 1979682: 2
2026-03-25 16:35:10 [ayvens.it] INFO: Extracting data for car ID: 1979682
2026-03-25 16:35:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 559cf240-cefa-5112-a1a4-f00c7aab06d1 with identifier: 1979682
2026-03-25 16:35:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 559cf240-cefa-5112-a1a4-f00c7aab06d1 with scrape type 2
2026-03-25 16:35:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 559cf240-cefa-5112-a1a4-f00c7aab06d1 with scrape type 2
2026-03-25 16:35:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 559cf240-cefa-5112-a1a4-f00c7aab06d1, identifier: 1979682
2026-03-25 16:35:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:35:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34de448350>
2026-03-25 16:35:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:35:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:35:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:35:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95274bde-7267-5245-a4c3-bf013298eef0/95274bde-7267-5245-a4c3-bf013298eef0_image_7.jpg HTTP/1.1" 201 0
2026-03-25 16:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs0%252F24a9396a6cf74061abd614e97451ce3e%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 16:35:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs0/24a9396a6cf74061abd614e97451ce3e/images/large/8.jpg saved to cache
2026-03-25 16:35:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 95274bde-7267-5245-a4c3-bf013298eef0
2026-03-25 16:35:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 95274bde-7267-5245-a4c3-bf013298eef0, skipping ID generation
2026-03-25 16:35:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 95274bde-7267-5245-a4c3-bf013298eef0 with scrape type 1
2026-03-25 16:35:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 95274bde-7267-5245-a4c3-bf013298eef0 sending to next pipeline
2026-03-25 16:35:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 95274bde-7267-5245-a4c3-bf013298eef0, identifier: 1983658
2026-03-25 16:35:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge9/a549559d3f7d4835a3b18a516e67d64a/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:35:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd8/1450d957cc27479a9d54cff382252d3f/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:35:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 559cf240-cefa-5112-a1a4-f00c7aab06d1 with identifier: 1979682
2026-03-25 16:35:10 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:35:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 559cf240-cefa-5112-a1a4-f00c7aab06d1 with identifier: 1979682
2026-03-25 16:35:10 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 559cf240-cefa-5112-a1a4-f00c7aab06d1 with identifier: 1979682 to the API
2026-03-25 16:35:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:35:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:35:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'BIANCO POLARE PASTELLO',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.9L',
'expiration_date': '2026-03-26T09:30:00Z',
'fuel_type': 'diesel',
'id': '559cf240-cefa-5112-a1a4-f00c7aab06d1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40968',
'listing': 'auction',
'location': None,
'make': 'MERCEDES-BENZ',
'model': 'MERCEDES A-CLASS A 180 D PREMIUM FP',
'odometer': 188407,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-07-21',
'seats_number': 5,
'seller_name': None,
'title': 'MERCEDES-BENZ MERCEDES A-CLASS A 180 D PREMIUM FP -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-25 16:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979682%27 HTTP/1.1" 200 None
2026-03-25 16:35:10 [ayvens.it] INFO: Saving data for 1979682: {'auction_closing_time': 1774517400.0, 'created_time': 1774369902.665206, 'last_price_update_time': 1774456510.566325}
2026-03-25 16:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1979682') HTTP/1.1" 204 0
2026-03-25 16:35:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 95274bde-7267-5245-a4c3-bf013298eef0 with identifier: 1983658
2026-03-25 16:35:10 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:35:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 95274bde-7267-5245-a4c3-bf013298eef0 with identifier: 1983658
2026-03-25 16:35:10 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 95274bde-7267-5245-a4c3-bf013298eef0 with identifier: 1983658 to the API
2026-03-25 16:35:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:35:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:35:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gs0/24a9396a6cf74061abd614e97451ce3e/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Digital White Metallic',
'currency': 'EUR',
'doors_number': 5,
'engine': '',
'expiration_date': '2026-03-27T09:30:00Z',
'fuel_type': 'electric',
'id': '95274bde-7267-5245-a4c3-bf013298eef0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41025',
'listing': 'auction',
'location': None,
'make': 'SMART',
'model': 'SMART #1 66 kWh Pro+ Sport utility vehicle 5-door',
'odometer': 20443,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 69,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95274bde-7267-5245-a4c3-bf013298eef0/95274bde-7267-5245-a4c3-bf013298eef0_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 596933,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs0/24a9396a6cf74061abd614e97451ce3e/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95274bde-7267-5245-a4c3-bf013298eef0/95274bde-7267-5245-a4c3-bf013298eef0_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 641262,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs0/24a9396a6cf74061abd614e97451ce3e/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95274bde-7267-5245-a4c3-bf013298eef0/95274bde-7267-5245-a4c3-bf013298eef0_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 596933,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs0/24a9396a6cf74061abd614e97451ce3e/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95274bde-7267-5245-a4c3-bf013298eef0/95274bde-7267-5245-a4c3-bf013298eef0_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 656563,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs0/24a9396a6cf74061abd614e97451ce3e/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95274bde-7267-5245-a4c3-bf013298eef0/95274bde-7267-5245-a4c3-bf013298eef0_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 709651,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs0/24a9396a6cf74061abd614e97451ce3e/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95274bde-7267-5245-a4c3-bf013298eef0/95274bde-7267-5245-a4c3-bf013298eef0_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 561144,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs0/24a9396a6cf74061abd614e97451ce3e/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95274bde-7267-5245-a4c3-bf013298eef0/95274bde-7267-5245-a4c3-bf013298eef0_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 561859,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs0/24a9396a6cf74061abd614e97451ce3e/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95274bde-7267-5245-a4c3-bf013298eef0/95274bde-7267-5245-a4c3-bf013298eef0_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 416074,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs0/24a9396a6cf74061abd614e97451ce3e/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95274bde-7267-5245-a4c3-bf013298eef0/95274bde-7267-5245-a4c3-bf013298eef0_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 554125,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs0/24a9396a6cf74061abd614e97451ce3e/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95274bde-7267-5245-a4c3-bf013298eef0/95274bde-7267-5245-a4c3-bf013298eef0_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 466780,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs0/24a9396a6cf74061abd614e97451ce3e/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-01-09',
'seats_number': 5,
'seller_name': None,
'title': 'SMART SMART #1 66 kWh Pro+ Sport utility vehicle 5-door -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2024}
2026-03-25 16:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983658%27 HTTP/1.1" 200 None
2026-03-25 16:35:10 [ayvens.it] INFO: Saving data for 1983658: {'created_time': 1774456510.926355, 'last_price_update_time': 1774456510.926365, 'auction_closing_time': 1774603800.0}
2026-03-25 16:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1983658') HTTP/1.1" 204 0
2026-03-25 16:35:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd8/1450d957cc27479a9d54cff382252d3f/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:35:10 [ayvens.it] INFO: Found listing with ID: 1979683
2026-03-25 16:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979683%27 HTTP/1.1" 200 None
2026-03-25 16:35:10 [ayvens.it] INFO: Scrape type for 1979683: 2
2026-03-25 16:35:10 [ayvens.it] INFO: Extracting data for car ID: 1979683
2026-03-25 16:35:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1bdecd24-4767-598e-a968-13f39d1ee307 with identifier: 1979683
2026-03-25 16:35:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1bdecd24-4767-598e-a968-13f39d1ee307 with scrape type 2
2026-03-25 16:35:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1bdecd24-4767-598e-a968-13f39d1ee307 with scrape type 2
2026-03-25 16:35:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 1bdecd24-4767-598e-a968-13f39d1ee307, identifier: 1979683
2026-03-25 16:35:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:35:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc94e590>
2026-03-25 16:35:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:35:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:35:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:35:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05a6e2ea-e98e-5f95-be6b-f6d497a39c9a/05a6e2ea-e98e-5f95-be6b-f6d497a39c9a_image_9.jpg HTTP/1.1" 201 0
2026-03-25 16:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge9%252Fa549559d3f7d4835a3b18a516e67d64a%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 16:35:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge9/a549559d3f7d4835a3b18a516e67d64a/images/large/10.jpg saved to cache
2026-03-25 16:35:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 05a6e2ea-e98e-5f95-be6b-f6d497a39c9a
2026-03-25 16:35:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:35:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcc0a310>
2026-03-25 16:35:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:35:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:35:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:35:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05a6e2ea-e98e-5f95-be6b-f6d497a39c9a/05a6e2ea-e98e-5f95-be6b-f6d497a39c9a_image_8.jpg HTTP/1.1" 201 0
2026-03-25 16:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge9%252Fa549559d3f7d4835a3b18a516e67d64a%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 16:35:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge9/a549559d3f7d4835a3b18a516e67d64a/images/large/9.jpg saved to cache
2026-03-25 16:35:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 05a6e2ea-e98e-5f95-be6b-f6d497a39c9a
2026-03-25 16:35:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 1bdecd24-4767-598e-a968-13f39d1ee307 with identifier: 1979683
2026-03-25 16:35:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 1bdecd24-4767-598e-a968-13f39d1ee307 with identifier: 1979683
2026-03-25 16:35:11 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 1bdecd24-4767-598e-a968-13f39d1ee307 with identifier: 1979683 to the API
2026-03-25 16:35:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:35:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:35:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'BIANCO MINERALE PASTELLO',
'currency': 'EUR',
'doors_number': 4,
'engine': '2.3L',
'expiration_date': '2026-03-26T09:30:00Z',
'fuel_type': 'diesel',
'id': '1bdecd24-4767-598e-a968-13f39d1ee307',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40968',
'listing': 'auction',
'location': None,
'make': 'RENAULT',
'model': 'RENAULT MASTER (PC) FG TA L2 H2 T33 DCI 135 ICE FP',
'odometer': 95856,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-06-20',
'seats_number': 5,
'seller_name': None,
'title': 'RENAULT RENAULT MASTER (PC) FG TA L2 H2 T33 DCI 135 ICE FP -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2023}
2026-03-25 16:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979683%27 HTTP/1.1" 200 None
2026-03-25 16:35:11 [ayvens.it] INFO: Saving data for 1979683: {'auction_closing_time': 1774517400.0, 'created_time': 1774369904.545688, 'last_price_update_time': 1774456511.413493}
2026-03-25 16:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1979683') HTTP/1.1" 204 0
2026-03-25 16:35:11 [ayvens.it] INFO: Found listing with ID: 1979684
2026-03-25 16:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979684%27 HTTP/1.1" 200 None
2026-03-25 16:35:11 [ayvens.it] INFO: Scrape type for 1979684: 2
2026-03-25 16:35:11 [ayvens.it] INFO: Extracting data for car ID: 1979684
2026-03-25 16:35:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1db772d4-2809-5f73-9965-adcd3d68dce9 with identifier: 1979684
2026-03-25 16:35:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1db772d4-2809-5f73-9965-adcd3d68dce9 with scrape type 2
2026-03-25 16:35:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1db772d4-2809-5f73-9965-adcd3d68dce9 with scrape type 2
2026-03-25 16:35:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 1db772d4-2809-5f73-9965-adcd3d68dce9, identifier: 1979684
2026-03-25 16:35:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:35:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc5ac710>
2026-03-25 16:35:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:35:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:35:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:35:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dcb399f9-d9cb-5963-880f-81846afd1cae/dcb399f9-d9cb-5963-880f-81846afd1cae_image_7.jpg HTTP/1.1" 201 0
2026-03-25 16:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb8%252F5e476d0705434205ade88f3826dea59f%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 16:35:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb8/5e476d0705434205ade88f3826dea59f/images/large/8.jpg saved to cache
2026-03-25 16:35:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item dcb399f9-d9cb-5963-880f-81846afd1cae
2026-03-25 16:35:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: dcb399f9-d9cb-5963-880f-81846afd1cae, skipping ID generation
2026-03-25 16:35:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dcb399f9-d9cb-5963-880f-81846afd1cae with scrape type 1
2026-03-25 16:35:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item dcb399f9-d9cb-5963-880f-81846afd1cae sending to next pipeline
2026-03-25 16:35:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: dcb399f9-d9cb-5963-880f-81846afd1cae, identifier: 1983656
2026-03-25 16:35:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:35:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc35b850>
2026-03-25 16:35:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:35:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:35:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:35:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05a6e2ea-e98e-5f95-be6b-f6d497a39c9a/05a6e2ea-e98e-5f95-be6b-f6d497a39c9a_image_7.jpg HTTP/1.1" 201 0
2026-03-25 16:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge9%252Fa549559d3f7d4835a3b18a516e67d64a%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 16:35:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge9/a549559d3f7d4835a3b18a516e67d64a/images/large/8.jpg saved to cache
2026-03-25 16:35:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 05a6e2ea-e98e-5f95-be6b-f6d497a39c9a
2026-03-25 16:35:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 05a6e2ea-e98e-5f95-be6b-f6d497a39c9a, skipping ID generation
2026-03-25 16:35:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 05a6e2ea-e98e-5f95-be6b-f6d497a39c9a with scrape type 1
2026-03-25 16:35:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 05a6e2ea-e98e-5f95-be6b-f6d497a39c9a sending to next pipeline
2026-03-25 16:35:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 05a6e2ea-e98e-5f95-be6b-f6d497a39c9a, identifier: 1983657
2026-03-25 16:35:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:35:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dca22b10>
2026-03-25 16:35:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:35:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:35:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:35:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7bb69958-3da4-524f-a7f1-87281c287245/7bb69958-3da4-524f-a7f1-87281c287245_image_7.jpg HTTP/1.1" 201 0
2026-03-25 16:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd8%252F1450d957cc27479a9d54cff382252d3f%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 16:35:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd8/1450d957cc27479a9d54cff382252d3f/images/large/8.jpg saved to cache
2026-03-25 16:35:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7bb69958-3da4-524f-a7f1-87281c287245
2026-03-25 16:35:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 1db772d4-2809-5f73-9965-adcd3d68dce9 with identifier: 1979684
2026-03-25 16:35:12 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:35:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 1db772d4-2809-5f73-9965-adcd3d68dce9 with identifier: 1979684
2026-03-25 16:35:12 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 1db772d4-2809-5f73-9965-adcd3d68dce9 with identifier: 1979684 to the API
2026-03-25 16:35:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:35:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:35:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Unknown',
'currency': 'EUR',
'doors_number': 5,
'engine': '',
'expiration_date': '2026-03-26T09:30:00Z',
'fuel_type': 'electric',
'id': '1db772d4-2809-5f73-9965-adcd3d68dce9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40968',
'listing': 'auction',
'location': None,
'make': 'FORD',
'model': 'FORD MUSTANG MACH-E 269CV Standard Range Sport utility vehicle '
'5-door',
'odometer': 13351,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-08-29',
'seats_number': 5,
'seller_name': None,
'title': 'FORD FORD MUSTANG MACH-E 269CV Standard Range Sport utility vehicle '
'5-door -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2023}
2026-03-25 16:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979684%27 HTTP/1.1" 200 None
2026-03-25 16:35:12 [ayvens.it] INFO: Saving data for 1979684: {'auction_closing_time': 1774517400.0, 'created_time': 1774369906.670708, 'last_price_update_time': 1774456512.293077}
2026-03-25 16:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1979684') HTTP/1.1" 204 0
2026-03-25 16:35:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: dcb399f9-d9cb-5963-880f-81846afd1cae with identifier: 1983656
2026-03-25 16:35:12 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:35:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: dcb399f9-d9cb-5963-880f-81846afd1cae with identifier: 1983656
2026-03-25 16:35:12 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: dcb399f9-d9cb-5963-880f-81846afd1cae with identifier: 1983656 to the API
2026-03-25 16:35:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:35:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:35:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gb8/5e476d0705434205ade88f3826dea59f/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'SCHWARZ PASTELLO',
'currency': 'EUR',
'doors_number': 5,
'engine': '3.0L',
'expiration_date': '2026-03-27T09:30:00Z',
'fuel_type': 'diesel',
'id': 'dcb399f9-d9cb-5963-880f-81846afd1cae',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41025',
'listing': 'auction',
'location': None,
'make': 'BMW',
'model': 'BMW SERIES 3 SW 330D XDRIVE BUSINESS ADVANT. TOURING AUT FP',
'odometer': 95858,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 58,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dcb399f9-d9cb-5963-880f-81846afd1cae/dcb399f9-d9cb-5963-880f-81846afd1cae_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 777651,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb8/5e476d0705434205ade88f3826dea59f/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dcb399f9-d9cb-5963-880f-81846afd1cae/dcb399f9-d9cb-5963-880f-81846afd1cae_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 697775,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb8/5e476d0705434205ade88f3826dea59f/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dcb399f9-d9cb-5963-880f-81846afd1cae/dcb399f9-d9cb-5963-880f-81846afd1cae_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 777651,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb8/5e476d0705434205ade88f3826dea59f/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dcb399f9-d9cb-5963-880f-81846afd1cae/dcb399f9-d9cb-5963-880f-81846afd1cae_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 748762,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb8/5e476d0705434205ade88f3826dea59f/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dcb399f9-d9cb-5963-880f-81846afd1cae/dcb399f9-d9cb-5963-880f-81846afd1cae_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 768337,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb8/5e476d0705434205ade88f3826dea59f/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dcb399f9-d9cb-5963-880f-81846afd1cae/dcb399f9-d9cb-5963-880f-81846afd1cae_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 591359,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb8/5e476d0705434205ade88f3826dea59f/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dcb399f9-d9cb-5963-880f-81846afd1cae/dcb399f9-d9cb-5963-880f-81846afd1cae_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 526034,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb8/5e476d0705434205ade88f3826dea59f/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dcb399f9-d9cb-5963-880f-81846afd1cae/dcb399f9-d9cb-5963-880f-81846afd1cae_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 511369,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb8/5e476d0705434205ade88f3826dea59f/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dcb399f9-d9cb-5963-880f-81846afd1cae/dcb399f9-d9cb-5963-880f-81846afd1cae_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 628450,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb8/5e476d0705434205ade88f3826dea59f/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dcb399f9-d9cb-5963-880f-81846afd1cae/dcb399f9-d9cb-5963-880f-81846afd1cae_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 578435,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb8/5e476d0705434205ade88f3826dea59f/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-07-23',
'seats_number': 5,
'seller_name': None,
'title': 'BMW BMW SERIES 3 SW 330D XDRIVE BUSINESS ADVANT. TOURING AUT FP -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2020}
2026-03-25 16:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983656%27 HTTP/1.1" 200 None
2026-03-25 16:35:12 [ayvens.it] INFO: Saving data for 1983656: {'created_time': 1774456512.637146, 'last_price_update_time': 1774456512.637156, 'auction_closing_time': 1774603800.0}
2026-03-25 16:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1983656') HTTP/1.1" 204 0
2026-03-25 16:35:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 05a6e2ea-e98e-5f95-be6b-f6d497a39c9a with identifier: 1983657
2026-03-25 16:35:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 05a6e2ea-e98e-5f95-be6b-f6d497a39c9a with identifier: 1983657
2026-03-25 16:35:12 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 05a6e2ea-e98e-5f95-be6b-f6d497a39c9a with identifier: 1983657 to the API
2026-03-25 16:35:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:35:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:35:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/ge9/a549559d3f7d4835a3b18a516e67d64a/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'BIANCO GELATO PASTELLO',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-27T09:30:00Z',
'fuel_type': 'petrol',
'id': '05a6e2ea-e98e-5f95-be6b-f6d497a39c9a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41025',
'listing': 'auction',
'location': None,
'make': 'FIAT',
'model': 'FIAT PANDA (PC) 1.2 69CV E6 EASY FP',
'odometer': 95263,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 57,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05a6e2ea-e98e-5f95-be6b-f6d497a39c9a/05a6e2ea-e98e-5f95-be6b-f6d497a39c9a_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 680804,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge9/a549559d3f7d4835a3b18a516e67d64a/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05a6e2ea-e98e-5f95-be6b-f6d497a39c9a/05a6e2ea-e98e-5f95-be6b-f6d497a39c9a_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 671708,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge9/a549559d3f7d4835a3b18a516e67d64a/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05a6e2ea-e98e-5f95-be6b-f6d497a39c9a/05a6e2ea-e98e-5f95-be6b-f6d497a39c9a_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 680804,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge9/a549559d3f7d4835a3b18a516e67d64a/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05a6e2ea-e98e-5f95-be6b-f6d497a39c9a/05a6e2ea-e98e-5f95-be6b-f6d497a39c9a_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 637267,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge9/a549559d3f7d4835a3b18a516e67d64a/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05a6e2ea-e98e-5f95-be6b-f6d497a39c9a/05a6e2ea-e98e-5f95-be6b-f6d497a39c9a_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 644807,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge9/a549559d3f7d4835a3b18a516e67d64a/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05a6e2ea-e98e-5f95-be6b-f6d497a39c9a/05a6e2ea-e98e-5f95-be6b-f6d497a39c9a_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 566792,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge9/a549559d3f7d4835a3b18a516e67d64a/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05a6e2ea-e98e-5f95-be6b-f6d497a39c9a/05a6e2ea-e98e-5f95-be6b-f6d497a39c9a_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 601091,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge9/a549559d3f7d4835a3b18a516e67d64a/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05a6e2ea-e98e-5f95-be6b-f6d497a39c9a/05a6e2ea-e98e-5f95-be6b-f6d497a39c9a_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 558736,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge9/a549559d3f7d4835a3b18a516e67d64a/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05a6e2ea-e98e-5f95-be6b-f6d497a39c9a/05a6e2ea-e98e-5f95-be6b-f6d497a39c9a_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 573147,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge9/a549559d3f7d4835a3b18a516e67d64a/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05a6e2ea-e98e-5f95-be6b-f6d497a39c9a/05a6e2ea-e98e-5f95-be6b-f6d497a39c9a_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 470421,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge9/a549559d3f7d4835a3b18a516e67d64a/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-02-23',
'seats_number': 5,
'seller_name': None,
'title': 'FIAT FIAT PANDA (PC) 1.2 69CV E6 EASY FP -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2021}
2026-03-25 16:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983657%27 HTTP/1.1" 200 None
2026-03-25 16:35:12 [ayvens.it] INFO: Saving data for 1983657: {'created_time': 1774456512.968708, 'last_price_update_time': 1774456512.968718, 'auction_closing_time': 1774603800.0}
2026-03-25 16:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1983657') HTTP/1.1" 204 0
2026-03-25 16:35:13 [ayvens.it] INFO: Found listing with ID: 1979685
2026-03-25 16:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979685%27 HTTP/1.1" 200 None
2026-03-25 16:35:13 [ayvens.it] INFO: Scrape type for 1979685: 2
2026-03-25 16:35:13 [ayvens.it] INFO: Extracting data for car ID: 1979685
2026-03-25 16:35:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 754ee9de-524c-57d6-a01b-445bd30d65cb with identifier: 1979685
2026-03-25 16:35:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 754ee9de-524c-57d6-a01b-445bd30d65cb with scrape type 2
2026-03-25 16:35:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 754ee9de-524c-57d6-a01b-445bd30d65cb with scrape type 2
2026-03-25 16:35:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 754ee9de-524c-57d6-a01b-445bd30d65cb, identifier: 1979685
2026-03-25 16:35:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge1/eee8c5d66241403d801d1d1d8535fb6e/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:35:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 754ee9de-524c-57d6-a01b-445bd30d65cb with identifier: 1979685
2026-03-25 16:35:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 754ee9de-524c-57d6-a01b-445bd30d65cb with identifier: 1979685
2026-03-25 16:35:13 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 754ee9de-524c-57d6-a01b-445bd30d65cb with identifier: 1979685 to the API
2026-03-25 16:35:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:35:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:35:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Generic Color',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-26T09:30:00Z',
'fuel_type': 'hybrid',
'id': '754ee9de-524c-57d6-a01b-445bd30d65cb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40968',
'listing': 'auction',
'location': None,
'make': 'FORD',
'model': 'FORD FIESTA (PC) 1.0 ECOBOOST HYBRID 125CV S&S TITANIUM FP',
'odometer': 237659,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-11-22',
'seats_number': 5,
'seller_name': None,
'title': 'FORD FORD FIESTA (PC) 1.0 ECOBOOST HYBRID 125CV S&S TITANIUM FP -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-25 16:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979685%27 HTTP/1.1" 200 None
2026-03-25 16:35:13 [ayvens.it] INFO: Saving data for 1979685: {'auction_closing_time': 1774517400.0, 'created_time': 1774369908.734138, 'last_price_update_time': 1774456513.343853}
2026-03-25 16:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1979685') HTTP/1.1" 204 0
2026-03-25 16:35:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:35:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34d7437190>
2026-03-25 16:35:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:35:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:35:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:35:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7bb69958-3da4-524f-a7f1-87281c287245/7bb69958-3da4-524f-a7f1-87281c287245_image_8.jpg HTTP/1.1" 201 0
2026-03-25 16:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd8%252F1450d957cc27479a9d54cff382252d3f%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 16:35:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd8/1450d957cc27479a9d54cff382252d3f/images/large/9.jpg saved to cache
2026-03-25 16:35:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7bb69958-3da4-524f-a7f1-87281c287245
2026-03-25 16:35:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7bb69958-3da4-524f-a7f1-87281c287245, skipping ID generation
2026-03-25 16:35:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7bb69958-3da4-524f-a7f1-87281c287245 with scrape type 1
2026-03-25 16:35:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7bb69958-3da4-524f-a7f1-87281c287245 sending to next pipeline
2026-03-25 16:35:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 7bb69958-3da4-524f-a7f1-87281c287245, identifier: 1983655
2026-03-25 16:35:13 [ayvens.it] INFO: Found listing with ID: 1979686
2026-03-25 16:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979686%27 HTTP/1.1" 200 None
2026-03-25 16:35:13 [ayvens.it] INFO: Scrape type for 1979686: 2
2026-03-25 16:35:13 [ayvens.it] INFO: Extracting data for car ID: 1979686
2026-03-25 16:35:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6f2367e9-e347-58f2-9106-826eb9ff10e8 with identifier: 1979686
2026-03-25 16:35:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6f2367e9-e347-58f2-9106-826eb9ff10e8 with scrape type 2
2026-03-25 16:35:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6f2367e9-e347-58f2-9106-826eb9ff10e8 with scrape type 2
2026-03-25 16:35:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 6f2367e9-e347-58f2-9106-826eb9ff10e8, identifier: 1979686
2026-03-25 16:35:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 7bb69958-3da4-524f-a7f1-87281c287245 with identifier: 1983655
2026-03-25 16:35:13 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:35:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 7bb69958-3da4-524f-a7f1-87281c287245 with identifier: 1983655
2026-03-25 16:35:13 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 7bb69958-3da4-524f-a7f1-87281c287245 with identifier: 1983655 to the API
2026-03-25 16:35:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:35:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:35:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gd8/1450d957cc27479a9d54cff382252d3f/images/large/9.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'ATLANTIC BLUE METALL',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-27T09:30:00Z',
'fuel_type': 'diesel',
'id': '7bb69958-3da4-524f-a7f1-87281c287245',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41025',
'listing': 'auction',
'location': None,
'make': 'VOLKSWAGEN',
'model': 'VOLKSWAGEN T-ROC (PC) 1.6 TDI SCR BUSINESS',
'odometer': 168725,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 31,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7bb69958-3da4-524f-a7f1-87281c287245/7bb69958-3da4-524f-a7f1-87281c287245_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 683520,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd8/1450d957cc27479a9d54cff382252d3f/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7bb69958-3da4-524f-a7f1-87281c287245/7bb69958-3da4-524f-a7f1-87281c287245_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 694572,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd8/1450d957cc27479a9d54cff382252d3f/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7bb69958-3da4-524f-a7f1-87281c287245/7bb69958-3da4-524f-a7f1-87281c287245_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 683520,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd8/1450d957cc27479a9d54cff382252d3f/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7bb69958-3da4-524f-a7f1-87281c287245/7bb69958-3da4-524f-a7f1-87281c287245_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 569140,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd8/1450d957cc27479a9d54cff382252d3f/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7bb69958-3da4-524f-a7f1-87281c287245/7bb69958-3da4-524f-a7f1-87281c287245_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 571815,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd8/1450d957cc27479a9d54cff382252d3f/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7bb69958-3da4-524f-a7f1-87281c287245/7bb69958-3da4-524f-a7f1-87281c287245_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 679352,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd8/1450d957cc27479a9d54cff382252d3f/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7bb69958-3da4-524f-a7f1-87281c287245/7bb69958-3da4-524f-a7f1-87281c287245_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 487370,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd8/1450d957cc27479a9d54cff382252d3f/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7bb69958-3da4-524f-a7f1-87281c287245/7bb69958-3da4-524f-a7f1-87281c287245_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 403924,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd8/1450d957cc27479a9d54cff382252d3f/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7bb69958-3da4-524f-a7f1-87281c287245/7bb69958-3da4-524f-a7f1-87281c287245_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 504261,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd8/1450d957cc27479a9d54cff382252d3f/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7bb69958-3da4-524f-a7f1-87281c287245/7bb69958-3da4-524f-a7f1-87281c287245_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 474649,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd8/1450d957cc27479a9d54cff382252d3f/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-12-11',
'seats_number': 5,
'seller_name': None,
'title': 'VOLKSWAGEN VOLKSWAGEN T-ROC (PC) 1.6 TDI SCR BUSINESS -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2020}
2026-03-25 16:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983655%27 HTTP/1.1" 200 None
2026-03-25 16:35:13 [ayvens.it] INFO: Saving data for 1983655: {'created_time': 1774456513.912921, 'last_price_update_time': 1774456513.912932, 'auction_closing_time': 1774603800.0}
2026-03-25 16:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1983655') HTTP/1.1" 204 0
2026-03-25 16:35:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg3/512ea53b1dcd45d0af220de05282a961/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:35:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 6f2367e9-e347-58f2-9106-826eb9ff10e8 with identifier: 1979686
2026-03-25 16:35:13 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:35:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 6f2367e9-e347-58f2-9106-826eb9ff10e8 with identifier: 1979686
2026-03-25 16:35:14 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 6f2367e9-e347-58f2-9106-826eb9ff10e8 with identifier: 1979686 to the API
2026-03-25 16:35:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:35:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:35:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Rosso Passione pastello',
'currency': 'EUR',
'doors_number': 3,
'engine': '1.0L',
'expiration_date': '2026-03-26T09:30:00Z',
'fuel_type': 'hybrid',
'id': '6f2367e9-e347-58f2-9106-826eb9ff10e8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40968',
'listing': 'auction',
'location': None,
'make': 'FIAT',
'model': 'FIAT 500 1.0 70cv Ibrido Hatchback 3-door',
'odometer': 48318,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-07-28',
'seats_number': 5,
'seller_name': None,
'title': 'FIAT FIAT 500 1.0 70cv Ibrido Hatchback 3-door -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2023}
2026-03-25 16:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979686%27 HTTP/1.1" 200 None
2026-03-25 16:35:14 [ayvens.it] INFO: Saving data for 1979686: {'auction_closing_time': 1774517400.0, 'created_time': 1774369910.084174, 'last_price_update_time': 1774456514.243148}
2026-03-25 16:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1979686') HTTP/1.1" 204 0
2026-03-25 16:35:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge1/eee8c5d66241403d801d1d1d8535fb6e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:35:14 [ayvens.it] INFO: Found listing with ID: 1979687
2026-03-25 16:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979687%27 HTTP/1.1" 200 None
2026-03-25 16:35:14 [ayvens.it] INFO: Scrape type for 1979687: 2
2026-03-25 16:35:14 [ayvens.it] INFO: Extracting data for car ID: 1979687
2026-03-25 16:35:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0b0e9d38-4d7a-560d-9da7-6edb7721983a with identifier: 1979687
2026-03-25 16:35:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0b0e9d38-4d7a-560d-9da7-6edb7721983a with scrape type 2
2026-03-25 16:35:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0b0e9d38-4d7a-560d-9da7-6edb7721983a with scrape type 2
2026-03-25 16:35:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 0b0e9d38-4d7a-560d-9da7-6edb7721983a, identifier: 1979687
2026-03-25 16:35:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg3/512ea53b1dcd45d0af220de05282a961/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:35:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 0b0e9d38-4d7a-560d-9da7-6edb7721983a with identifier: 1979687
2026-03-25 16:35:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 0b0e9d38-4d7a-560d-9da7-6edb7721983a with identifier: 1979687
2026-03-25 16:35:14 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 0b0e9d38-4d7a-560d-9da7-6edb7721983a with identifier: 1979687 to the API
2026-03-25 16:35:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:35:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:35:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'BIANCO PASTELLO',
'currency': 'EUR',
'doors_number': 4,
'engine': '2.0L',
'expiration_date': '2026-03-26T09:30:00Z',
'fuel_type': 'diesel',
'id': '0b0e9d38-4d7a-560d-9da7-6edb7721983a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40968',
'listing': 'auction',
'location': None,
'make': 'FIAT',
'model': 'FIAT DUCATO 35 MH1 2.0 Mjet 16V 115CV ALU Dop.Cab. Cassone a sponde '
'abbattibili doppia cabina 4-door',
'odometer': 127710,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-11-27',
'seats_number': 5,
'seller_name': None,
'title': 'FIAT FIAT DUCATO 35 MH1 2.0 Mjet 16V 115CV ALU Dop.Cab. Cassone a '
'sponde abbattibili doppia cabina 4-door -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2018}
2026-03-25 16:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979687%27 HTTP/1.1" 200 None
2026-03-25 16:35:14 [ayvens.it] INFO: Saving data for 1979687: {'auction_closing_time': 1774517400.0, 'created_time': 1774369911.670183, 'last_price_update_time': 1774456514.578835}
2026-03-25 16:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1979687') HTTP/1.1" 204 0
2026-03-25 16:35:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:35:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34de185b90>
2026-03-25 16:35:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:35:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:35:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:35:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25ed13e5-aeaa-5bf4-a336-be76cf36f272/25ed13e5-aeaa-5bf4-a336-be76cf36f272_image_7.jpg HTTP/1.1" 201 0
2026-03-25 16:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge1%252Feee8c5d66241403d801d1d1d8535fb6e%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 16:35:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge1/eee8c5d66241403d801d1d1d8535fb6e/images/large/8.jpg saved to cache
2026-03-25 16:35:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 25ed13e5-aeaa-5bf4-a336-be76cf36f272
2026-03-25 16:35:14 [ayvens.it] INFO: Found listing with ID: 1979688
2026-03-25 16:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979688%27 HTTP/1.1" 200 None
2026-03-25 16:35:14 [ayvens.it] INFO: Scrape type for 1979688: 2
2026-03-25 16:35:14 [ayvens.it] INFO: Extracting data for car ID: 1979688
2026-03-25 16:35:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 076f401b-f5d2-5390-8b2e-7d1eff007f1c with identifier: 1979688
2026-03-25 16:35:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 076f401b-f5d2-5390-8b2e-7d1eff007f1c with scrape type 2
2026-03-25 16:35:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 076f401b-f5d2-5390-8b2e-7d1eff007f1c with scrape type 2
2026-03-25 16:35:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 076f401b-f5d2-5390-8b2e-7d1eff007f1c, identifier: 1979688
2026-03-25 16:35:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga7/5eef134e2c3a4be68ac51ea2f852e943/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:35:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga7/5eef134e2c3a4be68ac51ea2f852e943/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:35:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 076f401b-f5d2-5390-8b2e-7d1eff007f1c with identifier: 1979688
2026-03-25 16:35:14 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:35:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 076f401b-f5d2-5390-8b2e-7d1eff007f1c with identifier: 1979688
2026-03-25 16:35:15 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 076f401b-f5d2-5390-8b2e-7d1eff007f1c with identifier: 1979688 to the API
2026-03-25 16:35:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:35:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:35:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'WHITE PEARL',
'currency': 'EUR',
'doors_number': 5,
'engine': '',
'expiration_date': '2026-03-26T09:30:00Z',
'fuel_type': 'electric',
'id': '076f401b-f5d2-5390-8b2e-7d1eff007f1c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40968',
'listing': 'auction',
'location': None,
'make': 'NISSAN',
'model': 'NISSAN LEAF (PC) E+ N-CONNECTA FP',
'odometer': 10245,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-08-25',
'seats_number': 5,
'seller_name': None,
'title': 'NISSAN NISSAN LEAF (PC) E+ N-CONNECTA FP -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2021}
2026-03-25 16:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979688%27 HTTP/1.1" 200 None
2026-03-25 16:35:15 [ayvens.it] INFO: Saving data for 1979688: {'auction_closing_time': 1774517400.0, 'created_time': 1774369913.440161, 'last_price_update_time': 1774456515.309804}
2026-03-25 16:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1979688') HTTP/1.1" 204 0
2026-03-25 16:35:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga7/5eef134e2c3a4be68ac51ea2f852e943/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:35:15 [ayvens.it] INFO: Found listing with ID: 1979689
2026-03-25 16:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979689%27 HTTP/1.1" 200 None
2026-03-25 16:35:15 [ayvens.it] INFO: Scrape type for 1979689: 2
2026-03-25 16:35:15 [ayvens.it] INFO: Extracting data for car ID: 1979689
2026-03-25 16:35:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6859d15b-a63d-508d-ac3e-167906ce6430 with identifier: 1979689
2026-03-25 16:35:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6859d15b-a63d-508d-ac3e-167906ce6430 with scrape type 2
2026-03-25 16:35:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6859d15b-a63d-508d-ac3e-167906ce6430 with scrape type 2
2026-03-25 16:35:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 6859d15b-a63d-508d-ac3e-167906ce6430, identifier: 1979689
2026-03-25 16:35:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:35:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcd9d310>
2026-03-25 16:35:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:35:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:35:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:35:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25812a36-404f-5fd2-a60d-14a5f17164c2/25812a36-404f-5fd2-a60d-14a5f17164c2_image_9.jpg HTTP/1.1" 201 0
2026-03-25 16:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg3%252F512ea53b1dcd45d0af220de05282a961%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 16:35:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg3/512ea53b1dcd45d0af220de05282a961/images/large/10.jpg saved to cache
2026-03-25 16:35:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 25812a36-404f-5fd2-a60d-14a5f17164c2
2026-03-25 16:35:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:35:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dca740d0>
2026-03-25 16:35:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:35:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:35:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:35:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25ed13e5-aeaa-5bf4-a336-be76cf36f272/25ed13e5-aeaa-5bf4-a336-be76cf36f272_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge1%252Feee8c5d66241403d801d1d1d8535fb6e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 16:35:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge1/eee8c5d66241403d801d1d1d8535fb6e/images/large/1.jpg saved to cache
2026-03-25 16:35:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 25ed13e5-aeaa-5bf4-a336-be76cf36f272
2026-03-25 16:35:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 25ed13e5-aeaa-5bf4-a336-be76cf36f272, skipping ID generation
2026-03-25 16:35:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 25ed13e5-aeaa-5bf4-a336-be76cf36f272 with scrape type 1
2026-03-25 16:35:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 25ed13e5-aeaa-5bf4-a336-be76cf36f272 sending to next pipeline
2026-03-25 16:35:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 25ed13e5-aeaa-5bf4-a336-be76cf36f272, identifier: 1983654
2026-03-25 16:35:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:35:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcc4c390>
2026-03-25 16:35:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:35:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:35:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:35:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25812a36-404f-5fd2-a60d-14a5f17164c2/25812a36-404f-5fd2-a60d-14a5f17164c2_image_8.jpg HTTP/1.1" 201 0
2026-03-25 16:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg3%252F512ea53b1dcd45d0af220de05282a961%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 16:35:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg3/512ea53b1dcd45d0af220de05282a961/images/large/9.jpg saved to cache
2026-03-25 16:35:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 25812a36-404f-5fd2-a60d-14a5f17164c2
2026-03-25 16:35:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 25812a36-404f-5fd2-a60d-14a5f17164c2, skipping ID generation
2026-03-25 16:35:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 25812a36-404f-5fd2-a60d-14a5f17164c2 with scrape type 1
2026-03-25 16:35:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 25812a36-404f-5fd2-a60d-14a5f17164c2 sending to next pipeline
2026-03-25 16:35:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 25812a36-404f-5fd2-a60d-14a5f17164c2, identifier: 1983653
2026-03-25 16:35:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 6859d15b-a63d-508d-ac3e-167906ce6430 with identifier: 1979689
2026-03-25 16:35:15 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:35:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 6859d15b-a63d-508d-ac3e-167906ce6430 with identifier: 1979689
2026-03-25 16:35:15 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 6859d15b-a63d-508d-ac3e-167906ce6430 with identifier: 1979689 to the API
2026-03-25 16:35:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:35:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:35:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'DEEP BLACK PERLA',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-26T09:30:00Z',
'fuel_type': 'diesel',
'id': '6859d15b-a63d-508d-ac3e-167906ce6430',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40968',
'listing': 'auction',
'location': None,
'make': 'VOLKSWAGEN',
'model': 'VOLKSWAGEN TIGUAN 2.0 TDI SCR 110KW ELEGANCE DSG FP',
'odometer': 173247,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-06-29',
'seats_number': 5,
'seller_name': None,
'title': 'VOLKSWAGEN VOLKSWAGEN TIGUAN 2.0 TDI SCR 110KW ELEGANCE DSG FP -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2021}
2026-03-25 16:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979689%27 HTTP/1.1" 200 None
2026-03-25 16:35:16 [ayvens.it] INFO: Saving data for 1979689: {'auction_closing_time': 1774517400.0, 'created_time': 1774369915.667045, 'last_price_update_time': 1774456516.040895}
2026-03-25 16:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1979689') HTTP/1.1" 204 0
2026-03-25 16:35:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 25ed13e5-aeaa-5bf4-a336-be76cf36f272 with identifier: 1983654
2026-03-25 16:35:16 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:35:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 25ed13e5-aeaa-5bf4-a336-be76cf36f272 with identifier: 1983654
2026-03-25 16:35:16 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 25ed13e5-aeaa-5bf4-a336-be76cf36f272 with identifier: 1983654 to the API
2026-03-25 16:35:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:35:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:35:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/ge1/eee8c5d66241403d801d1d1d8535fb6e/images/large/1.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'MOONWALK GREY METALLIZZATO',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-27T09:30:00Z',
'fuel_type': 'hybrid',
'id': '25ed13e5-aeaa-5bf4-a336-be76cf36f272',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41025',
'listing': 'auction',
'location': None,
'make': 'MINI',
'model': 'MINI COUNTRYMAN Cooper S E ALL4 Business autom. Hatchback 5-door '
'(Euro 6.2)',
'odometer': 140404,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 22,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25ed13e5-aeaa-5bf4-a336-be76cf36f272/25ed13e5-aeaa-5bf4-a336-be76cf36f272_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 811175,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge1/eee8c5d66241403d801d1d1d8535fb6e/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25ed13e5-aeaa-5bf4-a336-be76cf36f272/25ed13e5-aeaa-5bf4-a336-be76cf36f272_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 828905,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge1/eee8c5d66241403d801d1d1d8535fb6e/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25ed13e5-aeaa-5bf4-a336-be76cf36f272/25ed13e5-aeaa-5bf4-a336-be76cf36f272_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 811175,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge1/eee8c5d66241403d801d1d1d8535fb6e/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25ed13e5-aeaa-5bf4-a336-be76cf36f272/25ed13e5-aeaa-5bf4-a336-be76cf36f272_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 809100,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge1/eee8c5d66241403d801d1d1d8535fb6e/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25ed13e5-aeaa-5bf4-a336-be76cf36f272/25ed13e5-aeaa-5bf4-a336-be76cf36f272_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 844035,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge1/eee8c5d66241403d801d1d1d8535fb6e/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25ed13e5-aeaa-5bf4-a336-be76cf36f272/25ed13e5-aeaa-5bf4-a336-be76cf36f272_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 768908,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge1/eee8c5d66241403d801d1d1d8535fb6e/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25ed13e5-aeaa-5bf4-a336-be76cf36f272/25ed13e5-aeaa-5bf4-a336-be76cf36f272_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 817750,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge1/eee8c5d66241403d801d1d1d8535fb6e/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25ed13e5-aeaa-5bf4-a336-be76cf36f272/25ed13e5-aeaa-5bf4-a336-be76cf36f272_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 703899,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge1/eee8c5d66241403d801d1d1d8535fb6e/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25ed13e5-aeaa-5bf4-a336-be76cf36f272/25ed13e5-aeaa-5bf4-a336-be76cf36f272_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 747686,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge1/eee8c5d66241403d801d1d1d8535fb6e/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25ed13e5-aeaa-5bf4-a336-be76cf36f272/25ed13e5-aeaa-5bf4-a336-be76cf36f272_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 646162,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge1/eee8c5d66241403d801d1d1d8535fb6e/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-01-20',
'seats_number': 5,
'seller_name': None,
'title': 'MINI MINI COUNTRYMAN Cooper S E ALL4 Business autom. Hatchback '
'5-door (Euro 6.2) -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2021}
2026-03-25 16:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983654%27 HTTP/1.1" 200 None
2026-03-25 16:35:17 [ayvens.it] INFO: Saving data for 1983654: {'created_time': 1774456517.615052, 'last_price_update_time': 1774456517.615065, 'auction_closing_time': 1774603800.0}
2026-03-25 16:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1983654') HTTP/1.1" 204 0
2026-03-25 16:35:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 25812a36-404f-5fd2-a60d-14a5f17164c2 with identifier: 1983653
2026-03-25 16:35:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 25812a36-404f-5fd2-a60d-14a5f17164c2 with identifier: 1983653
2026-03-25 16:35:17 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 25812a36-404f-5fd2-a60d-14a5f17164c2 with identifier: 1983653 to the API
2026-03-25 16:35:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:35:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:35:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gg3/512ea53b1dcd45d0af220de05282a961/images/large/9.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'GRIGIO CRISTALLO MTZ',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-27T09:30:00Z',
'fuel_type': 'diesel',
'id': '25812a36-404f-5fd2-a60d-14a5f17164c2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41025',
'listing': 'auction',
'location': None,
'make': 'CITROËN',
'model': 'CITROEN DS 7 CROSSBACK BLUEHDI 130 AUTOMATICA BUSINESS (PC) FP',
'odometer': 78538,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 39,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25812a36-404f-5fd2-a60d-14a5f17164c2/25812a36-404f-5fd2-a60d-14a5f17164c2_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 735752,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg3/512ea53b1dcd45d0af220de05282a961/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25812a36-404f-5fd2-a60d-14a5f17164c2/25812a36-404f-5fd2-a60d-14a5f17164c2_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 706493,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg3/512ea53b1dcd45d0af220de05282a961/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25812a36-404f-5fd2-a60d-14a5f17164c2/25812a36-404f-5fd2-a60d-14a5f17164c2_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 735752,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg3/512ea53b1dcd45d0af220de05282a961/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25812a36-404f-5fd2-a60d-14a5f17164c2/25812a36-404f-5fd2-a60d-14a5f17164c2_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 682907,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg3/512ea53b1dcd45d0af220de05282a961/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25812a36-404f-5fd2-a60d-14a5f17164c2/25812a36-404f-5fd2-a60d-14a5f17164c2_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 646123,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg3/512ea53b1dcd45d0af220de05282a961/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25812a36-404f-5fd2-a60d-14a5f17164c2/25812a36-404f-5fd2-a60d-14a5f17164c2_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 507811,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg3/512ea53b1dcd45d0af220de05282a961/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25812a36-404f-5fd2-a60d-14a5f17164c2/25812a36-404f-5fd2-a60d-14a5f17164c2_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 538267,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg3/512ea53b1dcd45d0af220de05282a961/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25812a36-404f-5fd2-a60d-14a5f17164c2/25812a36-404f-5fd2-a60d-14a5f17164c2_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 611609,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg3/512ea53b1dcd45d0af220de05282a961/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25812a36-404f-5fd2-a60d-14a5f17164c2/25812a36-404f-5fd2-a60d-14a5f17164c2_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 567874,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg3/512ea53b1dcd45d0af220de05282a961/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25812a36-404f-5fd2-a60d-14a5f17164c2/25812a36-404f-5fd2-a60d-14a5f17164c2_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 525429,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg3/512ea53b1dcd45d0af220de05282a961/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-09-30',
'seats_number': 5,
'seller_name': None,
'title': 'CITROËN CITROEN DS 7 CROSSBACK BLUEHDI 130 AUTOMATICA BUSINESS (PC) '
'FP -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2021}
2026-03-25 16:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983653%27 HTTP/1.1" 200 None
2026-03-25 16:35:17 [ayvens.it] INFO: Saving data for 1983653: {'created_time': 1774456517.956848, 'last_price_update_time': 1774456517.956859, 'auction_closing_time': 1774603800.0}
2026-03-25 16:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1983653') HTTP/1.1" 204 0
2026-03-25 16:35:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga7/5eef134e2c3a4be68ac51ea2f852e943/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:35:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fy9/3a989ed1aef64201a4b3321a990cbfb1/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:35:17 [ayvens.it] INFO: Found listing with ID: 1979690
2026-03-25 16:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979690%27 HTTP/1.1" 200 None
2026-03-25 16:35:17 [ayvens.it] INFO: Scrape type for 1979690: 2
2026-03-25 16:35:17 [ayvens.it] INFO: Extracting data for car ID: 1979690
2026-03-25 16:35:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c19f2c4e-7e75-50e4-a808-e55b18f17982 with identifier: 1979690
2026-03-25 16:35:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c19f2c4e-7e75-50e4-a808-e55b18f17982 with scrape type 2
2026-03-25 16:35:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c19f2c4e-7e75-50e4-a808-e55b18f17982 with scrape type 2
2026-03-25 16:35:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: c19f2c4e-7e75-50e4-a808-e55b18f17982, identifier: 1979690
2026-03-25 16:35:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: c19f2c4e-7e75-50e4-a808-e55b18f17982 with identifier: 1979690
2026-03-25 16:35:18 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:35:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: c19f2c4e-7e75-50e4-a808-e55b18f17982 with identifier: 1979690
2026-03-25 16:35:18 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: c19f2c4e-7e75-50e4-a808-e55b18f17982 with identifier: 1979690 to the API
2026-03-25 16:35:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:35:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:35:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'r Comment',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-26T09:30:00Z',
'fuel_type': 'diesel',
'id': 'c19f2c4e-7e75-50e4-a808-e55b18f17982',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40968',
'listing': 'auction',
'location': None,
'make': 'FORD',
'model': 'FORD KUGA 1.5 TDCi 120CV Pshift S&S 2WD Edition Sport utility '
'vehicle 5-door (Euro 6.2)',
'odometer': 130078,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-10-31',
'seats_number': 5,
'seller_name': None,
'title': 'FORD FORD KUGA 1.5 TDCi 120CV Pshift S&S 2WD Edition Sport utility '
'vehicle 5-door (Euro 6.2) -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2019}
2026-03-25 16:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979690%27 HTTP/1.1" 200 None
2026-03-25 16:35:18 [ayvens.it] INFO: Saving data for 1979690: {'auction_closing_time': 1774517400.0, 'created_time': 1774369917.326219, 'last_price_update_time': 1774456518.319891}
2026-03-25 16:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1979690') HTTP/1.1" 204 0
2026-03-25 16:35:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:35:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34de45bb90>
2026-03-25 16:35:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:35:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:35:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:35:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54af0571-5b5c-57f4-9f15-e12a257e8528/54af0571-5b5c-57f4-9f15-e12a257e8528_image_9.jpg HTTP/1.1" 201 0
2026-03-25 16:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga7%252F5eef134e2c3a4be68ac51ea2f852e943%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 16:35:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga7/5eef134e2c3a4be68ac51ea2f852e943/images/large/10.jpg saved to cache
2026-03-25 16:35:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 54af0571-5b5c-57f4-9f15-e12a257e8528
2026-03-25 16:35:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:35:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcb9b310>
2026-03-25 16:35:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:35:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:35:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:35:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54af0571-5b5c-57f4-9f15-e12a257e8528/54af0571-5b5c-57f4-9f15-e12a257e8528_image_7.jpg HTTP/1.1" 201 0
2026-03-25 16:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga7%252F5eef134e2c3a4be68ac51ea2f852e943%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 16:35:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga7/5eef134e2c3a4be68ac51ea2f852e943/images/large/8.jpg saved to cache
2026-03-25 16:35:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 54af0571-5b5c-57f4-9f15-e12a257e8528
2026-03-25 16:35:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:35:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34d7d7d490>
2026-03-25 16:35:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:35:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:35:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:35:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54af0571-5b5c-57f4-9f15-e12a257e8528/54af0571-5b5c-57f4-9f15-e12a257e8528_image_6.jpg HTTP/1.1" 201 0
2026-03-25 16:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga7%252F5eef134e2c3a4be68ac51ea2f852e943%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 16:35:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga7/5eef134e2c3a4be68ac51ea2f852e943/images/large/7.jpg saved to cache
2026-03-25 16:35:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 54af0571-5b5c-57f4-9f15-e12a257e8528
2026-03-25 16:35:18 [ayvens.it] INFO: Found listing with ID: 1979691
2026-03-25 16:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979691%27 HTTP/1.1" 200 None
2026-03-25 16:35:18 [ayvens.it] INFO: Scrape type for 1979691: 2
2026-03-25 16:35:18 [ayvens.it] INFO: Extracting data for car ID: 1979691
2026-03-25 16:35:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4b966d20-8ec9-5812-ac01-07a37a76d8e7 with identifier: 1979691
2026-03-25 16:35:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4b966d20-8ec9-5812-ac01-07a37a76d8e7 with scrape type 2
2026-03-25 16:35:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4b966d20-8ec9-5812-ac01-07a37a76d8e7 with scrape type 2
2026-03-25 16:35:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 4b966d20-8ec9-5812-ac01-07a37a76d8e7, identifier: 1979691
2026-03-25 16:35:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 4b966d20-8ec9-5812-ac01-07a37a76d8e7 with identifier: 1979691
2026-03-25 16:35:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 4b966d20-8ec9-5812-ac01-07a37a76d8e7 with identifier: 1979691
2026-03-25 16:35:18 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 4b966d20-8ec9-5812-ac01-07a37a76d8e7 with identifier: 1979691 to the API
2026-03-25 16:35:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:35:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:35:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Unknown',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-26T09:30:00Z',
'fuel_type': 'hybrid',
'id': '4b966d20-8ec9-5812-ac01-07a37a76d8e7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40968',
'listing': 'auction',
'location': None,
'make': 'FORD',
'model': 'FORD PUMA 1.0 Ecoboost Hybrid 125CV ST-Line Sport utility vehicle '
'5-door (Euro 6.2)',
'odometer': 58863,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-12-07',
'seats_number': 5,
'seller_name': None,
'title': 'FORD FORD PUMA 1.0 Ecoboost Hybrid 125CV ST-Line Sport utility '
'vehicle 5-door (Euro 6.2) -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2021}
2026-03-25 16:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979691%27 HTTP/1.1" 200 None
2026-03-25 16:35:18 [ayvens.it] INFO: Saving data for 1979691: {'auction_closing_time': 1774517400.0, 'created_time': 1774369919.471682, 'last_price_update_time': 1774456518.896201}
2026-03-25 16:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1979691') HTTP/1.1" 204 0
2026-03-25 16:35:18 [ayvens.it] INFO: Found listing with ID: 1979692
2026-03-25 16:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979692%27 HTTP/1.1" 200 None
2026-03-25 16:35:18 [ayvens.it] INFO: Scrape type for 1979692: 2
2026-03-25 16:35:18 [ayvens.it] INFO: Extracting data for car ID: 1979692
2026-03-25 16:35:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 67e79cb0-8c5b-56c7-a698-425e64d81c5f with identifier: 1979692
2026-03-25 16:35:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 67e79cb0-8c5b-56c7-a698-425e64d81c5f with scrape type 2
2026-03-25 16:35:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 67e79cb0-8c5b-56c7-a698-425e64d81c5f with scrape type 2
2026-03-25 16:35:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 67e79cb0-8c5b-56c7-a698-425e64d81c5f, identifier: 1979692
2026-03-25 16:35:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fy9/3a989ed1aef64201a4b3321a990cbfb1/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:35:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 67e79cb0-8c5b-56c7-a698-425e64d81c5f with identifier: 1979692
2026-03-25 16:35:19 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:35:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 67e79cb0-8c5b-56c7-a698-425e64d81c5f with identifier: 1979692
2026-03-25 16:35:19 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 67e79cb0-8c5b-56c7-a698-425e64d81c5f with identifier: 1979692 to the API
2026-03-25 16:35:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:35:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:35:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'SPARKLING SILVER',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-26T09:30:00Z',
'fuel_type': 'diesel',
'id': '67e79cb0-8c5b-56c7-a698-425e64d81c5f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40968',
'listing': 'auction',
'location': None,
'make': 'KIA',
'model': 'KIA SPORTAGE (PC) 1.6 CRDI MHYB 100KW BUSIN. CLASS DCT 2WD',
'odometer': 63317,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-11-10',
'seats_number': 5,
'seller_name': None,
'title': 'KIA KIA SPORTAGE (PC) 1.6 CRDI MHYB 100KW BUSIN. CLASS DCT 2WD -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2021}
2026-03-25 16:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979692%27 HTTP/1.1" 200 None
2026-03-25 16:35:19 [ayvens.it] INFO: Saving data for 1979692: {'auction_closing_time': 1774517400.0, 'created_time': 1774369922.068778, 'last_price_update_time': 1774456519.362916}
2026-03-25 16:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1979692') HTTP/1.1" 204 0
2026-03-25 16:35:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx7/8f177403eb46420099916f8a93ba34e3/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:35:19 [ayvens.it] INFO: Found listing with ID: 1979693
2026-03-25 16:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979693%27 HTTP/1.1" 200 None
2026-03-25 16:35:19 [ayvens.it] INFO: Scrape type for 1979693: 2
2026-03-25 16:35:19 [ayvens.it] INFO: Extracting data for car ID: 1979693
2026-03-25 16:35:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c6588bb5-2650-5d4d-bd4e-fbc448e13a47 with identifier: 1979693
2026-03-25 16:35:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c6588bb5-2650-5d4d-bd4e-fbc448e13a47 with scrape type 2
2026-03-25 16:35:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c6588bb5-2650-5d4d-bd4e-fbc448e13a47 with scrape type 2
2026-03-25 16:35:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: c6588bb5-2650-5d4d-bd4e-fbc448e13a47, identifier: 1979693
2026-03-25 16:35:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:35:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc8d5690>
2026-03-25 16:35:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:35:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:35:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:35:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54af0571-5b5c-57f4-9f15-e12a257e8528/54af0571-5b5c-57f4-9f15-e12a257e8528_image_8.jpg HTTP/1.1" 201 0
2026-03-25 16:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga7%252F5eef134e2c3a4be68ac51ea2f852e943%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 16:35:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga7/5eef134e2c3a4be68ac51ea2f852e943/images/large/9.jpg saved to cache
2026-03-25 16:35:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 54af0571-5b5c-57f4-9f15-e12a257e8528
2026-03-25 16:35:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 54af0571-5b5c-57f4-9f15-e12a257e8528, skipping ID generation
2026-03-25 16:35:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 54af0571-5b5c-57f4-9f15-e12a257e8528 with scrape type 1
2026-03-25 16:35:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 54af0571-5b5c-57f4-9f15-e12a257e8528 sending to next pipeline
2026-03-25 16:35:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 54af0571-5b5c-57f4-9f15-e12a257e8528, identifier: 1983652
2026-03-25 16:35:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:35:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34d745b610>
2026-03-25 16:35:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:35:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:35:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:35:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ebcaa8a4-42c5-54d0-b134-bc5461aab68f/ebcaa8a4-42c5-54d0-b134-bc5461aab68f_image_9.jpg HTTP/1.1" 201 0
2026-03-25 16:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy9%252F3a989ed1aef64201a4b3321a990cbfb1%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 16:35:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy9/3a989ed1aef64201a4b3321a990cbfb1/images/large/10.jpg saved to cache
2026-03-25 16:35:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ebcaa8a4-42c5-54d0-b134-bc5461aab68f
2026-03-25 16:35:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fy9/3a989ed1aef64201a4b3321a990cbfb1/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:35:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: c6588bb5-2650-5d4d-bd4e-fbc448e13a47 with identifier: 1979693
2026-03-25 16:35:19 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:35:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: c6588bb5-2650-5d4d-bd4e-fbc448e13a47 with identifier: 1979693
2026-03-25 16:35:19 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: c6588bb5-2650-5d4d-bd4e-fbc448e13a47 with identifier: 1979693 to the API
2026-03-25 16:35:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:35:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:35:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Alpine White pastello',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.3L',
'expiration_date': '2026-03-26T09:30:00Z',
'fuel_type': 'hybrid',
'id': 'c6588bb5-2650-5d4d-bd4e-fbc448e13a47',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40968',
'listing': 'auction',
'location': None,
'make': 'JEEP',
'model': 'JEEP COMPASS 1.3 T4 PHEV 190cv Limited 4xe Auto Sport utility '
'vehicle 5-door (Euro 6D)',
'odometer': 76708,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-10-29',
'seats_number': 5,
'seller_name': None,
'title': 'JEEP JEEP COMPASS 1.3 T4 PHEV 190cv Limited 4xe Auto Sport utility '
'vehicle 5-door (Euro 6D) -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2021}
2026-03-25 16:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979693%27 HTTP/1.1" 200 None
2026-03-25 16:35:20 [ayvens.it] INFO: Saving data for 1979693: {'auction_closing_time': 1774517400.0, 'created_time': 1774369923.191284, 'last_price_update_time': 1774456520.069207}
2026-03-25 16:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1979693') HTTP/1.1" 204 0
2026-03-25 16:35:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 54af0571-5b5c-57f4-9f15-e12a257e8528 with identifier: 1983652
2026-03-25 16:35:20 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:35:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 54af0571-5b5c-57f4-9f15-e12a257e8528 with identifier: 1983652
2026-03-25 16:35:20 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 54af0571-5b5c-57f4-9f15-e12a257e8528 with identifier: 1983652 to the API
2026-03-25 16:35:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:35:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:35:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/ga7/5eef134e2c3a4be68ac51ea2f852e943/images/large/9.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'NERO PERLATO',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-27T09:30:00Z',
'fuel_type': 'diesel',
'id': '54af0571-5b5c-57f4-9f15-e12a257e8528',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41025',
'listing': 'auction',
'location': None,
'make': 'VOLKSWAGEN',
'model': 'VOLKSWAGEN TIGUAN (PC) 2.0 TDI SCR 110KW BUSINESS BMT 4MOT DSG FP',
'odometer': 137919,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 17,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54af0571-5b5c-57f4-9f15-e12a257e8528/54af0571-5b5c-57f4-9f15-e12a257e8528_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 834000,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga7/5eef134e2c3a4be68ac51ea2f852e943/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54af0571-5b5c-57f4-9f15-e12a257e8528/54af0571-5b5c-57f4-9f15-e12a257e8528_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 834000,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga7/5eef134e2c3a4be68ac51ea2f852e943/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54af0571-5b5c-57f4-9f15-e12a257e8528/54af0571-5b5c-57f4-9f15-e12a257e8528_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 843464,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga7/5eef134e2c3a4be68ac51ea2f852e943/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54af0571-5b5c-57f4-9f15-e12a257e8528/54af0571-5b5c-57f4-9f15-e12a257e8528_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 858729,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga7/5eef134e2c3a4be68ac51ea2f852e943/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54af0571-5b5c-57f4-9f15-e12a257e8528/54af0571-5b5c-57f4-9f15-e12a257e8528_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 836747,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga7/5eef134e2c3a4be68ac51ea2f852e943/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54af0571-5b5c-57f4-9f15-e12a257e8528/54af0571-5b5c-57f4-9f15-e12a257e8528_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 630054,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga7/5eef134e2c3a4be68ac51ea2f852e943/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54af0571-5b5c-57f4-9f15-e12a257e8528/54af0571-5b5c-57f4-9f15-e12a257e8528_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 629799,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga7/5eef134e2c3a4be68ac51ea2f852e943/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54af0571-5b5c-57f4-9f15-e12a257e8528/54af0571-5b5c-57f4-9f15-e12a257e8528_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 566957,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga7/5eef134e2c3a4be68ac51ea2f852e943/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54af0571-5b5c-57f4-9f15-e12a257e8528/54af0571-5b5c-57f4-9f15-e12a257e8528_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 721151,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga7/5eef134e2c3a4be68ac51ea2f852e943/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54af0571-5b5c-57f4-9f15-e12a257e8528/54af0571-5b5c-57f4-9f15-e12a257e8528_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 676130,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga7/5eef134e2c3a4be68ac51ea2f852e943/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-02-07',
'seats_number': 5,
'seller_name': None,
'title': 'VOLKSWAGEN VOLKSWAGEN TIGUAN (PC) 2.0 TDI SCR 110KW BUSINESS BMT '
'4MOT DSG FP -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2020}
2026-03-25 16:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983652%27 HTTP/1.1" 200 None
2026-03-25 16:35:20 [ayvens.it] INFO: Saving data for 1983652: {'created_time': 1774456520.43991, 'last_price_update_time': 1774456520.439922, 'auction_closing_time': 1774603800.0}
2026-03-25 16:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1983652') HTTP/1.1" 204 0
2026-03-25 16:35:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fy9/3a989ed1aef64201a4b3321a990cbfb1/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:35:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx7/8f177403eb46420099916f8a93ba34e3/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:35:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx7/8f177403eb46420099916f8a93ba34e3/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:35:20 [ayvens.it] INFO: Found listing with ID: 1979694
2026-03-25 16:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979694%27 HTTP/1.1" 200 None
2026-03-25 16:35:20 [ayvens.it] INFO: Scrape type for 1979694: 2
2026-03-25 16:35:20 [ayvens.it] INFO: Extracting data for car ID: 1979694
2026-03-25 16:35:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 636c7f2f-e2c3-5358-81d0-d23853c163bc with identifier: 1979694
2026-03-25 16:35:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 636c7f2f-e2c3-5358-81d0-d23853c163bc with scrape type 2
2026-03-25 16:35:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 636c7f2f-e2c3-5358-81d0-d23853c163bc with scrape type 2
2026-03-25 16:35:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 636c7f2f-e2c3-5358-81d0-d23853c163bc, identifier: 1979694
2026-03-25 16:35:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:35:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34eb537350>
2026-03-25 16:35:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:35:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:35:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:35:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ebcaa8a4-42c5-54d0-b134-bc5461aab68f/ebcaa8a4-42c5-54d0-b134-bc5461aab68f_image_8.jpg HTTP/1.1" 201 0
2026-03-25 16:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy9%252F3a989ed1aef64201a4b3321a990cbfb1%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 16:35:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy9/3a989ed1aef64201a4b3321a990cbfb1/images/large/9.jpg saved to cache
2026-03-25 16:35:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ebcaa8a4-42c5-54d0-b134-bc5461aab68f
2026-03-25 16:35:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 636c7f2f-e2c3-5358-81d0-d23853c163bc with identifier: 1979694
2026-03-25 16:35:20 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:35:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 636c7f2f-e2c3-5358-81d0-d23853c163bc with identifier: 1979694
2026-03-25 16:35:20 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 636c7f2f-e2c3-5358-81d0-d23853c163bc with identifier: 1979694 to the API
2026-03-25 16:35:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:35:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:35:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Cape York Green mettallizato',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-26T09:30:00Z',
'fuel_type': 'diesel',
'id': '636c7f2f-e2c3-5358-81d0-d23853c163bc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40968',
'listing': 'auction',
'location': None,
'make': 'BMW',
'model': 'BMW X1 sDrive 18d Edition Essence DCT Sport utility vehicle 5-door '
'(Euro 6D)',
'odometer': 180363,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-11-14',
'seats_number': 5,
'seller_name': None,
'title': 'BMW BMW X1 sDrive 18d Edition Essence DCT Sport utility vehicle '
'5-door (Euro 6D) -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-25 16:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979694%27 HTTP/1.1" 200 None
2026-03-25 16:35:20 [ayvens.it] INFO: Saving data for 1979694: {'auction_closing_time': 1774517400.0, 'created_time': 1774369925.134959, 'last_price_update_time': 1774456520.859286}
2026-03-25 16:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1979694') HTTP/1.1" 204 0
2026-03-25 16:35:20 [ayvens.it] INFO: Found listing with ID: 1979695
2026-03-25 16:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979695%27 HTTP/1.1" 200 None
2026-03-25 16:35:20 [ayvens.it] INFO: Scrape type for 1979695: 2
2026-03-25 16:35:20 [ayvens.it] INFO: Extracting data for car ID: 1979695
2026-03-25 16:35:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 52011d99-1028-554a-b723-3d6569ba0cdd with identifier: 1979695
2026-03-25 16:35:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 52011d99-1028-554a-b723-3d6569ba0cdd with scrape type 2
2026-03-25 16:35:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 52011d99-1028-554a-b723-3d6569ba0cdd with scrape type 2
2026-03-25 16:35:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 52011d99-1028-554a-b723-3d6569ba0cdd, identifier: 1979695
2026-03-25 16:35:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ft5/875e4a38596447dea1d30b5831669e36/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:35:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 52011d99-1028-554a-b723-3d6569ba0cdd with identifier: 1979695
2026-03-25 16:35:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 52011d99-1028-554a-b723-3d6569ba0cdd with identifier: 1979695
2026-03-25 16:35:21 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 52011d99-1028-554a-b723-3d6569ba0cdd with identifier: 1979695 to the API
2026-03-25 16:35:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:35:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:35:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'BIANCO GHIACCIO',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-26T09:30:00Z',
'fuel_type': 'diesel',
'id': '52011d99-1028-554a-b723-3d6569ba0cdd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40968',
'listing': 'auction',
'location': None,
'make': 'RENAULT',
'model': 'RENAULT CLIO (PC) 1.5 DCI BLUE 74KW BUSINESS FP',
'odometer': 98872,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-02-24',
'seats_number': 5,
'seller_name': None,
'title': 'RENAULT RENAULT CLIO (PC) 1.5 DCI BLUE 74KW BUSINESS FP -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-25 16:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979695%27 HTTP/1.1" 200 None
2026-03-25 16:35:21 [ayvens.it] INFO: Saving data for 1979695: {'auction_closing_time': 1774517400.0, 'created_time': 1774369926.804821, 'last_price_update_time': 1774456521.330375}
2026-03-25 16:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1979695') HTTP/1.1" 204 0
2026-03-25 16:35:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:35:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dca9d450>
2026-03-25 16:35:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:35:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:35:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:35:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cde862d8-02a9-52de-961d-e5f81a6da6df/cde862d8-02a9-52de-961d-e5f81a6da6df_image_9.jpg HTTP/1.1" 201 0
2026-03-25 16:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx7%252F8f177403eb46420099916f8a93ba34e3%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 16:35:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx7/8f177403eb46420099916f8a93ba34e3/images/large/10.jpg saved to cache
2026-03-25 16:35:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item cde862d8-02a9-52de-961d-e5f81a6da6df
2026-03-25 16:35:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:35:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc649a50>
2026-03-25 16:35:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:35:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:35:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:35:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ebcaa8a4-42c5-54d0-b134-bc5461aab68f/ebcaa8a4-42c5-54d0-b134-bc5461aab68f_image_7.jpg HTTP/1.1" 201 0
2026-03-25 16:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy9%252F3a989ed1aef64201a4b3321a990cbfb1%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 16:35:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy9/3a989ed1aef64201a4b3321a990cbfb1/images/large/8.jpg saved to cache
2026-03-25 16:35:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ebcaa8a4-42c5-54d0-b134-bc5461aab68f
2026-03-25 16:35:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:35:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcf2e490>
2026-03-25 16:35:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:35:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:35:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:35:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ebcaa8a4-42c5-54d0-b134-bc5461aab68f/ebcaa8a4-42c5-54d0-b134-bc5461aab68f_image_6.jpg HTTP/1.1" 201 0
2026-03-25 16:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy9%252F3a989ed1aef64201a4b3321a990cbfb1%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 16:35:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy9/3a989ed1aef64201a4b3321a990cbfb1/images/large/7.jpg saved to cache
2026-03-25 16:35:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ebcaa8a4-42c5-54d0-b134-bc5461aab68f
2026-03-25 16:35:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ebcaa8a4-42c5-54d0-b134-bc5461aab68f, skipping ID generation
2026-03-25 16:35:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ebcaa8a4-42c5-54d0-b134-bc5461aab68f with scrape type 1
2026-03-25 16:35:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ebcaa8a4-42c5-54d0-b134-bc5461aab68f sending to next pipeline
2026-03-25 16:35:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: ebcaa8a4-42c5-54d0-b134-bc5461aab68f, identifier: 1983651
2026-03-25 16:35:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:35:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc5eb450>
2026-03-25 16:35:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:35:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:35:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:35:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cde862d8-02a9-52de-961d-e5f81a6da6df/cde862d8-02a9-52de-961d-e5f81a6da6df_image_7.jpg HTTP/1.1" 201 0
2026-03-25 16:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx7%252F8f177403eb46420099916f8a93ba34e3%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 16:35:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx7/8f177403eb46420099916f8a93ba34e3/images/large/8.jpg saved to cache
2026-03-25 16:35:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item cde862d8-02a9-52de-961d-e5f81a6da6df
2026-03-25 16:35:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:35:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc5d7d90>
2026-03-25 16:35:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:35:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:35:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:35:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cde862d8-02a9-52de-961d-e5f81a6da6df/cde862d8-02a9-52de-961d-e5f81a6da6df_image_8.jpg HTTP/1.1" 201 0
2026-03-25 16:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx7%252F8f177403eb46420099916f8a93ba34e3%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 16:35:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx7/8f177403eb46420099916f8a93ba34e3/images/large/9.jpg saved to cache
2026-03-25 16:35:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item cde862d8-02a9-52de-961d-e5f81a6da6df
2026-03-25 16:35:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cde862d8-02a9-52de-961d-e5f81a6da6df, skipping ID generation
2026-03-25 16:35:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cde862d8-02a9-52de-961d-e5f81a6da6df with scrape type 1
2026-03-25 16:35:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cde862d8-02a9-52de-961d-e5f81a6da6df sending to next pipeline
2026-03-25 16:35:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: cde862d8-02a9-52de-961d-e5f81a6da6df, identifier: 1983649
2026-03-25 16:35:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ft5/875e4a38596447dea1d30b5831669e36/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:35:21 [ayvens.it] INFO: Found listing with ID: 1979696
2026-03-25 16:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979696%27 HTTP/1.1" 200 None
2026-03-25 16:35:21 [ayvens.it] INFO: Scrape type for 1979696: 2
2026-03-25 16:35:21 [ayvens.it] INFO: Extracting data for car ID: 1979696
2026-03-25 16:35:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 411849ee-8ffa-5bce-ba19-3181b3bcc83a with identifier: 1979696
2026-03-25 16:35:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 411849ee-8ffa-5bce-ba19-3181b3bcc83a with scrape type 2
2026-03-25 16:35:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 411849ee-8ffa-5bce-ba19-3181b3bcc83a with scrape type 2
2026-03-25 16:35:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 411849ee-8ffa-5bce-ba19-3181b3bcc83a, identifier: 1979696
2026-03-25 16:35:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: ebcaa8a4-42c5-54d0-b134-bc5461aab68f with identifier: 1983651
2026-03-25 16:35:22 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:35:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: ebcaa8a4-42c5-54d0-b134-bc5461aab68f with identifier: 1983651
2026-03-25 16:35:22 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: ebcaa8a4-42c5-54d0-b134-bc5461aab68f with identifier: 1983651 to the API
2026-03-25 16:35:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:35:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:35:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fy9/3a989ed1aef64201a4b3321a990cbfb1/images/large/7.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Dark Grey Met',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.8L',
'expiration_date': '2026-03-27T09:30:00Z',
'fuel_type': 'hybrid',
'id': 'ebcaa8a4-42c5-54d0-b134-bc5461aab68f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41025',
'listing': 'auction',
'location': None,
'make': 'TOYOTA',
'model': 'TOYOTA C-HR 1.8H (122CV) E-CVT Business Sport utility vehicle '
'5-door (Euro 6.2)',
'odometer': 135131,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 55,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ebcaa8a4-42c5-54d0-b134-bc5461aab68f/ebcaa8a4-42c5-54d0-b134-bc5461aab68f_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 792097,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fy9/3a989ed1aef64201a4b3321a990cbfb1/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ebcaa8a4-42c5-54d0-b134-bc5461aab68f/ebcaa8a4-42c5-54d0-b134-bc5461aab68f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 792097,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fy9/3a989ed1aef64201a4b3321a990cbfb1/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ebcaa8a4-42c5-54d0-b134-bc5461aab68f/ebcaa8a4-42c5-54d0-b134-bc5461aab68f_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 755830,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fy9/3a989ed1aef64201a4b3321a990cbfb1/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ebcaa8a4-42c5-54d0-b134-bc5461aab68f/ebcaa8a4-42c5-54d0-b134-bc5461aab68f_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 841965,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fy9/3a989ed1aef64201a4b3321a990cbfb1/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ebcaa8a4-42c5-54d0-b134-bc5461aab68f/ebcaa8a4-42c5-54d0-b134-bc5461aab68f_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 843702,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fy9/3a989ed1aef64201a4b3321a990cbfb1/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ebcaa8a4-42c5-54d0-b134-bc5461aab68f/ebcaa8a4-42c5-54d0-b134-bc5461aab68f_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 603683,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fy9/3a989ed1aef64201a4b3321a990cbfb1/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ebcaa8a4-42c5-54d0-b134-bc5461aab68f/ebcaa8a4-42c5-54d0-b134-bc5461aab68f_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 601873,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fy9/3a989ed1aef64201a4b3321a990cbfb1/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ebcaa8a4-42c5-54d0-b134-bc5461aab68f/ebcaa8a4-42c5-54d0-b134-bc5461aab68f_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 633689,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fy9/3a989ed1aef64201a4b3321a990cbfb1/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ebcaa8a4-42c5-54d0-b134-bc5461aab68f/ebcaa8a4-42c5-54d0-b134-bc5461aab68f_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 568048,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fy9/3a989ed1aef64201a4b3321a990cbfb1/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ebcaa8a4-42c5-54d0-b134-bc5461aab68f/ebcaa8a4-42c5-54d0-b134-bc5461aab68f_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 440188,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fy9/3a989ed1aef64201a4b3321a990cbfb1/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-07-31',
'seats_number': 5,
'seller_name': None,
'title': 'TOYOTA TOYOTA C-HR 1.8H (122CV) E-CVT Business Sport utility '
'vehicle 5-door (Euro 6.2) -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2019}
2026-03-25 16:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983651%27 HTTP/1.1" 200 None
2026-03-25 16:35:22 [ayvens.it] INFO: Saving data for 1983651: {'created_time': 1774456522.403707, 'last_price_update_time': 1774456522.403717, 'auction_closing_time': 1774603800.0}
2026-03-25 16:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1983651') HTTP/1.1" 204 0
2026-03-25 16:35:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: cde862d8-02a9-52de-961d-e5f81a6da6df with identifier: 1983649
2026-03-25 16:35:22 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:35:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: cde862d8-02a9-52de-961d-e5f81a6da6df with identifier: 1983649
2026-03-25 16:35:22 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: cde862d8-02a9-52de-961d-e5f81a6da6df with identifier: 1983649 to the API
2026-03-25 16:35:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:35:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:35:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fx7/8f177403eb46420099916f8a93ba34e3/images/large/9.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'GRIGIO MAESTRO MTZ',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-27T09:30:00Z',
'fuel_type': 'diesel',
'id': 'cde862d8-02a9-52de-961d-e5f81a6da6df',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41025',
'listing': 'auction',
'location': None,
'make': 'FIAT',
'model': 'FIAT TIPO CONSIP13 1.3 MJT 95CV 5M S&S POP FP',
'odometer': 118214,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 34,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cde862d8-02a9-52de-961d-e5f81a6da6df/cde862d8-02a9-52de-961d-e5f81a6da6df_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 658538,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx7/8f177403eb46420099916f8a93ba34e3/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cde862d8-02a9-52de-961d-e5f81a6da6df/cde862d8-02a9-52de-961d-e5f81a6da6df_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 658538,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx7/8f177403eb46420099916f8a93ba34e3/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cde862d8-02a9-52de-961d-e5f81a6da6df/cde862d8-02a9-52de-961d-e5f81a6da6df_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 643134,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx7/8f177403eb46420099916f8a93ba34e3/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cde862d8-02a9-52de-961d-e5f81a6da6df/cde862d8-02a9-52de-961d-e5f81a6da6df_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 622912,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx7/8f177403eb46420099916f8a93ba34e3/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cde862d8-02a9-52de-961d-e5f81a6da6df/cde862d8-02a9-52de-961d-e5f81a6da6df_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 570260,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx7/8f177403eb46420099916f8a93ba34e3/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cde862d8-02a9-52de-961d-e5f81a6da6df/cde862d8-02a9-52de-961d-e5f81a6da6df_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 446506,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx7/8f177403eb46420099916f8a93ba34e3/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cde862d8-02a9-52de-961d-e5f81a6da6df/cde862d8-02a9-52de-961d-e5f81a6da6df_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 474975,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx7/8f177403eb46420099916f8a93ba34e3/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cde862d8-02a9-52de-961d-e5f81a6da6df/cde862d8-02a9-52de-961d-e5f81a6da6df_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 505766,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx7/8f177403eb46420099916f8a93ba34e3/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cde862d8-02a9-52de-961d-e5f81a6da6df/cde862d8-02a9-52de-961d-e5f81a6da6df_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 487291,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx7/8f177403eb46420099916f8a93ba34e3/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cde862d8-02a9-52de-961d-e5f81a6da6df/cde862d8-02a9-52de-961d-e5f81a6da6df_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 391106,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx7/8f177403eb46420099916f8a93ba34e3/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-07-08',
'seats_number': 5,
'seller_name': None,
'title': 'FIAT FIAT TIPO CONSIP13 1.3 MJT 95CV 5M S&S POP FP -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2019}
2026-03-25 16:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983649%27 HTTP/1.1" 200 None
2026-03-25 16:35:22 [ayvens.it] INFO: Saving data for 1983649: {'created_time': 1774456522.746884, 'last_price_update_time': 1774456522.746895, 'auction_closing_time': 1774603800.0}
2026-03-25 16:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1983649') HTTP/1.1" 204 0
2026-03-25 16:35:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 411849ee-8ffa-5bce-ba19-3181b3bcc83a with identifier: 1979696
2026-03-25 16:35:22 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:35:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 411849ee-8ffa-5bce-ba19-3181b3bcc83a with identifier: 1979696
2026-03-25 16:35:22 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 411849ee-8ffa-5bce-ba19-3181b3bcc83a with identifier: 1979696 to the API
2026-03-25 16:35:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:35:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:35:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'BLU CHROME METALLIZZATO',
'currency': 'EUR',
'doors_number': 4,
'engine': '2.0L',
'expiration_date': '2026-03-26T09:30:00Z',
'fuel_type': 'diesel',
'id': '411849ee-8ffa-5bce-ba19-3181b3bcc83a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40968',
'listing': 'auction',
'location': None,
'make': 'FORD',
'model': 'FORD TRANSIT CUSTOM 320 L2H1 TREND 2.0 ECOBLUE 130 CV FP (PC) FP',
'odometer': 155336,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-09-24',
'seats_number': 5,
'seller_name': None,
'title': 'FORD FORD TRANSIT CUSTOM 320 L2H1 TREND 2.0 ECOBLUE 130 CV FP (PC) '
'FP -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2021}
2026-03-25 16:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979696%27 HTTP/1.1" 200 None
2026-03-25 16:35:23 [ayvens.it] INFO: Saving data for 1979696: {'auction_closing_time': 1774517400.0, 'created_time': 1774369929.091827, 'last_price_update_time': 1774456523.025228}
2026-03-25 16:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1979696') HTTP/1.1" 204 0
2026-03-25 16:35:23 [ayvens.it] INFO: Found listing with ID: 1979697
2026-03-25 16:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979697%27 HTTP/1.1" 200 None
2026-03-25 16:35:23 [ayvens.it] INFO: Scrape type for 1979697: 2
2026-03-25 16:35:23 [ayvens.it] INFO: Extracting data for car ID: 1979697
2026-03-25 16:35:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a0a61e44-90fd-5461-8c2b-3c941d13c5ca with identifier: 1979697
2026-03-25 16:35:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a0a61e44-90fd-5461-8c2b-3c941d13c5ca with scrape type 2
2026-03-25 16:35:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a0a61e44-90fd-5461-8c2b-3c941d13c5ca with scrape type 2
2026-03-25 16:35:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: a0a61e44-90fd-5461-8c2b-3c941d13c5ca, identifier: 1979697
2026-03-25 16:35:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: a0a61e44-90fd-5461-8c2b-3c941d13c5ca with identifier: 1979697
2026-03-25 16:35:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: a0a61e44-90fd-5461-8c2b-3c941d13c5ca with identifier: 1979697
2026-03-25 16:35:23 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: a0a61e44-90fd-5461-8c2b-3c941d13c5ca with identifier: 1979697 to the API
2026-03-25 16:35:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:35:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:35:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Agate Black metallizzato',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-26T09:30:00Z',
'fuel_type': 'diesel',
'id': 'a0a61e44-90fd-5461-8c2b-3c941d13c5ca',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40968',
'listing': 'auction',
'location': None,
'make': 'FORD',
'model': 'FORD FOCUS 1.5 Ecoblue 120cv Business SW SW 5-door (Euro 6.2)',
'odometer': 241937,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-01-19',
'seats_number': 5,
'seller_name': None,
'title': 'FORD FORD FOCUS 1.5 Ecoblue 120cv Business SW SW 5-door (Euro 6.2) '
'-',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-25 16:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979697%27 HTTP/1.1" 200 None
2026-03-25 16:35:23 [ayvens.it] INFO: Saving data for 1979697: {'auction_closing_time': 1774517400.0, 'created_time': 1774369930.90845, 'last_price_update_time': 1774456523.385603}
2026-03-25 16:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1979697') HTTP/1.1" 204 0
2026-03-25 16:35:23 [ayvens.it] INFO: Found listing with ID: 1979698
2026-03-25 16:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979698%27 HTTP/1.1" 200 None
2026-03-25 16:35:23 [ayvens.it] INFO: Scrape type for 1979698: 2
2026-03-25 16:35:23 [ayvens.it] INFO: Extracting data for car ID: 1979698
2026-03-25 16:35:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c060093a-c0a7-56ff-a02e-20888a4367d6 with identifier: 1979698
2026-03-25 16:35:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c060093a-c0a7-56ff-a02e-20888a4367d6 with scrape type 2
2026-03-25 16:35:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c060093a-c0a7-56ff-a02e-20888a4367d6 with scrape type 2
2026-03-25 16:35:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: c060093a-c0a7-56ff-a02e-20888a4367d6, identifier: 1979698
2026-03-25 16:35:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:35:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcada690>
2026-03-25 16:35:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:35:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:35:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:35:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7224100-5392-58cc-a067-1aa8692a6e31/c7224100-5392-58cc-a067-1aa8692a6e31_image_7.jpg HTTP/1.1" 201 0
2026-03-25 16:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft5%252F875e4a38596447dea1d30b5831669e36%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 16:35:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft5/875e4a38596447dea1d30b5831669e36/images/large/8.jpg saved to cache
2026-03-25 16:35:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c7224100-5392-58cc-a067-1aa8692a6e31
2026-03-25 16:35:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:35:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc7847d0>
2026-03-25 16:35:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:35:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:35:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:35:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7224100-5392-58cc-a067-1aa8692a6e31/c7224100-5392-58cc-a067-1aa8692a6e31_image_6.jpg HTTP/1.1" 201 0
2026-03-25 16:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft5%252F875e4a38596447dea1d30b5831669e36%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 16:35:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft5/875e4a38596447dea1d30b5831669e36/images/large/7.jpg saved to cache
2026-03-25 16:35:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c7224100-5392-58cc-a067-1aa8692a6e31
2026-03-25 16:35:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c7224100-5392-58cc-a067-1aa8692a6e31, skipping ID generation
2026-03-25 16:35:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c7224100-5392-58cc-a067-1aa8692a6e31 with scrape type 1
2026-03-25 16:35:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c7224100-5392-58cc-a067-1aa8692a6e31 sending to next pipeline
2026-03-25 16:35:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: c7224100-5392-58cc-a067-1aa8692a6e31, identifier: 1983648
2026-03-25 16:35:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: c060093a-c0a7-56ff-a02e-20888a4367d6 with identifier: 1979698
2026-03-25 16:35:23 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:35:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: c060093a-c0a7-56ff-a02e-20888a4367d6 with identifier: 1979698
2026-03-25 16:35:23 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: c060093a-c0a7-56ff-a02e-20888a4367d6 with identifier: 1979698 to the API
2026-03-25 16:35:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:35:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:35:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'ROSSO ALFA PASTELLO',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.1L',
'expiration_date': '2026-03-26T09:30:00Z',
'fuel_type': 'diesel',
'id': 'c060093a-c0a7-56ff-a02e-20888a4367d6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40968',
'listing': 'auction',
'location': None,
'make': 'ALFA ROMEO',
'model': 'ALFA ROMEO STELVIO 2.2 TURBO DIESEL 190CV EXECUTIVE AT8 Q4 FP',
'odometer': 129228,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-12-15',
'seats_number': 5,
'seller_name': None,
'title': 'ALFA ROMEO ALFA ROMEO STELVIO 2.2 TURBO DIESEL 190CV EXECUTIVE AT8 '
'Q4 FP -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2021}
2026-03-25 16:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979698%27 HTTP/1.1" 200 None
2026-03-25 16:35:24 [ayvens.it] INFO: Saving data for 1979698: {'auction_closing_time': 1774517400.0, 'created_time': 1774369932.80724, 'last_price_update_time': 1774456524.045577}
2026-03-25 16:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1979698') HTTP/1.1" 204 0
2026-03-25 16:35:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: c7224100-5392-58cc-a067-1aa8692a6e31 with identifier: 1983648
2026-03-25 16:35:24 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:35:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: c7224100-5392-58cc-a067-1aa8692a6e31 with identifier: 1983648
2026-03-25 16:35:24 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: c7224100-5392-58cc-a067-1aa8692a6e31 with identifier: 1983648 to the API
2026-03-25 16:35:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:35:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:35:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/ft5/875e4a38596447dea1d30b5831669e36/images/large/7.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Santorini black metallizzato',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-27T09:30:00Z',
'fuel_type': 'diesel',
'id': 'c7224100-5392-58cc-a067-1aa8692a6e31',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41025',
'listing': 'auction',
'location': None,
'make': 'LAND ROVER',
'model': 'LAND ROVER RANGE ROVER VELAR 2.0 D I4 240 S 4WD Auto Sport utility '
'vehicle 5-door (Euro 6.2)',
'odometer': 122277,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 12,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7224100-5392-58cc-a067-1aa8692a6e31/c7224100-5392-58cc-a067-1aa8692a6e31_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 735832,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ft5/875e4a38596447dea1d30b5831669e36/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7224100-5392-58cc-a067-1aa8692a6e31/c7224100-5392-58cc-a067-1aa8692a6e31_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 735832,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ft5/875e4a38596447dea1d30b5831669e36/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7224100-5392-58cc-a067-1aa8692a6e31/c7224100-5392-58cc-a067-1aa8692a6e31_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 719469,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ft5/875e4a38596447dea1d30b5831669e36/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7224100-5392-58cc-a067-1aa8692a6e31/c7224100-5392-58cc-a067-1aa8692a6e31_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 706665,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ft5/875e4a38596447dea1d30b5831669e36/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7224100-5392-58cc-a067-1aa8692a6e31/c7224100-5392-58cc-a067-1aa8692a6e31_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 777624,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ft5/875e4a38596447dea1d30b5831669e36/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7224100-5392-58cc-a067-1aa8692a6e31/c7224100-5392-58cc-a067-1aa8692a6e31_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 570269,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ft5/875e4a38596447dea1d30b5831669e36/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7224100-5392-58cc-a067-1aa8692a6e31/c7224100-5392-58cc-a067-1aa8692a6e31_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 529076,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ft5/875e4a38596447dea1d30b5831669e36/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7224100-5392-58cc-a067-1aa8692a6e31/c7224100-5392-58cc-a067-1aa8692a6e31_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 475305,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ft5/875e4a38596447dea1d30b5831669e36/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7224100-5392-58cc-a067-1aa8692a6e31/c7224100-5392-58cc-a067-1aa8692a6e31_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 541112,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ft5/875e4a38596447dea1d30b5831669e36/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7224100-5392-58cc-a067-1aa8692a6e31/c7224100-5392-58cc-a067-1aa8692a6e31_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 510948,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ft5/875e4a38596447dea1d30b5831669e36/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-03-06',
'seats_number': 5,
'seller_name': None,
'title': 'LAND ROVER LAND ROVER RANGE ROVER VELAR 2.0 D I4 240 S 4WD Auto '
'Sport utility vehicle 5-door (Euro 6.2) -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2019}
2026-03-25 16:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983648%27 HTTP/1.1" 200 None
2026-03-25 16:35:24 [ayvens.it] INFO: Saving data for 1983648: {'created_time': 1774456524.459282, 'last_price_update_time': 1774456524.459295, 'auction_closing_time': 1774603800.0}
2026-03-25 16:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1983648') HTTP/1.1" 204 0
2026-03-25 16:35:24 [ayvens.it] INFO: Found listing with ID: 1979699
2026-03-25 16:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979699%27 HTTP/1.1" 200 None
2026-03-25 16:35:24 [ayvens.it] INFO: Scrape type for 1979699: 2
2026-03-25 16:35:24 [ayvens.it] INFO: Extracting data for car ID: 1979699
2026-03-25 16:35:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fe83ca8e-1ad5-507a-8c89-b09a5426ca15 with identifier: 1979699
2026-03-25 16:35:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fe83ca8e-1ad5-507a-8c89-b09a5426ca15 with scrape type 2
2026-03-25 16:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fe83ca8e-1ad5-507a-8c89-b09a5426ca15 with scrape type 2
2026-03-25 16:35:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: fe83ca8e-1ad5-507a-8c89-b09a5426ca15, identifier: 1979699
2026-03-25 16:35:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx6/a1a85cf5a5d24bdba3952fe5e83348af/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:35:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: fe83ca8e-1ad5-507a-8c89-b09a5426ca15 with identifier: 1979699
2026-03-25 16:35:24 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:35:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: fe83ca8e-1ad5-507a-8c89-b09a5426ca15 with identifier: 1979699
2026-03-25 16:35:24 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: fe83ca8e-1ad5-507a-8c89-b09a5426ca15 with identifier: 1979699 to the API
2026-03-25 16:35:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:35:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:35:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'INDIUM GREY METALL',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.4L',
'expiration_date': '2026-03-26T09:30:00Z',
'fuel_type': 'hybrid',
'id': 'fe83ca8e-1ad5-507a-8c89-b09a5426ca15',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40968',
'listing': 'auction',
'location': None,
'make': 'VOLKSWAGEN',
'model': 'VOLKSWAGEN GOLF GTE 1.4 TSI Plug-In-Hybrid DSG Hatchback 5-door',
'odometer': 96663,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-03-26',
'seats_number': 5,
'seller_name': None,
'title': 'VOLKSWAGEN VOLKSWAGEN GOLF GTE 1.4 TSI Plug-In-Hybrid DSG Hatchback '
'5-door -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2018}
2026-03-25 16:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979699%27 HTTP/1.1" 200 None
2026-03-25 16:35:24 [ayvens.it] INFO: Saving data for 1979699: {'auction_closing_time': 1774517400.0, 'created_time': 1774369934.190619, 'last_price_update_time': 1774456524.930978}
2026-03-25 16:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1979699') HTTP/1.1" 204 0
2026-03-25 16:35:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fl4/dc19e02cca57456caafb51fc8c43034b/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:35:24 [ayvens.it] INFO: Found listing with ID: 1979700
2026-03-25 16:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979700%27 HTTP/1.1" 200 None
2026-03-25 16:35:24 [ayvens.it] INFO: Scrape type for 1979700: 2
2026-03-25 16:35:24 [ayvens.it] INFO: Extracting data for car ID: 1979700
2026-03-25 16:35:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 98a2879b-34f0-5b0e-9446-00a99008070a with identifier: 1979700
2026-03-25 16:35:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 98a2879b-34f0-5b0e-9446-00a99008070a with scrape type 2
2026-03-25 16:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 98a2879b-34f0-5b0e-9446-00a99008070a with scrape type 2
2026-03-25 16:35:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 98a2879b-34f0-5b0e-9446-00a99008070a, identifier: 1979700
2026-03-25 16:35:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv5/d9e52072d552428ba13c61575842de28/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:35:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv5/d9e52072d552428ba13c61575842de28/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:35:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fl4/dc19e02cca57456caafb51fc8c43034b/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:35:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 98a2879b-34f0-5b0e-9446-00a99008070a with identifier: 1979700
2026-03-25 16:35:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 98a2879b-34f0-5b0e-9446-00a99008070a with identifier: 1979700
2026-03-25 16:35:25 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 98a2879b-34f0-5b0e-9446-00a99008070a with identifier: 1979700 to the API
2026-03-25 16:35:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:35:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:35:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'BIANCO GELATO PASTELLO',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-26T09:30:00Z',
'fuel_type': 'diesel',
'id': '98a2879b-34f0-5b0e-9446-00a99008070a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40968',
'listing': 'auction',
'location': None,
'make': 'FIAT',
'model': 'FIAT TIPO (PC) 1.3 MJT 95CV S&S CROSS FP',
'odometer': 212048,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-10-18',
'seats_number': 5,
'seller_name': None,
'title': 'FIAT FIAT TIPO (PC) 1.3 MJT 95CV S&S CROSS FP -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-25 16:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979700%27 HTTP/1.1" 200 None
2026-03-25 16:35:25 [ayvens.it] INFO: Saving data for 1979700: {'auction_closing_time': 1774517400.0, 'created_time': 1774369935.76538, 'last_price_update_time': 1774456525.340144}
2026-03-25 16:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1979700') HTTP/1.1" 204 0
2026-03-25 16:35:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx6/a1a85cf5a5d24bdba3952fe5e83348af/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:35:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fl4/dc19e02cca57456caafb51fc8c43034b/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:35:25 [ayvens.it] INFO: Found listing with ID: 1979701
2026-03-25 16:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979701%27 HTTP/1.1" 200 None
2026-03-25 16:35:25 [ayvens.it] INFO: Scrape type for 1979701: 2
2026-03-25 16:35:25 [ayvens.it] INFO: Extracting data for car ID: 1979701
2026-03-25 16:35:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2e7a8a02-d88c-5c7b-9e4a-c5ab95f987c9 with identifier: 1979701
2026-03-25 16:35:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2e7a8a02-d88c-5c7b-9e4a-c5ab95f987c9 with scrape type 2
2026-03-25 16:35:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2e7a8a02-d88c-5c7b-9e4a-c5ab95f987c9 with scrape type 2
2026-03-25 16:35:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 2e7a8a02-d88c-5c7b-9e4a-c5ab95f987c9, identifier: 1979701
2026-03-25 16:35:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 2e7a8a02-d88c-5c7b-9e4a-c5ab95f987c9 with identifier: 1979701
2026-03-25 16:35:25 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:35:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 2e7a8a02-d88c-5c7b-9e4a-c5ab95f987c9 with identifier: 1979701
2026-03-25 16:35:25 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 2e7a8a02-d88c-5c7b-9e4a-c5ab95f987c9 with identifier: 1979701 to the API
2026-03-25 16:35:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:35:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:35:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'BLU BRILLANTE METALLIZZATO',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.9L',
'expiration_date': '2026-03-26T09:30:00Z',
'fuel_type': 'diesel',
'id': '2e7a8a02-d88c-5c7b-9e4a-c5ab95f987c9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40968',
'listing': 'auction',
'location': None,
'make': 'MERCEDES-BENZ',
'model': 'MERCEDES-BENZ GLE GLE 300 d 4MATIC Executive Sport utility vehicle '
'5-door (Euro 6.2)',
'odometer': 148032,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-03-11',
'seats_number': 5,
'seller_name': None,
'title': 'MERCEDES-BENZ MERCEDES-BENZ GLE GLE 300 d 4MATIC Executive Sport '
'utility vehicle 5-door (Euro 6.2) -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2021}
2026-03-25 16:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979701%27 HTTP/1.1" 200 None
2026-03-25 16:35:25 [ayvens.it] INFO: Saving data for 1979701: {'auction_closing_time': 1774517400.0, 'created_time': 1774369937.716999, 'last_price_update_time': 1774456525.789341}
2026-03-25 16:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1979701') HTTP/1.1" 204 0
2026-03-25 16:35:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:35:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcaea0d0>
2026-03-25 16:35:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:35:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:35:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:35:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b21c9297-2aab-5439-b236-62e408f17181/b21c9297-2aab-5439-b236-62e408f17181_image_7.jpg HTTP/1.1" 201 0
2026-03-25 16:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx6%252Fa1a85cf5a5d24bdba3952fe5e83348af%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 16:35:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx6/a1a85cf5a5d24bdba3952fe5e83348af/images/large/8.jpg saved to cache
2026-03-25 16:35:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b21c9297-2aab-5439-b236-62e408f17181
2026-03-25 16:35:25 [ayvens.it] INFO: Found listing with ID: 1979702
2026-03-25 16:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979702%27 HTTP/1.1" 200 None
2026-03-25 16:35:25 [ayvens.it] INFO: Scrape type for 1979702: 2
2026-03-25 16:35:25 [ayvens.it] INFO: Extracting data for car ID: 1979702
2026-03-25 16:35:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1dea58d5-d584-521f-a49e-2037d4807b02 with identifier: 1979702
2026-03-25 16:35:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1dea58d5-d584-521f-a49e-2037d4807b02 with scrape type 2
2026-03-25 16:35:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1dea58d5-d584-521f-a49e-2037d4807b02 with scrape type 2
2026-03-25 16:35:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 1dea58d5-d584-521f-a49e-2037d4807b02, identifier: 1979702
2026-03-25 16:35:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 1dea58d5-d584-521f-a49e-2037d4807b02 with identifier: 1979702
2026-03-25 16:35:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 1dea58d5-d584-521f-a49e-2037d4807b02 with identifier: 1979702
2026-03-25 16:35:26 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 1dea58d5-d584-521f-a49e-2037d4807b02 with identifier: 1979702 to the API
2026-03-25 16:35:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:35:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:35:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Unknown',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-26T09:30:00Z',
'fuel_type': 'hybrid',
'id': '1dea58d5-d584-521f-a49e-2037d4807b02',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40968',
'listing': 'auction',
'location': None,
'make': 'FORD',
'model': 'FORD PUMA 1.0 Ecoboost Hybrid 125CV ST-Line Auto Sport utility '
'vehicle 5-door (Euro 6.2)',
'odometer': 75952,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-05-24',
'seats_number': 5,
'seller_name': None,
'title': 'FORD FORD PUMA 1.0 Ecoboost Hybrid 125CV ST-Line Auto Sport utility '
'vehicle 5-door (Euro 6.2) -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2023}
2026-03-25 16:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979702%27 HTTP/1.1" 200 None
2026-03-25 16:35:26 [ayvens.it] INFO: Saving data for 1979702: {'auction_closing_time': 1774517400.0, 'created_time': 1774369938.892408, 'last_price_update_time': 1774456526.340837}
2026-03-25 16:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1979702') HTTP/1.1" 204 0
2026-03-25 16:35:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:35:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34d74cc890>
2026-03-25 16:35:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:35:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:35:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:35:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3e477d17-f202-5848-be6b-361f9695c549/3e477d17-f202-5848-be6b-361f9695c549_image_9.jpg HTTP/1.1" 201 0
2026-03-25 16:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl4%252Fdc19e02cca57456caafb51fc8c43034b%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 16:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl4/dc19e02cca57456caafb51fc8c43034b/images/large/10.jpg saved to cache
2026-03-25 16:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3e477d17-f202-5848-be6b-361f9695c549
2026-03-25 16:35:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:35:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc7fae10>
2026-03-25 16:35:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:35:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:35:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:35:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9307fa4f-4aa1-5b76-947b-8451840fae63/9307fa4f-4aa1-5b76-947b-8451840fae63_image_2.jpg HTTP/1.1" 201 0
2026-03-25 16:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv5%252Fd9e52072d552428ba13c61575842de28%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 16:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv5/d9e52072d552428ba13c61575842de28/images/large/3.jpg saved to cache
2026-03-25 16:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9307fa4f-4aa1-5b76-947b-8451840fae63
2026-03-25 16:35:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:35:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc785390>
2026-03-25 16:35:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:35:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:35:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:35:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9307fa4f-4aa1-5b76-947b-8451840fae63/9307fa4f-4aa1-5b76-947b-8451840fae63_image_3.jpg HTTP/1.1" 201 0
2026-03-25 16:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv5%252Fd9e52072d552428ba13c61575842de28%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 16:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv5/d9e52072d552428ba13c61575842de28/images/large/4.jpg saved to cache
2026-03-25 16:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9307fa4f-4aa1-5b76-947b-8451840fae63
2026-03-25 16:35:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9307fa4f-4aa1-5b76-947b-8451840fae63, skipping ID generation
2026-03-25 16:35:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9307fa4f-4aa1-5b76-947b-8451840fae63 with scrape type 1
2026-03-25 16:35:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9307fa4f-4aa1-5b76-947b-8451840fae63 sending to next pipeline
2026-03-25 16:35:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 9307fa4f-4aa1-5b76-947b-8451840fae63, identifier: 1983646
2026-03-25 16:35:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:35:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34de16bb50>
2026-03-25 16:35:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:35:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:35:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:35:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3e477d17-f202-5848-be6b-361f9695c549/3e477d17-f202-5848-be6b-361f9695c549_image_8.jpg HTTP/1.1" 201 0
2026-03-25 16:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl4%252Fdc19e02cca57456caafb51fc8c43034b%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 16:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl4/dc19e02cca57456caafb51fc8c43034b/images/large/9.jpg saved to cache
2026-03-25 16:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3e477d17-f202-5848-be6b-361f9695c549
2026-03-25 16:35:26 [ayvens.it] INFO: Found listing with ID: 1979703
2026-03-25 16:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979703%27 HTTP/1.1" 200 None
2026-03-25 16:35:26 [ayvens.it] INFO: Scrape type for 1979703: 2
2026-03-25 16:35:26 [ayvens.it] INFO: Extracting data for car ID: 1979703
2026-03-25 16:35:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bad00cf5-bc34-5860-b4c2-e825c3500605 with identifier: 1979703
2026-03-25 16:35:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bad00cf5-bc34-5860-b4c2-e825c3500605 with scrape type 2
2026-03-25 16:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bad00cf5-bc34-5860-b4c2-e825c3500605 with scrape type 2
2026-03-25 16:35:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: bad00cf5-bc34-5860-b4c2-e825c3500605, identifier: 1979703
2026-03-25 16:35:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 9307fa4f-4aa1-5b76-947b-8451840fae63 with identifier: 1983646
2026-03-25 16:35:27 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:35:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 9307fa4f-4aa1-5b76-947b-8451840fae63 with identifier: 1983646
2026-03-25 16:35:27 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 9307fa4f-4aa1-5b76-947b-8451840fae63 with identifier: 1983646 to the API
2026-03-25 16:35:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:35:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:35:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fv5/d9e52072d552428ba13c61575842de28/images/large/4.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'ARGENTO RIFLESSO METALL',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-27T09:30:00Z',
'fuel_type': 'diesel',
'id': '9307fa4f-4aa1-5b76-947b-8451840fae63',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41025',
'listing': 'auction',
'location': None,
'make': 'VOLKSWAGEN',
'model': 'VOLKSWAGEN POLO 1.6 TDI SCR 59kW Comfortline BMT Hatchback 5-door',
'odometer': 134016,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9307fa4f-4aa1-5b76-947b-8451840fae63/9307fa4f-4aa1-5b76-947b-8451840fae63_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 806451,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv5/d9e52072d552428ba13c61575842de28/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9307fa4f-4aa1-5b76-947b-8451840fae63/9307fa4f-4aa1-5b76-947b-8451840fae63_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 781310,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv5/d9e52072d552428ba13c61575842de28/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9307fa4f-4aa1-5b76-947b-8451840fae63/9307fa4f-4aa1-5b76-947b-8451840fae63_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 806451,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv5/d9e52072d552428ba13c61575842de28/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9307fa4f-4aa1-5b76-947b-8451840fae63/9307fa4f-4aa1-5b76-947b-8451840fae63_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 799820,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv5/d9e52072d552428ba13c61575842de28/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9307fa4f-4aa1-5b76-947b-8451840fae63/9307fa4f-4aa1-5b76-947b-8451840fae63_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 795919,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv5/d9e52072d552428ba13c61575842de28/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9307fa4f-4aa1-5b76-947b-8451840fae63/9307fa4f-4aa1-5b76-947b-8451840fae63_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 584838,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv5/d9e52072d552428ba13c61575842de28/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9307fa4f-4aa1-5b76-947b-8451840fae63/9307fa4f-4aa1-5b76-947b-8451840fae63_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 679152,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv5/d9e52072d552428ba13c61575842de28/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9307fa4f-4aa1-5b76-947b-8451840fae63/9307fa4f-4aa1-5b76-947b-8451840fae63_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 679152,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv5/d9e52072d552428ba13c61575842de28/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9307fa4f-4aa1-5b76-947b-8451840fae63/9307fa4f-4aa1-5b76-947b-8451840fae63_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 631291,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv5/d9e52072d552428ba13c61575842de28/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9307fa4f-4aa1-5b76-947b-8451840fae63/9307fa4f-4aa1-5b76-947b-8451840fae63_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 544550,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv5/d9e52072d552428ba13c61575842de28/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-02-04',
'seats_number': 5,
'seller_name': None,
'title': 'VOLKSWAGEN VOLKSWAGEN POLO 1.6 TDI SCR 59kW Comfortline BMT '
'Hatchback 5-door -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2019}
2026-03-25 16:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983646%27 HTTP/1.1" 200 None
2026-03-25 16:35:27 [ayvens.it] INFO: Saving data for 1983646: {'created_time': 1774456527.407426, 'last_price_update_time': 1774456527.407438, 'auction_closing_time': 1774603800.0}
2026-03-25 16:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1983646') HTTP/1.1" 204 0
2026-03-25 16:35:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fl4/dc19e02cca57456caafb51fc8c43034b/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:35:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: bad00cf5-bc34-5860-b4c2-e825c3500605 with identifier: 1979703
2026-03-25 16:35:27 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:35:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: bad00cf5-bc34-5860-b4c2-e825c3500605 with identifier: 1979703
2026-03-25 16:35:27 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: bad00cf5-bc34-5860-b4c2-e825c3500605 with identifier: 1979703 to the API
2026-03-25 16:35:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:35:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:35:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'BIANCO IBIS TINTA UNITA',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-26T09:30:00Z',
'fuel_type': 'petrol',
'id': 'bad00cf5-bc34-5860-b4c2-e825c3500605',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40968',
'listing': 'auction',
'location': None,
'make': 'AUDI',
'model': 'AUDI A3 40 TFSI S TRONIC QUATTRO S.BACK FP',
'odometer': 102632,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-10-29',
'seats_number': 5,
'seller_name': None,
'title': 'AUDI AUDI A3 40 TFSI S TRONIC QUATTRO S.BACK FP -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2019}
2026-03-25 16:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979703%27 HTTP/1.1" 200 None
2026-03-25 16:35:27 [ayvens.it] INFO: Saving data for 1979703: {'auction_closing_time': 1774517400.0, 'created_time': 1774369939.989071, 'last_price_update_time': 1774456527.65999}
2026-03-25 16:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1979703') HTTP/1.1" 204 0
2026-03-25 16:35:27 [ayvens.it] INFO: Found listing with ID: 1979704
2026-03-25 16:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979704%27 HTTP/1.1" 200 None
2026-03-25 16:35:27 [ayvens.it] INFO: Scrape type for 1979704: 2
2026-03-25 16:35:27 [ayvens.it] INFO: Extracting data for car ID: 1979704
2026-03-25 16:35:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9582ddc9-e236-5c14-af54-712fe2997406 with identifier: 1979704
2026-03-25 16:35:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9582ddc9-e236-5c14-af54-712fe2997406 with scrape type 2
2026-03-25 16:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9582ddc9-e236-5c14-af54-712fe2997406 with scrape type 2
2026-03-25 16:35:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 9582ddc9-e236-5c14-af54-712fe2997406, identifier: 1979704
2026-03-25 16:35:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:35:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc5e8050>
2026-03-25 16:35:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:35:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:35:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:35:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b21c9297-2aab-5439-b236-62e408f17181/b21c9297-2aab-5439-b236-62e408f17181_image_6.jpg HTTP/1.1" 201 0
2026-03-25 16:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx6%252Fa1a85cf5a5d24bdba3952fe5e83348af%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 16:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx6/a1a85cf5a5d24bdba3952fe5e83348af/images/large/7.jpg saved to cache
2026-03-25 16:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b21c9297-2aab-5439-b236-62e408f17181
2026-03-25 16:35:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b21c9297-2aab-5439-b236-62e408f17181, skipping ID generation
2026-03-25 16:35:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b21c9297-2aab-5439-b236-62e408f17181 with scrape type 1
2026-03-25 16:35:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b21c9297-2aab-5439-b236-62e408f17181 sending to next pipeline
2026-03-25 16:35:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: b21c9297-2aab-5439-b236-62e408f17181, identifier: 1983645
2026-03-25 16:35:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:35:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc7de810>
2026-03-25 16:35:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:35:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:35:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:35:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3e477d17-f202-5848-be6b-361f9695c549/3e477d17-f202-5848-be6b-361f9695c549_image_7.jpg HTTP/1.1" 201 0
2026-03-25 16:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl4%252Fdc19e02cca57456caafb51fc8c43034b%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 16:35:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl4/dc19e02cca57456caafb51fc8c43034b/images/large/8.jpg saved to cache
2026-03-25 16:35:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3e477d17-f202-5848-be6b-361f9695c549
2026-03-25 16:35:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 9582ddc9-e236-5c14-af54-712fe2997406 with identifier: 1979704
2026-03-25 16:35:28 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:35:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 9582ddc9-e236-5c14-af54-712fe2997406 with identifier: 1979704
2026-03-25 16:35:28 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 9582ddc9-e236-5c14-af54-712fe2997406 with identifier: 1979704 to the API
2026-03-25 16:35:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:35:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:35:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'PURE WHITE PASTELLO',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-26T09:30:00Z',
'fuel_type': 'hybrid',
'id': '9582ddc9-e236-5c14-af54-712fe2997406',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40968',
'listing': 'auction',
'location': None,
'make': 'VOLKSWAGEN',
'model': 'VOLKSWAGEN GOLF 1.0 eTSI 81kW EVO Life DSG Hatchback 5-door (Euro '
'6D)',
'odometer': 93592,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-09-26',
'seats_number': 5,
'seller_name': None,
'title': 'VOLKSWAGEN VOLKSWAGEN GOLF 1.0 eTSI 81kW EVO Life DSG Hatchback '
'5-door (Euro 6D) -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-25 16:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979704%27 HTTP/1.1" 200 None
2026-03-25 16:35:28 [ayvens.it] INFO: Saving data for 1979704: {'auction_closing_time': 1774517400.0, 'created_time': 1774369941.642907, 'last_price_update_time': 1774456528.422813}
2026-03-25 16:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1979704') HTTP/1.1" 204 0
2026-03-25 16:35:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: b21c9297-2aab-5439-b236-62e408f17181 with identifier: 1983645
2026-03-25 16:35:28 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:35:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: b21c9297-2aab-5439-b236-62e408f17181 with identifier: 1983645
2026-03-25 16:35:28 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: b21c9297-2aab-5439-b236-62e408f17181 with identifier: 1983645 to the API
2026-03-25 16:35:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:35:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:35:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fx6/a1a85cf5a5d24bdba3952fe5e83348af/images/large/7.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'OSMIUM GREY METALLIZZATO',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-27T09:30:00Z',
'fuel_type': 'hybrid',
'id': 'b21c9297-2aab-5439-b236-62e408f17181',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41025',
'listing': 'auction',
'location': None,
'make': 'VOLVO',
'model': 'VOLVO XC90 T8 Twin Engine AWD Geartr.7p.Inscription Sport utility '
'vehicle 5-door (Euro 6.2)',
'odometer': 117840,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 75,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b21c9297-2aab-5439-b236-62e408f17181/b21c9297-2aab-5439-b236-62e408f17181_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 764495,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx6/a1a85cf5a5d24bdba3952fe5e83348af/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b21c9297-2aab-5439-b236-62e408f17181/b21c9297-2aab-5439-b236-62e408f17181_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 755356,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx6/a1a85cf5a5d24bdba3952fe5e83348af/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b21c9297-2aab-5439-b236-62e408f17181/b21c9297-2aab-5439-b236-62e408f17181_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 764495,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx6/a1a85cf5a5d24bdba3952fe5e83348af/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b21c9297-2aab-5439-b236-62e408f17181/b21c9297-2aab-5439-b236-62e408f17181_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 699357,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx6/a1a85cf5a5d24bdba3952fe5e83348af/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b21c9297-2aab-5439-b236-62e408f17181/b21c9297-2aab-5439-b236-62e408f17181_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 743198,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx6/a1a85cf5a5d24bdba3952fe5e83348af/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b21c9297-2aab-5439-b236-62e408f17181/b21c9297-2aab-5439-b236-62e408f17181_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 659263,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx6/a1a85cf5a5d24bdba3952fe5e83348af/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b21c9297-2aab-5439-b236-62e408f17181/b21c9297-2aab-5439-b236-62e408f17181_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 776079,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx6/a1a85cf5a5d24bdba3952fe5e83348af/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b21c9297-2aab-5439-b236-62e408f17181/b21c9297-2aab-5439-b236-62e408f17181_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 584734,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx6/a1a85cf5a5d24bdba3952fe5e83348af/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b21c9297-2aab-5439-b236-62e408f17181/b21c9297-2aab-5439-b236-62e408f17181_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 689945,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx6/a1a85cf5a5d24bdba3952fe5e83348af/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b21c9297-2aab-5439-b236-62e408f17181/b21c9297-2aab-5439-b236-62e408f17181_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 660705,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx6/a1a85cf5a5d24bdba3952fe5e83348af/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-06-05',
'seats_number': 5,
'seller_name': None,
'title': 'VOLVO VOLVO XC90 T8 Twin Engine AWD Geartr.7p.Inscription Sport '
'utility vehicle 5-door (Euro 6.2) -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2019}
2026-03-25 16:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983645%27 HTTP/1.1" 200 None
2026-03-25 16:35:28 [ayvens.it] INFO: Saving data for 1983645: {'created_time': 1774456528.799762, 'last_price_update_time': 1774456528.799771, 'auction_closing_time': 1774603800.0}
2026-03-25 16:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1983645') HTTP/1.1" 204 0
2026-03-25 16:35:28 [ayvens.it] INFO: Found listing with ID: 1979705
2026-03-25 16:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979705%27 HTTP/1.1" 200 None
2026-03-25 16:35:28 [ayvens.it] INFO: Scrape type for 1979705: 2
2026-03-25 16:35:28 [ayvens.it] INFO: Extracting data for car ID: 1979705
2026-03-25 16:35:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2e261644-00a0-5414-9827-7679e16e522a with identifier: 1979705
2026-03-25 16:35:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2e261644-00a0-5414-9827-7679e16e522a with scrape type 2
2026-03-25 16:35:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2e261644-00a0-5414-9827-7679e16e522a with scrape type 2
2026-03-25 16:35:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 2e261644-00a0-5414-9827-7679e16e522a, identifier: 1979705
2026-03-25 16:35:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:35:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc5eb010>
2026-03-25 16:35:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:35:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:35:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:35:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3e477d17-f202-5848-be6b-361f9695c549/3e477d17-f202-5848-be6b-361f9695c549_image_6.jpg HTTP/1.1" 201 0
2026-03-25 16:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl4%252Fdc19e02cca57456caafb51fc8c43034b%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 16:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl4/dc19e02cca57456caafb51fc8c43034b/images/large/7.jpg saved to cache
2026-03-25 16:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3e477d17-f202-5848-be6b-361f9695c549
2026-03-25 16:35:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3e477d17-f202-5848-be6b-361f9695c549, skipping ID generation
2026-03-25 16:35:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3e477d17-f202-5848-be6b-361f9695c549 with scrape type 1
2026-03-25 16:35:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3e477d17-f202-5848-be6b-361f9695c549 sending to next pipeline
2026-03-25 16:35:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 3e477d17-f202-5848-be6b-361f9695c549, identifier: 1983644
2026-03-25 16:35:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 2e261644-00a0-5414-9827-7679e16e522a with identifier: 1979705
2026-03-25 16:35:29 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:35:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 2e261644-00a0-5414-9827-7679e16e522a with identifier: 1979705
2026-03-25 16:35:29 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 2e261644-00a0-5414-9827-7679e16e522a with identifier: 1979705 to the API
2026-03-25 16:35:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:35:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:35:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'DOLPHIN GREY METALL',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-26T09:30:00Z',
'fuel_type': 'hybrid',
'id': '2e261644-00a0-5414-9827-7679e16e522a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40968',
'listing': 'auction',
'location': None,
'make': 'VOLKSWAGEN',
'model': 'VOLKSWAGEN GOLF 1.0 eTSI 81kW EVO Life DSG Hatchback 5-door (Euro '
'6D)',
'odometer': 70525,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-06-15',
'seats_number': 5,
'seller_name': None,
'title': 'VOLKSWAGEN VOLKSWAGEN GOLF 1.0 eTSI 81kW EVO Life DSG Hatchback '
'5-door (Euro 6D) -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2021}
2026-03-25 16:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979705%27 HTTP/1.1" 200 None
2026-03-25 16:35:29 [ayvens.it] INFO: Saving data for 1979705: {'auction_closing_time': 1774517400.0, 'created_time': 1774369947.53274, 'last_price_update_time': 1774456529.362055}
2026-03-25 16:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1979705') HTTP/1.1" 204 0
2026-03-25 16:35:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 3e477d17-f202-5848-be6b-361f9695c549 with identifier: 1983644
2026-03-25 16:35:29 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:35:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 3e477d17-f202-5848-be6b-361f9695c549 with identifier: 1983644
2026-03-25 16:35:29 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 3e477d17-f202-5848-be6b-361f9695c549 with identifier: 1983644 to the API
2026-03-25 16:35:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:35:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:35:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fl4/dc19e02cca57456caafb51fc8c43034b/images/large/7.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'SUPER WHITE PASTELLO',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-27T09:30:00Z',
'fuel_type': 'hybrid',
'id': '3e477d17-f202-5848-be6b-361f9695c549',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41025',
'listing': 'auction',
'location': None,
'make': 'TOYOTA',
'model': 'TOYOTA YARIS 1.5 Hybrid Active Hatchback 5-door',
'odometer': 164759,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 94,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e477d17-f202-5848-be6b-361f9695c549/3e477d17-f202-5848-be6b-361f9695c549_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 674572,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fl4/dc19e02cca57456caafb51fc8c43034b/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e477d17-f202-5848-be6b-361f9695c549/3e477d17-f202-5848-be6b-361f9695c549_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 759803,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fl4/dc19e02cca57456caafb51fc8c43034b/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e477d17-f202-5848-be6b-361f9695c549/3e477d17-f202-5848-be6b-361f9695c549_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 674572,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fl4/dc19e02cca57456caafb51fc8c43034b/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e477d17-f202-5848-be6b-361f9695c549/3e477d17-f202-5848-be6b-361f9695c549_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 700789,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fl4/dc19e02cca57456caafb51fc8c43034b/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e477d17-f202-5848-be6b-361f9695c549/3e477d17-f202-5848-be6b-361f9695c549_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 608744,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fl4/dc19e02cca57456caafb51fc8c43034b/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e477d17-f202-5848-be6b-361f9695c549/3e477d17-f202-5848-be6b-361f9695c549_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 663344,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fl4/dc19e02cca57456caafb51fc8c43034b/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e477d17-f202-5848-be6b-361f9695c549/3e477d17-f202-5848-be6b-361f9695c549_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 716288,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fl4/dc19e02cca57456caafb51fc8c43034b/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e477d17-f202-5848-be6b-361f9695c549/3e477d17-f202-5848-be6b-361f9695c549_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 535672,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fl4/dc19e02cca57456caafb51fc8c43034b/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e477d17-f202-5848-be6b-361f9695c549/3e477d17-f202-5848-be6b-361f9695c549_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 669811,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fl4/dc19e02cca57456caafb51fc8c43034b/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e477d17-f202-5848-be6b-361f9695c549/3e477d17-f202-5848-be6b-361f9695c549_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 589770,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fl4/dc19e02cca57456caafb51fc8c43034b/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-09-07',
'seats_number': 5,
'seller_name': None,
'title': 'TOYOTA TOYOTA YARIS 1.5 Hybrid Active Hatchback 5-door -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2017}
2026-03-25 16:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983644%27 HTTP/1.1" 200 None
2026-03-25 16:35:29 [ayvens.it] INFO: Saving data for 1983644: {'created_time': 1774456529.816477, 'last_price_update_time': 1774456529.816487, 'auction_closing_time': 1774603800.0}
2026-03-25 16:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1983644') HTTP/1.1" 204 0
2026-03-25 16:35:29 [ayvens.it] INFO: Found listing with ID: 1979706
2026-03-25 16:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979706%27 HTTP/1.1" 200 None
2026-03-25 16:35:29 [ayvens.it] INFO: Scrape type for 1979706: 2
2026-03-25 16:35:29 [ayvens.it] INFO: Extracting data for car ID: 1979706
2026-03-25 16:35:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d3aab56b-1eab-5c83-b3b1-2e24164a74a4 with identifier: 1979706
2026-03-25 16:35:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d3aab56b-1eab-5c83-b3b1-2e24164a74a4 with scrape type 2
2026-03-25 16:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d3aab56b-1eab-5c83-b3b1-2e24164a74a4 with scrape type 2
2026-03-25 16:35:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: d3aab56b-1eab-5c83-b3b1-2e24164a74a4, identifier: 1979706
2026-03-25 16:35:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fw5/627e30186c9240ecbd1f1fc8f663932d/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:35:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: d3aab56b-1eab-5c83-b3b1-2e24164a74a4 with identifier: 1979706
2026-03-25 16:35:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: d3aab56b-1eab-5c83-b3b1-2e24164a74a4 with identifier: 1979706
2026-03-25 16:35:30 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: d3aab56b-1eab-5c83-b3b1-2e24164a74a4 with identifier: 1979706 to the API
2026-03-25 16:35:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:35:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:35:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Bianco Gelato pastello',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-26T09:30:00Z',
'fuel_type': 'petrol',
'id': 'd3aab56b-1eab-5c83-b3b1-2e24164a74a4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40968',
'listing': 'auction',
'location': None,
'make': 'FIAT',
'model': 'FIAT PANDA 1.2 69 Cv Van 2 posti Euro6d POP Commercial hatch 5-door '
'(Euro 6.2)',
'odometer': 122419,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-07-11',
'seats_number': 5,
'seller_name': None,
'title': 'FIAT FIAT PANDA 1.2 69 Cv Van 2 posti Euro6d POP Commercial hatch '
'5-door (Euro 6.2) -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2019}
2026-03-25 16:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979706%27 HTTP/1.1" 200 None
2026-03-25 16:35:30 [ayvens.it] INFO: Saving data for 1979706: {'auction_closing_time': 1774517400.0, 'created_time': 1774369953.234408, 'last_price_update_time': 1774456530.181336}
2026-03-25 16:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1979706') HTTP/1.1" 204 0
2026-03-25 16:35:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fw3/a0424e9d06554414a7e17901fa142b75/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:35:30 [ayvens.it] INFO: Found listing with ID: 1979707
2026-03-25 16:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979707%27 HTTP/1.1" 200 None
2026-03-25 16:35:30 [ayvens.it] INFO: Scrape type for 1979707: 2
2026-03-25 16:35:30 [ayvens.it] INFO: Extracting data for car ID: 1979707
2026-03-25 16:35:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1abc234d-95db-5a46-a1b4-f5864e740e71 with identifier: 1979707
2026-03-25 16:35:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1abc234d-95db-5a46-a1b4-f5864e740e71 with scrape type 2
2026-03-25 16:35:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1abc234d-95db-5a46-a1b4-f5864e740e71 with scrape type 2
2026-03-25 16:35:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 1abc234d-95db-5a46-a1b4-f5864e740e71, identifier: 1979707
2026-03-25 16:35:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fw3/a0424e9d06554414a7e17901fa142b75/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:35:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fw5/627e30186c9240ecbd1f1fc8f663932d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:35:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 1abc234d-95db-5a46-a1b4-f5864e740e71 with identifier: 1979707
2026-03-25 16:35:30 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:35:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 1abc234d-95db-5a46-a1b4-f5864e740e71 with identifier: 1979707
2026-03-25 16:35:30 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 1abc234d-95db-5a46-a1b4-f5864e740e71 with identifier: 1979707 to the API
2026-03-25 16:35:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:35:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:35:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'BIANCO GHIACCIO MTZ',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.4L',
'expiration_date': '2026-03-26T09:30:00Z',
'fuel_type': 'hybrid',
'id': '1abc234d-95db-5a46-a1b4-f5864e740e71',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40968',
'listing': 'auction',
'location': None,
'make': 'AUDI',
'model': 'AUDI Q3 SPORTBACK PC 45 TFSI E S TRONIC BUSINESS PLUS FP',
'odometer': 94626,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-11-25',
'seats_number': 5,
'seller_name': None,
'title': 'AUDI AUDI Q3 SPORTBACK PC 45 TFSI E S TRONIC BUSINESS PLUS FP -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2021}
2026-03-25 16:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979707%27 HTTP/1.1" 200 None
2026-03-25 16:35:30 [ayvens.it] INFO: Saving data for 1979707: {'auction_closing_time': 1774517400.0, 'created_time': 1774369958.344973, 'last_price_update_time': 1774456530.845645}
2026-03-25 16:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1979707') HTTP/1.1" 204 0
2026-03-25 16:35:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fw3/a0424e9d06554414a7e17901fa142b75/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:35:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg0/32846e25335d48619c285a6b7891011f/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:35:30 [ayvens.it] INFO: Found listing with ID: 1979708
2026-03-25 16:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979708%27 HTTP/1.1" 200 None
2026-03-25 16:35:30 [ayvens.it] INFO: Scrape type for 1979708: 2
2026-03-25 16:35:30 [ayvens.it] INFO: Extracting data for car ID: 1979708
2026-03-25 16:35:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c6428693-3c34-508a-b498-6eda6e9eac69 with identifier: 1979708
2026-03-25 16:35:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c6428693-3c34-508a-b498-6eda6e9eac69 with scrape type 2
2026-03-25 16:35:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c6428693-3c34-508a-b498-6eda6e9eac69 with scrape type 2
2026-03-25 16:35:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: c6428693-3c34-508a-b498-6eda6e9eac69, identifier: 1979708
2026-03-25 16:35:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fw3/a0424e9d06554414a7e17901fa142b75/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:35:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: c6428693-3c34-508a-b498-6eda6e9eac69 with identifier: 1979708
2026-03-25 16:35:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: c6428693-3c34-508a-b498-6eda6e9eac69 with identifier: 1979708
2026-03-25 16:35:31 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: c6428693-3c34-508a-b498-6eda6e9eac69 with identifier: 1979708 to the API
2026-03-25 16:35:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:35:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:35:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'BIANCO PASTELLO',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-26T09:30:00Z',
'fuel_type': 'diesel',
'id': 'c6428693-3c34-508a-b498-6eda6e9eac69',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40968',
'listing': 'auction',
'location': None,
'make': 'FIAT',
'model': 'FIAT DOBLÃ’ CARGO COMBI 1.3 Mijet 16v 95CV (cat. N1) Euro6 Combi '
'5-door (Euro 6)',
'odometer': 212742,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-11-27',
'seats_number': 5,
'seller_name': None,
'title': 'FIAT FIAT DOBLÃ’ CARGO COMBI 1.3 Mijet 16v 95CV (cat. N1) Euro6 '
'Combi 5-door (Euro 6) -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2018}
2026-03-25 16:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979708%27 HTTP/1.1" 200 None
2026-03-25 16:35:31 [ayvens.it] INFO: Saving data for 1979708: {'auction_closing_time': 1774517400.0, 'created_time': 1774369964.842609, 'last_price_update_time': 1774456531.438574}
2026-03-25 16:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1979708') HTTP/1.1" 204 0
2026-03-25 16:35:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:35:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dca9f690>
2026-03-25 16:35:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:35:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:35:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:35:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_529f8bf8-8eca-5cc1-bc57-c32dca723da7/529f8bf8-8eca-5cc1-bc57-c32dca723da7_image_1.jpg HTTP/1.1" 201 0
2026-03-25 16:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw5%252F627e30186c9240ecbd1f1fc8f663932d%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 16:35:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw5/627e30186c9240ecbd1f1fc8f663932d/images/large/2.jpg saved to cache
2026-03-25 16:35:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 529f8bf8-8eca-5cc1-bc57-c32dca723da7
2026-03-25 16:35:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:35:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34d7dacb10>
2026-03-25 16:35:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:35:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:35:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:35:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ed70d07-7f53-519a-9c6e-07489eefec7f/0ed70d07-7f53-519a-9c6e-07489eefec7f_image_9.jpg HTTP/1.1" 201 0
2026-03-25 16:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw3%252Fa0424e9d06554414a7e17901fa142b75%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 16:35:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw3/a0424e9d06554414a7e17901fa142b75/images/large/10.jpg saved to cache
2026-03-25 16:35:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0ed70d07-7f53-519a-9c6e-07489eefec7f
2026-03-25 16:35:31 [ayvens.it] INFO: Found listing with ID: 1979709
2026-03-25 16:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979709%27 HTTP/1.1" 200 None
2026-03-25 16:35:31 [ayvens.it] INFO: Scrape type for 1979709: 2
2026-03-25 16:35:31 [ayvens.it] INFO: Extracting data for car ID: 1979709
2026-03-25 16:35:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b2cafcea-75ee-5375-85cf-64e9d0245be7 with identifier: 1979709
2026-03-25 16:35:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b2cafcea-75ee-5375-85cf-64e9d0245be7 with scrape type 2
2026-03-25 16:35:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b2cafcea-75ee-5375-85cf-64e9d0245be7 with scrape type 2
2026-03-25 16:35:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: b2cafcea-75ee-5375-85cf-64e9d0245be7, identifier: 1979709
2026-03-25 16:35:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: b2cafcea-75ee-5375-85cf-64e9d0245be7 with identifier: 1979709
2026-03-25 16:35:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: b2cafcea-75ee-5375-85cf-64e9d0245be7 with identifier: 1979709
2026-03-25 16:35:31 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: b2cafcea-75ee-5375-85cf-64e9d0245be7 with identifier: 1979709 to the API
2026-03-25 16:35:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:35:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:35:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'POLAR WHITE PASTELLO',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-26T09:30:00Z',
'fuel_type': 'diesel',
'id': 'b2cafcea-75ee-5375-85cf-64e9d0245be7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40968',
'listing': 'auction',
'location': None,
'make': 'CITROËN',
'model': 'CITROEN C3 (PC) BLUEHDI 100 S&S BUSINESS COMBI FP',
'odometer': 81611,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-10-29',
'seats_number': 5,
'seller_name': None,
'title': 'CITROËN CITROEN C3 (PC) BLUEHDI 100 S&S BUSINESS COMBI FP -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2021}
2026-03-25 16:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979709%27 HTTP/1.1" 200 None
2026-03-25 16:35:32 [ayvens.it] INFO: Saving data for 1979709: {'auction_closing_time': 1774517400.0, 'created_time': 1774369971.626674, 'last_price_update_time': 1774456532.008184}
2026-03-25 16:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1979709') HTTP/1.1" 204 0
2026-03-25 16:35:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:35:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dca61010>
2026-03-25 16:35:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:35:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:35:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:35:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ed70d07-7f53-519a-9c6e-07489eefec7f/0ed70d07-7f53-519a-9c6e-07489eefec7f_image_7.jpg HTTP/1.1" 201 0
2026-03-25 16:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw3%252Fa0424e9d06554414a7e17901fa142b75%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 16:35:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw3/a0424e9d06554414a7e17901fa142b75/images/large/8.jpg saved to cache
2026-03-25 16:35:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0ed70d07-7f53-519a-9c6e-07489eefec7f
2026-03-25 16:35:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:35:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcf2ded0>
2026-03-25 16:35:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:35:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:35:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:35:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_529f8bf8-8eca-5cc1-bc57-c32dca723da7/529f8bf8-8eca-5cc1-bc57-c32dca723da7_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw5%252F627e30186c9240ecbd1f1fc8f663932d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 16:35:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw5/627e30186c9240ecbd1f1fc8f663932d/images/large/1.jpg saved to cache
2026-03-25 16:35:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 529f8bf8-8eca-5cc1-bc57-c32dca723da7
2026-03-25 16:35:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 529f8bf8-8eca-5cc1-bc57-c32dca723da7, skipping ID generation
2026-03-25 16:35:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 529f8bf8-8eca-5cc1-bc57-c32dca723da7 with scrape type 1
2026-03-25 16:35:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 529f8bf8-8eca-5cc1-bc57-c32dca723da7 sending to next pipeline
2026-03-25 16:35:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 529f8bf8-8eca-5cc1-bc57-c32dca723da7, identifier: 1983643
2026-03-25 16:35:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg0/32846e25335d48619c285a6b7891011f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:35:32 [ayvens.it] INFO: Found listing with ID: 1979710
2026-03-25 16:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979710%27 HTTP/1.1" 200 None
2026-03-25 16:35:32 [ayvens.it] INFO: Scrape type for 1979710: 2
2026-03-25 16:35:32 [ayvens.it] INFO: Extracting data for car ID: 1979710
2026-03-25 16:35:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0cc99042-ff57-554e-9829-21abdeca38f3 with identifier: 1979710
2026-03-25 16:35:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0cc99042-ff57-554e-9829-21abdeca38f3 with scrape type 2
2026-03-25 16:35:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0cc99042-ff57-554e-9829-21abdeca38f3 with scrape type 2
2026-03-25 16:35:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 0cc99042-ff57-554e-9829-21abdeca38f3, identifier: 1979710
2026-03-25 16:35:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 529f8bf8-8eca-5cc1-bc57-c32dca723da7 with identifier: 1983643
2026-03-25 16:35:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 529f8bf8-8eca-5cc1-bc57-c32dca723da7 with identifier: 1983643
2026-03-25 16:35:32 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 529f8bf8-8eca-5cc1-bc57-c32dca723da7 with identifier: 1983643 to the API
2026-03-25 16:35:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:35:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:35:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fw5/627e30186c9240ecbd1f1fc8f663932d/images/large/1.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'CASABLANCA WHITE',
'currency': 'EUR',
'doors_number': 4,
'engine': '1.6L',
'expiration_date': '2026-03-27T09:30:00Z',
'fuel_type': 'diesel',
'id': '529f8bf8-8eca-5cc1-bc57-c32dca723da7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41025',
'listing': 'auction',
'location': None,
'make': 'OPEL',
'model': 'OPEL VIVARO (PC) 1.6 CDTI 120CV S&S EURO 6C L1H1 27 QLI FP',
'odometer': 119157,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 44,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_529f8bf8-8eca-5cc1-bc57-c32dca723da7/529f8bf8-8eca-5cc1-bc57-c32dca723da7_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 753311,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fw5/627e30186c9240ecbd1f1fc8f663932d/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_529f8bf8-8eca-5cc1-bc57-c32dca723da7/529f8bf8-8eca-5cc1-bc57-c32dca723da7_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 722880,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fw5/627e30186c9240ecbd1f1fc8f663932d/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_529f8bf8-8eca-5cc1-bc57-c32dca723da7/529f8bf8-8eca-5cc1-bc57-c32dca723da7_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 753311,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fw5/627e30186c9240ecbd1f1fc8f663932d/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_529f8bf8-8eca-5cc1-bc57-c32dca723da7/529f8bf8-8eca-5cc1-bc57-c32dca723da7_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 683039,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fw5/627e30186c9240ecbd1f1fc8f663932d/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_529f8bf8-8eca-5cc1-bc57-c32dca723da7/529f8bf8-8eca-5cc1-bc57-c32dca723da7_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 650850,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fw5/627e30186c9240ecbd1f1fc8f663932d/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_529f8bf8-8eca-5cc1-bc57-c32dca723da7/529f8bf8-8eca-5cc1-bc57-c32dca723da7_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 561056,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fw5/627e30186c9240ecbd1f1fc8f663932d/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_529f8bf8-8eca-5cc1-bc57-c32dca723da7/529f8bf8-8eca-5cc1-bc57-c32dca723da7_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 500894,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fw5/627e30186c9240ecbd1f1fc8f663932d/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_529f8bf8-8eca-5cc1-bc57-c32dca723da7/529f8bf8-8eca-5cc1-bc57-c32dca723da7_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 377008,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fw5/627e30186c9240ecbd1f1fc8f663932d/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_529f8bf8-8eca-5cc1-bc57-c32dca723da7/529f8bf8-8eca-5cc1-bc57-c32dca723da7_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 620456,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fw5/627e30186c9240ecbd1f1fc8f663932d/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_529f8bf8-8eca-5cc1-bc57-c32dca723da7/529f8bf8-8eca-5cc1-bc57-c32dca723da7_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 508522,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fw5/627e30186c9240ecbd1f1fc8f663932d/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-02-28',
'seats_number': 5,
'seller_name': None,
'title': 'OPEL OPEL VIVARO (PC) 1.6 CDTI 120CV S&S EURO 6C L1H1 27 QLI FP -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2019}
2026-03-25 16:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983643%27 HTTP/1.1" 200 None
2026-03-25 16:35:32 [ayvens.it] INFO: Saving data for 1983643: {'created_time': 1774456532.672906, 'last_price_update_time': 1774456532.672917, 'auction_closing_time': 1774603800.0}
2026-03-25 16:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1983643') HTTP/1.1" 204 0
2026-03-25 16:35:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 0cc99042-ff57-554e-9829-21abdeca38f3 with identifier: 1979710
2026-03-25 16:35:32 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:35:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 0cc99042-ff57-554e-9829-21abdeca38f3 with identifier: 1979710
2026-03-25 16:35:32 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 0cc99042-ff57-554e-9829-21abdeca38f3 with identifier: 1979710 to the API
2026-03-25 16:35:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:35:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:35:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'MOTO COLORE',
'currency': 'EUR',
'doors_number': None,
'engine': '0.7L',
'expiration_date': '2026-03-26T09:30:00Z',
'fuel_type': 'petrol',
'id': '0cc99042-ff57-554e-9829-21abdeca38f3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40968',
'listing': 'auction',
'location': None,
'make': 'HONDA',
'model': 'HONDA NC 750X DCT Motociclo (Euro 5)',
'odometer': 39791,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-10-10',
'seats_number': 5,
'seller_name': None,
'title': 'HONDA HONDA NC 750X DCT Motociclo (Euro 5) -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2023}
2026-03-25 16:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979710%27 HTTP/1.1" 200 None
2026-03-25 16:35:32 [ayvens.it] INFO: Saving data for 1979710: {'auction_closing_time': 1774517400.0, 'created_time': 1774369973.075271, 'last_price_update_time': 1774456532.952945}
2026-03-25 16:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1979710') HTTP/1.1" 204 0
2026-03-25 16:35:32 [ayvens.it] INFO: Found listing with ID: 1979711
2026-03-25 16:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979711%27 HTTP/1.1" 200 None
2026-03-25 16:35:32 [ayvens.it] INFO: Scrape type for 1979711: 2
2026-03-25 16:35:32 [ayvens.it] INFO: Extracting data for car ID: 1979711
2026-03-25 16:35:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 082a0923-2829-5888-95e2-6d546071e14b with identifier: 1979711
2026-03-25 16:35:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 082a0923-2829-5888-95e2-6d546071e14b with scrape type 2
2026-03-25 16:35:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 082a0923-2829-5888-95e2-6d546071e14b with scrape type 2
2026-03-25 16:35:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 082a0923-2829-5888-95e2-6d546071e14b, identifier: 1979711
2026-03-25 16:35:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:35:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc9b1090>
2026-03-25 16:35:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:35:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:35:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:35:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ed70d07-7f53-519a-9c6e-07489eefec7f/0ed70d07-7f53-519a-9c6e-07489eefec7f_image_8.jpg HTTP/1.1" 201 0
2026-03-25 16:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw3%252Fa0424e9d06554414a7e17901fa142b75%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 16:35:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw3/a0424e9d06554414a7e17901fa142b75/images/large/9.jpg saved to cache
2026-03-25 16:35:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0ed70d07-7f53-519a-9c6e-07489eefec7f
2026-03-25 16:35:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:35:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcc18b50>
2026-03-25 16:35:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:35:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:35:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:35:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_084155de-6d5a-5744-82b0-8a6ba2c2d6c2/084155de-6d5a-5744-82b0-8a6ba2c2d6c2_image_1.jpg HTTP/1.1" 201 0
2026-03-25 16:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg0%252F32846e25335d48619c285a6b7891011f%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 16:35:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg0/32846e25335d48619c285a6b7891011f/images/large/2.jpg saved to cache
2026-03-25 16:35:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 084155de-6d5a-5744-82b0-8a6ba2c2d6c2
2026-03-25 16:35:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:35:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc5d4550>
2026-03-25 16:35:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:35:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:35:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:35:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ed70d07-7f53-519a-9c6e-07489eefec7f/0ed70d07-7f53-519a-9c6e-07489eefec7f_image_6.jpg HTTP/1.1" 201 0
2026-03-25 16:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw3%252Fa0424e9d06554414a7e17901fa142b75%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 16:35:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw3/a0424e9d06554414a7e17901fa142b75/images/large/7.jpg saved to cache
2026-03-25 16:35:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0ed70d07-7f53-519a-9c6e-07489eefec7f
2026-03-25 16:35:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0ed70d07-7f53-519a-9c6e-07489eefec7f, skipping ID generation
2026-03-25 16:35:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0ed70d07-7f53-519a-9c6e-07489eefec7f with scrape type 1
2026-03-25 16:35:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0ed70d07-7f53-519a-9c6e-07489eefec7f sending to next pipeline
2026-03-25 16:35:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 0ed70d07-7f53-519a-9c6e-07489eefec7f, identifier: 1983642
2026-03-25 16:35:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj2/9baa31c9d2274d90b97e2b17ddbe9e4d/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:35:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 082a0923-2829-5888-95e2-6d546071e14b with identifier: 1979711
2026-03-25 16:35:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 082a0923-2829-5888-95e2-6d546071e14b with identifier: 1979711
2026-03-25 16:35:33 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 082a0923-2829-5888-95e2-6d546071e14b with identifier: 1979711 to the API
2026-03-25 16:35:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:35:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:35:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'BIANCO BANQUISE PASTELLO',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-26T09:30:00Z',
'fuel_type': 'diesel',
'id': '082a0923-2829-5888-95e2-6d546071e14b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40968',
'listing': 'auction',
'location': None,
'make': 'CITROËN',
'model': 'CITROEN C3 BLUEHDI 100 S&S FEEL VAN FP',
'odometer': 91734,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-04-30',
'seats_number': 5,
'seller_name': None,
'title': 'CITROËN CITROEN C3 BLUEHDI 100 S&S FEEL VAN FP -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2021}
2026-03-25 16:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979711%27 HTTP/1.1" 200 None
2026-03-25 16:35:33 [ayvens.it] INFO: Saving data for 1979711: {'auction_closing_time': 1774517400.0, 'created_time': 1774369974.574908, 'last_price_update_time': 1774456533.686034}
2026-03-25 16:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1979711') HTTP/1.1" 204 0
2026-03-25 16:35:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 0ed70d07-7f53-519a-9c6e-07489eefec7f with identifier: 1983642
2026-03-25 16:35:33 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:35:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 0ed70d07-7f53-519a-9c6e-07489eefec7f with identifier: 1983642
2026-03-25 16:35:33 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 0ed70d07-7f53-519a-9c6e-07489eefec7f with identifier: 1983642 to the API
2026-03-25 16:35:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:35:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:35:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fw3/a0424e9d06554414a7e17901fa142b75/images/large/7.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'R COMMENT',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-27T09:30:00Z',
'fuel_type': 'diesel',
'id': '0ed70d07-7f53-519a-9c6e-07489eefec7f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41025',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': 'PEUGEOT 3008 BlueHDI 130 EAT8 S&S GT Line Sport utility vehicle '
'5-door (Euro 6.2)',
'odometer': 182385,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 21,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ed70d07-7f53-519a-9c6e-07489eefec7f/0ed70d07-7f53-519a-9c6e-07489eefec7f_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 666258,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fw3/a0424e9d06554414a7e17901fa142b75/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ed70d07-7f53-519a-9c6e-07489eefec7f/0ed70d07-7f53-519a-9c6e-07489eefec7f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 663045,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fw3/a0424e9d06554414a7e17901fa142b75/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ed70d07-7f53-519a-9c6e-07489eefec7f/0ed70d07-7f53-519a-9c6e-07489eefec7f_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 666258,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fw3/a0424e9d06554414a7e17901fa142b75/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ed70d07-7f53-519a-9c6e-07489eefec7f/0ed70d07-7f53-519a-9c6e-07489eefec7f_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 712118,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fw3/a0424e9d06554414a7e17901fa142b75/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ed70d07-7f53-519a-9c6e-07489eefec7f/0ed70d07-7f53-519a-9c6e-07489eefec7f_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 718452,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fw3/a0424e9d06554414a7e17901fa142b75/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ed70d07-7f53-519a-9c6e-07489eefec7f/0ed70d07-7f53-519a-9c6e-07489eefec7f_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 661261,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fw3/a0424e9d06554414a7e17901fa142b75/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ed70d07-7f53-519a-9c6e-07489eefec7f/0ed70d07-7f53-519a-9c6e-07489eefec7f_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 723426,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fw3/a0424e9d06554414a7e17901fa142b75/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ed70d07-7f53-519a-9c6e-07489eefec7f/0ed70d07-7f53-519a-9c6e-07489eefec7f_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 722795,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fw3/a0424e9d06554414a7e17901fa142b75/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ed70d07-7f53-519a-9c6e-07489eefec7f/0ed70d07-7f53-519a-9c6e-07489eefec7f_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 724300,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fw3/a0424e9d06554414a7e17901fa142b75/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ed70d07-7f53-519a-9c6e-07489eefec7f/0ed70d07-7f53-519a-9c6e-07489eefec7f_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 674375,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fw3/a0424e9d06554414a7e17901fa142b75/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-04-05',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT PEUGEOT 3008 BlueHDI 130 EAT8 S&S GT Line Sport utility '
'vehicle 5-door (Euro 6.2) -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2019}
2026-03-25 16:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983642%27 HTTP/1.1" 200 None
2026-03-25 16:35:34 [ayvens.it] INFO: Saving data for 1983642: {'created_time': 1774456534.115059, 'last_price_update_time': 1774456534.11507, 'auction_closing_time': 1774603800.0}
2026-03-25 16:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1983642') HTTP/1.1" 204 0
2026-03-25 16:35:34 [ayvens.it] INFO: Found listing with ID: 1979712
2026-03-25 16:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979712%27 HTTP/1.1" 200 None
2026-03-25 16:35:34 [ayvens.it] INFO: Scrape type for 1979712: 2
2026-03-25 16:35:34 [ayvens.it] INFO: Extracting data for car ID: 1979712
2026-03-25 16:35:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ca208af0-5524-5d16-9bba-90a2b58258a6 with identifier: 1979712
2026-03-25 16:35:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ca208af0-5524-5d16-9bba-90a2b58258a6 with scrape type 2
2026-03-25 16:35:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ca208af0-5524-5d16-9bba-90a2b58258a6 with scrape type 2
2026-03-25 16:35:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: ca208af0-5524-5d16-9bba-90a2b58258a6, identifier: 1979712
2026-03-25 16:35:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:35:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcbb5790>
2026-03-25 16:35:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:35:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:35:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:35:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_084155de-6d5a-5744-82b0-8a6ba2c2d6c2/084155de-6d5a-5744-82b0-8a6ba2c2d6c2_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg0%252F32846e25335d48619c285a6b7891011f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 16:35:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg0/32846e25335d48619c285a6b7891011f/images/large/1.jpg saved to cache
2026-03-25 16:35:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 084155de-6d5a-5744-82b0-8a6ba2c2d6c2
2026-03-25 16:35:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 084155de-6d5a-5744-82b0-8a6ba2c2d6c2, skipping ID generation
2026-03-25 16:35:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 084155de-6d5a-5744-82b0-8a6ba2c2d6c2 with scrape type 1
2026-03-25 16:35:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 084155de-6d5a-5744-82b0-8a6ba2c2d6c2 sending to next pipeline
2026-03-25 16:35:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 084155de-6d5a-5744-82b0-8a6ba2c2d6c2, identifier: 1983640
2026-03-25 16:35:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj2/9baa31c9d2274d90b97e2b17ddbe9e4d/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:35:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: ca208af0-5524-5d16-9bba-90a2b58258a6 with identifier: 1979712
2026-03-25 16:35:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: ca208af0-5524-5d16-9bba-90a2b58258a6 with identifier: 1979712
2026-03-25 16:35:34 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: ca208af0-5524-5d16-9bba-90a2b58258a6 with identifier: 1979712 to the API
2026-03-25 16:35:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:35:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:35:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'BIANCO',
'currency': 'EUR',
'doors_number': 2,
'engine': '1.9L',
'expiration_date': '2026-03-26T09:30:00Z',
'fuel_type': 'diesel',
'id': 'ca208af0-5524-5d16-9bba-90a2b58258a6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40968',
'listing': 'auction',
'location': None,
'make': 'ISUZU',
'model': 'ISUZU M21 (PC) 35 1.9 CRD HEAVY FP',
'odometer': 138046,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-09-28',
'seats_number': 5,
'seller_name': None,
'title': 'ISUZU ISUZU M21 (PC) 35 1.9 CRD HEAVY FP -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2018}
2026-03-25 16:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979712%27 HTTP/1.1" 200 None
2026-03-25 16:35:34 [ayvens.it] INFO: Saving data for 1979712: {'auction_closing_time': 1774517400.0, 'created_time': 1774369976.059547, 'last_price_update_time': 1774456534.877317}
2026-03-25 16:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1979712') HTTP/1.1" 204 0
2026-03-25 16:35:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 084155de-6d5a-5744-82b0-8a6ba2c2d6c2 with identifier: 1983640
2026-03-25 16:35:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 084155de-6d5a-5744-82b0-8a6ba2c2d6c2 with identifier: 1983640
2026-03-25 16:35:35 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 084155de-6d5a-5744-82b0-8a6ba2c2d6c2 with identifier: 1983640 to the API
2026-03-25 16:35:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:35:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:35:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gg0/32846e25335d48619c285a6b7891011f/images/large/1.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'BIANCO IBIS TINTA UNITA',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-27T09:30:00Z',
'fuel_type': 'diesel',
'id': '084155de-6d5a-5744-82b0-8a6ba2c2d6c2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41025',
'listing': 'auction',
'location': None,
'make': 'AUDI',
'model': 'AUDI Q3 35 TDI S tronic Business Sport utility vehicle 5-door (Euro '
'6D)',
'odometer': 183145,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 18,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_084155de-6d5a-5744-82b0-8a6ba2c2d6c2/084155de-6d5a-5744-82b0-8a6ba2c2d6c2_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 626027,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg0/32846e25335d48619c285a6b7891011f/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_084155de-6d5a-5744-82b0-8a6ba2c2d6c2/084155de-6d5a-5744-82b0-8a6ba2c2d6c2_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 702421,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg0/32846e25335d48619c285a6b7891011f/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_084155de-6d5a-5744-82b0-8a6ba2c2d6c2/084155de-6d5a-5744-82b0-8a6ba2c2d6c2_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 626027,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg0/32846e25335d48619c285a6b7891011f/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_084155de-6d5a-5744-82b0-8a6ba2c2d6c2/084155de-6d5a-5744-82b0-8a6ba2c2d6c2_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 656705,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg0/32846e25335d48619c285a6b7891011f/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_084155de-6d5a-5744-82b0-8a6ba2c2d6c2/084155de-6d5a-5744-82b0-8a6ba2c2d6c2_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 627611,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg0/32846e25335d48619c285a6b7891011f/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_084155de-6d5a-5744-82b0-8a6ba2c2d6c2/084155de-6d5a-5744-82b0-8a6ba2c2d6c2_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 502476,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg0/32846e25335d48619c285a6b7891011f/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_084155de-6d5a-5744-82b0-8a6ba2c2d6c2/084155de-6d5a-5744-82b0-8a6ba2c2d6c2_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 521827,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg0/32846e25335d48619c285a6b7891011f/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_084155de-6d5a-5744-82b0-8a6ba2c2d6c2/084155de-6d5a-5744-82b0-8a6ba2c2d6c2_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 407437,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg0/32846e25335d48619c285a6b7891011f/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_084155de-6d5a-5744-82b0-8a6ba2c2d6c2/084155de-6d5a-5744-82b0-8a6ba2c2d6c2_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 595339,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg0/32846e25335d48619c285a6b7891011f/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_084155de-6d5a-5744-82b0-8a6ba2c2d6c2/084155de-6d5a-5744-82b0-8a6ba2c2d6c2_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 537219,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg0/32846e25335d48619c285a6b7891011f/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-10-07',
'seats_number': 5,
'seller_name': None,
'title': 'AUDI AUDI Q3 35 TDI S tronic Business Sport utility vehicle 5-door '
'(Euro 6D) -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2021}
2026-03-25 16:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983640%27 HTTP/1.1" 200 None
2026-03-25 16:35:35 [ayvens.it] INFO: Saving data for 1983640: {'created_time': 1774456535.433989, 'last_price_update_time': 1774456535.433999, 'auction_closing_time': 1774603800.0}
2026-03-25 16:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1983640') HTTP/1.1" 204 0
2026-03-25 16:35:35 [ayvens.it] INFO: Found listing with ID: 1979713
2026-03-25 16:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979713%27 HTTP/1.1" 200 None
2026-03-25 16:35:35 [ayvens.it] INFO: Scrape type for 1979713: 2
2026-03-25 16:35:35 [ayvens.it] INFO: Extracting data for car ID: 1979713
2026-03-25 16:35:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 80ccc09d-8522-59f9-9905-3ac3f30205c6 with identifier: 1979713
2026-03-25 16:35:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 80ccc09d-8522-59f9-9905-3ac3f30205c6 with scrape type 2
2026-03-25 16:35:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 80ccc09d-8522-59f9-9905-3ac3f30205c6 with scrape type 2
2026-03-25 16:35:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 80ccc09d-8522-59f9-9905-3ac3f30205c6, identifier: 1979713
2026-03-25 16:35:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl1/873b413c4a314f4297dcc1c18fae0e31/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:35:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 80ccc09d-8522-59f9-9905-3ac3f30205c6 with identifier: 1979713
2026-03-25 16:35:35 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:35:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 80ccc09d-8522-59f9-9905-3ac3f30205c6 with identifier: 1979713
2026-03-25 16:35:35 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 80ccc09d-8522-59f9-9905-3ac3f30205c6 with identifier: 1979713 to the API
2026-03-25 16:35:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:35:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:35:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'WHITE PEARL',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-26T09:30:00Z',
'fuel_type': 'hybrid',
'id': '80ccc09d-8522-59f9-9905-3ac3f30205c6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40968',
'listing': 'auction',
'location': None,
'make': 'TOYOTA',
'model': 'TOYOTA C-HR (PC) 2.0H (184CV) E-CVT MOREBUSINESS FP',
'odometer': 71379,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-02-14',
'seats_number': 5,
'seller_name': None,
'title': 'TOYOTA TOYOTA C-HR (PC) 2.0H (184CV) E-CVT MOREBUSINESS FP -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2020}
2026-03-25 16:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979713%27 HTTP/1.1" 200 None
2026-03-25 16:35:35 [ayvens.it] INFO: Saving data for 1979713: {'auction_closing_time': 1774517400.0, 'created_time': 1774369978.344403, 'last_price_update_time': 1774456535.879189}
2026-03-25 16:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1979713') HTTP/1.1" 204 0
2026-03-25 16:35:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:35:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34d7d7d790>
2026-03-25 16:35:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:35:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:35:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:35:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f26b538-3014-5b45-9cbe-c0d8ec7dfd01/3f26b538-3014-5b45-9cbe-c0d8ec7dfd01_image_9.jpg HTTP/1.1" 201 0
2026-03-25 16:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj2%252F9baa31c9d2274d90b97e2b17ddbe9e4d%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 16:35:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj2/9baa31c9d2274d90b97e2b17ddbe9e4d/images/large/10.jpg saved to cache
2026-03-25 16:35:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3f26b538-3014-5b45-9cbe-c0d8ec7dfd01
2026-03-25 16:35:35 [ayvens.it] INFO: Found listing with ID: 1979714
2026-03-25 16:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979714%27 HTTP/1.1" 200 None
2026-03-25 16:35:35 [ayvens.it] INFO: Scrape type for 1979714: 2
2026-03-25 16:35:35 [ayvens.it] INFO: Extracting data for car ID: 1979714
2026-03-25 16:35:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 07204ef6-4c1c-53d6-9f37-bcf9e59450bc with identifier: 1979714
2026-03-25 16:35:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 07204ef6-4c1c-53d6-9f37-bcf9e59450bc with scrape type 2
2026-03-25 16:35:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 07204ef6-4c1c-53d6-9f37-bcf9e59450bc with scrape type 2
2026-03-25 16:35:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 07204ef6-4c1c-53d6-9f37-bcf9e59450bc, identifier: 1979714
2026-03-25 16:35:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr9/37c82360341040d198a24c54756d4934/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:35:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs5/eeeb82b554b24c3691af86eeac4b977c/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:35:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 07204ef6-4c1c-53d6-9f37-bcf9e59450bc with identifier: 1979714
2026-03-25 16:35:36 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:35:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 07204ef6-4c1c-53d6-9f37-bcf9e59450bc with identifier: 1979714
2026-03-25 16:35:36 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 07204ef6-4c1c-53d6-9f37-bcf9e59450bc with identifier: 1979714 to the API
2026-03-25 16:35:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:35:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:35:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Mediterranean Blue metallizzat',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-26T09:30:00Z',
'fuel_type': 'diesel',
'id': '07204ef6-4c1c-53d6-9f37-bcf9e59450bc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40968',
'listing': 'auction',
'location': None,
'make': 'BMW',
'model': 'BMW X1 sDrive 20d Business Advantage automatico Sport utility '
'vehicle 5-door (Euro 6.2)',
'odometer': 151739,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-05-19',
'seats_number': 5,
'seller_name': None,
'title': 'BMW BMW X1 sDrive 20d Business Advantage automatico Sport utility '
'vehicle 5-door (Euro 6.2) -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2020}
2026-03-25 16:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979714%27 HTTP/1.1" 200 None
2026-03-25 16:35:36 [ayvens.it] INFO: Saving data for 1979714: {'auction_closing_time': 1774517400.0, 'created_time': 1774369979.829687, 'last_price_update_time': 1774456536.443053}
2026-03-25 16:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1979714') HTTP/1.1" 204 0
2026-03-25 16:35:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:35:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc9c25d0>
2026-03-25 16:35:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:35:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:35:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:35:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f26b538-3014-5b45-9cbe-c0d8ec7dfd01/3f26b538-3014-5b45-9cbe-c0d8ec7dfd01_image_7.jpg HTTP/1.1" 201 0
2026-03-25 16:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj2%252F9baa31c9d2274d90b97e2b17ddbe9e4d%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 16:35:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj2/9baa31c9d2274d90b97e2b17ddbe9e4d/images/large/8.jpg saved to cache
2026-03-25 16:35:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3f26b538-3014-5b45-9cbe-c0d8ec7dfd01
2026-03-25 16:35:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3f26b538-3014-5b45-9cbe-c0d8ec7dfd01, skipping ID generation
2026-03-25 16:35:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3f26b538-3014-5b45-9cbe-c0d8ec7dfd01 with scrape type 1
2026-03-25 16:35:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3f26b538-3014-5b45-9cbe-c0d8ec7dfd01 sending to next pipeline
2026-03-25 16:35:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 3f26b538-3014-5b45-9cbe-c0d8ec7dfd01, identifier: 1983639
2026-03-25 16:35:36 [ayvens.it] INFO: Found listing with ID: 1979715
2026-03-25 16:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979715%27 HTTP/1.1" 200 None
2026-03-25 16:35:36 [ayvens.it] INFO: Scrape type for 1979715: 2
2026-03-25 16:35:36 [ayvens.it] INFO: Extracting data for car ID: 1979715
2026-03-25 16:35:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 76395bf3-152e-5b74-bef9-a1897b2f73b8 with identifier: 1979715
2026-03-25 16:35:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 76395bf3-152e-5b74-bef9-a1897b2f73b8 with scrape type 2
2026-03-25 16:35:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 76395bf3-152e-5b74-bef9-a1897b2f73b8 with scrape type 2
2026-03-25 16:35:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 76395bf3-152e-5b74-bef9-a1897b2f73b8, identifier: 1979715
2026-03-25 16:35:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 3f26b538-3014-5b45-9cbe-c0d8ec7dfd01 with identifier: 1983639
2026-03-25 16:35:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 3f26b538-3014-5b45-9cbe-c0d8ec7dfd01 with identifier: 1983639
2026-03-25 16:35:36 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 3f26b538-3014-5b45-9cbe-c0d8ec7dfd01 with identifier: 1983639 to the API
2026-03-25 16:35:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:35:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:35:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gj2/9baa31c9d2274d90b97e2b17ddbe9e4d/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'AGATE BLACK METALLIZZATO',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-27T09:30:00Z',
'fuel_type': 'diesel',
'id': '3f26b538-3014-5b45-9cbe-c0d8ec7dfd01',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41025',
'listing': 'auction',
'location': None,
'make': 'FORD',
'model': 'FORD FOCUS 1.5 Ecoblue 120cv Active V Co-Pil.Aut SW SW 5-door (Euro '
'6.2)',
'odometer': 217770,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 23,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f26b538-3014-5b45-9cbe-c0d8ec7dfd01/3f26b538-3014-5b45-9cbe-c0d8ec7dfd01_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 720774,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj2/9baa31c9d2274d90b97e2b17ddbe9e4d/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f26b538-3014-5b45-9cbe-c0d8ec7dfd01/3f26b538-3014-5b45-9cbe-c0d8ec7dfd01_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 720774,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj2/9baa31c9d2274d90b97e2b17ddbe9e4d/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f26b538-3014-5b45-9cbe-c0d8ec7dfd01/3f26b538-3014-5b45-9cbe-c0d8ec7dfd01_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 667854,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj2/9baa31c9d2274d90b97e2b17ddbe9e4d/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f26b538-3014-5b45-9cbe-c0d8ec7dfd01/3f26b538-3014-5b45-9cbe-c0d8ec7dfd01_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 654240,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj2/9baa31c9d2274d90b97e2b17ddbe9e4d/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f26b538-3014-5b45-9cbe-c0d8ec7dfd01/3f26b538-3014-5b45-9cbe-c0d8ec7dfd01_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 710482,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj2/9baa31c9d2274d90b97e2b17ddbe9e4d/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f26b538-3014-5b45-9cbe-c0d8ec7dfd01/3f26b538-3014-5b45-9cbe-c0d8ec7dfd01_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 637722,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj2/9baa31c9d2274d90b97e2b17ddbe9e4d/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f26b538-3014-5b45-9cbe-c0d8ec7dfd01/3f26b538-3014-5b45-9cbe-c0d8ec7dfd01_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 596304,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj2/9baa31c9d2274d90b97e2b17ddbe9e4d/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f26b538-3014-5b45-9cbe-c0d8ec7dfd01/3f26b538-3014-5b45-9cbe-c0d8ec7dfd01_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 509586,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj2/9baa31c9d2274d90b97e2b17ddbe9e4d/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f26b538-3014-5b45-9cbe-c0d8ec7dfd01/3f26b538-3014-5b45-9cbe-c0d8ec7dfd01_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 613811,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj2/9baa31c9d2274d90b97e2b17ddbe9e4d/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f26b538-3014-5b45-9cbe-c0d8ec7dfd01/3f26b538-3014-5b45-9cbe-c0d8ec7dfd01_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 514941,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj2/9baa31c9d2274d90b97e2b17ddbe9e4d/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-01-27',
'seats_number': 5,
'seller_name': None,
'title': 'FORD FORD FOCUS 1.5 Ecoblue 120cv Active V Co-Pil.Aut SW SW 5-door '
'(Euro 6.2) -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-25 16:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983639%27 HTTP/1.1" 200 None
2026-03-25 16:35:36 [ayvens.it] INFO: Saving data for 1983639: {'created_time': 1774456536.995731, 'last_price_update_time': 1774456536.995743, 'auction_closing_time': 1774603800.0}
2026-03-25 16:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1983639') HTTP/1.1" 204 0
2026-03-25 16:35:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 76395bf3-152e-5b74-bef9-a1897b2f73b8 with identifier: 1979715
2026-03-25 16:35:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 76395bf3-152e-5b74-bef9-a1897b2f73b8 with identifier: 1979715
2026-03-25 16:35:37 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 76395bf3-152e-5b74-bef9-a1897b2f73b8 with identifier: 1979715 to the API
2026-03-25 16:35:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:35:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:35:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'BIANCO GELATO PASTELLO',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-26T09:30:00Z',
'fuel_type': 'petrol_lpg',
'id': '76395bf3-152e-5b74-bef9-a1897b2f73b8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40968',
'listing': 'auction',
'location': None,
'make': 'FIAT',
'model': 'FIAT PANDA CONSIP14 1.2 69 CV EASYPOWER E6D-TEMP EASY FP',
'odometer': 38140,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-07-08',
'seats_number': 5,
'seller_name': None,
'title': 'FIAT FIAT PANDA CONSIP14 1.2 69 CV EASYPOWER E6D-TEMP EASY FP -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2020}
2026-03-25 16:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979715%27 HTTP/1.1" 200 None
2026-03-25 16:35:37 [ayvens.it] INFO: Saving data for 1979715: {'auction_closing_time': 1774517400.0, 'created_time': 1774369982.43634, 'last_price_update_time': 1774456537.457776}
2026-03-25 16:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1979715') HTTP/1.1" 204 0
2026-03-25 16:35:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:35:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34d7d62210>
2026-03-25 16:35:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:35:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:35:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:35:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31980461-b272-54f2-9fec-4761f502b635/31980461-b272-54f2-9fec-4761f502b635_image_9.jpg HTTP/1.1" 201 0
2026-03-25 16:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl1%252F873b413c4a314f4297dcc1c18fae0e31%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 16:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl1/873b413c4a314f4297dcc1c18fae0e31/images/large/10.jpg saved to cache
2026-03-25 16:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 31980461-b272-54f2-9fec-4761f502b635
2026-03-25 16:35:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 31980461-b272-54f2-9fec-4761f502b635, skipping ID generation
2026-03-25 16:35:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 31980461-b272-54f2-9fec-4761f502b635 with scrape type 1
2026-03-25 16:35:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 31980461-b272-54f2-9fec-4761f502b635 sending to next pipeline
2026-03-25 16:35:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 31980461-b272-54f2-9fec-4761f502b635, identifier: 1983638
2026-03-25 16:35:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn6/3eeb8698be3c4dde9f0c9ebc26a8ee94/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:35:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs5/eeeb82b554b24c3691af86eeac4b977c/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:35:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs5/eeeb82b554b24c3691af86eeac4b977c/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:35:37 [ayvens.it] INFO: Found listing with ID: 1979716
2026-03-25 16:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979716%27 HTTP/1.1" 200 None
2026-03-25 16:35:37 [ayvens.it] INFO: Scrape type for 1979716: 2
2026-03-25 16:35:37 [ayvens.it] INFO: Extracting data for car ID: 1979716
2026-03-25 16:35:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0ee44960-aea6-5595-b79c-54f879757b1c with identifier: 1979716
2026-03-25 16:35:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0ee44960-aea6-5595-b79c-54f879757b1c with scrape type 2
2026-03-25 16:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0ee44960-aea6-5595-b79c-54f879757b1c with scrape type 2
2026-03-25 16:35:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 0ee44960-aea6-5595-b79c-54f879757b1c, identifier: 1979716
2026-03-25 16:35:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 31980461-b272-54f2-9fec-4761f502b635 with identifier: 1983638
2026-03-25 16:35:37 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:35:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 31980461-b272-54f2-9fec-4761f502b635 with identifier: 1983638
2026-03-25 16:35:37 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 31980461-b272-54f2-9fec-4761f502b635 with identifier: 1983638 to the API
2026-03-25 16:35:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:35:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:35:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gl1/873b413c4a314f4297dcc1c18fae0e31/images/large/10.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'GRIGIO TITANIO MTZ',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-27T09:30:00Z',
'fuel_type': 'diesel',
'id': '31980461-b272-54f2-9fec-4761f502b635',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41025',
'listing': 'auction',
'location': None,
'make': 'RENAULT',
'model': 'RENAULT CLIO (PC) 1.5 DCI BLUE 74KW BUSINESS FP',
'odometer': 39732,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 37,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31980461-b272-54f2-9fec-4761f502b635/31980461-b272-54f2-9fec-4761f502b635_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 805500,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl1/873b413c4a314f4297dcc1c18fae0e31/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31980461-b272-54f2-9fec-4761f502b635/31980461-b272-54f2-9fec-4761f502b635_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 808437,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl1/873b413c4a314f4297dcc1c18fae0e31/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31980461-b272-54f2-9fec-4761f502b635/31980461-b272-54f2-9fec-4761f502b635_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 805500,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl1/873b413c4a314f4297dcc1c18fae0e31/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31980461-b272-54f2-9fec-4761f502b635/31980461-b272-54f2-9fec-4761f502b635_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 702751,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl1/873b413c4a314f4297dcc1c18fae0e31/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31980461-b272-54f2-9fec-4761f502b635/31980461-b272-54f2-9fec-4761f502b635_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 764238,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl1/873b413c4a314f4297dcc1c18fae0e31/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31980461-b272-54f2-9fec-4761f502b635/31980461-b272-54f2-9fec-4761f502b635_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 585324,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl1/873b413c4a314f4297dcc1c18fae0e31/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31980461-b272-54f2-9fec-4761f502b635/31980461-b272-54f2-9fec-4761f502b635_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 573206,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl1/873b413c4a314f4297dcc1c18fae0e31/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31980461-b272-54f2-9fec-4761f502b635/31980461-b272-54f2-9fec-4761f502b635_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 604596,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl1/873b413c4a314f4297dcc1c18fae0e31/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31980461-b272-54f2-9fec-4761f502b635/31980461-b272-54f2-9fec-4761f502b635_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 592274,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl1/873b413c4a314f4297dcc1c18fae0e31/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31980461-b272-54f2-9fec-4761f502b635/31980461-b272-54f2-9fec-4761f502b635_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 535908,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl1/873b413c4a314f4297dcc1c18fae0e31/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-09-21',
'seats_number': 5,
'seller_name': None,
'title': 'RENAULT RENAULT CLIO (PC) 1.5 DCI BLUE 74KW BUSINESS FP -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-25 16:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983638%27 HTTP/1.1" 200 None
2026-03-25 16:35:38 [ayvens.it] INFO: Saving data for 1983638: {'created_time': 1774456538.092529, 'last_price_update_time': 1774456538.092541, 'auction_closing_time': 1774603800.0}
2026-03-25 16:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1983638') HTTP/1.1" 204 0
2026-03-25 16:35:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 0ee44960-aea6-5595-b79c-54f879757b1c with identifier: 1979716
2026-03-25 16:35:38 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:35:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 0ee44960-aea6-5595-b79c-54f879757b1c with identifier: 1979716
2026-03-25 16:35:38 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 0ee44960-aea6-5595-b79c-54f879757b1c with identifier: 1979716 to the API
2026-03-25 16:35:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:35:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:35:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Blue Celebes metallizzato',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-26T09:30:00Z',
'fuel_type': 'diesel',
'id': '0ee44960-aea6-5595-b79c-54f879757b1c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40968',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': 'PEUGEOT 5008 BlueHDi 130 Active Business EAT8 S/S aut Sport utility '
'vehicle 5-door (Euro 6D)',
'odometer': 79056,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-03-11',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT PEUGEOT 5008 BlueHDi 130 Active Business EAT8 S/S aut Sport '
'utility vehicle 5-door (Euro 6D) -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2021}
2026-03-25 16:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979716%27 HTTP/1.1" 200 None
2026-03-25 16:35:38 [ayvens.it] INFO: Saving data for 1979716: {'auction_closing_time': 1774517400.0, 'created_time': 1774369984.049357, 'last_price_update_time': 1774456538.512241}
2026-03-25 16:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1979716') HTTP/1.1" 204 0
2026-03-25 16:35:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:35:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcde2610>
2026-03-25 16:35:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:35:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:35:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:35:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e68fe672-5693-5f9d-80bd-54c0e8bc5ea8/e68fe672-5693-5f9d-80bd-54c0e8bc5ea8_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr9%252F37c82360341040d198a24c54756d4934%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 16:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr9/37c82360341040d198a24c54756d4934/images/large/1.jpg saved to cache
2026-03-25 16:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e68fe672-5693-5f9d-80bd-54c0e8bc5ea8
2026-03-25 16:35:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e68fe672-5693-5f9d-80bd-54c0e8bc5ea8, skipping ID generation
2026-03-25 16:35:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e68fe672-5693-5f9d-80bd-54c0e8bc5ea8 with scrape type 1
2026-03-25 16:35:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e68fe672-5693-5f9d-80bd-54c0e8bc5ea8 sending to next pipeline
2026-03-25 16:35:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: e68fe672-5693-5f9d-80bd-54c0e8bc5ea8, identifier: 1983632
2026-03-25 16:35:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:35:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc92f590>
2026-03-25 16:35:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:35:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:35:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:35:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5ed1d76a-8bb0-5206-94a2-60a4233c82b7/5ed1d76a-8bb0-5206-94a2-60a4233c82b7_image_2.jpg HTTP/1.1" 201 0
2026-03-25 16:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs5%252Feeeb82b554b24c3691af86eeac4b977c%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 16:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs5/eeeb82b554b24c3691af86eeac4b977c/images/large/3.jpg saved to cache
2026-03-25 16:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5ed1d76a-8bb0-5206-94a2-60a4233c82b7
2026-03-25 16:35:38 [ayvens.it] INFO: Found listing with ID: 1979717
2026-03-25 16:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979717%27 HTTP/1.1" 200 None
2026-03-25 16:35:38 [ayvens.it] INFO: Scrape type for 1979717: 2
2026-03-25 16:35:38 [ayvens.it] INFO: Extracting data for car ID: 1979717
2026-03-25 16:35:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 215f8a46-4d3a-518f-8b9a-317d285c6f4b with identifier: 1979717
2026-03-25 16:35:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 215f8a46-4d3a-518f-8b9a-317d285c6f4b with scrape type 2
2026-03-25 16:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 215f8a46-4d3a-518f-8b9a-317d285c6f4b with scrape type 2
2026-03-25 16:35:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 215f8a46-4d3a-518f-8b9a-317d285c6f4b, identifier: 1979717
2026-03-25 16:35:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: e68fe672-5693-5f9d-80bd-54c0e8bc5ea8 with identifier: 1983632
2026-03-25 16:35:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: e68fe672-5693-5f9d-80bd-54c0e8bc5ea8 with identifier: 1983632
2026-03-25 16:35:39 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: e68fe672-5693-5f9d-80bd-54c0e8bc5ea8 with identifier: 1983632 to the API
2026-03-25 16:35:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:35:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:35:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gr9/37c82360341040d198a24c54756d4934/images/large/1.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'BIANCO ICY PASTELLO',
'currency': 'EUR',
'doors_number': 4,
'engine': '2.2L',
'expiration_date': '2026-03-27T09:30:00Z',
'fuel_type': 'diesel',
'id': 'e68fe672-5693-5f9d-80bd-54c0e8bc5ea8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41025',
'listing': 'auction',
'location': None,
'make': 'OPEL',
'model': 'OPEL MOVANO Furgone 33 L2H2 BlueHDi 120 S&S Furgone 4-door (Euro '
'6D)',
'odometer': 87936,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 33,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e68fe672-5693-5f9d-80bd-54c0e8bc5ea8/e68fe672-5693-5f9d-80bd-54c0e8bc5ea8_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 654538,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr9/37c82360341040d198a24c54756d4934/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e68fe672-5693-5f9d-80bd-54c0e8bc5ea8/e68fe672-5693-5f9d-80bd-54c0e8bc5ea8_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 654538,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr9/37c82360341040d198a24c54756d4934/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e68fe672-5693-5f9d-80bd-54c0e8bc5ea8/e68fe672-5693-5f9d-80bd-54c0e8bc5ea8_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 636544,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr9/37c82360341040d198a24c54756d4934/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e68fe672-5693-5f9d-80bd-54c0e8bc5ea8/e68fe672-5693-5f9d-80bd-54c0e8bc5ea8_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 528496,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr9/37c82360341040d198a24c54756d4934/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e68fe672-5693-5f9d-80bd-54c0e8bc5ea8/e68fe672-5693-5f9d-80bd-54c0e8bc5ea8_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 531392,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr9/37c82360341040d198a24c54756d4934/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e68fe672-5693-5f9d-80bd-54c0e8bc5ea8/e68fe672-5693-5f9d-80bd-54c0e8bc5ea8_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 494635,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr9/37c82360341040d198a24c54756d4934/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e68fe672-5693-5f9d-80bd-54c0e8bc5ea8/e68fe672-5693-5f9d-80bd-54c0e8bc5ea8_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 563721,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr9/37c82360341040d198a24c54756d4934/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e68fe672-5693-5f9d-80bd-54c0e8bc5ea8/e68fe672-5693-5f9d-80bd-54c0e8bc5ea8_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 517442,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr9/37c82360341040d198a24c54756d4934/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e68fe672-5693-5f9d-80bd-54c0e8bc5ea8/e68fe672-5693-5f9d-80bd-54c0e8bc5ea8_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 523154,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr9/37c82360341040d198a24c54756d4934/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e68fe672-5693-5f9d-80bd-54c0e8bc5ea8/e68fe672-5693-5f9d-80bd-54c0e8bc5ea8_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 523154,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr9/37c82360341040d198a24c54756d4934/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-09-07',
'seats_number': 5,
'seller_name': None,
'title': 'OPEL OPEL MOVANO Furgone 33 L2H2 BlueHDi 120 S&S Furgone 4-door '
'(Euro 6D) -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2023}
2026-03-25 16:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983632%27 HTTP/1.1" 200 None
2026-03-25 16:35:39 [ayvens.it] INFO: Saving data for 1983632: {'created_time': 1774456539.453307, 'last_price_update_time': 1774456539.453319, 'auction_closing_time': 1774603800.0}
2026-03-25 16:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1983632') HTTP/1.1" 204 0
2026-03-25 16:35:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn6/3eeb8698be3c4dde9f0c9ebc26a8ee94/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:35:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 215f8a46-4d3a-518f-8b9a-317d285c6f4b with identifier: 1979717
2026-03-25 16:35:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 215f8a46-4d3a-518f-8b9a-317d285c6f4b with identifier: 1979717
2026-03-25 16:35:39 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 215f8a46-4d3a-518f-8b9a-317d285c6f4b with identifier: 1979717 to the API
2026-03-25 16:35:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:35:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:35:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Nero pastello',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-26T09:30:00Z',
'fuel_type': 'hybrid',
'id': '215f8a46-4d3a-518f-8b9a-317d285c6f4b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40968',
'listing': 'auction',
'location': None,
'make': 'VOLVO',
'model': 'VOLVO XC40 T5 Plug-in Hybrid auto Rech Inscrip Expr Sport utility '
'vehicle 5-door (Euro 6D)',
'odometer': 69705,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-01-28',
'seats_number': 5,
'seller_name': None,
'title': 'VOLVO VOLVO XC40 T5 Plug-in Hybrid auto Rech Inscrip Expr Sport '
'utility vehicle 5-door (Euro 6D) -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-25 16:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979717%27 HTTP/1.1" 200 None
2026-03-25 16:35:39 [ayvens.it] INFO: Saving data for 1979717: {'auction_closing_time': 1774517400.0, 'created_time': 1774369986.115536, 'last_price_update_time': 1774456539.71213}
2026-03-25 16:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1979717') HTTP/1.1" 204 0
2026-03-25 16:35:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm2/baf415c092c24cd79c96f548a2af1c5e/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:35:39 [ayvens.it] INFO: Found listing with ID: 1979718
2026-03-25 16:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979718%27 HTTP/1.1" 200 None
2026-03-25 16:35:39 [ayvens.it] INFO: Scrape type for 1979718: 2
2026-03-25 16:35:39 [ayvens.it] INFO: Extracting data for car ID: 1979718
2026-03-25 16:35:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c8d5fdd6-79a0-54db-99c5-81326bcdb496 with identifier: 1979718
2026-03-25 16:35:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c8d5fdd6-79a0-54db-99c5-81326bcdb496 with scrape type 2
2026-03-25 16:35:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c8d5fdd6-79a0-54db-99c5-81326bcdb496 with scrape type 2
2026-03-25 16:35:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: c8d5fdd6-79a0-54db-99c5-81326bcdb496, identifier: 1979718
2026-03-25 16:35:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:35:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcdd3b90>
2026-03-25 16:35:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:35:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:35:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:35:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8742a68b-6978-5b8c-888b-c27c18056674/8742a68b-6978-5b8c-888b-c27c18056674_image_1.jpg HTTP/1.1" 201 0
2026-03-25 16:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn6%252F3eeb8698be3c4dde9f0c9ebc26a8ee94%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 16:35:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn6/3eeb8698be3c4dde9f0c9ebc26a8ee94/images/large/2.jpg saved to cache
2026-03-25 16:35:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8742a68b-6978-5b8c-888b-c27c18056674
2026-03-25 16:35:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:35:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc5796d0>
2026-03-25 16:35:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:35:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:35:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:35:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5ed1d76a-8bb0-5206-94a2-60a4233c82b7/5ed1d76a-8bb0-5206-94a2-60a4233c82b7_image_3.jpg HTTP/1.1" 201 0
2026-03-25 16:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs5%252Feeeb82b554b24c3691af86eeac4b977c%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 16:35:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs5/eeeb82b554b24c3691af86eeac4b977c/images/large/4.jpg saved to cache
2026-03-25 16:35:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5ed1d76a-8bb0-5206-94a2-60a4233c82b7
2026-03-25 16:35:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:35:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc928c50>
2026-03-25 16:35:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:35:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:35:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:35:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5ed1d76a-8bb0-5206-94a2-60a4233c82b7/5ed1d76a-8bb0-5206-94a2-60a4233c82b7_image_1.jpg HTTP/1.1" 201 0
2026-03-25 16:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs5%252Feeeb82b554b24c3691af86eeac4b977c%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 16:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs5/eeeb82b554b24c3691af86eeac4b977c/images/large/2.jpg saved to cache
2026-03-25 16:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5ed1d76a-8bb0-5206-94a2-60a4233c82b7
2026-03-25 16:35:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5ed1d76a-8bb0-5206-94a2-60a4233c82b7, skipping ID generation
2026-03-25 16:35:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5ed1d76a-8bb0-5206-94a2-60a4233c82b7 with scrape type 1
2026-03-25 16:35:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5ed1d76a-8bb0-5206-94a2-60a4233c82b7 sending to next pipeline
2026-03-25 16:35:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 5ed1d76a-8bb0-5206-94a2-60a4233c82b7, identifier: 1983629
2026-03-25 16:35:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: c8d5fdd6-79a0-54db-99c5-81326bcdb496 with identifier: 1979718
2026-03-25 16:35:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: c8d5fdd6-79a0-54db-99c5-81326bcdb496 with identifier: 1979718
2026-03-25 16:35:40 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: c8d5fdd6-79a0-54db-99c5-81326bcdb496 with identifier: 1979718 to the API
2026-03-25 16:35:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:35:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:35:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'NERO PERLA METALLIZZATO',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-26T09:30:00Z',
'fuel_type': 'diesel',
'id': 'c8d5fdd6-79a0-54db-99c5-81326bcdb496',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40968',
'listing': 'auction',
'location': None,
'make': 'CITROËN',
'model': 'CITROEN DS 7 CROSSBACK BLUEHDI 130 AUTOMATICA BUSINESS (PC) FP',
'odometer': 62639,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-10-18',
'seats_number': 5,
'seller_name': None,
'title': 'CITROËN CITROEN DS 7 CROSSBACK BLUEHDI 130 AUTOMATICA BUSINESS (PC) '
'FP -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2021}
2026-03-25 16:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979718%27 HTTP/1.1" 200 None
2026-03-25 16:35:40 [ayvens.it] INFO: Saving data for 1979718: {'auction_closing_time': 1774517400.0, 'created_time': 1774369987.648066, 'last_price_update_time': 1774456540.368102}
2026-03-25 16:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1979718') HTTP/1.1" 204 0
2026-03-25 16:35:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 5ed1d76a-8bb0-5206-94a2-60a4233c82b7 with identifier: 1983629
2026-03-25 16:35:40 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:35:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 5ed1d76a-8bb0-5206-94a2-60a4233c82b7 with identifier: 1983629
2026-03-25 16:35:40 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 5ed1d76a-8bb0-5206-94a2-60a4233c82b7 with identifier: 1983629 to the API
2026-03-25 16:35:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:35:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:35:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gs5/eeeb82b554b24c3691af86eeac4b977c/images/large/2.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'BLACK SAPPHIRE',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-27T09:30:00Z',
'fuel_type': 'diesel',
'id': '5ed1d76a-8bb0-5206-94a2-60a4233c82b7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41025',
'listing': 'auction',
'location': None,
'make': 'BMW',
'model': 'BMW SERIE 2 ACTIVE TOURER 218d Auto',
'odometer': 93245,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ed1d76a-8bb0-5206-94a2-60a4233c82b7/5ed1d76a-8bb0-5206-94a2-60a4233c82b7_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 736185,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs5/eeeb82b554b24c3691af86eeac4b977c/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ed1d76a-8bb0-5206-94a2-60a4233c82b7/5ed1d76a-8bb0-5206-94a2-60a4233c82b7_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 449344,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs5/eeeb82b554b24c3691af86eeac4b977c/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ed1d76a-8bb0-5206-94a2-60a4233c82b7/5ed1d76a-8bb0-5206-94a2-60a4233c82b7_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 437677,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs5/eeeb82b554b24c3691af86eeac4b977c/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ed1d76a-8bb0-5206-94a2-60a4233c82b7/5ed1d76a-8bb0-5206-94a2-60a4233c82b7_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 727924,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs5/eeeb82b554b24c3691af86eeac4b977c/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ed1d76a-8bb0-5206-94a2-60a4233c82b7/5ed1d76a-8bb0-5206-94a2-60a4233c82b7_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 556284,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs5/eeeb82b554b24c3691af86eeac4b977c/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ed1d76a-8bb0-5206-94a2-60a4233c82b7/5ed1d76a-8bb0-5206-94a2-60a4233c82b7_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 701045,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs5/eeeb82b554b24c3691af86eeac4b977c/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ed1d76a-8bb0-5206-94a2-60a4233c82b7/5ed1d76a-8bb0-5206-94a2-60a4233c82b7_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 469896,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs5/eeeb82b554b24c3691af86eeac4b977c/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ed1d76a-8bb0-5206-94a2-60a4233c82b7/5ed1d76a-8bb0-5206-94a2-60a4233c82b7_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 408390,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs5/eeeb82b554b24c3691af86eeac4b977c/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ed1d76a-8bb0-5206-94a2-60a4233c82b7/5ed1d76a-8bb0-5206-94a2-60a4233c82b7_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 591536,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs5/eeeb82b554b24c3691af86eeac4b977c/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ed1d76a-8bb0-5206-94a2-60a4233c82b7/5ed1d76a-8bb0-5206-94a2-60a4233c82b7_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 716580,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs5/eeeb82b554b24c3691af86eeac4b977c/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-01-15',
'seats_number': 5,
'seller_name': None,
'title': 'BMW BMW SERIE 2 ACTIVE TOURER 218d Auto -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2024}
2026-03-25 16:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983629%27 HTTP/1.1" 200 None
2026-03-25 16:35:40 [ayvens.it] INFO: Saving data for 1983629: {'created_time': 1774456540.71367, 'last_price_update_time': 1774456540.713681, 'auction_closing_time': 1774603800.0}
2026-03-25 16:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1983629') HTTP/1.1" 204 0
2026-03-25 16:35:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs9/18426bbc778648bd901230c8baae5eff/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:35:40 [ayvens.it] INFO: Found listing with ID: 1979719
2026-03-25 16:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979719%27 HTTP/1.1" 200 None
2026-03-25 16:35:40 [ayvens.it] INFO: Scrape type for 1979719: 2
2026-03-25 16:35:40 [ayvens.it] INFO: Extracting data for car ID: 1979719
2026-03-25 16:35:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0658ef4d-c3c6-5693-abdf-acb7c4ce48d5 with identifier: 1979719
2026-03-25 16:35:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0658ef4d-c3c6-5693-abdf-acb7c4ce48d5 with scrape type 2
2026-03-25 16:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0658ef4d-c3c6-5693-abdf-acb7c4ce48d5 with scrape type 2
2026-03-25 16:35:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 0658ef4d-c3c6-5693-abdf-acb7c4ce48d5, identifier: 1979719
2026-03-25 16:35:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:35:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34d6b4a890>
2026-03-25 16:35:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:35:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:35:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:35:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8742a68b-6978-5b8c-888b-c27c18056674/8742a68b-6978-5b8c-888b-c27c18056674_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn6%252F3eeb8698be3c4dde9f0c9ebc26a8ee94%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 16:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn6/3eeb8698be3c4dde9f0c9ebc26a8ee94/images/large/1.jpg saved to cache
2026-03-25 16:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8742a68b-6978-5b8c-888b-c27c18056674
2026-03-25 16:35:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8742a68b-6978-5b8c-888b-c27c18056674, skipping ID generation
2026-03-25 16:35:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8742a68b-6978-5b8c-888b-c27c18056674 with scrape type 1
2026-03-25 16:35:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8742a68b-6978-5b8c-888b-c27c18056674 sending to next pipeline
2026-03-25 16:35:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 8742a68b-6978-5b8c-888b-c27c18056674, identifier: 1983631
2026-03-25 16:35:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 0658ef4d-c3c6-5693-abdf-acb7c4ce48d5 with identifier: 1979719
2026-03-25 16:35:40 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:35:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 0658ef4d-c3c6-5693-abdf-acb7c4ce48d5 with identifier: 1979719
2026-03-25 16:35:41 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 0658ef4d-c3c6-5693-abdf-acb7c4ce48d5 with identifier: 1979719 to the API
2026-03-25 16:35:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:35:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:35:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'GRAPHITE GREY MTZ',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.3L',
'expiration_date': '2026-03-26T09:30:00Z',
'fuel_type': 'hybrid',
'id': '0658ef4d-c3c6-5693-abdf-acb7c4ce48d5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40968',
'listing': 'auction',
'location': None,
'make': 'JEEP',
'model': 'JEEP COMPASS (PC) 1.3 T4 PHEV 190CV BUSINESS 4XE AUTO FP',
'odometer': 101308,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-11-30',
'seats_number': 5,
'seller_name': None,
'title': 'JEEP JEEP COMPASS (PC) 1.3 T4 PHEV 190CV BUSINESS 4XE AUTO FP -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2021}
2026-03-25 16:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979719%27 HTTP/1.1" 200 None
2026-03-25 16:35:41 [ayvens.it] INFO: Saving data for 1979719: {'auction_closing_time': 1774517400.0, 'created_time': 1774369989.482471, 'last_price_update_time': 1774456541.223093}
2026-03-25 16:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1979719') HTTP/1.1" 204 0
2026-03-25 16:35:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 8742a68b-6978-5b8c-888b-c27c18056674 with identifier: 1983631
2026-03-25 16:35:41 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:35:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 8742a68b-6978-5b8c-888b-c27c18056674 with identifier: 1983631
2026-03-25 16:35:41 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 8742a68b-6978-5b8c-888b-c27c18056674 with identifier: 1983631 to the API
2026-03-25 16:35:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:35:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:35:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gn6/3eeb8698be3c4dde9f0c9ebc26a8ee94/images/large/1.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'BLACK PERLA METALLIZZATO',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-27T09:30:00Z',
'fuel_type': 'diesel',
'id': '8742a68b-6978-5b8c-888b-c27c18056674',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41025',
'listing': 'auction',
'location': None,
'make': 'OPEL',
'model': 'OPEL GRANDLAND 1.5 130cv AT8 Business Elegance Sport utility '
'vehicle 5-door (Euro 6D)',
'odometer': 139623,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 19,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8742a68b-6978-5b8c-888b-c27c18056674/8742a68b-6978-5b8c-888b-c27c18056674_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 961444,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn6/3eeb8698be3c4dde9f0c9ebc26a8ee94/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8742a68b-6978-5b8c-888b-c27c18056674/8742a68b-6978-5b8c-888b-c27c18056674_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 732580,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn6/3eeb8698be3c4dde9f0c9ebc26a8ee94/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8742a68b-6978-5b8c-888b-c27c18056674/8742a68b-6978-5b8c-888b-c27c18056674_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 833976,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn6/3eeb8698be3c4dde9f0c9ebc26a8ee94/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8742a68b-6978-5b8c-888b-c27c18056674/8742a68b-6978-5b8c-888b-c27c18056674_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 567183,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn6/3eeb8698be3c4dde9f0c9ebc26a8ee94/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8742a68b-6978-5b8c-888b-c27c18056674/8742a68b-6978-5b8c-888b-c27c18056674_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 802203,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn6/3eeb8698be3c4dde9f0c9ebc26a8ee94/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8742a68b-6978-5b8c-888b-c27c18056674/8742a68b-6978-5b8c-888b-c27c18056674_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 649732,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn6/3eeb8698be3c4dde9f0c9ebc26a8ee94/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8742a68b-6978-5b8c-888b-c27c18056674/8742a68b-6978-5b8c-888b-c27c18056674_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 517193,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn6/3eeb8698be3c4dde9f0c9ebc26a8ee94/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8742a68b-6978-5b8c-888b-c27c18056674/8742a68b-6978-5b8c-888b-c27c18056674_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 661003,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn6/3eeb8698be3c4dde9f0c9ebc26a8ee94/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8742a68b-6978-5b8c-888b-c27c18056674/8742a68b-6978-5b8c-888b-c27c18056674_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 550889,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn6/3eeb8698be3c4dde9f0c9ebc26a8ee94/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8742a68b-6978-5b8c-888b-c27c18056674/8742a68b-6978-5b8c-888b-c27c18056674_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 512374,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn6/3eeb8698be3c4dde9f0c9ebc26a8ee94/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-03-03',
'seats_number': 5,
'seller_name': None,
'title': 'OPEL OPEL GRANDLAND 1.5 130cv AT8 Business Elegance Sport utility '
'vehicle 5-door (Euro 6D) -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2023}
2026-03-25 16:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983631%27 HTTP/1.1" 200 None
2026-03-25 16:35:41 [ayvens.it] INFO: Saving data for 1983631: {'created_time': 1774456541.534438, 'last_price_update_time': 1774456541.534448, 'auction_closing_time': 1774603800.0}
2026-03-25 16:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1983631') HTTP/1.1" 204 0
2026-03-25 16:35:41 [ayvens.it] INFO: Found listing with ID: 1979720
2026-03-25 16:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979720%27 HTTP/1.1" 200 None
2026-03-25 16:35:41 [ayvens.it] INFO: Scrape type for 1979720: 2
2026-03-25 16:35:41 [ayvens.it] INFO: Extracting data for car ID: 1979720
2026-03-25 16:35:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2b15b2ca-d4ed-5280-8f88-251afa359535 with identifier: 1979720
2026-03-25 16:35:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2b15b2ca-d4ed-5280-8f88-251afa359535 with scrape type 2
2026-03-25 16:35:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2b15b2ca-d4ed-5280-8f88-251afa359535 with scrape type 2
2026-03-25 16:35:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 2b15b2ca-d4ed-5280-8f88-251afa359535, identifier: 1979720
2026-03-25 16:35:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:35:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34d6b4b410>
2026-03-25 16:35:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:35:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:35:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:35:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe7a7a81-f812-55d1-b287-e9ac51e6562b/fe7a7a81-f812-55d1-b287-e9ac51e6562b_image_3.jpg HTTP/1.1" 201 0
2026-03-25 16:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm2%252Fbaf415c092c24cd79c96f548a2af1c5e%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 16:35:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm2/baf415c092c24cd79c96f548a2af1c5e/images/large/4.jpg saved to cache
2026-03-25 16:35:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item fe7a7a81-f812-55d1-b287-e9ac51e6562b
2026-03-25 16:35:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fe7a7a81-f812-55d1-b287-e9ac51e6562b, skipping ID generation
2026-03-25 16:35:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fe7a7a81-f812-55d1-b287-e9ac51e6562b with scrape type 1
2026-03-25 16:35:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fe7a7a81-f812-55d1-b287-e9ac51e6562b sending to next pipeline
2026-03-25 16:35:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: fe7a7a81-f812-55d1-b287-e9ac51e6562b, identifier: 1983627
2026-03-25 16:35:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 2b15b2ca-d4ed-5280-8f88-251afa359535 with identifier: 1979720
2026-03-25 16:35:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 2b15b2ca-d4ed-5280-8f88-251afa359535 with identifier: 1979720
2026-03-25 16:35:41 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 2b15b2ca-d4ed-5280-8f88-251afa359535 with identifier: 1979720 to the API
2026-03-25 16:35:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:35:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:35:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'BIANCO FROZEN PASTELLO',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-26T09:30:00Z',
'fuel_type': 'diesel',
'id': '2b15b2ca-d4ed-5280-8f88-251afa359535',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40968',
'listing': 'auction',
'location': None,
'make': 'FORD',
'model': 'FORD KUGA N1 1.5 ECOBLUE 120CV 2WD TITANIUM BUS. AUTO FP',
'odometer': 163959,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-02-24',
'seats_number': 5,
'seller_name': None,
'title': 'FORD FORD KUGA N1 1.5 ECOBLUE 120CV 2WD TITANIUM BUS. AUTO FP -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-25 16:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979720%27 HTTP/1.1" 200 None
2026-03-25 16:35:42 [ayvens.it] INFO: Saving data for 1979720: {'auction_closing_time': 1774517400.0, 'created_time': 1774369991.544706, 'last_price_update_time': 1774456542.124118}
2026-03-25 16:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1979720') HTTP/1.1" 204 0
2026-03-25 16:35:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: fe7a7a81-f812-55d1-b287-e9ac51e6562b with identifier: 1983627
2026-03-25 16:35:42 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:35:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: fe7a7a81-f812-55d1-b287-e9ac51e6562b with identifier: 1983627
2026-03-25 16:35:42 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: fe7a7a81-f812-55d1-b287-e9ac51e6562b with identifier: 1983627 to the API
2026-03-25 16:35:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:35:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:35:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gm2/baf415c092c24cd79c96f548a2af1c5e/images/large/4.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'NERO TULIPANO PERLATO',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-27T09:30:00Z',
'fuel_type': 'diesel',
'id': 'fe7a7a81-f812-55d1-b287-e9ac51e6562b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41025',
'listing': 'auction',
'location': None,
'make': 'SKODA',
'model': 'SKODA OCTAVIA WAGON 2.0 TDI EVO 85KW EXECUTIVE DSG SW 5-door (Euro '
'6D)',
'odometer': 151183,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 12,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe7a7a81-f812-55d1-b287-e9ac51e6562b/fe7a7a81-f812-55d1-b287-e9ac51e6562b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 685770,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm2/baf415c092c24cd79c96f548a2af1c5e/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe7a7a81-f812-55d1-b287-e9ac51e6562b/fe7a7a81-f812-55d1-b287-e9ac51e6562b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 512547,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm2/baf415c092c24cd79c96f548a2af1c5e/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe7a7a81-f812-55d1-b287-e9ac51e6562b/fe7a7a81-f812-55d1-b287-e9ac51e6562b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 685770,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm2/baf415c092c24cd79c96f548a2af1c5e/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe7a7a81-f812-55d1-b287-e9ac51e6562b/fe7a7a81-f812-55d1-b287-e9ac51e6562b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 546466,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm2/baf415c092c24cd79c96f548a2af1c5e/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe7a7a81-f812-55d1-b287-e9ac51e6562b/fe7a7a81-f812-55d1-b287-e9ac51e6562b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 516145,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm2/baf415c092c24cd79c96f548a2af1c5e/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe7a7a81-f812-55d1-b287-e9ac51e6562b/fe7a7a81-f812-55d1-b287-e9ac51e6562b_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 585183,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm2/baf415c092c24cd79c96f548a2af1c5e/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe7a7a81-f812-55d1-b287-e9ac51e6562b/fe7a7a81-f812-55d1-b287-e9ac51e6562b_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 702885,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm2/baf415c092c24cd79c96f548a2af1c5e/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe7a7a81-f812-55d1-b287-e9ac51e6562b/fe7a7a81-f812-55d1-b287-e9ac51e6562b_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 549382,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm2/baf415c092c24cd79c96f548a2af1c5e/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe7a7a81-f812-55d1-b287-e9ac51e6562b/fe7a7a81-f812-55d1-b287-e9ac51e6562b_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 758822,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm2/baf415c092c24cd79c96f548a2af1c5e/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe7a7a81-f812-55d1-b287-e9ac51e6562b/fe7a7a81-f812-55d1-b287-e9ac51e6562b_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 500216,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm2/baf415c092c24cd79c96f548a2af1c5e/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-11-25',
'seats_number': 5,
'seller_name': None,
'title': 'SKODA SKODA OCTAVIA WAGON 2.0 TDI EVO 85KW EXECUTIVE DSG SW 5-door '
'(Euro 6D) -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-25 16:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983627%27 HTTP/1.1" 200 None
2026-03-25 16:35:42 [ayvens.it] INFO: Saving data for 1983627: {'created_time': 1774456542.489251, 'last_price_update_time': 1774456542.489261, 'auction_closing_time': 1774603800.0}
2026-03-25 16:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1983627') HTTP/1.1" 204 0
2026-03-25 16:35:42 [ayvens.it] INFO: Found listing with ID: 1979721
2026-03-25 16:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979721%27 HTTP/1.1" 200 None
2026-03-25 16:35:42 [ayvens.it] INFO: Scrape type for 1979721: 2
2026-03-25 16:35:42 [ayvens.it] INFO: Extracting data for car ID: 1979721
2026-03-25 16:35:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d8522511-2a4e-5ed9-856e-19e606a4304e with identifier: 1979721
2026-03-25 16:35:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d8522511-2a4e-5ed9-856e-19e606a4304e with scrape type 2
2026-03-25 16:35:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d8522511-2a4e-5ed9-856e-19e606a4304e with scrape type 2
2026-03-25 16:35:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: d8522511-2a4e-5ed9-856e-19e606a4304e, identifier: 1979721
2026-03-25 16:35:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs9/18426bbc778648bd901230c8baae5eff/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:35:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl4/25ae0912f8cd497189bd7ed0ba2ec4ef/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:35:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: d8522511-2a4e-5ed9-856e-19e606a4304e with identifier: 1979721
2026-03-25 16:35:42 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:35:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: d8522511-2a4e-5ed9-856e-19e606a4304e with identifier: 1979721
2026-03-25 16:35:42 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: d8522511-2a4e-5ed9-856e-19e606a4304e with identifier: 1979721 to the API
2026-03-25 16:35:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:35:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:35:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'GRIGIO QUANTUM PASTELLO',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-26T09:30:00Z',
'fuel_type': 'diesel',
'id': 'd8522511-2a4e-5ed9-856e-19e606a4304e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40968',
'listing': 'auction',
'location': None,
'make': 'AUDI',
'model': 'AUDI A4 SW 2.0 40 TDI QUAT. SLINE EDIT. S TRONIC FP',
'odometer': 95145,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-02-10',
'seats_number': 5,
'seller_name': None,
'title': 'AUDI AUDI A4 SW 2.0 40 TDI QUAT. SLINE EDIT. S TRONIC FP -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-25 16:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979721%27 HTTP/1.1" 200 None
2026-03-25 16:35:42 [ayvens.it] INFO: Saving data for 1979721: {'auction_closing_time': 1774517400.0, 'created_time': 1774369993.516319, 'last_price_update_time': 1774456542.845266}
2026-03-25 16:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1979721') HTTP/1.1" 204 0
2026-03-25 16:35:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:35:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc63e150>
2026-03-25 16:35:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:35:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:35:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:35:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f546f75c-0089-5ab2-8797-45d810f1df9d/f546f75c-0089-5ab2-8797-45d810f1df9d_image_5.jpg HTTP/1.1" 201 0
2026-03-25 16:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs9%252F18426bbc778648bd901230c8baae5eff%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 16:35:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs9/18426bbc778648bd901230c8baae5eff/images/large/6.jpg saved to cache
2026-03-25 16:35:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f546f75c-0089-5ab2-8797-45d810f1df9d
2026-03-25 16:35:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs9/18426bbc778648bd901230c8baae5eff/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:35:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg1/0012bd9b17724fa4ae7e969cb4721d11/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:35:43 [ayvens.it] INFO: Found listing with ID: 1979722
2026-03-25 16:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979722%27 HTTP/1.1" 200 None
2026-03-25 16:35:43 [ayvens.it] INFO: Scrape type for 1979722: 2
2026-03-25 16:35:43 [ayvens.it] INFO: Extracting data for car ID: 1979722
2026-03-25 16:35:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 226bd012-df2b-5aaa-b1eb-a9b410b9bed2 with identifier: 1979722
2026-03-25 16:35:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 226bd012-df2b-5aaa-b1eb-a9b410b9bed2 with scrape type 2
2026-03-25 16:35:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 226bd012-df2b-5aaa-b1eb-a9b410b9bed2 with scrape type 2
2026-03-25 16:35:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 226bd012-df2b-5aaa-b1eb-a9b410b9bed2, identifier: 1979722
2026-03-25 16:35:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 226bd012-df2b-5aaa-b1eb-a9b410b9bed2 with identifier: 1979722
2026-03-25 16:35:43 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:35:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 226bd012-df2b-5aaa-b1eb-a9b410b9bed2 with identifier: 1979722
2026-03-25 16:35:43 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 226bd012-df2b-5aaa-b1eb-a9b410b9bed2 with identifier: 1979722 to the API
2026-03-25 16:35:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:35:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:35:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Moonstone Grey Metallizzato',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-26T09:30:00Z',
'fuel_type': 'petrol',
'id': '226bd012-df2b-5aaa-b1eb-a9b410b9bed2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40968',
'listing': 'auction',
'location': None,
'make': 'OPEL',
'model': 'OPEL CROSSLAND X 1.2 130cv Innovation S&S AT6 Cross over 5-door '
'(Euro 6D)',
'odometer': 22814,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-07-27',
'seats_number': 5,
'seller_name': None,
'title': 'OPEL OPEL CROSSLAND X 1.2 130cv Innovation S&S AT6 Cross over '
'5-door (Euro 6D) -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2020}
2026-03-25 16:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979722%27 HTTP/1.1" 200 None
2026-03-25 16:35:43 [ayvens.it] INFO: Saving data for 1979722: {'auction_closing_time': 1774517400.0, 'created_time': 1774369995.599683, 'last_price_update_time': 1774456543.377271}
2026-03-25 16:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1979722') HTTP/1.1" 204 0
2026-03-25 16:35:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl4/25ae0912f8cd497189bd7ed0ba2ec4ef/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:35:43 [ayvens.it] INFO: Found listing with ID: 1979723
2026-03-25 16:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979723%27 HTTP/1.1" 200 None
2026-03-25 16:35:43 [ayvens.it] INFO: Scrape type for 1979723: 2
2026-03-25 16:35:43 [ayvens.it] INFO: Extracting data for car ID: 1979723
2026-03-25 16:35:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 26212171-3cae-5ce8-a6ce-5aba869266b4 with identifier: 1979723
2026-03-25 16:35:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 26212171-3cae-5ce8-a6ce-5aba869266b4 with scrape type 2
2026-03-25 16:35:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 26212171-3cae-5ce8-a6ce-5aba869266b4 with scrape type 2
2026-03-25 16:35:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 26212171-3cae-5ce8-a6ce-5aba869266b4, identifier: 1979723
2026-03-25 16:35:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 26212171-3cae-5ce8-a6ce-5aba869266b4 with identifier: 1979723
2026-03-25 16:35:43 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:35:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 26212171-3cae-5ce8-a6ce-5aba869266b4 with identifier: 1979723
2026-03-25 16:35:43 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 26212171-3cae-5ce8-a6ce-5aba869266b4 with identifier: 1979723 to the API
2026-03-25 16:35:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:35:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:35:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'MTZ',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-26T09:30:00Z',
'fuel_type': 'diesel',
'id': '26212171-3cae-5ce8-a6ce-5aba869266b4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40968',
'listing': 'auction',
'location': None,
'make': 'BMW',
'model': 'BMW SERIE 3 320d xDrive 48V Bus.Adv. Touring aut SW 5-door (Euro '
'6D)',
'odometer': 88494,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-10-23',
'seats_number': 5,
'seller_name': None,
'title': 'BMW BMW SERIE 3 320d xDrive 48V Bus.Adv. Touring aut SW 5-door '
'(Euro 6D) -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2020}
2026-03-25 16:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979723%27 HTTP/1.1" 200 None
2026-03-25 16:35:43 [ayvens.it] INFO: Saving data for 1979723: {'auction_closing_time': 1774517400.0, 'created_time': 1774369997.705292, 'last_price_update_time': 1774456543.832514}
2026-03-25 16:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1979723') HTTP/1.1" 204 0
2026-03-25 16:35:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl9/5eb47c0ca41242638cdb8b1659971e9f/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:35:43 [ayvens.it] INFO: Found listing with ID: 1979724
2026-03-25 16:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979724%27 HTTP/1.1" 200 None
2026-03-25 16:35:43 [ayvens.it] INFO: Scrape type for 1979724: 2
2026-03-25 16:35:43 [ayvens.it] INFO: Extracting data for car ID: 1979724
2026-03-25 16:35:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 24b82a17-1b1d-5394-b539-408aa0c94935 with identifier: 1979724
2026-03-25 16:35:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 24b82a17-1b1d-5394-b539-408aa0c94935 with scrape type 2
2026-03-25 16:35:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 24b82a17-1b1d-5394-b539-408aa0c94935 with scrape type 2
2026-03-25 16:35:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 24b82a17-1b1d-5394-b539-408aa0c94935, identifier: 1979724
2026-03-25 16:35:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:35:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcc0bd50>
2026-03-25 16:35:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:35:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:35:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:35:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f546f75c-0089-5ab2-8797-45d810f1df9d/f546f75c-0089-5ab2-8797-45d810f1df9d_image_3.jpg HTTP/1.1" 201 0
2026-03-25 16:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs9%252F18426bbc778648bd901230c8baae5eff%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 16:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs9/18426bbc778648bd901230c8baae5eff/images/large/4.jpg saved to cache
2026-03-25 16:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f546f75c-0089-5ab2-8797-45d810f1df9d
2026-03-25 16:35:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:35:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34d7dace50>
2026-03-25 16:35:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:35:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:35:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:35:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e2d6e5b-fb6b-559f-81a9-c47f5fb5a609/8e2d6e5b-fb6b-559f-81a9-c47f5fb5a609_image_4.jpg HTTP/1.1" 201 0
2026-03-25 16:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl4%252F25ae0912f8cd497189bd7ed0ba2ec4ef%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 16:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl4/25ae0912f8cd497189bd7ed0ba2ec4ef/images/large/5.jpg saved to cache
2026-03-25 16:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8e2d6e5b-fb6b-559f-81a9-c47f5fb5a609
2026-03-25 16:35:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:35:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc906250>
2026-03-25 16:35:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:35:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:35:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:35:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f546f75c-0089-5ab2-8797-45d810f1df9d/f546f75c-0089-5ab2-8797-45d810f1df9d_image_4.jpg HTTP/1.1" 201 0
2026-03-25 16:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs9%252F18426bbc778648bd901230c8baae5eff%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 16:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs9/18426bbc778648bd901230c8baae5eff/images/large/5.jpg saved to cache
2026-03-25 16:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f546f75c-0089-5ab2-8797-45d810f1df9d
2026-03-25 16:35:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f546f75c-0089-5ab2-8797-45d810f1df9d, skipping ID generation
2026-03-25 16:35:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f546f75c-0089-5ab2-8797-45d810f1df9d with scrape type 1
2026-03-25 16:35:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f546f75c-0089-5ab2-8797-45d810f1df9d sending to next pipeline
2026-03-25 16:35:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: f546f75c-0089-5ab2-8797-45d810f1df9d, identifier: 1983626
2026-03-25 16:35:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:35:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc96b050>
2026-03-25 16:35:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:35:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:35:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:35:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc6f7d34-d2f5-5554-be9d-90ec57e1a887/fc6f7d34-d2f5-5554-be9d-90ec57e1a887_image_5.jpg HTTP/1.1" 201 0
2026-03-25 16:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg1%252F0012bd9b17724fa4ae7e969cb4721d11%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 16:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg1/0012bd9b17724fa4ae7e969cb4721d11/images/large/6.jpg saved to cache
2026-03-25 16:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item fc6f7d34-d2f5-5554-be9d-90ec57e1a887
2026-03-25 16:35:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg1/0012bd9b17724fa4ae7e969cb4721d11/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:35:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl9/5eb47c0ca41242638cdb8b1659971e9f/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:35:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 24b82a17-1b1d-5394-b539-408aa0c94935 with identifier: 1979724
2026-03-25 16:35:44 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:35:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 24b82a17-1b1d-5394-b539-408aa0c94935 with identifier: 1979724
2026-03-25 16:35:44 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 24b82a17-1b1d-5394-b539-408aa0c94935 with identifier: 1979724 to the API
2026-03-25 16:35:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:35:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:35:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Moondust Silver metallizzato',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-26T09:30:00Z',
'fuel_type': 'diesel',
'id': '24b82a17-1b1d-5394-b539-408aa0c94935',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40968',
'listing': 'auction',
'location': None,
'make': 'FORD',
'model': 'FORD FOCUS 1.5 Ecoblue 95cv Business Hatchback 5-door (Euro 6.2)',
'odometer': 166252,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-02-24',
'seats_number': 5,
'seller_name': None,
'title': 'FORD FORD FOCUS 1.5 Ecoblue 95cv Business Hatchback 5-door (Euro '
'6.2) -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2021}
2026-03-25 16:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979724%27 HTTP/1.1" 200 None
2026-03-25 16:35:45 [ayvens.it] INFO: Saving data for 1979724: {'auction_closing_time': 1774517400.0, 'created_time': 1774369999.324358, 'last_price_update_time': 1774456545.504931}
2026-03-25 16:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1979724') HTTP/1.1" 204 0
2026-03-25 16:35:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: f546f75c-0089-5ab2-8797-45d810f1df9d with identifier: 1983626
2026-03-25 16:35:45 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:35:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: f546f75c-0089-5ab2-8797-45d810f1df9d with identifier: 1983626
2026-03-25 16:35:45 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: f546f75c-0089-5ab2-8797-45d810f1df9d with identifier: 1983626 to the API
2026-03-25 16:35:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:35:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:35:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gs9/18426bbc778648bd901230c8baae5eff/images/large/5.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'ABSOLUTE BLACK PASTELLO',
'currency': 'EUR',
'doors_number': 5,
'engine': '',
'expiration_date': '2026-03-27T09:30:00Z',
'fuel_type': 'electric',
'id': 'f546f75c-0089-5ab2-8797-45d810f1df9d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41025',
'listing': 'auction',
'location': None,
'make': 'FORD',
'model': 'FORD MUSTANG MACH-E 269CV Standard Range',
'odometer': 34898,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f546f75c-0089-5ab2-8797-45d810f1df9d/f546f75c-0089-5ab2-8797-45d810f1df9d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 729207,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs9/18426bbc778648bd901230c8baae5eff/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f546f75c-0089-5ab2-8797-45d810f1df9d/f546f75c-0089-5ab2-8797-45d810f1df9d_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 337500,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs9/18426bbc778648bd901230c8baae5eff/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f546f75c-0089-5ab2-8797-45d810f1df9d/f546f75c-0089-5ab2-8797-45d810f1df9d_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 433064,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs9/18426bbc778648bd901230c8baae5eff/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f546f75c-0089-5ab2-8797-45d810f1df9d/f546f75c-0089-5ab2-8797-45d810f1df9d_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 729207,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs9/18426bbc778648bd901230c8baae5eff/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f546f75c-0089-5ab2-8797-45d810f1df9d/f546f75c-0089-5ab2-8797-45d810f1df9d_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 793894,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs9/18426bbc778648bd901230c8baae5eff/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f546f75c-0089-5ab2-8797-45d810f1df9d/f546f75c-0089-5ab2-8797-45d810f1df9d_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 532940,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs9/18426bbc778648bd901230c8baae5eff/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f546f75c-0089-5ab2-8797-45d810f1df9d/f546f75c-0089-5ab2-8797-45d810f1df9d_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 431787,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs9/18426bbc778648bd901230c8baae5eff/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f546f75c-0089-5ab2-8797-45d810f1df9d/f546f75c-0089-5ab2-8797-45d810f1df9d_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 537132,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs9/18426bbc778648bd901230c8baae5eff/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f546f75c-0089-5ab2-8797-45d810f1df9d/f546f75c-0089-5ab2-8797-45d810f1df9d_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 607165,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs9/18426bbc778648bd901230c8baae5eff/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f546f75c-0089-5ab2-8797-45d810f1df9d/f546f75c-0089-5ab2-8797-45d810f1df9d_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 648570,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs9/18426bbc778648bd901230c8baae5eff/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-11-20',
'seats_number': 5,
'seller_name': None,
'title': 'FORD FORD MUSTANG MACH-E 269CV Standard Range -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2023}
2026-03-25 16:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983626%27 HTTP/1.1" 200 None
2026-03-25 16:35:45 [ayvens.it] INFO: Saving data for 1983626: {'created_time': 1774456545.860522, 'last_price_update_time': 1774456545.860533, 'auction_closing_time': 1774603800.0}
2026-03-25 16:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1983626') HTTP/1.1" 204 0
2026-03-25 16:35:45 [ayvens.it] INFO: Found listing with ID: 1979725
2026-03-25 16:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979725%27 HTTP/1.1" 200 None
2026-03-25 16:35:45 [ayvens.it] INFO: Scrape type for 1979725: 2
2026-03-25 16:35:45 [ayvens.it] INFO: Extracting data for car ID: 1979725
2026-03-25 16:35:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2cfe371e-91e8-5fb0-ae90-f650bd3514f2 with identifier: 1979725
2026-03-25 16:35:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2cfe371e-91e8-5fb0-ae90-f650bd3514f2 with scrape type 2
2026-03-25 16:35:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2cfe371e-91e8-5fb0-ae90-f650bd3514f2 with scrape type 2
2026-03-25 16:35:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 2cfe371e-91e8-5fb0-ae90-f650bd3514f2, identifier: 1979725
2026-03-25 16:35:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:35:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcbb72d0>
2026-03-25 16:35:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:35:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:35:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:35:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e2d6e5b-fb6b-559f-81a9-c47f5fb5a609/8e2d6e5b-fb6b-559f-81a9-c47f5fb5a609_image_3.jpg HTTP/1.1" 201 0
2026-03-25 16:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl4%252F25ae0912f8cd497189bd7ed0ba2ec4ef%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 16:35:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl4/25ae0912f8cd497189bd7ed0ba2ec4ef/images/large/4.jpg saved to cache
2026-03-25 16:35:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8e2d6e5b-fb6b-559f-81a9-c47f5fb5a609
2026-03-25 16:35:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8e2d6e5b-fb6b-559f-81a9-c47f5fb5a609, skipping ID generation
2026-03-25 16:35:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8e2d6e5b-fb6b-559f-81a9-c47f5fb5a609 with scrape type 1
2026-03-25 16:35:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8e2d6e5b-fb6b-559f-81a9-c47f5fb5a609 sending to next pipeline
2026-03-25 16:35:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 8e2d6e5b-fb6b-559f-81a9-c47f5fb5a609, identifier: 1983625
2026-03-25 16:35:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 2cfe371e-91e8-5fb0-ae90-f650bd3514f2 with identifier: 1979725
2026-03-25 16:35:46 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:35:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 2cfe371e-91e8-5fb0-ae90-f650bd3514f2 with identifier: 1979725
2026-03-25 16:35:46 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 2cfe371e-91e8-5fb0-ae90-f650bd3514f2 with identifier: 1979725 to the API
2026-03-25 16:35:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:35:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:35:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'ISLAND BLUE METALLIZZATO',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-26T09:30:00Z',
'fuel_type': 'hybrid',
'id': '2cfe371e-91e8-5fb0-ae90-f650bd3514f2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40968',
'listing': 'auction',
'location': None,
'make': 'MINI',
'model': 'MINI COUNTRYMAN (PC) COOPER S E ALL4 AUTOMATICA FP',
'odometer': 97613,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-02-11',
'seats_number': 5,
'seller_name': None,
'title': 'MINI MINI COUNTRYMAN (PC) COOPER S E ALL4 AUTOMATICA FP -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2021}
2026-03-25 16:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979725%27 HTTP/1.1" 200 None
2026-03-25 16:35:46 [ayvens.it] INFO: Saving data for 1979725: {'auction_closing_time': 1774517400.0, 'created_time': 1774370001.13992, 'last_price_update_time': 1774456546.478811}
2026-03-25 16:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1979725') HTTP/1.1" 204 0
2026-03-25 16:35:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 8e2d6e5b-fb6b-559f-81a9-c47f5fb5a609 with identifier: 1983625
2026-03-25 16:35:46 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:35:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 8e2d6e5b-fb6b-559f-81a9-c47f5fb5a609 with identifier: 1983625
2026-03-25 16:35:46 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 8e2d6e5b-fb6b-559f-81a9-c47f5fb5a609 with identifier: 1983625 to the API
2026-03-25 16:35:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:35:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:35:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gl4/25ae0912f8cd497189bd7ed0ba2ec4ef/images/large/4.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'BLACK SAPPHIRE METALLIZZATO',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-27T09:30:00Z',
'fuel_type': 'diesel',
'id': '8e2d6e5b-fb6b-559f-81a9-c47f5fb5a609',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41025',
'listing': 'auction',
'location': None,
'make': 'BMW',
'model': 'BMW SERIE 3 318d 48V Touring auto SW 5-door (Euro 6D)',
'odometer': 130098,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 38,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e2d6e5b-fb6b-559f-81a9-c47f5fb5a609/8e2d6e5b-fb6b-559f-81a9-c47f5fb5a609_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 702833,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl4/25ae0912f8cd497189bd7ed0ba2ec4ef/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e2d6e5b-fb6b-559f-81a9-c47f5fb5a609/8e2d6e5b-fb6b-559f-81a9-c47f5fb5a609_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 493393,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl4/25ae0912f8cd497189bd7ed0ba2ec4ef/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e2d6e5b-fb6b-559f-81a9-c47f5fb5a609/8e2d6e5b-fb6b-559f-81a9-c47f5fb5a609_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 445266,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl4/25ae0912f8cd497189bd7ed0ba2ec4ef/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e2d6e5b-fb6b-559f-81a9-c47f5fb5a609/8e2d6e5b-fb6b-559f-81a9-c47f5fb5a609_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 659240,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl4/25ae0912f8cd497189bd7ed0ba2ec4ef/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e2d6e5b-fb6b-559f-81a9-c47f5fb5a609/8e2d6e5b-fb6b-559f-81a9-c47f5fb5a609_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 499569,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl4/25ae0912f8cd497189bd7ed0ba2ec4ef/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e2d6e5b-fb6b-559f-81a9-c47f5fb5a609/8e2d6e5b-fb6b-559f-81a9-c47f5fb5a609_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 487738,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl4/25ae0912f8cd497189bd7ed0ba2ec4ef/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e2d6e5b-fb6b-559f-81a9-c47f5fb5a609/8e2d6e5b-fb6b-559f-81a9-c47f5fb5a609_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 526598,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl4/25ae0912f8cd497189bd7ed0ba2ec4ef/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e2d6e5b-fb6b-559f-81a9-c47f5fb5a609/8e2d6e5b-fb6b-559f-81a9-c47f5fb5a609_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 492903,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl4/25ae0912f8cd497189bd7ed0ba2ec4ef/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e2d6e5b-fb6b-559f-81a9-c47f5fb5a609/8e2d6e5b-fb6b-559f-81a9-c47f5fb5a609_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 476488,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl4/25ae0912f8cd497189bd7ed0ba2ec4ef/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e2d6e5b-fb6b-559f-81a9-c47f5fb5a609/8e2d6e5b-fb6b-559f-81a9-c47f5fb5a609_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 632294,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl4/25ae0912f8cd497189bd7ed0ba2ec4ef/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-10-18',
'seats_number': 5,
'seller_name': None,
'title': 'BMW BMW SERIE 3 318d 48V Touring auto SW 5-door (Euro 6D) -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-25 16:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983625%27 HTTP/1.1" 200 None
2026-03-25 16:35:46 [ayvens.it] INFO: Saving data for 1983625: {'created_time': 1774456546.865923, 'last_price_update_time': 1774456546.865934, 'auction_closing_time': 1774603800.0}
2026-03-25 16:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1983625') HTTP/1.1" 204 0
2026-03-25 16:35:46 [ayvens.it] INFO: Found listing with ID: 1979726
2026-03-25 16:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979726%27 HTTP/1.1" 200 None
2026-03-25 16:35:46 [ayvens.it] INFO: Scrape type for 1979726: 2
2026-03-25 16:35:46 [ayvens.it] INFO: Extracting data for car ID: 1979726
2026-03-25 16:35:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1625db10-1d3a-5ae1-afed-31f29f0cc355 with identifier: 1979726
2026-03-25 16:35:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1625db10-1d3a-5ae1-afed-31f29f0cc355 with scrape type 2
2026-03-25 16:35:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1625db10-1d3a-5ae1-afed-31f29f0cc355 with scrape type 2
2026-03-25 16:35:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 1625db10-1d3a-5ae1-afed-31f29f0cc355, identifier: 1979726
2026-03-25 16:35:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 1625db10-1d3a-5ae1-afed-31f29f0cc355 with identifier: 1979726
2026-03-25 16:35:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 1625db10-1d3a-5ae1-afed-31f29f0cc355 with identifier: 1979726
2026-03-25 16:35:47 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 1625db10-1d3a-5ae1-afed-31f29f0cc355 with identifier: 1979726 to the API
2026-03-25 16:35:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:35:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:35:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'R COMMENT',
'currency': 'EUR',
'doors_number': 2,
'engine': '0.5L',
'expiration_date': '2026-03-26T09:30:00Z',
'fuel_type': 'petrol',
'id': '1625db10-1d3a-5ae1-afed-31f29f0cc355',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40968',
'listing': 'auction',
'location': None,
'make': 'YAMAHA',
'model': 'YAMAHA TMAX ABS Motociclo (Euro 4)',
'odometer': 17686,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-05-13',
'seats_number': 5,
'seller_name': None,
'title': 'YAMAHA YAMAHA TMAX ABS Motociclo (Euro 4) -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2019}
2026-03-25 16:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979726%27 HTTP/1.1" 200 None
2026-03-25 16:35:47 [ayvens.it] INFO: Saving data for 1979726: {'auction_closing_time': 1774517400.0, 'created_time': 1774370002.747294, 'last_price_update_time': 1774456547.243807}
2026-03-25 16:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1979726') HTTP/1.1" 204 0
2026-03-25 16:35:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:35:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dca94810>
2026-03-25 16:35:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:35:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:35:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:35:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95217f32-f9d7-5868-b63d-86254a35ea78/95217f32-f9d7-5868-b63d-86254a35ea78_image_9.jpg HTTP/1.1" 201 0
2026-03-25 16:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl9%252F5eb47c0ca41242638cdb8b1659971e9f%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 16:35:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl9/5eb47c0ca41242638cdb8b1659971e9f/images/large/10.jpg saved to cache
2026-03-25 16:35:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 95217f32-f9d7-5868-b63d-86254a35ea78
2026-03-25 16:35:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:35:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcaab110>
2026-03-25 16:35:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:35:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:35:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:35:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc6f7d34-d2f5-5554-be9d-90ec57e1a887/fc6f7d34-d2f5-5554-be9d-90ec57e1a887_image_4.jpg HTTP/1.1" 201 0
2026-03-25 16:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg1%252F0012bd9b17724fa4ae7e969cb4721d11%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 16:35:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg1/0012bd9b17724fa4ae7e969cb4721d11/images/large/5.jpg saved to cache
2026-03-25 16:35:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item fc6f7d34-d2f5-5554-be9d-90ec57e1a887
2026-03-25 16:35:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fc6f7d34-d2f5-5554-be9d-90ec57e1a887, skipping ID generation
2026-03-25 16:35:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fc6f7d34-d2f5-5554-be9d-90ec57e1a887 with scrape type 1
2026-03-25 16:35:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fc6f7d34-d2f5-5554-be9d-90ec57e1a887 sending to next pipeline
2026-03-25 16:35:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: fc6f7d34-d2f5-5554-be9d-90ec57e1a887, identifier: 1983622
2026-03-25 16:35:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:35:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcf2fed0>
2026-03-25 16:35:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:35:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:35:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:35:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95217f32-f9d7-5868-b63d-86254a35ea78/95217f32-f9d7-5868-b63d-86254a35ea78_image_8.jpg HTTP/1.1" 201 0
2026-03-25 16:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl9%252F5eb47c0ca41242638cdb8b1659971e9f%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 16:35:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl9/5eb47c0ca41242638cdb8b1659971e9f/images/large/9.jpg saved to cache
2026-03-25 16:35:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 95217f32-f9d7-5868-b63d-86254a35ea78
2026-03-25 16:35:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl9/5eb47c0ca41242638cdb8b1659971e9f/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:35:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl9/5eb47c0ca41242638cdb8b1659971e9f/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:35:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fr6/3fdc4b196fd840789c94643c58daa4f3/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:35:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fr6/3fdc4b196fd840789c94643c58daa4f3/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:35:47 [ayvens.it] INFO: Found listing with ID: 1979727
2026-03-25 16:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979727%27 HTTP/1.1" 200 None
2026-03-25 16:35:47 [ayvens.it] INFO: Scrape type for 1979727: 2
2026-03-25 16:35:47 [ayvens.it] INFO: Extracting data for car ID: 1979727
2026-03-25 16:35:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dd24dde0-9182-50ea-a766-422e0fecaf6d with identifier: 1979727
2026-03-25 16:35:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dd24dde0-9182-50ea-a766-422e0fecaf6d with scrape type 2
2026-03-25 16:35:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dd24dde0-9182-50ea-a766-422e0fecaf6d with scrape type 2
2026-03-25 16:35:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: dd24dde0-9182-50ea-a766-422e0fecaf6d, identifier: 1979727
2026-03-25 16:35:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: fc6f7d34-d2f5-5554-be9d-90ec57e1a887 with identifier: 1983622
2026-03-25 16:35:47 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:35:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: fc6f7d34-d2f5-5554-be9d-90ec57e1a887 with identifier: 1983622
2026-03-25 16:35:47 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: fc6f7d34-d2f5-5554-be9d-90ec57e1a887 with identifier: 1983622 to the API
2026-03-25 16:35:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:35:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:35:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gg1/0012bd9b17724fa4ae7e969cb4721d11/images/large/5.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'PYRIT SILVER METALLIC',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-27T09:30:00Z',
'fuel_type': 'diesel',
'id': 'fc6f7d34-d2f5-5554-be9d-90ec57e1a887',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41025',
'listing': 'auction',
'location': None,
'make': 'VOLKSWAGEN',
'model': 'VOLKSWAGEN PASSAT SW VAR. 2.0 TDI SCR EVO 110KW EXECUTIVE FP',
'odometer': 104546,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 22,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc6f7d34-d2f5-5554-be9d-90ec57e1a887/fc6f7d34-d2f5-5554-be9d-90ec57e1a887_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 858164,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg1/0012bd9b17724fa4ae7e969cb4721d11/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc6f7d34-d2f5-5554-be9d-90ec57e1a887/fc6f7d34-d2f5-5554-be9d-90ec57e1a887_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 858164,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg1/0012bd9b17724fa4ae7e969cb4721d11/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc6f7d34-d2f5-5554-be9d-90ec57e1a887/fc6f7d34-d2f5-5554-be9d-90ec57e1a887_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 683177,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg1/0012bd9b17724fa4ae7e969cb4721d11/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc6f7d34-d2f5-5554-be9d-90ec57e1a887/fc6f7d34-d2f5-5554-be9d-90ec57e1a887_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 226092,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg1/0012bd9b17724fa4ae7e969cb4721d11/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc6f7d34-d2f5-5554-be9d-90ec57e1a887/fc6f7d34-d2f5-5554-be9d-90ec57e1a887_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 657197,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg1/0012bd9b17724fa4ae7e969cb4721d11/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc6f7d34-d2f5-5554-be9d-90ec57e1a887/fc6f7d34-d2f5-5554-be9d-90ec57e1a887_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 582215,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg1/0012bd9b17724fa4ae7e969cb4721d11/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc6f7d34-d2f5-5554-be9d-90ec57e1a887/fc6f7d34-d2f5-5554-be9d-90ec57e1a887_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 485889,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg1/0012bd9b17724fa4ae7e969cb4721d11/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc6f7d34-d2f5-5554-be9d-90ec57e1a887/fc6f7d34-d2f5-5554-be9d-90ec57e1a887_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 421011,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg1/0012bd9b17724fa4ae7e969cb4721d11/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc6f7d34-d2f5-5554-be9d-90ec57e1a887/fc6f7d34-d2f5-5554-be9d-90ec57e1a887_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 658951,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg1/0012bd9b17724fa4ae7e969cb4721d11/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc6f7d34-d2f5-5554-be9d-90ec57e1a887/fc6f7d34-d2f5-5554-be9d-90ec57e1a887_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 222239,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg1/0012bd9b17724fa4ae7e969cb4721d11/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-06-28',
'seats_number': 5,
'seller_name': None,
'title': 'VOLKSWAGEN VOLKSWAGEN PASSAT SW VAR. 2.0 TDI SCR EVO 110KW '
'EXECUTIVE FP -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2021}
2026-03-25 16:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983622%27 HTTP/1.1" 200 None
2026-03-25 16:35:47 [ayvens.it] INFO: Saving data for 1983622: {'created_time': 1774456547.960569, 'last_price_update_time': 1774456547.960579, 'auction_closing_time': 1774603800.0}
2026-03-25 16:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1983622') HTTP/1.1" 204 0
2026-03-25 16:35:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: dd24dde0-9182-50ea-a766-422e0fecaf6d with identifier: 1979727
2026-03-25 16:35:48 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:35:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: dd24dde0-9182-50ea-a766-422e0fecaf6d with identifier: 1979727
2026-03-25 16:35:48 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: dd24dde0-9182-50ea-a766-422e0fecaf6d with identifier: 1979727 to the API
2026-03-25 16:35:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:35:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:35:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'CHROME BLUE METALLIZZATO',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-26T09:30:00Z',
'fuel_type': 'diesel',
'id': 'dd24dde0-9182-50ea-a766-422e0fecaf6d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40968',
'listing': 'auction',
'location': None,
'make': 'FORD',
'model': 'FORD FOCUS SW (PC) 1.5 ECOBLUE 120CV BUSINESS SW FP',
'odometer': 150049,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-02-16',
'seats_number': 5,
'seller_name': None,
'title': 'FORD FORD FOCUS SW (PC) 1.5 ECOBLUE 120CV BUSINESS SW FP -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-25 16:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979727%27 HTTP/1.1" 200 None
2026-03-25 16:35:48 [ayvens.it] INFO: Saving data for 1979727: {'auction_closing_time': 1774517400.0, 'created_time': 1774370005.169845, 'last_price_update_time': 1774456548.299255}
2026-03-25 16:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1979727') HTTP/1.1" 204 0
2026-03-25 16:35:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh0/ebe36cf566d4486cba2be86f61b41eeb/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:35:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh0/ebe36cf566d4486cba2be86f61b41eeb/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:35:48 [ayvens.it] INFO: Found listing with ID: 1979728
2026-03-25 16:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979728%27 HTTP/1.1" 200 None
2026-03-25 16:35:48 [ayvens.it] INFO: Scrape type for 1979728: 2
2026-03-25 16:35:48 [ayvens.it] INFO: Extracting data for car ID: 1979728
2026-03-25 16:35:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b602872c-40a4-5e84-a6e2-c7f21fe889f5 with identifier: 1979728
2026-03-25 16:35:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b602872c-40a4-5e84-a6e2-c7f21fe889f5 with scrape type 2
2026-03-25 16:35:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b602872c-40a4-5e84-a6e2-c7f21fe889f5 with scrape type 2
2026-03-25 16:35:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: b602872c-40a4-5e84-a6e2-c7f21fe889f5, identifier: 1979728
2026-03-25 16:35:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: b602872c-40a4-5e84-a6e2-c7f21fe889f5 with identifier: 1979728
2026-03-25 16:35:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: b602872c-40a4-5e84-a6e2-c7f21fe889f5 with identifier: 1979728
2026-03-25 16:35:48 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: b602872c-40a4-5e84-a6e2-c7f21fe889f5 with identifier: 1979728 to the API
2026-03-25 16:35:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:35:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:35:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'BIANCO GELATO PASTELLO',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-26T09:30:00Z',
'fuel_type': 'petrol_lpg',
'id': 'b602872c-40a4-5e84-a6e2-c7f21fe889f5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40968',
'listing': 'auction',
'location': None,
'make': 'FIAT',
'model': 'FIAT PANDA CONSIPAQ1 1.2 FIRE 69CV S&S EASYPOWER CITY LIFE FP',
'odometer': 185454,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-04-19',
'seats_number': 5,
'seller_name': None,
'title': 'FIAT FIAT PANDA CONSIPAQ1 1.2 FIRE 69CV S&S EASYPOWER CITY LIFE FP '
'-',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2021}
2026-03-25 16:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979728%27 HTTP/1.1" 200 None
2026-03-25 16:35:48 [ayvens.it] INFO: Saving data for 1979728: {'auction_closing_time': 1774517400.0, 'created_time': 1774370006.405633, 'last_price_update_time': 1774456548.673585}
2026-03-25 16:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1979728') HTTP/1.1" 204 0
2026-03-25 16:35:48 [ayvens.it] INFO: Found listing with ID: 1979729
2026-03-25 16:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979729%27 HTTP/1.1" 200 None
2026-03-25 16:35:48 [ayvens.it] INFO: Scrape type for 1979729: 2
2026-03-25 16:35:48 [ayvens.it] INFO: Extracting data for car ID: 1979729
2026-03-25 16:35:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 05555777-9e47-5eae-83b5-ae379f1bf3bd with identifier: 1979729
2026-03-25 16:35:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 05555777-9e47-5eae-83b5-ae379f1bf3bd with scrape type 2
2026-03-25 16:35:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 05555777-9e47-5eae-83b5-ae379f1bf3bd with scrape type 2
2026-03-25 16:35:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 05555777-9e47-5eae-83b5-ae379f1bf3bd, identifier: 1979729
2026-03-25 16:35:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:35:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcc09110>
2026-03-25 16:35:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:35:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:35:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:35:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95217f32-f9d7-5868-b63d-86254a35ea78/95217f32-f9d7-5868-b63d-86254a35ea78_image_6.jpg HTTP/1.1" 201 0
2026-03-25 16:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl9%252F5eb47c0ca41242638cdb8b1659971e9f%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 16:35:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl9/5eb47c0ca41242638cdb8b1659971e9f/images/large/7.jpg saved to cache
2026-03-25 16:35:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 95217f32-f9d7-5868-b63d-86254a35ea78
2026-03-25 16:35:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:35:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc9dea50>
2026-03-25 16:35:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:35:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:35:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:35:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95217f32-f9d7-5868-b63d-86254a35ea78/95217f32-f9d7-5868-b63d-86254a35ea78_image_7.jpg HTTP/1.1" 201 0
2026-03-25 16:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl9%252F5eb47c0ca41242638cdb8b1659971e9f%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 16:35:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl9/5eb47c0ca41242638cdb8b1659971e9f/images/large/8.jpg saved to cache
2026-03-25 16:35:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 95217f32-f9d7-5868-b63d-86254a35ea78
2026-03-25 16:35:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 95217f32-f9d7-5868-b63d-86254a35ea78, skipping ID generation
2026-03-25 16:35:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 95217f32-f9d7-5868-b63d-86254a35ea78 with scrape type 1
2026-03-25 16:35:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 95217f32-f9d7-5868-b63d-86254a35ea78 sending to next pipeline
2026-03-25 16:35:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 95217f32-f9d7-5868-b63d-86254a35ea78, identifier: 1983621
2026-03-25 16:35:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:35:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcaab550>
2026-03-25 16:35:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:35:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:35:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:35:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bce268a8-273a-5a1e-8706-946ac8db3862/bce268a8-273a-5a1e-8706-946ac8db3862_image_7.jpg HTTP/1.1" 201 0
2026-03-25 16:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr6%252F3fdc4b196fd840789c94643c58daa4f3%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 16:35:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr6/3fdc4b196fd840789c94643c58daa4f3/images/large/8.jpg saved to cache
2026-03-25 16:35:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item bce268a8-273a-5a1e-8706-946ac8db3862
2026-03-25 16:35:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:35:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dca04350>
2026-03-25 16:35:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:35:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:35:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:35:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bce268a8-273a-5a1e-8706-946ac8db3862/bce268a8-273a-5a1e-8706-946ac8db3862_image_6.jpg HTTP/1.1" 201 0
2026-03-25 16:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr6%252F3fdc4b196fd840789c94643c58daa4f3%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 16:35:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr6/3fdc4b196fd840789c94643c58daa4f3/images/large/7.jpg saved to cache
2026-03-25 16:35:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item bce268a8-273a-5a1e-8706-946ac8db3862
2026-03-25 16:35:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bce268a8-273a-5a1e-8706-946ac8db3862, skipping ID generation
2026-03-25 16:35:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bce268a8-273a-5a1e-8706-946ac8db3862 with scrape type 1
2026-03-25 16:35:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bce268a8-273a-5a1e-8706-946ac8db3862 sending to next pipeline
2026-03-25 16:35:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: bce268a8-273a-5a1e-8706-946ac8db3862, identifier: 1983620
2026-03-25 16:35:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 05555777-9e47-5eae-83b5-ae379f1bf3bd with identifier: 1979729
2026-03-25 16:35:49 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:35:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 05555777-9e47-5eae-83b5-ae379f1bf3bd with identifier: 1979729
2026-03-25 16:35:49 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 05555777-9e47-5eae-83b5-ae379f1bf3bd with identifier: 1979729 to the API
2026-03-25 16:35:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:35:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:35:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Bianco Ghiaccio metallizzato',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-26T09:30:00Z',
'fuel_type': 'hybrid',
'id': '05555777-9e47-5eae-83b5-ae379f1bf3bd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40968',
'listing': 'auction',
'location': None,
'make': 'AUDI',
'model': 'AUDI Q3 45 TFSI e S tronic Business Sport utility vehicle 5-door '
'(Euro 6D)',
'odometer': 80348,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-07-28',
'seats_number': 5,
'seller_name': None,
'title': 'AUDI AUDI Q3 45 TFSI e S tronic Business Sport utility vehicle '
'5-door (Euro 6D) -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-25 16:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979729%27 HTTP/1.1" 200 None
2026-03-25 16:35:49 [ayvens.it] INFO: Saving data for 1979729: {'auction_closing_time': 1774517400.0, 'created_time': 1774370007.575822, 'last_price_update_time': 1774456549.491909}
2026-03-25 16:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1979729') HTTP/1.1" 204 0
2026-03-25 16:35:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 95217f32-f9d7-5868-b63d-86254a35ea78 with identifier: 1983621
2026-03-25 16:35:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 95217f32-f9d7-5868-b63d-86254a35ea78 with identifier: 1983621
2026-03-25 16:35:49 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 95217f32-f9d7-5868-b63d-86254a35ea78 with identifier: 1983621 to the API
2026-03-25 16:35:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:35:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:35:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gl9/5eb47c0ca41242638cdb8b1659971e9f/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'BIANCO LUNA METALLIZZATO',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-27T09:30:00Z',
'fuel_type': 'diesel',
'id': '95217f32-f9d7-5868-b63d-86254a35ea78',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41025',
'listing': 'auction',
'location': None,
'make': 'SKODA',
'model': 'SKODA KODIAQ 2.0 TDI 110KW AMBITION DSG 7P FP',
'odometer': 127848,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 12,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95217f32-f9d7-5868-b63d-86254a35ea78/95217f32-f9d7-5868-b63d-86254a35ea78_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 608122,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl9/5eb47c0ca41242638cdb8b1659971e9f/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95217f32-f9d7-5868-b63d-86254a35ea78/95217f32-f9d7-5868-b63d-86254a35ea78_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 568710,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl9/5eb47c0ca41242638cdb8b1659971e9f/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95217f32-f9d7-5868-b63d-86254a35ea78/95217f32-f9d7-5868-b63d-86254a35ea78_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 608122,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl9/5eb47c0ca41242638cdb8b1659971e9f/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95217f32-f9d7-5868-b63d-86254a35ea78/95217f32-f9d7-5868-b63d-86254a35ea78_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 613022,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl9/5eb47c0ca41242638cdb8b1659971e9f/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95217f32-f9d7-5868-b63d-86254a35ea78/95217f32-f9d7-5868-b63d-86254a35ea78_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 647617,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl9/5eb47c0ca41242638cdb8b1659971e9f/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95217f32-f9d7-5868-b63d-86254a35ea78/95217f32-f9d7-5868-b63d-86254a35ea78_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 559645,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl9/5eb47c0ca41242638cdb8b1659971e9f/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95217f32-f9d7-5868-b63d-86254a35ea78/95217f32-f9d7-5868-b63d-86254a35ea78_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 581022,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl9/5eb47c0ca41242638cdb8b1659971e9f/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95217f32-f9d7-5868-b63d-86254a35ea78/95217f32-f9d7-5868-b63d-86254a35ea78_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 559645,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl9/5eb47c0ca41242638cdb8b1659971e9f/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95217f32-f9d7-5868-b63d-86254a35ea78/95217f32-f9d7-5868-b63d-86254a35ea78_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 585514,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl9/5eb47c0ca41242638cdb8b1659971e9f/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95217f32-f9d7-5868-b63d-86254a35ea78/95217f32-f9d7-5868-b63d-86254a35ea78_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 626336,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl9/5eb47c0ca41242638cdb8b1659971e9f/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-10-26',
'seats_number': 5,
'seller_name': None,
'title': 'SKODA SKODA KODIAQ 2.0 TDI 110KW AMBITION DSG 7P FP -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-25 16:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983621%27 HTTP/1.1" 200 None
2026-03-25 16:35:49 [ayvens.it] INFO: Saving data for 1983621: {'created_time': 1774456549.925639, 'last_price_update_time': 1774456549.925654, 'auction_closing_time': 1774603800.0}
2026-03-25 16:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1983621') HTTP/1.1" 204 0
2026-03-25 16:35:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: bce268a8-273a-5a1e-8706-946ac8db3862 with identifier: 1983620
2026-03-25 16:35:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: bce268a8-273a-5a1e-8706-946ac8db3862 with identifier: 1983620
2026-03-25 16:35:50 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: bce268a8-273a-5a1e-8706-946ac8db3862 with identifier: 1983620 to the API
2026-03-25 16:35:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:35:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:35:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fr6/3fdc4b196fd840789c94643c58daa4f3/images/large/7.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'BIANCO PASTELLO',
'currency': 'EUR',
'doors_number': 4,
'engine': '2.0L',
'expiration_date': '2026-03-27T09:30:00Z',
'fuel_type': 'diesel',
'id': 'bce268a8-273a-5a1e-8706-946ac8db3862',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41025',
'listing': 'auction',
'location': None,
'make': 'FIAT',
'model': 'FIAT DUCATO 35 MH1 2.0 Mjet 16V 115CV ALU Dop.Cab. Cassone a sponde '
'abbattibili doppia cabina 4-door',
'odometer': 184670,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 17,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bce268a8-273a-5a1e-8706-946ac8db3862/bce268a8-273a-5a1e-8706-946ac8db3862_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 692089,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fr6/3fdc4b196fd840789c94643c58daa4f3/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bce268a8-273a-5a1e-8706-946ac8db3862/bce268a8-273a-5a1e-8706-946ac8db3862_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 599636,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fr6/3fdc4b196fd840789c94643c58daa4f3/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bce268a8-273a-5a1e-8706-946ac8db3862/bce268a8-273a-5a1e-8706-946ac8db3862_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 428833,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fr6/3fdc4b196fd840789c94643c58daa4f3/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bce268a8-273a-5a1e-8706-946ac8db3862/bce268a8-273a-5a1e-8706-946ac8db3862_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 629264,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fr6/3fdc4b196fd840789c94643c58daa4f3/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bce268a8-273a-5a1e-8706-946ac8db3862/bce268a8-273a-5a1e-8706-946ac8db3862_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 622237,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fr6/3fdc4b196fd840789c94643c58daa4f3/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bce268a8-273a-5a1e-8706-946ac8db3862/bce268a8-273a-5a1e-8706-946ac8db3862_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 715317,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fr6/3fdc4b196fd840789c94643c58daa4f3/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bce268a8-273a-5a1e-8706-946ac8db3862/bce268a8-273a-5a1e-8706-946ac8db3862_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 448696,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fr6/3fdc4b196fd840789c94643c58daa4f3/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bce268a8-273a-5a1e-8706-946ac8db3862/bce268a8-273a-5a1e-8706-946ac8db3862_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 396246,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fr6/3fdc4b196fd840789c94643c58daa4f3/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bce268a8-273a-5a1e-8706-946ac8db3862/bce268a8-273a-5a1e-8706-946ac8db3862_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 701896,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fr6/3fdc4b196fd840789c94643c58daa4f3/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bce268a8-273a-5a1e-8706-946ac8db3862/bce268a8-273a-5a1e-8706-946ac8db3862_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 636530,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fr6/3fdc4b196fd840789c94643c58daa4f3/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-09-07',
'seats_number': 5,
'seller_name': None,
'title': 'FIAT FIAT DUCATO 35 MH1 2.0 Mjet 16V 115CV ALU Dop.Cab. Cassone a '
'sponde abbattibili doppia cabina 4-door -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2018}
2026-03-25 16:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983620%27 HTTP/1.1" 200 None
2026-03-25 16:35:50 [ayvens.it] INFO: Saving data for 1983620: {'created_time': 1774456550.563476, 'last_price_update_time': 1774456550.563487, 'auction_closing_time': 1774603800.0}
2026-03-25 16:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1983620') HTTP/1.1" 204 0
2026-03-25 16:35:50 [ayvens.it] INFO: Found listing with ID: 1979730
2026-03-25 16:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979730%27 HTTP/1.1" 200 None
2026-03-25 16:35:50 [ayvens.it] INFO: Scrape type for 1979730: 2
2026-03-25 16:35:50 [ayvens.it] INFO: Extracting data for car ID: 1979730
2026-03-25 16:35:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5000ce7b-d11a-5e23-866d-a4178ba285d1 with identifier: 1979730
2026-03-25 16:35:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5000ce7b-d11a-5e23-866d-a4178ba285d1 with scrape type 2
2026-03-25 16:35:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5000ce7b-d11a-5e23-866d-a4178ba285d1 with scrape type 2
2026-03-25 16:35:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 5000ce7b-d11a-5e23-866d-a4178ba285d1, identifier: 1979730
2026-03-25 16:35:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 5000ce7b-d11a-5e23-866d-a4178ba285d1 with identifier: 1979730
2026-03-25 16:35:50 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:35:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 5000ce7b-d11a-5e23-866d-a4178ba285d1 with identifier: 1979730
2026-03-25 16:35:50 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 5000ce7b-d11a-5e23-866d-a4178ba285d1 with identifier: 1979730 to the API
2026-03-25 16:35:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:35:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:35:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'ROSSO TIZIANO',
'currency': 'EUR',
'doors_number': 4,
'engine': '2.2L',
'expiration_date': '2026-03-26T09:30:00Z',
'fuel_type': 'diesel',
'id': '5000ce7b-d11a-5e23-866d-a4178ba285d1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40968',
'listing': 'auction',
'location': None,
'make': 'FIAT',
'model': 'FIAT DUCATO (PC) 33 MH2 2.2 MJT3 120CV E6D-FIN',
'odometer': 89066,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-01-11',
'seats_number': 5,
'seller_name': None,
'title': 'FIAT FIAT DUCATO (PC) 33 MH2 2.2 MJT3 120CV E6D-FIN -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2024}
2026-03-25 16:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979730%27 HTTP/1.1" 200 None
2026-03-25 16:35:50 [ayvens.it] INFO: Saving data for 1979730: {'auction_closing_time': 1774517400.0, 'created_time': 1774370009.465864, 'last_price_update_time': 1774456550.945614}
2026-03-25 16:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1979730') HTTP/1.1" 204 0
2026-03-25 16:35:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:35:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc993110>
2026-03-25 16:35:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:35:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:35:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:35:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9a3271e-25b7-5f7a-aff8-28aa46299a87/d9a3271e-25b7-5f7a-aff8-28aa46299a87_image_8.jpg HTTP/1.1" 201 0
2026-03-25 16:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh0%252Febe36cf566d4486cba2be86f61b41eeb%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 16:35:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh0/ebe36cf566d4486cba2be86f61b41eeb/images/large/9.jpg saved to cache
2026-03-25 16:35:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d9a3271e-25b7-5f7a-aff8-28aa46299a87
2026-03-25 16:35:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:35:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc588d50>
2026-03-25 16:35:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:35:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:35:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:35:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9a3271e-25b7-5f7a-aff8-28aa46299a87/d9a3271e-25b7-5f7a-aff8-28aa46299a87_image_7.jpg HTTP/1.1" 201 0
2026-03-25 16:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh0%252Febe36cf566d4486cba2be86f61b41eeb%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 16:35:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh0/ebe36cf566d4486cba2be86f61b41eeb/images/large/8.jpg saved to cache
2026-03-25 16:35:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d9a3271e-25b7-5f7a-aff8-28aa46299a87
2026-03-25 16:35:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d9a3271e-25b7-5f7a-aff8-28aa46299a87, skipping ID generation
2026-03-25 16:35:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d9a3271e-25b7-5f7a-aff8-28aa46299a87 with scrape type 1
2026-03-25 16:35:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d9a3271e-25b7-5f7a-aff8-28aa46299a87 sending to next pipeline
2026-03-25 16:35:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: d9a3271e-25b7-5f7a-aff8-28aa46299a87, identifier: 1983618
2026-03-25 16:35:51 [ayvens.it] INFO: Found listing with ID: 1979731
2026-03-25 16:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979731%27 HTTP/1.1" 200 None
2026-03-25 16:35:51 [ayvens.it] INFO: Scrape type for 1979731: 2
2026-03-25 16:35:51 [ayvens.it] INFO: Extracting data for car ID: 1979731
2026-03-25 16:35:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f8ce7f63-3a8d-52e9-ab6e-c81a76d5f536 with identifier: 1979731
2026-03-25 16:35:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f8ce7f63-3a8d-52e9-ab6e-c81a76d5f536 with scrape type 2
2026-03-25 16:35:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f8ce7f63-3a8d-52e9-ab6e-c81a76d5f536 with scrape type 2
2026-03-25 16:35:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: f8ce7f63-3a8d-52e9-ab6e-c81a76d5f536, identifier: 1979731
2026-03-25 16:35:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: d9a3271e-25b7-5f7a-aff8-28aa46299a87 with identifier: 1983618
2026-03-25 16:35:51 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:35:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: d9a3271e-25b7-5f7a-aff8-28aa46299a87 with identifier: 1983618
2026-03-25 16:35:51 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: d9a3271e-25b7-5f7a-aff8-28aa46299a87 with identifier: 1983618 to the API
2026-03-25 16:35:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:35:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:35:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gh0/ebe36cf566d4486cba2be86f61b41eeb/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'BIANCO GESSO',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.9L',
'expiration_date': '2026-03-27T09:30:00Z',
'fuel_type': 'hybrid',
'id': 'd9a3271e-25b7-5f7a-aff8-28aa46299a87',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41025',
'listing': 'auction',
'location': None,
'make': 'PORSCHE',
'model': 'PORSCHE PANAMERA PANAMERA 4S E-HYBRID SPORT TURISMO FP',
'odometer': 79521,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 26,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9a3271e-25b7-5f7a-aff8-28aa46299a87/d9a3271e-25b7-5f7a-aff8-28aa46299a87_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 541854,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh0/ebe36cf566d4486cba2be86f61b41eeb/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9a3271e-25b7-5f7a-aff8-28aa46299a87/d9a3271e-25b7-5f7a-aff8-28aa46299a87_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 541882,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh0/ebe36cf566d4486cba2be86f61b41eeb/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9a3271e-25b7-5f7a-aff8-28aa46299a87/d9a3271e-25b7-5f7a-aff8-28aa46299a87_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 541854,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh0/ebe36cf566d4486cba2be86f61b41eeb/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9a3271e-25b7-5f7a-aff8-28aa46299a87/d9a3271e-25b7-5f7a-aff8-28aa46299a87_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 564220,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh0/ebe36cf566d4486cba2be86f61b41eeb/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9a3271e-25b7-5f7a-aff8-28aa46299a87/d9a3271e-25b7-5f7a-aff8-28aa46299a87_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 556938,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh0/ebe36cf566d4486cba2be86f61b41eeb/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9a3271e-25b7-5f7a-aff8-28aa46299a87/d9a3271e-25b7-5f7a-aff8-28aa46299a87_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 479349,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh0/ebe36cf566d4486cba2be86f61b41eeb/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9a3271e-25b7-5f7a-aff8-28aa46299a87/d9a3271e-25b7-5f7a-aff8-28aa46299a87_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 468015,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh0/ebe36cf566d4486cba2be86f61b41eeb/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9a3271e-25b7-5f7a-aff8-28aa46299a87/d9a3271e-25b7-5f7a-aff8-28aa46299a87_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 367065,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh0/ebe36cf566d4486cba2be86f61b41eeb/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9a3271e-25b7-5f7a-aff8-28aa46299a87/d9a3271e-25b7-5f7a-aff8-28aa46299a87_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 485178,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh0/ebe36cf566d4486cba2be86f61b41eeb/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9a3271e-25b7-5f7a-aff8-28aa46299a87/d9a3271e-25b7-5f7a-aff8-28aa46299a87_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 449271,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh0/ebe36cf566d4486cba2be86f61b41eeb/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-12-10',
'seats_number': 5,
'seller_name': None,
'title': 'PORSCHE PORSCHE PANAMERA PANAMERA 4S E-HYBRID SPORT TURISMO FP -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2021}
2026-03-25 16:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983618%27 HTTP/1.1" 200 None
2026-03-25 16:35:52 [ayvens.it] INFO: Saving data for 1983618: {'created_time': 1774456552.074812, 'last_price_update_time': 1774456552.074826, 'auction_closing_time': 1774603800.0}
2026-03-25 16:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1983618') HTTP/1.1" 204 0
2026-03-25 16:35:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg6/5188b70e7e9c4f1a9e8ac0b56981065f/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:35:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: f8ce7f63-3a8d-52e9-ab6e-c81a76d5f536 with identifier: 1979731
2026-03-25 16:35:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: f8ce7f63-3a8d-52e9-ab6e-c81a76d5f536 with identifier: 1979731
2026-03-25 16:35:52 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: f8ce7f63-3a8d-52e9-ab6e-c81a76d5f536 with identifier: 1979731 to the API
2026-03-25 16:35:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:35:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:35:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Eiger Grey metallizzato',
'currency': 'EUR',
'doors_number': 5,
'engine': '3.0L',
'expiration_date': '2026-03-26T09:30:00Z',
'fuel_type': 'diesel',
'id': 'f8ce7f63-3a8d-52e9-ab6e-c81a76d5f536',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40968',
'listing': 'auction',
'location': None,
'make': 'LAND ROVER',
'model': 'LAND ROVER RANGE ROVER VELAR 3.0 D V6 275 R-Dynamic SE 4WD Auto '
'Sport utility vehicle 5-door (Euro 6.2)',
'odometer': 104224,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-05-14',
'seats_number': 5,
'seller_name': None,
'title': 'LAND ROVER LAND ROVER RANGE ROVER VELAR 3.0 D V6 275 R-Dynamic SE '
'4WD Auto Sport utility vehicle 5-door (Euro 6.2) -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2020}
2026-03-25 16:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979731%27 HTTP/1.1" 200 None
2026-03-25 16:35:52 [ayvens.it] INFO: Saving data for 1979731: {'auction_closing_time': 1774517400.0, 'created_time': 1774370010.882072, 'last_price_update_time': 1774456552.348389}
2026-03-25 16:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1979731') HTTP/1.1" 204 0
2026-03-25 16:35:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg6/5188b70e7e9c4f1a9e8ac0b56981065f/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:35:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm7/21e046b1c7d54c9f984c355cc889538d/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:35:52 [ayvens.it] INFO: Found listing with ID: 1979732
2026-03-25 16:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979732%27 HTTP/1.1" 200 None
2026-03-25 16:35:52 [ayvens.it] INFO: Scrape type for 1979732: 2
2026-03-25 16:35:52 [ayvens.it] INFO: Extracting data for car ID: 1979732
2026-03-25 16:35:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 215866c0-86da-5185-9f9a-e91997bec542 with identifier: 1979732
2026-03-25 16:35:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 215866c0-86da-5185-9f9a-e91997bec542 with scrape type 2
2026-03-25 16:35:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 215866c0-86da-5185-9f9a-e91997bec542 with scrape type 2
2026-03-25 16:35:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 215866c0-86da-5185-9f9a-e91997bec542, identifier: 1979732
2026-03-25 16:35:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 215866c0-86da-5185-9f9a-e91997bec542 with identifier: 1979732
2026-03-25 16:35:52 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:35:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 215866c0-86da-5185-9f9a-e91997bec542 with identifier: 1979732
2026-03-25 16:35:52 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 215866c0-86da-5185-9f9a-e91997bec542 with identifier: 1979732 to the API
2026-03-25 16:35:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:35:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:35:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Unknown',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.5L',
'expiration_date': '2026-03-26T09:30:00Z',
'fuel_type': 'hybrid',
'id': '215866c0-86da-5185-9f9a-e91997bec542',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40968',
'listing': 'auction',
'location': None,
'make': 'FORD',
'model': 'FORD KUGA 2.5 Benzina FHEV 190CV 2WD ST-Line Aut Sport utility '
'vehicle 5-door (Euro 6.2)',
'odometer': 121077,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-08-31',
'seats_number': 5,
'seller_name': None,
'title': 'FORD FORD KUGA 2.5 Benzina FHEV 190CV 2WD ST-Line Aut Sport utility '
'vehicle 5-door (Euro 6.2) -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-25 16:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979732%27 HTTP/1.1" 200 None
2026-03-25 16:35:52 [ayvens.it] INFO: Saving data for 1979732: {'auction_closing_time': 1774517400.0, 'created_time': 1774370013.226578, 'last_price_update_time': 1774456552.699756}
2026-03-25 16:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1979732') HTTP/1.1" 204 0
2026-03-25 16:35:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg6/5188b70e7e9c4f1a9e8ac0b56981065f/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:35:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg3/69bc720cc60b4c49b4f73ff7cf290539/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:35:52 [ayvens.it] INFO: Found listing with ID: 1979733
2026-03-25 16:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979733%27 HTTP/1.1" 200 None
2026-03-25 16:35:52 [ayvens.it] INFO: Scrape type for 1979733: 2
2026-03-25 16:35:52 [ayvens.it] INFO: Extracting data for car ID: 1979733
2026-03-25 16:35:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 350a38c8-cd73-53ee-ae00-0c09e481e760 with identifier: 1979733
2026-03-25 16:35:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 350a38c8-cd73-53ee-ae00-0c09e481e760 with scrape type 2
2026-03-25 16:35:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 350a38c8-cd73-53ee-ae00-0c09e481e760 with scrape type 2
2026-03-25 16:35:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 350a38c8-cd73-53ee-ae00-0c09e481e760, identifier: 1979733
2026-03-25 16:35:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:35:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34d7440c50>
2026-03-25 16:35:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:35:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:35:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:35:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aad6231e-71a2-5614-85d8-887e7eb3c91a/aad6231e-71a2-5614-85d8-887e7eb3c91a_image_9.jpg HTTP/1.1" 201 0
2026-03-25 16:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg6%252F5188b70e7e9c4f1a9e8ac0b56981065f%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 16:35:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg6/5188b70e7e9c4f1a9e8ac0b56981065f/images/large/10.jpg saved to cache
2026-03-25 16:35:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item aad6231e-71a2-5614-85d8-887e7eb3c91a
2026-03-25 16:35:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg6/5188b70e7e9c4f1a9e8ac0b56981065f/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:35:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg6/5188b70e7e9c4f1a9e8ac0b56981065f/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:35:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 350a38c8-cd73-53ee-ae00-0c09e481e760 with identifier: 1979733
2026-03-25 16:35:52 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:35:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 350a38c8-cd73-53ee-ae00-0c09e481e760 with identifier: 1979733
2026-03-25 16:35:53 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 350a38c8-cd73-53ee-ae00-0c09e481e760 with identifier: 1979733 to the API
2026-03-25 16:35:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:35:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:35:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'BIANCO DUCATO PASTELLO',
'currency': 'EUR',
'doors_number': 4,
'engine': '2.3L',
'expiration_date': '2026-03-26T09:30:00Z',
'fuel_type': 'diesel',
'id': '350a38c8-cd73-53ee-ae00-0c09e481e760',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40968',
'listing': 'auction',
'location': None,
'make': 'FIAT',
'model': 'FIAT DUCATO MAXI 35 XLH3 2.3 Multijet 130CV 6M Furgone 4-door',
'odometer': 231243,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-09-21',
'seats_number': 5,
'seller_name': None,
'title': 'FIAT FIAT DUCATO MAXI 35 XLH3 2.3 Multijet 130CV 6M Furgone 4-door '
'-',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2017}
2026-03-25 16:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979733%27 HTTP/1.1" 200 None
2026-03-25 16:35:53 [ayvens.it] INFO: Saving data for 1979733: {'auction_closing_time': 1774517400.0, 'created_time': 1774370015.029063, 'last_price_update_time': 1774456553.224389}
2026-03-25 16:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1979733') HTTP/1.1" 204 0
2026-03-25 16:35:53 [ayvens.it] INFO: Found listing with ID: 1979734
2026-03-25 16:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979734%27 HTTP/1.1" 200 None
2026-03-25 16:35:53 [ayvens.it] INFO: Scrape type for 1979734: 2
2026-03-25 16:35:53 [ayvens.it] INFO: Extracting data for car ID: 1979734
2026-03-25 16:35:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: acd7688b-1422-57d6-82ea-229d3bd464f1 with identifier: 1979734
2026-03-25 16:35:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item acd7688b-1422-57d6-82ea-229d3bd464f1 with scrape type 2
2026-03-25 16:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item acd7688b-1422-57d6-82ea-229d3bd464f1 with scrape type 2
2026-03-25 16:35:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: acd7688b-1422-57d6-82ea-229d3bd464f1, identifier: 1979734
2026-03-25 16:35:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:35:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dca9fd10>
2026-03-25 16:35:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:35:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:35:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:35:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aad6231e-71a2-5614-85d8-887e7eb3c91a/aad6231e-71a2-5614-85d8-887e7eb3c91a_image_8.jpg HTTP/1.1" 201 0
2026-03-25 16:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg6%252F5188b70e7e9c4f1a9e8ac0b56981065f%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 16:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg6/5188b70e7e9c4f1a9e8ac0b56981065f/images/large/9.jpg saved to cache
2026-03-25 16:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item aad6231e-71a2-5614-85d8-887e7eb3c91a
2026-03-25 16:35:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:35:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc34fb10>
2026-03-25 16:35:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:35:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:35:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:35:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25281f6d-89b3-5e6e-b5f9-4a5841838a94/25281f6d-89b3-5e6e-b5f9-4a5841838a94_image_6.jpg HTTP/1.1" 201 0
2026-03-25 16:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm7%252F21e046b1c7d54c9f984c355cc889538d%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 16:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm7/21e046b1c7d54c9f984c355cc889538d/images/large/7.jpg saved to cache
2026-03-25 16:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 25281f6d-89b3-5e6e-b5f9-4a5841838a94
2026-03-25 16:35:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc4/fa0188f63eec458c8153df5741b8198f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:35:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: acd7688b-1422-57d6-82ea-229d3bd464f1 with identifier: 1979734
2026-03-25 16:35:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: acd7688b-1422-57d6-82ea-229d3bd464f1 with identifier: 1979734
2026-03-25 16:35:53 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: acd7688b-1422-57d6-82ea-229d3bd464f1 with identifier: 1979734 to the API
2026-03-25 16:35:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:35:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:35:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'r Comment',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-26T09:30:00Z',
'fuel_type': 'hybrid',
'id': 'acd7688b-1422-57d6-82ea-229d3bd464f1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40968',
'listing': 'auction',
'location': None,
'make': 'MINI',
'model': 'MINI COUNTRYMAN Cooper S E ALL4 Hype automatica Hatchback 5-door',
'odometer': 56026,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-07-13',
'seats_number': 5,
'seller_name': None,
'title': 'MINI MINI COUNTRYMAN Cooper S E ALL4 Hype automatica Hatchback '
'5-door -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2018}
2026-03-25 16:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979734%27 HTTP/1.1" 200 None
2026-03-25 16:35:53 [ayvens.it] INFO: Saving data for 1979734: {'auction_closing_time': 1774517400.0, 'created_time': 1774370017.24594, 'last_price_update_time': 1774456553.814741}
2026-03-25 16:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1979734') HTTP/1.1" 204 0
2026-03-25 16:35:53 [ayvens.it] INFO: Found listing with ID: 1979735
2026-03-25 16:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979735%27 HTTP/1.1" 200 None
2026-03-25 16:35:53 [ayvens.it] INFO: Scrape type for 1979735: 2
2026-03-25 16:35:53 [ayvens.it] INFO: Extracting data for car ID: 1979735
2026-03-25 16:35:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 973cca48-c60a-5356-9041-27c3ea093c69 with identifier: 1979735
2026-03-25 16:35:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 973cca48-c60a-5356-9041-27c3ea093c69 with scrape type 2
2026-03-25 16:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 973cca48-c60a-5356-9041-27c3ea093c69 with scrape type 2
2026-03-25 16:35:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 973cca48-c60a-5356-9041-27c3ea093c69, identifier: 1979735
2026-03-25 16:35:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 973cca48-c60a-5356-9041-27c3ea093c69 with identifier: 1979735
2026-03-25 16:35:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 973cca48-c60a-5356-9041-27c3ea093c69 with identifier: 1979735
2026-03-25 16:35:54 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 973cca48-c60a-5356-9041-27c3ea093c69 with identifier: 1979735 to the API
2026-03-25 16:35:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:35:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:35:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'BLU CHROME METALLIZZATO',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-26T09:30:00Z',
'fuel_type': 'diesel',
'id': '973cca48-c60a-5356-9041-27c3ea093c69',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40968',
'listing': 'auction',
'location': None,
'make': 'FORD',
'model': 'FORD TOURNEO CONNECT 1.5 TDCI 100 CV TITANIUM FP',
'odometer': 206001,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-02-04',
'seats_number': 5,
'seller_name': None,
'title': 'FORD FORD TOURNEO CONNECT 1.5 TDCI 100 CV TITANIUM FP -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2021}
2026-03-25 16:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979735%27 HTTP/1.1" 200 None
2026-03-25 16:35:54 [ayvens.it] INFO: Saving data for 1979735: {'auction_closing_time': 1774517400.0, 'created_time': 1774370018.657482, 'last_price_update_time': 1774456554.258906}
2026-03-25 16:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1979735') HTTP/1.1" 204 0
2026-03-25 16:35:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:35:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34de186d10>
2026-03-25 16:35:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:35:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:35:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:35:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aad6231e-71a2-5614-85d8-887e7eb3c91a/aad6231e-71a2-5614-85d8-887e7eb3c91a_image_6.jpg HTTP/1.1" 201 0
2026-03-25 16:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg6%252F5188b70e7e9c4f1a9e8ac0b56981065f%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 16:35:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg6/5188b70e7e9c4f1a9e8ac0b56981065f/images/large/7.jpg saved to cache
2026-03-25 16:35:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item aad6231e-71a2-5614-85d8-887e7eb3c91a
2026-03-25 16:35:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:35:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc53d510>
2026-03-25 16:35:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:35:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:35:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:35:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_23fafe66-5f7d-5e27-8abe-0d833cc15db0/23fafe66-5f7d-5e27-8abe-0d833cc15db0_image_5.jpg HTTP/1.1" 201 0
2026-03-25 16:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg3%252F69bc720cc60b4c49b4f73ff7cf290539%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 16:35:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg3/69bc720cc60b4c49b4f73ff7cf290539/images/large/6.jpg saved to cache
2026-03-25 16:35:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 23fafe66-5f7d-5e27-8abe-0d833cc15db0
2026-03-25 16:35:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 23fafe66-5f7d-5e27-8abe-0d833cc15db0, skipping ID generation
2026-03-25 16:35:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 23fafe66-5f7d-5e27-8abe-0d833cc15db0 with scrape type 1
2026-03-25 16:35:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 23fafe66-5f7d-5e27-8abe-0d833cc15db0 sending to next pipeline
2026-03-25 16:35:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 23fafe66-5f7d-5e27-8abe-0d833cc15db0, identifier: 1983613
2026-03-25 16:35:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:35:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcaaa1d0>
2026-03-25 16:35:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:35:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:35:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:35:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aad6231e-71a2-5614-85d8-887e7eb3c91a/aad6231e-71a2-5614-85d8-887e7eb3c91a_image_5.jpg HTTP/1.1" 201 0
2026-03-25 16:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg6%252F5188b70e7e9c4f1a9e8ac0b56981065f%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 16:35:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg6/5188b70e7e9c4f1a9e8ac0b56981065f/images/large/6.jpg saved to cache
2026-03-25 16:35:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item aad6231e-71a2-5614-85d8-887e7eb3c91a
2026-03-25 16:35:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:35:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcb15850>
2026-03-25 16:35:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:35:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:35:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:35:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aad6231e-71a2-5614-85d8-887e7eb3c91a/aad6231e-71a2-5614-85d8-887e7eb3c91a_image_7.jpg HTTP/1.1" 201 0
2026-03-25 16:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg6%252F5188b70e7e9c4f1a9e8ac0b56981065f%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 16:35:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg6/5188b70e7e9c4f1a9e8ac0b56981065f/images/large/8.jpg saved to cache
2026-03-25 16:35:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item aad6231e-71a2-5614-85d8-887e7eb3c91a
2026-03-25 16:35:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: aad6231e-71a2-5614-85d8-887e7eb3c91a, skipping ID generation
2026-03-25 16:35:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aad6231e-71a2-5614-85d8-887e7eb3c91a with scrape type 1
2026-03-25 16:35:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item aad6231e-71a2-5614-85d8-887e7eb3c91a sending to next pipeline
2026-03-25 16:35:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: aad6231e-71a2-5614-85d8-887e7eb3c91a, identifier: 1983617
2026-03-25 16:35:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm7/21e046b1c7d54c9f984c355cc889538d/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:35:54 [ayvens.it] INFO: Found listing with ID: 1979736
2026-03-25 16:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979736%27 HTTP/1.1" 200 None
2026-03-25 16:35:54 [ayvens.it] INFO: Scrape type for 1979736: 2
2026-03-25 16:35:54 [ayvens.it] INFO: Extracting data for car ID: 1979736
2026-03-25 16:35:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 479d940c-ad4d-52b0-8624-1a171b10e3ab with identifier: 1979736
2026-03-25 16:35:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 479d940c-ad4d-52b0-8624-1a171b10e3ab with scrape type 2
2026-03-25 16:35:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 479d940c-ad4d-52b0-8624-1a171b10e3ab with scrape type 2
2026-03-25 16:35:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 479d940c-ad4d-52b0-8624-1a171b10e3ab, identifier: 1979736
2026-03-25 16:35:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 23fafe66-5f7d-5e27-8abe-0d833cc15db0 with identifier: 1983613
2026-03-25 16:35:54 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:35:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 23fafe66-5f7d-5e27-8abe-0d833cc15db0 with identifier: 1983613
2026-03-25 16:35:55 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 23fafe66-5f7d-5e27-8abe-0d833cc15db0 with identifier: 1983613 to the API
2026-03-25 16:35:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:35:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:35:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gg3/69bc720cc60b4c49b4f73ff7cf290539/images/large/6.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Silver Met',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.5L',
'expiration_date': '2026-03-27T09:30:00Z',
'fuel_type': 'hybrid',
'id': '23fafe66-5f7d-5e27-8abe-0d833cc15db0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41025',
'listing': 'auction',
'location': None,
'make': 'TOYOTA',
'model': 'TOYOTA RAV4 2.5 HV 218cv E-CVT Dynamic 2WD Cross over 5-door (Euro '
'6.2)',
'odometer': 153329,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 49,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_23fafe66-5f7d-5e27-8abe-0d833cc15db0/23fafe66-5f7d-5e27-8abe-0d833cc15db0_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 691043,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg3/69bc720cc60b4c49b4f73ff7cf290539/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_23fafe66-5f7d-5e27-8abe-0d833cc15db0/23fafe66-5f7d-5e27-8abe-0d833cc15db0_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 691043,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg3/69bc720cc60b4c49b4f73ff7cf290539/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_23fafe66-5f7d-5e27-8abe-0d833cc15db0/23fafe66-5f7d-5e27-8abe-0d833cc15db0_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 704267,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg3/69bc720cc60b4c49b4f73ff7cf290539/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_23fafe66-5f7d-5e27-8abe-0d833cc15db0/23fafe66-5f7d-5e27-8abe-0d833cc15db0_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 687201,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg3/69bc720cc60b4c49b4f73ff7cf290539/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_23fafe66-5f7d-5e27-8abe-0d833cc15db0/23fafe66-5f7d-5e27-8abe-0d833cc15db0_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 738014,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg3/69bc720cc60b4c49b4f73ff7cf290539/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_23fafe66-5f7d-5e27-8abe-0d833cc15db0/23fafe66-5f7d-5e27-8abe-0d833cc15db0_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 646986,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg3/69bc720cc60b4c49b4f73ff7cf290539/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_23fafe66-5f7d-5e27-8abe-0d833cc15db0/23fafe66-5f7d-5e27-8abe-0d833cc15db0_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 541392,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg3/69bc720cc60b4c49b4f73ff7cf290539/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_23fafe66-5f7d-5e27-8abe-0d833cc15db0/23fafe66-5f7d-5e27-8abe-0d833cc15db0_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 569422,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg3/69bc720cc60b4c49b4f73ff7cf290539/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_23fafe66-5f7d-5e27-8abe-0d833cc15db0/23fafe66-5f7d-5e27-8abe-0d833cc15db0_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 658200,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg3/69bc720cc60b4c49b4f73ff7cf290539/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_23fafe66-5f7d-5e27-8abe-0d833cc15db0/23fafe66-5f7d-5e27-8abe-0d833cc15db0_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 555647,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg3/69bc720cc60b4c49b4f73ff7cf290539/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-07-27',
'seats_number': 5,
'seller_name': None,
'title': 'TOYOTA TOYOTA RAV4 2.5 HV 218cv E-CVT Dynamic 2WD Cross over 5-door '
'(Euro 6.2) -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2021}
2026-03-25 16:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983613%27 HTTP/1.1" 200 None
2026-03-25 16:35:55 [ayvens.it] INFO: Saving data for 1983613: {'created_time': 1774456555.304202, 'last_price_update_time': 1774456555.304213, 'auction_closing_time': 1774603800.0}
2026-03-25 16:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1983613') HTTP/1.1" 204 0
2026-03-25 16:35:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: aad6231e-71a2-5614-85d8-887e7eb3c91a with identifier: 1983617
2026-03-25 16:35:55 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:35:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: aad6231e-71a2-5614-85d8-887e7eb3c91a with identifier: 1983617
2026-03-25 16:35:55 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: aad6231e-71a2-5614-85d8-887e7eb3c91a with identifier: 1983617 to the API
2026-03-25 16:35:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:35:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:35:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gg6/5188b70e7e9c4f1a9e8ac0b56981065f/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'N',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-27T09:30:00Z',
'fuel_type': 'petrol',
'id': 'aad6231e-71a2-5614-85d8-887e7eb3c91a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41025',
'listing': 'auction',
'location': None,
'make': 'AUDI',
'model': 'AUDI A1 25 TFSI Admired Sportback Hatchback 5-door (Euro 6D)',
'odometer': 95397,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 33,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aad6231e-71a2-5614-85d8-887e7eb3c91a/aad6231e-71a2-5614-85d8-887e7eb3c91a_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 938819,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg6/5188b70e7e9c4f1a9e8ac0b56981065f/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aad6231e-71a2-5614-85d8-887e7eb3c91a/aad6231e-71a2-5614-85d8-887e7eb3c91a_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 938819,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg6/5188b70e7e9c4f1a9e8ac0b56981065f/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aad6231e-71a2-5614-85d8-887e7eb3c91a/aad6231e-71a2-5614-85d8-887e7eb3c91a_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 908161,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg6/5188b70e7e9c4f1a9e8ac0b56981065f/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aad6231e-71a2-5614-85d8-887e7eb3c91a/aad6231e-71a2-5614-85d8-887e7eb3c91a_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 948063,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg6/5188b70e7e9c4f1a9e8ac0b56981065f/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aad6231e-71a2-5614-85d8-887e7eb3c91a/aad6231e-71a2-5614-85d8-887e7eb3c91a_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 970561,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg6/5188b70e7e9c4f1a9e8ac0b56981065f/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aad6231e-71a2-5614-85d8-887e7eb3c91a/aad6231e-71a2-5614-85d8-887e7eb3c91a_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 692517,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg6/5188b70e7e9c4f1a9e8ac0b56981065f/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aad6231e-71a2-5614-85d8-887e7eb3c91a/aad6231e-71a2-5614-85d8-887e7eb3c91a_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 600488,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg6/5188b70e7e9c4f1a9e8ac0b56981065f/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aad6231e-71a2-5614-85d8-887e7eb3c91a/aad6231e-71a2-5614-85d8-887e7eb3c91a_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 672876,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg6/5188b70e7e9c4f1a9e8ac0b56981065f/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aad6231e-71a2-5614-85d8-887e7eb3c91a/aad6231e-71a2-5614-85d8-887e7eb3c91a_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 746650,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg6/5188b70e7e9c4f1a9e8ac0b56981065f/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aad6231e-71a2-5614-85d8-887e7eb3c91a/aad6231e-71a2-5614-85d8-887e7eb3c91a_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 672208,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg6/5188b70e7e9c4f1a9e8ac0b56981065f/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-10-14',
'seats_number': 5,
'seller_name': None,
'title': 'AUDI AUDI A1 25 TFSI Admired Sportback Hatchback 5-door (Euro 6D) -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2021}
2026-03-25 16:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983617%27 HTTP/1.1" 200 None
2026-03-25 16:35:55 [ayvens.it] INFO: Saving data for 1983617: {'created_time': 1774456555.671445, 'last_price_update_time': 1774456555.671457, 'auction_closing_time': 1774603800.0}
2026-03-25 16:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1983617') HTTP/1.1" 204 0
2026-03-25 16:35:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 479d940c-ad4d-52b0-8624-1a171b10e3ab with identifier: 1979736
2026-03-25 16:35:55 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:35:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 479d940c-ad4d-52b0-8624-1a171b10e3ab with identifier: 1979736
2026-03-25 16:35:55 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 479d940c-ad4d-52b0-8624-1a171b10e3ab with identifier: 1979736 to the API
2026-03-25 16:35:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:35:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:35:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'ROSSO PASSIONE PASTELLO',
'currency': 'EUR',
'doors_number': 3,
'engine': '1.0L',
'expiration_date': '2026-03-26T09:30:00Z',
'fuel_type': 'hybrid',
'id': '479d940c-ad4d-52b0-8624-1a171b10e3ab',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40968',
'listing': 'auction',
'location': None,
'make': 'FIAT',
'model': 'FIAT 500 1.0 70cv Ibrido Hatchback 3-door',
'odometer': 16801,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-09-28',
'seats_number': 5,
'seller_name': None,
'title': 'FIAT FIAT 500 1.0 70cv Ibrido Hatchback 3-door -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2023}
2026-03-25 16:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979736%27 HTTP/1.1" 200 None
2026-03-25 16:35:55 [ayvens.it] INFO: Saving data for 1979736: {'auction_closing_time': 1774517400.0, 'created_time': 1774370020.961565, 'last_price_update_time': 1774456555.945141}
2026-03-25 16:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1979736') HTTP/1.1" 204 0
2026-03-25 16:35:55 [ayvens.it] INFO: Found listing with ID: 1979737
2026-03-25 16:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979737%27 HTTP/1.1" 200 None
2026-03-25 16:35:55 [ayvens.it] INFO: Scrape type for 1979737: 2
2026-03-25 16:35:55 [ayvens.it] INFO: Extracting data for car ID: 1979737
2026-03-25 16:35:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e5d29849-e8f1-57f7-9ddb-3ea4617a575c with identifier: 1979737
2026-03-25 16:35:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e5d29849-e8f1-57f7-9ddb-3ea4617a575c with scrape type 2
2026-03-25 16:35:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e5d29849-e8f1-57f7-9ddb-3ea4617a575c with scrape type 2
2026-03-25 16:35:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: e5d29849-e8f1-57f7-9ddb-3ea4617a575c, identifier: 1979737
2026-03-25 16:35:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:35:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcc4d550>
2026-03-25 16:35:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:35:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:35:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:35:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7cdfe783-01ef-5813-824c-ed9e64604ad9/7cdfe783-01ef-5813-824c-ed9e64604ad9_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc4%252Ffa0188f63eec458c8153df5741b8198f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 16:35:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc4/fa0188f63eec458c8153df5741b8198f/images/large/1.jpg saved to cache
2026-03-25 16:35:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7cdfe783-01ef-5813-824c-ed9e64604ad9
2026-03-25 16:35:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7cdfe783-01ef-5813-824c-ed9e64604ad9, skipping ID generation
2026-03-25 16:35:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7cdfe783-01ef-5813-824c-ed9e64604ad9 with scrape type 1
2026-03-25 16:35:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7cdfe783-01ef-5813-824c-ed9e64604ad9 sending to next pipeline
2026-03-25 16:35:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 7cdfe783-01ef-5813-824c-ed9e64604ad9, identifier: 1983611
2026-03-25 16:35:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: e5d29849-e8f1-57f7-9ddb-3ea4617a575c with identifier: 1979737
2026-03-25 16:35:56 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:35:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: e5d29849-e8f1-57f7-9ddb-3ea4617a575c with identifier: 1979737
2026-03-25 16:35:56 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: e5d29849-e8f1-57f7-9ddb-3ea4617a575c with identifier: 1979737 to the API
2026-03-25 16:35:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:35:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:35:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'BLU IMPERIALE METALLIZZATO',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-26T09:30:00Z',
'fuel_type': 'diesel',
'id': 'e5d29849-e8f1-57f7-9ddb-3ea4617a575c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40968',
'listing': 'auction',
'location': None,
'make': 'DS AUTOMOBILES',
'model': 'DS DS 7 BLUEHDI 130 AUTOMATICA PERFORMANCE LINE+ FP',
'odometer': 94301,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-04-28',
'seats_number': 5,
'seller_name': None,
'title': 'DS AUTOMOBILES DS DS 7 BLUEHDI 130 AUTOMATICA PERFORMANCE LINE+ FP '
'-',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2023}
2026-03-25 16:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979737%27 HTTP/1.1" 200 None
2026-03-25 16:35:56 [ayvens.it] INFO: Saving data for 1979737: {'auction_closing_time': 1774517400.0, 'created_time': 1774370022.580756, 'last_price_update_time': 1774456556.492164}
2026-03-25 16:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1979737') HTTP/1.1" 204 0
2026-03-25 16:35:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 7cdfe783-01ef-5813-824c-ed9e64604ad9 with identifier: 1983611
2026-03-25 16:35:56 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:35:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 7cdfe783-01ef-5813-824c-ed9e64604ad9 with identifier: 1983611
2026-03-25 16:35:56 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 7cdfe783-01ef-5813-824c-ed9e64604ad9 with identifier: 1983611 to the API
2026-03-25 16:35:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:35:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:35:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gc4/fa0188f63eec458c8153df5741b8198f/images/large/1.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Moonwalk Grey metallizzato',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-27T09:30:00Z',
'fuel_type': 'hybrid',
'id': '7cdfe783-01ef-5813-824c-ed9e64604ad9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41025',
'listing': 'auction',
'location': None,
'make': 'MINI',
'model': 'MINI COUNTRYMAN Cooper S E ALL4 Business autom. Hatchback 5-door '
'(Euro 6.2)',
'odometer': 20291,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 62,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7cdfe783-01ef-5813-824c-ed9e64604ad9/7cdfe783-01ef-5813-824c-ed9e64604ad9_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 705077,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc4/fa0188f63eec458c8153df5741b8198f/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7cdfe783-01ef-5813-824c-ed9e64604ad9/7cdfe783-01ef-5813-824c-ed9e64604ad9_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 705077,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc4/fa0188f63eec458c8153df5741b8198f/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7cdfe783-01ef-5813-824c-ed9e64604ad9/7cdfe783-01ef-5813-824c-ed9e64604ad9_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 621063,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc4/fa0188f63eec458c8153df5741b8198f/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7cdfe783-01ef-5813-824c-ed9e64604ad9/7cdfe783-01ef-5813-824c-ed9e64604ad9_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 660626,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc4/fa0188f63eec458c8153df5741b8198f/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7cdfe783-01ef-5813-824c-ed9e64604ad9/7cdfe783-01ef-5813-824c-ed9e64604ad9_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 698854,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc4/fa0188f63eec458c8153df5741b8198f/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7cdfe783-01ef-5813-824c-ed9e64604ad9/7cdfe783-01ef-5813-824c-ed9e64604ad9_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 604300,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc4/fa0188f63eec458c8153df5741b8198f/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7cdfe783-01ef-5813-824c-ed9e64604ad9/7cdfe783-01ef-5813-824c-ed9e64604ad9_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 495410,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc4/fa0188f63eec458c8153df5741b8198f/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7cdfe783-01ef-5813-824c-ed9e64604ad9/7cdfe783-01ef-5813-824c-ed9e64604ad9_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 510233,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc4/fa0188f63eec458c8153df5741b8198f/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7cdfe783-01ef-5813-824c-ed9e64604ad9/7cdfe783-01ef-5813-824c-ed9e64604ad9_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 568682,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc4/fa0188f63eec458c8153df5741b8198f/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7cdfe783-01ef-5813-824c-ed9e64604ad9/7cdfe783-01ef-5813-824c-ed9e64604ad9_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 502820,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc4/fa0188f63eec458c8153df5741b8198f/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-10-19',
'seats_number': 5,
'seller_name': None,
'title': 'MINI MINI COUNTRYMAN Cooper S E ALL4 Business autom. Hatchback '
'5-door (Euro 6.2) -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2020}
2026-03-25 16:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983611%27 HTTP/1.1" 200 None
2026-03-25 16:35:56 [ayvens.it] INFO: Saving data for 1983611: {'created_time': 1774456556.848564, 'last_price_update_time': 1774456556.848578, 'auction_closing_time': 1774603800.0}
2026-03-25 16:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1983611') HTTP/1.1" 204 0
2026-03-25 16:35:56 [ayvens.it] INFO: Found listing with ID: 1979738
2026-03-25 16:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979738%27 HTTP/1.1" 200 None
2026-03-25 16:35:56 [ayvens.it] INFO: Scrape type for 1979738: 2
2026-03-25 16:35:56 [ayvens.it] INFO: Extracting data for car ID: 1979738
2026-03-25 16:35:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 654b1177-efa7-5ba7-a373-a393ea4426d7 with identifier: 1979738
2026-03-25 16:35:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 654b1177-efa7-5ba7-a373-a393ea4426d7 with scrape type 2
2026-03-25 16:35:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 654b1177-efa7-5ba7-a373-a393ea4426d7 with scrape type 2
2026-03-25 16:35:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 654b1177-efa7-5ba7-a373-a393ea4426d7, identifier: 1979738
2026-03-25 16:35:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:35:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc787690>
2026-03-25 16:35:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:35:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:35:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:35:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25281f6d-89b3-5e6e-b5f9-4a5841838a94/25281f6d-89b3-5e6e-b5f9-4a5841838a94_image_5.jpg HTTP/1.1" 201 0
2026-03-25 16:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm7%252F21e046b1c7d54c9f984c355cc889538d%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 16:35:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm7/21e046b1c7d54c9f984c355cc889538d/images/large/6.jpg saved to cache
2026-03-25 16:35:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 25281f6d-89b3-5e6e-b5f9-4a5841838a94
2026-03-25 16:35:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 25281f6d-89b3-5e6e-b5f9-4a5841838a94, skipping ID generation
2026-03-25 16:35:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 25281f6d-89b3-5e6e-b5f9-4a5841838a94 with scrape type 1
2026-03-25 16:35:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 25281f6d-89b3-5e6e-b5f9-4a5841838a94 sending to next pipeline
2026-03-25 16:35:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 25281f6d-89b3-5e6e-b5f9-4a5841838a94, identifier: 1983603
2026-03-25 16:35:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp4/be3ef3582f0f439ba8022810d5a35b53/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:35:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 654b1177-efa7-5ba7-a373-a393ea4426d7 with identifier: 1979738
2026-03-25 16:35:57 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:35:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 654b1177-efa7-5ba7-a373-a393ea4426d7 with identifier: 1979738
2026-03-25 16:35:57 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 654b1177-efa7-5ba7-a373-a393ea4426d7 with identifier: 1979738 to the API
2026-03-25 16:35:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:35:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:35:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'EIGER GREY METALLIZZATO',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-26T09:30:00Z',
'fuel_type': 'hybrid',
'id': '654b1177-efa7-5ba7-a373-a393ea4426d7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40968',
'listing': 'auction',
'location': None,
'make': 'LAND ROVER',
'model': 'LAND ROVER RANGE ROVER EVOQUE 1.5 I3 309 PHEV R-Dynamic S AWD auto '
'Sport utility vehicle 5-door (Euro 6D)',
'odometer': 40189,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-04-03',
'seats_number': 5,
'seller_name': None,
'title': 'LAND ROVER LAND ROVER RANGE ROVER EVOQUE 1.5 I3 309 PHEV R-Dynamic '
'S AWD auto Sport utility vehicle 5-door (Euro 6D) -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2023}
2026-03-25 16:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979738%27 HTTP/1.1" 200 None
2026-03-25 16:35:57 [ayvens.it] INFO: Saving data for 1979738: {'auction_closing_time': 1774517400.0, 'created_time': 1774370025.152355, 'last_price_update_time': 1774456557.340563}
2026-03-25 16:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1979738') HTTP/1.1" 204 0
2026-03-25 16:35:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 25281f6d-89b3-5e6e-b5f9-4a5841838a94 with identifier: 1983603
2026-03-25 16:35:57 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:35:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 25281f6d-89b3-5e6e-b5f9-4a5841838a94 with identifier: 1983603
2026-03-25 16:35:57 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 25281f6d-89b3-5e6e-b5f9-4a5841838a94 with identifier: 1983603 to the API
2026-03-25 16:35:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:35:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:35:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gm7/21e046b1c7d54c9f984c355cc889538d/images/large/6.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Dolphin Grey Metall',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-27T09:30:00Z',
'fuel_type': 'diesel',
'id': '25281f6d-89b3-5e6e-b5f9-4a5841838a94',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41025',
'listing': 'auction',
'location': None,
'make': 'VOLKSWAGEN',
'model': 'VOLKSWAGEN TIGUAN 2.0 TDI SCR 110KWR-Line DSG Sport utility vehicle '
'5-door (Euro 6D)',
'odometer': 181221,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 30,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25281f6d-89b3-5e6e-b5f9-4a5841838a94/25281f6d-89b3-5e6e-b5f9-4a5841838a94_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 545532,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm7/21e046b1c7d54c9f984c355cc889538d/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25281f6d-89b3-5e6e-b5f9-4a5841838a94/25281f6d-89b3-5e6e-b5f9-4a5841838a94_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 376951,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm7/21e046b1c7d54c9f984c355cc889538d/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25281f6d-89b3-5e6e-b5f9-4a5841838a94/25281f6d-89b3-5e6e-b5f9-4a5841838a94_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 233012,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm7/21e046b1c7d54c9f984c355cc889538d/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25281f6d-89b3-5e6e-b5f9-4a5841838a94/25281f6d-89b3-5e6e-b5f9-4a5841838a94_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 261241,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm7/21e046b1c7d54c9f984c355cc889538d/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25281f6d-89b3-5e6e-b5f9-4a5841838a94/25281f6d-89b3-5e6e-b5f9-4a5841838a94_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 231151,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm7/21e046b1c7d54c9f984c355cc889538d/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25281f6d-89b3-5e6e-b5f9-4a5841838a94/25281f6d-89b3-5e6e-b5f9-4a5841838a94_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 328590,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm7/21e046b1c7d54c9f984c355cc889538d/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25281f6d-89b3-5e6e-b5f9-4a5841838a94/25281f6d-89b3-5e6e-b5f9-4a5841838a94_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 334445,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm7/21e046b1c7d54c9f984c355cc889538d/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25281f6d-89b3-5e6e-b5f9-4a5841838a94/25281f6d-89b3-5e6e-b5f9-4a5841838a94_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 365403,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm7/21e046b1c7d54c9f984c355cc889538d/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25281f6d-89b3-5e6e-b5f9-4a5841838a94/25281f6d-89b3-5e6e-b5f9-4a5841838a94_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 275036,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm7/21e046b1c7d54c9f984c355cc889538d/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25281f6d-89b3-5e6e-b5f9-4a5841838a94/25281f6d-89b3-5e6e-b5f9-4a5841838a94_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 543990,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm7/21e046b1c7d54c9f984c355cc889538d/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-01-13',
'seats_number': 5,
'seller_name': None,
'title': 'VOLKSWAGEN VOLKSWAGEN TIGUAN 2.0 TDI SCR 110KWR-Line DSG Sport '
'utility vehicle 5-door (Euro 6D) -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2023}
2026-03-25 16:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983603%27 HTTP/1.1" 200 None
2026-03-25 16:35:57 [ayvens.it] INFO: Saving data for 1983603: {'created_time': 1774456557.864912, 'last_price_update_time': 1774456557.864921, 'auction_closing_time': 1774603800.0}
2026-03-25 16:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1983603') HTTP/1.1" 204 0
2026-03-25 16:35:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp4/be3ef3582f0f439ba8022810d5a35b53/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:35:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp4/be3ef3582f0f439ba8022810d5a35b53/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:35:57 [ayvens.it] INFO: Found listing with ID: 1979739
2026-03-25 16:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979739%27 HTTP/1.1" 200 None
2026-03-25 16:35:57 [ayvens.it] INFO: Scrape type for 1979739: 2
2026-03-25 16:35:57 [ayvens.it] INFO: Extracting data for car ID: 1979739
2026-03-25 16:35:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d5984bad-cd8d-52e9-87ce-af1423357eed with identifier: 1979739
2026-03-25 16:35:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d5984bad-cd8d-52e9-87ce-af1423357eed with scrape type 2
2026-03-25 16:35:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d5984bad-cd8d-52e9-87ce-af1423357eed with scrape type 2
2026-03-25 16:35:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: d5984bad-cd8d-52e9-87ce-af1423357eed, identifier: 1979739
2026-03-25 16:35:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge3/d11aaed2fc824b54825b57cb3783f6d0/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:35:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: d5984bad-cd8d-52e9-87ce-af1423357eed with identifier: 1979739
2026-03-25 16:35:57 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:35:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: d5984bad-cd8d-52e9-87ce-af1423357eed with identifier: 1979739
2026-03-25 16:35:58 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: d5984bad-cd8d-52e9-87ce-af1423357eed with identifier: 1979739 to the API
2026-03-25 16:35:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:35:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:35:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Nero Tulipano perlato',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-26T09:30:00Z',
'fuel_type': 'diesel',
'id': 'd5984bad-cd8d-52e9-87ce-af1423357eed',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40968',
'listing': 'auction',
'location': None,
'make': 'SKODA',
'model': 'SKODA KAROQ 2.0 TDI 85KW EVO SCR Executive DSG Sport utility '
'vehicle 5-door (Euro 6D)',
'odometer': 212724,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-02-22',
'seats_number': 5,
'seller_name': None,
'title': 'SKODA SKODA KAROQ 2.0 TDI 85KW EVO SCR Executive DSG Sport utility '
'vehicle 5-door (Euro 6D) -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2023}
2026-03-25 16:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979739%27 HTTP/1.1" 200 None
2026-03-25 16:35:58 [ayvens.it] INFO: Saving data for 1979739: {'auction_closing_time': 1774517400.0, 'created_time': 1774370026.015523, 'last_price_update_time': 1774456558.34829}
2026-03-25 16:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1979739') HTTP/1.1" 204 0
2026-03-25 16:35:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fs9/9f795b6663ec44e39f880b25b0ec85d1/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:35:58 [ayvens.it] INFO: Found listing with ID: 1979740
2026-03-25 16:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979740%27 HTTP/1.1" 200 None
2026-03-25 16:35:58 [ayvens.it] INFO: Scrape type for 1979740: 2
2026-03-25 16:35:58 [ayvens.it] INFO: Extracting data for car ID: 1979740
2026-03-25 16:35:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d6d262ae-1687-5c74-9271-931b16eaa703 with identifier: 1979740
2026-03-25 16:35:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d6d262ae-1687-5c74-9271-931b16eaa703 with scrape type 2
2026-03-25 16:35:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d6d262ae-1687-5c74-9271-931b16eaa703 with scrape type 2
2026-03-25 16:35:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: d6d262ae-1687-5c74-9271-931b16eaa703, identifier: 1979740
2026-03-25 16:35:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm4/a13df06b7b4042d4a614464e9a76a8ac/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:35:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj8/85df5ee543dd4007afb4aa933b685f10/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:35:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: d6d262ae-1687-5c74-9271-931b16eaa703 with identifier: 1979740
2026-03-25 16:35:58 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:35:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: d6d262ae-1687-5c74-9271-931b16eaa703 with identifier: 1979740
2026-03-25 16:35:58 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: d6d262ae-1687-5c74-9271-931b16eaa703 with identifier: 1979740 to the API
2026-03-25 16:35:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:35:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:35:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'AMAZON GREY METALLIZZATO',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-26T09:30:00Z',
'fuel_type': 'hybrid',
'id': 'd6d262ae-1687-5c74-9271-931b16eaa703',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40968',
'listing': 'auction',
'location': None,
'make': 'HYUNDAI',
'model': 'HYUNDAI TUCSON 1.6 HEV 2wd 230cv Xline Auto Sport utility vehicle '
'5-door (Euro 6.2)',
'odometer': 87225,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-03-30',
'seats_number': 5,
'seller_name': None,
'title': 'HYUNDAI HYUNDAI TUCSON 1.6 HEV 2wd 230cv Xline Auto Sport utility '
'vehicle 5-door (Euro 6.2) -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2023}
2026-03-25 16:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979740%27 HTTP/1.1" 200 None
2026-03-25 16:35:58 [ayvens.it] INFO: Saving data for 1979740: {'auction_closing_time': 1774517400.0, 'created_time': 1774370027.357075, 'last_price_update_time': 1774456558.730918}
2026-03-25 16:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1979740') HTTP/1.1" 204 0
2026-03-25 16:35:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:35:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34d6b49750>
2026-03-25 16:35:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:35:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:35:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:35:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14f4c1e9-3777-50bd-a1b5-1f001441b2b5/14f4c1e9-3777-50bd-a1b5-1f001441b2b5_image_6.jpg HTTP/1.1" 201 0
2026-03-25 16:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp4%252Fbe3ef3582f0f439ba8022810d5a35b53%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 16:35:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp4/be3ef3582f0f439ba8022810d5a35b53/images/large/7.jpg saved to cache
2026-03-25 16:35:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 14f4c1e9-3777-50bd-a1b5-1f001441b2b5
2026-03-25 16:35:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:35:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc9b1990>
2026-03-25 16:35:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:35:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:35:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:35:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14f4c1e9-3777-50bd-a1b5-1f001441b2b5/14f4c1e9-3777-50bd-a1b5-1f001441b2b5_image_7.jpg HTTP/1.1" 201 0
2026-03-25 16:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp4%252Fbe3ef3582f0f439ba8022810d5a35b53%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 16:35:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp4/be3ef3582f0f439ba8022810d5a35b53/images/large/8.jpg saved to cache
2026-03-25 16:35:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 14f4c1e9-3777-50bd-a1b5-1f001441b2b5
2026-03-25 16:35:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:35:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcb14b50>
2026-03-25 16:35:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:35:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:35:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:35:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14f4c1e9-3777-50bd-a1b5-1f001441b2b5/14f4c1e9-3777-50bd-a1b5-1f001441b2b5_image_8.jpg HTTP/1.1" 201 0
2026-03-25 16:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp4%252Fbe3ef3582f0f439ba8022810d5a35b53%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 16:35:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp4/be3ef3582f0f439ba8022810d5a35b53/images/large/9.jpg saved to cache
2026-03-25 16:35:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 14f4c1e9-3777-50bd-a1b5-1f001441b2b5
2026-03-25 16:35:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 14f4c1e9-3777-50bd-a1b5-1f001441b2b5, skipping ID generation
2026-03-25 16:35:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 14f4c1e9-3777-50bd-a1b5-1f001441b2b5 with scrape type 1
2026-03-25 16:35:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 14f4c1e9-3777-50bd-a1b5-1f001441b2b5 sending to next pipeline
2026-03-25 16:35:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 14f4c1e9-3777-50bd-a1b5-1f001441b2b5, identifier: 1983602
2026-03-25 16:35:59 [ayvens.it] INFO: Found listing with ID: 1979741
2026-03-25 16:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979741%27 HTTP/1.1" 200 None
2026-03-25 16:35:59 [ayvens.it] INFO: Scrape type for 1979741: 2
2026-03-25 16:35:59 [ayvens.it] INFO: Extracting data for car ID: 1979741
2026-03-25 16:35:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f115ff57-e2db-57f3-85e7-e8b367b8f72c with identifier: 1979741
2026-03-25 16:35:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f115ff57-e2db-57f3-85e7-e8b367b8f72c with scrape type 2
2026-03-25 16:35:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f115ff57-e2db-57f3-85e7-e8b367b8f72c with scrape type 2
2026-03-25 16:35:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: f115ff57-e2db-57f3-85e7-e8b367b8f72c, identifier: 1979741
2026-03-25 16:35:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 14f4c1e9-3777-50bd-a1b5-1f001441b2b5 with identifier: 1983602
2026-03-25 16:35:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 14f4c1e9-3777-50bd-a1b5-1f001441b2b5 with identifier: 1983602
2026-03-25 16:35:59 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 14f4c1e9-3777-50bd-a1b5-1f001441b2b5 with identifier: 1983602 to the API
2026-03-25 16:35:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:35:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:35:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gp4/be3ef3582f0f439ba8022810d5a35b53/images/large/9.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'CHROME BLUE METALLIZZATO',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-27T09:30:00Z',
'fuel_type': 'hybrid',
'id': '14f4c1e9-3777-50bd-a1b5-1f001441b2b5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41025',
'listing': 'auction',
'location': None,
'make': 'FORD',
'model': 'FORD FOCUS SW (PC) 1.0 ECOB. HYBR. 125CV ST-LINE DES.AUTOSW',
'odometer': 61878,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 40,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14f4c1e9-3777-50bd-a1b5-1f001441b2b5/14f4c1e9-3777-50bd-a1b5-1f001441b2b5_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 701938,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp4/be3ef3582f0f439ba8022810d5a35b53/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14f4c1e9-3777-50bd-a1b5-1f001441b2b5/14f4c1e9-3777-50bd-a1b5-1f001441b2b5_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 750803,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp4/be3ef3582f0f439ba8022810d5a35b53/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14f4c1e9-3777-50bd-a1b5-1f001441b2b5/14f4c1e9-3777-50bd-a1b5-1f001441b2b5_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 527011,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp4/be3ef3582f0f439ba8022810d5a35b53/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14f4c1e9-3777-50bd-a1b5-1f001441b2b5/14f4c1e9-3777-50bd-a1b5-1f001441b2b5_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 647810,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp4/be3ef3582f0f439ba8022810d5a35b53/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14f4c1e9-3777-50bd-a1b5-1f001441b2b5/14f4c1e9-3777-50bd-a1b5-1f001441b2b5_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 744861,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp4/be3ef3582f0f439ba8022810d5a35b53/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14f4c1e9-3777-50bd-a1b5-1f001441b2b5/14f4c1e9-3777-50bd-a1b5-1f001441b2b5_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 564900,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp4/be3ef3582f0f439ba8022810d5a35b53/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14f4c1e9-3777-50bd-a1b5-1f001441b2b5/14f4c1e9-3777-50bd-a1b5-1f001441b2b5_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 523996,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp4/be3ef3582f0f439ba8022810d5a35b53/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14f4c1e9-3777-50bd-a1b5-1f001441b2b5/14f4c1e9-3777-50bd-a1b5-1f001441b2b5_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 726394,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp4/be3ef3582f0f439ba8022810d5a35b53/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14f4c1e9-3777-50bd-a1b5-1f001441b2b5/14f4c1e9-3777-50bd-a1b5-1f001441b2b5_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 720230,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp4/be3ef3582f0f439ba8022810d5a35b53/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14f4c1e9-3777-50bd-a1b5-1f001441b2b5/14f4c1e9-3777-50bd-a1b5-1f001441b2b5_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 571761,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp4/be3ef3582f0f439ba8022810d5a35b53/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-07-20',
'seats_number': 5,
'seller_name': None,
'title': 'FORD FORD FOCUS SW (PC) 1.0 ECOB. HYBR. 125CV ST-LINE DES.AUTOSW -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2023}
2026-03-25 16:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983602%27 HTTP/1.1" 200 None
2026-03-25 16:35:59 [ayvens.it] INFO: Saving data for 1983602: {'created_time': 1774456559.5289, 'last_price_update_time': 1774456559.528914, 'auction_closing_time': 1774603800.0}
2026-03-25 16:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1983602') HTTP/1.1" 204 0
2026-03-25 16:35:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: f115ff57-e2db-57f3-85e7-e8b367b8f72c with identifier: 1979741
2026-03-25 16:35:59 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:35:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: f115ff57-e2db-57f3-85e7-e8b367b8f72c with identifier: 1979741
2026-03-25 16:35:59 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: f115ff57-e2db-57f3-85e7-e8b367b8f72c with identifier: 1979741 to the API
2026-03-25 16:35:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:35:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:35:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'GRIGIO SCISTO METALLIC',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-26T09:30:00Z',
'fuel_type': 'petrol',
'id': 'f115ff57-e2db-57f3-85e7-e8b367b8f72c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40968',
'listing': 'auction',
'location': None,
'make': 'RENAULT',
'model': 'RENAULT CLIO (PC) 1.0 SCE 49KW EVOLUTION FP',
'odometer': 35786,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-05-15',
'seats_number': 5,
'seller_name': None,
'title': 'RENAULT RENAULT CLIO (PC) 1.0 SCE 49KW EVOLUTION FP -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2024}
2026-03-25 16:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979741%27 HTTP/1.1" 200 None
2026-03-25 16:35:59 [ayvens.it] INFO: Saving data for 1979741: {'auction_closing_time': 1774517400.0, 'created_time': 1774370028.692927, 'last_price_update_time': 1774456559.827868}
2026-03-25 16:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1979741') HTTP/1.1" 204 0
2026-03-25 16:35:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:35:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc5a23d0>
2026-03-25 16:35:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:35:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:35:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:35:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad4830fa-b449-5585-8517-aac6390702f6/ad4830fa-b449-5585-8517-aac6390702f6_image_1.jpg HTTP/1.1" 201 0
2026-03-25 16:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge3%252Fd11aaed2fc824b54825b57cb3783f6d0%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 16:35:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge3/d11aaed2fc824b54825b57cb3783f6d0/images/large/2.jpg saved to cache
2026-03-25 16:35:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ad4830fa-b449-5585-8517-aac6390702f6
2026-03-25 16:35:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ad4830fa-b449-5585-8517-aac6390702f6, skipping ID generation
2026-03-25 16:35:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ad4830fa-b449-5585-8517-aac6390702f6 with scrape type 1
2026-03-25 16:35:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ad4830fa-b449-5585-8517-aac6390702f6 sending to next pipeline
2026-03-25 16:36:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: ad4830fa-b449-5585-8517-aac6390702f6, identifier: 1983567
2026-03-25 16:36:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:36:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dca975d0>
2026-03-25 16:36:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:36:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:36:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:36:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bf8bec1d-86ad-5e60-a97b-f1847175df2c/bf8bec1d-86ad-5e60-a97b-f1847175df2c_image_7.jpg HTTP/1.1" 201 0
2026-03-25 16:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs9%252F9f795b6663ec44e39f880b25b0ec85d1%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 16:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs9/9f795b6663ec44e39f880b25b0ec85d1/images/large/8.jpg saved to cache
2026-03-25 16:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item bf8bec1d-86ad-5e60-a97b-f1847175df2c
2026-03-25 16:36:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bf8bec1d-86ad-5e60-a97b-f1847175df2c, skipping ID generation
2026-03-25 16:36:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bf8bec1d-86ad-5e60-a97b-f1847175df2c with scrape type 1
2026-03-25 16:36:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bf8bec1d-86ad-5e60-a97b-f1847175df2c sending to next pipeline
2026-03-25 16:36:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: bf8bec1d-86ad-5e60-a97b-f1847175df2c, identifier: 1983568
2026-03-25 16:36:00 [ayvens.it] INFO: Found listing with ID: 1979742
2026-03-25 16:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979742%27 HTTP/1.1" 200 None
2026-03-25 16:36:00 [ayvens.it] INFO: Scrape type for 1979742: 2
2026-03-25 16:36:00 [ayvens.it] INFO: Extracting data for car ID: 1979742
2026-03-25 16:36:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 242958db-8f90-5c31-97f1-ffca3d4b612a with identifier: 1979742
2026-03-25 16:36:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 242958db-8f90-5c31-97f1-ffca3d4b612a with scrape type 2
2026-03-25 16:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 242958db-8f90-5c31-97f1-ffca3d4b612a with scrape type 2
2026-03-25 16:36:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 242958db-8f90-5c31-97f1-ffca3d4b612a, identifier: 1979742
2026-03-25 16:36:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: ad4830fa-b449-5585-8517-aac6390702f6 with identifier: 1983567
2026-03-25 16:36:00 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:36:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: ad4830fa-b449-5585-8517-aac6390702f6 with identifier: 1983567
2026-03-25 16:36:00 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: ad4830fa-b449-5585-8517-aac6390702f6 with identifier: 1983567 to the API
2026-03-25 16:36:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:36:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:36:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/ge3/d11aaed2fc824b54825b57cb3783f6d0/images/large/2.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Argento Riflesso metall',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-27T09:30:00Z',
'fuel_type': 'diesel',
'id': 'ad4830fa-b449-5585-8517-aac6390702f6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41025',
'listing': 'auction',
'location': None,
'make': 'VOLKSWAGEN',
'model': 'VOLKSWAGEN PASSAT Var. 2.0TDI SCR EVO 90kW Business DSG SW 5-door '
'(Euro 6.2)',
'odometer': 139640,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 26,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad4830fa-b449-5585-8517-aac6390702f6/ad4830fa-b449-5585-8517-aac6390702f6_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 778610,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge3/d11aaed2fc824b54825b57cb3783f6d0/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad4830fa-b449-5585-8517-aac6390702f6/ad4830fa-b449-5585-8517-aac6390702f6_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 535726,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge3/d11aaed2fc824b54825b57cb3783f6d0/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad4830fa-b449-5585-8517-aac6390702f6/ad4830fa-b449-5585-8517-aac6390702f6_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 579991,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge3/d11aaed2fc824b54825b57cb3783f6d0/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad4830fa-b449-5585-8517-aac6390702f6/ad4830fa-b449-5585-8517-aac6390702f6_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 778610,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge3/d11aaed2fc824b54825b57cb3783f6d0/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad4830fa-b449-5585-8517-aac6390702f6/ad4830fa-b449-5585-8517-aac6390702f6_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 714563,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge3/d11aaed2fc824b54825b57cb3783f6d0/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad4830fa-b449-5585-8517-aac6390702f6/ad4830fa-b449-5585-8517-aac6390702f6_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 778778,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge3/d11aaed2fc824b54825b57cb3783f6d0/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad4830fa-b449-5585-8517-aac6390702f6/ad4830fa-b449-5585-8517-aac6390702f6_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 622239,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge3/d11aaed2fc824b54825b57cb3783f6d0/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad4830fa-b449-5585-8517-aac6390702f6/ad4830fa-b449-5585-8517-aac6390702f6_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 672250,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge3/d11aaed2fc824b54825b57cb3783f6d0/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad4830fa-b449-5585-8517-aac6390702f6/ad4830fa-b449-5585-8517-aac6390702f6_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 587532,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge3/d11aaed2fc824b54825b57cb3783f6d0/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad4830fa-b449-5585-8517-aac6390702f6/ad4830fa-b449-5585-8517-aac6390702f6_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 707294,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge3/d11aaed2fc824b54825b57cb3783f6d0/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-02-26',
'seats_number': 5,
'seller_name': None,
'title': 'VOLKSWAGEN VOLKSWAGEN PASSAT Var. 2.0TDI SCR EVO 90kW Business DSG '
'SW 5-door (Euro 6.2) -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2021}
2026-03-25 16:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983567%27 HTTP/1.1" 200 None
2026-03-25 16:36:00 [ayvens.it] INFO: Saving data for 1983567: {'created_time': 1774456560.932934, 'last_price_update_time': 1774456560.932949, 'auction_closing_time': 1774603800.0}
2026-03-25 16:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1983567') HTTP/1.1" 204 0
2026-03-25 16:36:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: bf8bec1d-86ad-5e60-a97b-f1847175df2c with identifier: 1983568
2026-03-25 16:36:00 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:36:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: bf8bec1d-86ad-5e60-a97b-f1847175df2c with identifier: 1983568
2026-03-25 16:36:01 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: bf8bec1d-86ad-5e60-a97b-f1847175df2c with identifier: 1983568 to the API
2026-03-25 16:36:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:36:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:36:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fs9/9f795b6663ec44e39f880b25b0ec85d1/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Jazz Blue metallizzato',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-27T09:30:00Z',
'fuel_type': 'diesel',
'id': 'bf8bec1d-86ad-5e60-a97b-f1847175df2c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41025',
'listing': 'auction',
'location': None,
'make': 'JEEP',
'model': 'JEEP COMPASS 1.6 MJet 88kW Limited Sport utility vehicle 5-door '
'(Euro 6)',
'odometer': 61951,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 12,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf8bec1d-86ad-5e60-a97b-f1847175df2c/bf8bec1d-86ad-5e60-a97b-f1847175df2c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 754288,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs9/9f795b6663ec44e39f880b25b0ec85d1/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf8bec1d-86ad-5e60-a97b-f1847175df2c/bf8bec1d-86ad-5e60-a97b-f1847175df2c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 615356,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs9/9f795b6663ec44e39f880b25b0ec85d1/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf8bec1d-86ad-5e60-a97b-f1847175df2c/bf8bec1d-86ad-5e60-a97b-f1847175df2c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 628726,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs9/9f795b6663ec44e39f880b25b0ec85d1/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf8bec1d-86ad-5e60-a97b-f1847175df2c/bf8bec1d-86ad-5e60-a97b-f1847175df2c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 712676,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs9/9f795b6663ec44e39f880b25b0ec85d1/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf8bec1d-86ad-5e60-a97b-f1847175df2c/bf8bec1d-86ad-5e60-a97b-f1847175df2c_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 777755,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs9/9f795b6663ec44e39f880b25b0ec85d1/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf8bec1d-86ad-5e60-a97b-f1847175df2c/bf8bec1d-86ad-5e60-a97b-f1847175df2c_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 753800,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs9/9f795b6663ec44e39f880b25b0ec85d1/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf8bec1d-86ad-5e60-a97b-f1847175df2c/bf8bec1d-86ad-5e60-a97b-f1847175df2c_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 754288,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs9/9f795b6663ec44e39f880b25b0ec85d1/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf8bec1d-86ad-5e60-a97b-f1847175df2c/bf8bec1d-86ad-5e60-a97b-f1847175df2c_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 599470,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs9/9f795b6663ec44e39f880b25b0ec85d1/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf8bec1d-86ad-5e60-a97b-f1847175df2c/bf8bec1d-86ad-5e60-a97b-f1847175df2c_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 752249,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs9/9f795b6663ec44e39f880b25b0ec85d1/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf8bec1d-86ad-5e60-a97b-f1847175df2c/bf8bec1d-86ad-5e60-a97b-f1847175df2c_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 550566,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs9/9f795b6663ec44e39f880b25b0ec85d1/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-09-28',
'seats_number': 5,
'seller_name': None,
'title': 'JEEP JEEP COMPASS 1.6 MJet 88kW Limited Sport utility vehicle '
'5-door (Euro 6) -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2018}
2026-03-25 16:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983568%27 HTTP/1.1" 200 None
2026-03-25 16:36:01 [ayvens.it] INFO: Saving data for 1983568: {'created_time': 1774456561.425158, 'last_price_update_time': 1774456561.425168, 'auction_closing_time': 1774603800.0}
2026-03-25 16:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1983568') HTTP/1.1" 204 0
2026-03-25 16:36:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc4/bbdfd01b13b64024aaab469ceb8f1c6e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:36:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 242958db-8f90-5c31-97f1-ffca3d4b612a with identifier: 1979742
2026-03-25 16:36:01 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:36:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 242958db-8f90-5c31-97f1-ffca3d4b612a with identifier: 1979742
2026-03-25 16:36:01 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 242958db-8f90-5c31-97f1-ffca3d4b612a with identifier: 1979742 to the API
2026-03-25 16:36:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:36:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:36:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'BLU NAVARRA METALLIZZATO',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-26T09:30:00Z',
'fuel_type': 'hybrid',
'id': '242958db-8f90-5c31-97f1-ffca3d4b612a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40968',
'listing': 'auction',
'location': None,
'make': 'AUDI',
'model': 'AUDI Q5 50 TFSI E BUSINESS QUATTRO S TRONIC FP',
'odometer': 20718,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-09-29',
'seats_number': 5,
'seller_name': None,
'title': 'AUDI AUDI Q5 50 TFSI E BUSINESS QUATTRO S TRONIC FP -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2023}
2026-03-25 16:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979742%27 HTTP/1.1" 200 None
2026-03-25 16:36:01 [ayvens.it] INFO: Saving data for 1979742: {'auction_closing_time': 1774517400.0, 'created_time': 1774370033.538861, 'last_price_update_time': 1774456561.823626}
2026-03-25 16:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1979742') HTTP/1.1" 204 0
2026-03-25 16:36:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:36:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc906310>
2026-03-25 16:36:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:36:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:36:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:36:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41e4dd95-6716-53c2-aedf-859273b2edb6/41e4dd95-6716-53c2-aedf-859273b2edb6_image_6.jpg HTTP/1.1" 201 0
2026-03-25 16:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm4%252Fa13df06b7b4042d4a614464e9a76a8ac%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 16:36:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm4/a13df06b7b4042d4a614464e9a76a8ac/images/large/7.jpg saved to cache
2026-03-25 16:36:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 41e4dd95-6716-53c2-aedf-859273b2edb6
2026-03-25 16:36:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 41e4dd95-6716-53c2-aedf-859273b2edb6, skipping ID generation
2026-03-25 16:36:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 41e4dd95-6716-53c2-aedf-859273b2edb6 with scrape type 1
2026-03-25 16:36:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 41e4dd95-6716-53c2-aedf-859273b2edb6 sending to next pipeline
2026-03-25 16:36:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 41e4dd95-6716-53c2-aedf-859273b2edb6, identifier: 1983601
2026-03-25 16:36:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:36:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc943f10>
2026-03-25 16:36:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:36:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:36:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:36:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c70b927e-cb2d-5dfb-847c-0c314bd2fb22/c70b927e-cb2d-5dfb-847c-0c314bd2fb22_image_5.jpg HTTP/1.1" 201 0
2026-03-25 16:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj8%252F85df5ee543dd4007afb4aa933b685f10%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 16:36:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj8/85df5ee543dd4007afb4aa933b685f10/images/large/6.jpg saved to cache
2026-03-25 16:36:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c70b927e-cb2d-5dfb-847c-0c314bd2fb22
2026-03-25 16:36:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c70b927e-cb2d-5dfb-847c-0c314bd2fb22, skipping ID generation
2026-03-25 16:36:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c70b927e-cb2d-5dfb-847c-0c314bd2fb22 with scrape type 1
2026-03-25 16:36:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c70b927e-cb2d-5dfb-847c-0c314bd2fb22 sending to next pipeline
2026-03-25 16:36:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: c70b927e-cb2d-5dfb-847c-0c314bd2fb22, identifier: 1983562
2026-03-25 16:36:02 [ayvens.it] INFO: Found listing with ID: 1979743
2026-03-25 16:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979743%27 HTTP/1.1" 200 None
2026-03-25 16:36:02 [ayvens.it] INFO: Scrape type for 1979743: 2
2026-03-25 16:36:02 [ayvens.it] INFO: Extracting data for car ID: 1979743
2026-03-25 16:36:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: af960f69-6e1e-5806-92de-b527b7a17c9f with identifier: 1979743
2026-03-25 16:36:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item af960f69-6e1e-5806-92de-b527b7a17c9f with scrape type 2
2026-03-25 16:36:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item af960f69-6e1e-5806-92de-b527b7a17c9f with scrape type 2
2026-03-25 16:36:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: af960f69-6e1e-5806-92de-b527b7a17c9f, identifier: 1979743
2026-03-25 16:36:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 41e4dd95-6716-53c2-aedf-859273b2edb6 with identifier: 1983601
2026-03-25 16:36:02 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:36:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 41e4dd95-6716-53c2-aedf-859273b2edb6 with identifier: 1983601
2026-03-25 16:36:02 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 41e4dd95-6716-53c2-aedf-859273b2edb6 with identifier: 1983601 to the API
2026-03-25 16:36:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:36:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:36:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gm4/a13df06b7b4042d4a614464e9a76a8ac/images/large/7.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'THUNDER GREY',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-27T09:30:00Z',
'fuel_type': 'hybrid',
'id': '41e4dd95-6716-53c2-aedf-859273b2edb6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41025',
'listing': 'auction',
'location': None,
'make': 'VOLVO',
'model': 'VOLVO XC40 (PC) T4 RECHARGE PLUG-IN AUTO CORE FP',
'odometer': 87645,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 21,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41e4dd95-6716-53c2-aedf-859273b2edb6/41e4dd95-6716-53c2-aedf-859273b2edb6_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 828462,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm4/a13df06b7b4042d4a614464e9a76a8ac/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41e4dd95-6716-53c2-aedf-859273b2edb6/41e4dd95-6716-53c2-aedf-859273b2edb6_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 479797,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm4/a13df06b7b4042d4a614464e9a76a8ac/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41e4dd95-6716-53c2-aedf-859273b2edb6/41e4dd95-6716-53c2-aedf-859273b2edb6_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 720662,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm4/a13df06b7b4042d4a614464e9a76a8ac/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41e4dd95-6716-53c2-aedf-859273b2edb6/41e4dd95-6716-53c2-aedf-859273b2edb6_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 660199,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm4/a13df06b7b4042d4a614464e9a76a8ac/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41e4dd95-6716-53c2-aedf-859273b2edb6/41e4dd95-6716-53c2-aedf-859273b2edb6_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 556256,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm4/a13df06b7b4042d4a614464e9a76a8ac/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41e4dd95-6716-53c2-aedf-859273b2edb6/41e4dd95-6716-53c2-aedf-859273b2edb6_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 709152,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm4/a13df06b7b4042d4a614464e9a76a8ac/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41e4dd95-6716-53c2-aedf-859273b2edb6/41e4dd95-6716-53c2-aedf-859273b2edb6_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 828462,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm4/a13df06b7b4042d4a614464e9a76a8ac/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41e4dd95-6716-53c2-aedf-859273b2edb6/41e4dd95-6716-53c2-aedf-859273b2edb6_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 478818,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm4/a13df06b7b4042d4a614464e9a76a8ac/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41e4dd95-6716-53c2-aedf-859273b2edb6/41e4dd95-6716-53c2-aedf-859273b2edb6_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 422479,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm4/a13df06b7b4042d4a614464e9a76a8ac/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41e4dd95-6716-53c2-aedf-859273b2edb6/41e4dd95-6716-53c2-aedf-859273b2edb6_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 606781,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm4/a13df06b7b4042d4a614464e9a76a8ac/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-01-13',
'seats_number': 5,
'seller_name': None,
'title': 'VOLVO VOLVO XC40 (PC) T4 RECHARGE PLUG-IN AUTO CORE FP -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2023}
2026-03-25 16:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983601%27 HTTP/1.1" 200 None
2026-03-25 16:36:02 [ayvens.it] INFO: Saving data for 1983601: {'created_time': 1774456562.770603, 'last_price_update_time': 1774456562.770614, 'auction_closing_time': 1774603800.0}
2026-03-25 16:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1983601') HTTP/1.1" 204 0
2026-03-25 16:36:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: c70b927e-cb2d-5dfb-847c-0c314bd2fb22 with identifier: 1983562
2026-03-25 16:36:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: c70b927e-cb2d-5dfb-847c-0c314bd2fb22 with identifier: 1983562
2026-03-25 16:36:02 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: c70b927e-cb2d-5dfb-847c-0c314bd2fb22 with identifier: 1983562 to the API
2026-03-25 16:36:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:36:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:36:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gj8/85df5ee543dd4007afb4aa933b685f10/images/large/6.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'BIANCO LUNA METALLIZZATO',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-27T09:30:00Z',
'fuel_type': 'diesel',
'id': 'c70b927e-cb2d-5dfb-847c-0c314bd2fb22',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41025',
'listing': 'auction',
'location': None,
'make': 'SKODA',
'model': 'SKODA KODIAQ 2.0 TDI EVO SCR EXECUTIVE DSG 7p Sport utility vehicle '
'5-door (Euro 6D)',
'odometer': 130822,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 14,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c70b927e-cb2d-5dfb-847c-0c314bd2fb22/c70b927e-cb2d-5dfb-847c-0c314bd2fb22_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 764306,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj8/85df5ee543dd4007afb4aa933b685f10/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c70b927e-cb2d-5dfb-847c-0c314bd2fb22/c70b927e-cb2d-5dfb-847c-0c314bd2fb22_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 549544,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj8/85df5ee543dd4007afb4aa933b685f10/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c70b927e-cb2d-5dfb-847c-0c314bd2fb22/c70b927e-cb2d-5dfb-847c-0c314bd2fb22_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 679111,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj8/85df5ee543dd4007afb4aa933b685f10/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c70b927e-cb2d-5dfb-847c-0c314bd2fb22/c70b927e-cb2d-5dfb-847c-0c314bd2fb22_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 764306,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj8/85df5ee543dd4007afb4aa933b685f10/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c70b927e-cb2d-5dfb-847c-0c314bd2fb22/c70b927e-cb2d-5dfb-847c-0c314bd2fb22_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 720188,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj8/85df5ee543dd4007afb4aa933b685f10/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c70b927e-cb2d-5dfb-847c-0c314bd2fb22/c70b927e-cb2d-5dfb-847c-0c314bd2fb22_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 645302,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj8/85df5ee543dd4007afb4aa933b685f10/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c70b927e-cb2d-5dfb-847c-0c314bd2fb22/c70b927e-cb2d-5dfb-847c-0c314bd2fb22_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 646049,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj8/85df5ee543dd4007afb4aa933b685f10/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c70b927e-cb2d-5dfb-847c-0c314bd2fb22/c70b927e-cb2d-5dfb-847c-0c314bd2fb22_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 527254,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj8/85df5ee543dd4007afb4aa933b685f10/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c70b927e-cb2d-5dfb-847c-0c314bd2fb22/c70b927e-cb2d-5dfb-847c-0c314bd2fb22_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 774161,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj8/85df5ee543dd4007afb4aa933b685f10/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c70b927e-cb2d-5dfb-847c-0c314bd2fb22/c70b927e-cb2d-5dfb-847c-0c314bd2fb22_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 756352,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj8/85df5ee543dd4007afb4aa933b685f10/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-01-21',
'seats_number': 5,
'seller_name': None,
'title': 'SKODA SKODA KODIAQ 2.0 TDI EVO SCR EXECUTIVE DSG 7p Sport utility '
'vehicle 5-door (Euro 6D) -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-25 16:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983562%27 HTTP/1.1" 200 None
2026-03-25 16:36:03 [ayvens.it] INFO: Saving data for 1983562: {'created_time': 1774456563.10723, 'last_price_update_time': 1774456563.107241, 'auction_closing_time': 1774603800.0}
2026-03-25 16:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1983562') HTTP/1.1" 204 0
2026-03-25 16:36:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: af960f69-6e1e-5806-92de-b527b7a17c9f with identifier: 1979743
2026-03-25 16:36:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: af960f69-6e1e-5806-92de-b527b7a17c9f with identifier: 1979743
2026-03-25 16:36:03 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: af960f69-6e1e-5806-92de-b527b7a17c9f with identifier: 1979743 to the API
2026-03-25 16:36:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:36:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:36:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'ROSSO PASSIONE PASTELLO',
'currency': 'EUR',
'doors_number': 3,
'engine': '1.0L',
'expiration_date': '2026-03-26T09:30:00Z',
'fuel_type': 'hybrid',
'id': 'af960f69-6e1e-5806-92de-b527b7a17c9f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40968',
'listing': 'auction',
'location': None,
'make': 'FIAT',
'model': 'FIAT 500 1.0 70cv Ibrido Hatchback 3-door',
'odometer': 19022,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-09-27',
'seats_number': 5,
'seller_name': None,
'title': 'FIAT FIAT 500 1.0 70cv Ibrido Hatchback 3-door -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2023}
2026-03-25 16:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979743%27 HTTP/1.1" 200 None
2026-03-25 16:36:03 [ayvens.it] INFO: Saving data for 1979743: {'auction_closing_time': 1774517400.0, 'created_time': 1774370035.416961, 'last_price_update_time': 1774456563.360449}
2026-03-25 16:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1979743') HTTP/1.1" 204 0
2026-03-25 16:36:03 [ayvens.it] INFO: Found listing with ID: 1979744
2026-03-25 16:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979744%27 HTTP/1.1" 200 None
2026-03-25 16:36:03 [ayvens.it] INFO: Scrape type for 1979744: 2
2026-03-25 16:36:03 [ayvens.it] INFO: Extracting data for car ID: 1979744
2026-03-25 16:36:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3fbc2f63-2f91-5e6b-b332-fe6323169a31 with identifier: 1979744
2026-03-25 16:36:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3fbc2f63-2f91-5e6b-b332-fe6323169a31 with scrape type 2
2026-03-25 16:36:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3fbc2f63-2f91-5e6b-b332-fe6323169a31 with scrape type 2
2026-03-25 16:36:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 3fbc2f63-2f91-5e6b-b332-fe6323169a31, identifier: 1979744
2026-03-25 16:36:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:36:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34d7d7d790>
2026-03-25 16:36:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:36:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:36:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:36:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e1d0474-7c36-520d-9b10-965a59b503c9/2e1d0474-7c36-520d-9b10-965a59b503c9_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc4%252Fbbdfd01b13b64024aaab469ceb8f1c6e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 16:36:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc4/bbdfd01b13b64024aaab469ceb8f1c6e/images/large/1.jpg saved to cache
2026-03-25 16:36:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2e1d0474-7c36-520d-9b10-965a59b503c9
2026-03-25 16:36:03 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2e1d0474-7c36-520d-9b10-965a59b503c9, skipping ID generation
2026-03-25 16:36:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2e1d0474-7c36-520d-9b10-965a59b503c9 with scrape type 1
2026-03-25 16:36:03 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2e1d0474-7c36-520d-9b10-965a59b503c9 sending to next pipeline
2026-03-25 16:36:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 2e1d0474-7c36-520d-9b10-965a59b503c9, identifier: 1983560
2026-03-25 16:36:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 3fbc2f63-2f91-5e6b-b332-fe6323169a31 with identifier: 1979744
2026-03-25 16:36:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 3fbc2f63-2f91-5e6b-b332-fe6323169a31 with identifier: 1979744
2026-03-25 16:36:03 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 3fbc2f63-2f91-5e6b-b332-fe6323169a31 with identifier: 1979744 to the API
2026-03-25 16:36:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:36:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:36:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'NATURAL WHITE PASTELLO',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-26T09:30:00Z',
'fuel_type': 'diesel',
'id': '3fbc2f63-2f91-5e6b-b332-fe6323169a31',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40968',
'listing': 'auction',
'location': None,
'make': 'CITROËN',
'model': 'CITROEN C5 AIRCROSS (PC BLUEHDI 130 S&S C-SERIES EAT8',
'odometer': 44865,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-06-28',
'seats_number': 5,
'seller_name': None,
'title': 'CITROËN CITROEN C5 AIRCROSS (PC BLUEHDI 130 S&S C-SERIES EAT8 -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2023}
2026-03-25 16:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979744%27 HTTP/1.1" 200 None
2026-03-25 16:36:03 [ayvens.it] INFO: Saving data for 1979744: {'auction_closing_time': 1774517400.0, 'created_time': 1774370037.833929, 'last_price_update_time': 1774456563.917858}
2026-03-25 16:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1979744') HTTP/1.1" 204 0
2026-03-25 16:36:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 2e1d0474-7c36-520d-9b10-965a59b503c9 with identifier: 1983560
2026-03-25 16:36:03 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:36:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 2e1d0474-7c36-520d-9b10-965a59b503c9 with identifier: 1983560
2026-03-25 16:36:04 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 2e1d0474-7c36-520d-9b10-965a59b503c9 with identifier: 1983560 to the API
2026-03-25 16:36:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:36:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:36:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gc4/bbdfd01b13b64024aaab469ceb8f1c6e/images/large/1.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'METALLIC DEEP BLUE',
'currency': 'EUR',
'doors_number': 5,
'engine': '',
'expiration_date': '2026-03-27T09:30:00Z',
'fuel_type': 'electric',
'id': '2e1d0474-7c36-520d-9b10-965a59b503c9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41025',
'listing': 'auction',
'location': None,
'make': 'TESLA',
'model': 'TESLA MODEL 3 50 KWH STANDARD PLUS RWD FP',
'odometer': 124683,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e1d0474-7c36-520d-9b10-965a59b503c9/2e1d0474-7c36-520d-9b10-965a59b503c9_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 714602,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc4/bbdfd01b13b64024aaab469ceb8f1c6e/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e1d0474-7c36-520d-9b10-965a59b503c9/2e1d0474-7c36-520d-9b10-965a59b503c9_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 739369,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc4/bbdfd01b13b64024aaab469ceb8f1c6e/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e1d0474-7c36-520d-9b10-965a59b503c9/2e1d0474-7c36-520d-9b10-965a59b503c9_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 746917,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc4/bbdfd01b13b64024aaab469ceb8f1c6e/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e1d0474-7c36-520d-9b10-965a59b503c9/2e1d0474-7c36-520d-9b10-965a59b503c9_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 523635,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc4/bbdfd01b13b64024aaab469ceb8f1c6e/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e1d0474-7c36-520d-9b10-965a59b503c9/2e1d0474-7c36-520d-9b10-965a59b503c9_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 517224,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc4/bbdfd01b13b64024aaab469ceb8f1c6e/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e1d0474-7c36-520d-9b10-965a59b503c9/2e1d0474-7c36-520d-9b10-965a59b503c9_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 398796,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc4/bbdfd01b13b64024aaab469ceb8f1c6e/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e1d0474-7c36-520d-9b10-965a59b503c9/2e1d0474-7c36-520d-9b10-965a59b503c9_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 567082,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc4/bbdfd01b13b64024aaab469ceb8f1c6e/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e1d0474-7c36-520d-9b10-965a59b503c9/2e1d0474-7c36-520d-9b10-965a59b503c9_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 776299,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc4/bbdfd01b13b64024aaab469ceb8f1c6e/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e1d0474-7c36-520d-9b10-965a59b503c9/2e1d0474-7c36-520d-9b10-965a59b503c9_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 714602,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc4/bbdfd01b13b64024aaab469ceb8f1c6e/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e1d0474-7c36-520d-9b10-965a59b503c9/2e1d0474-7c36-520d-9b10-965a59b503c9_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 315402,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc4/bbdfd01b13b64024aaab469ceb8f1c6e/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-09-22',
'seats_number': 5,
'seller_name': None,
'title': 'TESLA TESLA MODEL 3 50 KWH STANDARD PLUS RWD FP -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2020}
2026-03-25 16:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983560%27 HTTP/1.1" 200 None
2026-03-25 16:36:04 [ayvens.it] INFO: Saving data for 1983560: {'created_time': 1774456564.39693, 'last_price_update_time': 1774456564.396941, 'auction_closing_time': 1774603800.0}
2026-03-25 16:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1983560') HTTP/1.1" 204 0
2026-03-25 16:36:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj9/d1d8bfde47a1408d85f60ec645375bff/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:36:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp0/e3e09c04425f4cd7b932ca3a8a47e10c/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:36:04 [ayvens.it] INFO: Found listing with ID: 1979745
2026-03-25 16:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979745%27 HTTP/1.1" 200 None
2026-03-25 16:36:04 [ayvens.it] INFO: Scrape type for 1979745: 2
2026-03-25 16:36:04 [ayvens.it] INFO: Extracting data for car ID: 1979745
2026-03-25 16:36:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c95d97c7-164d-5afe-ab4d-8a58ace33781 with identifier: 1979745
2026-03-25 16:36:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c95d97c7-164d-5afe-ab4d-8a58ace33781 with scrape type 2
2026-03-25 16:36:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c95d97c7-164d-5afe-ab4d-8a58ace33781 with scrape type 2
2026-03-25 16:36:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: c95d97c7-164d-5afe-ab4d-8a58ace33781, identifier: 1979745
2026-03-25 16:36:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp0/e3e09c04425f4cd7b932ca3a8a47e10c/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:36:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: c95d97c7-164d-5afe-ab4d-8a58ace33781 with identifier: 1979745
2026-03-25 16:36:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: c95d97c7-164d-5afe-ab4d-8a58ace33781 with identifier: 1979745
2026-03-25 16:36:04 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: c95d97c7-164d-5afe-ab4d-8a58ace33781 with identifier: 1979745 to the API
2026-03-25 16:36:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:36:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:36:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Bianco pastello',
'currency': 'EUR',
'doors_number': 4,
'engine': '1.6L',
'expiration_date': '2026-03-26T09:30:00Z',
'fuel_type': 'diesel',
'id': 'c95d97c7-164d-5afe-ab4d-8a58ace33781',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40968',
'listing': 'auction',
'location': None,
'make': 'FIAT',
'model': 'FIAT DOBLÃ’ CARGO MAXI LH1 LOUNGE 1.6 Mjet 105cv E6D-f S&S Vettura '
'Furgonata 4-door (Euro 6D)',
'odometer': 158125,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-01-24',
'seats_number': 5,
'seller_name': None,
'title': 'FIAT FIAT DOBLÃ’ CARGO MAXI LH1 LOUNGE 1.6 Mjet 105cv E6D-f S&S '
'Vettura Furgonata 4-door (Euro 6D) -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-25 16:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979745%27 HTTP/1.1" 200 None
2026-03-25 16:36:04 [ayvens.it] INFO: Saving data for 1979745: {'auction_closing_time': 1774517400.0, 'created_time': 1774370039.547205, 'last_price_update_time': 1774456564.764413}
2026-03-25 16:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1979745') HTTP/1.1" 204 0
2026-03-25 16:36:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm1/492184fd70884deea40c7b73c7b31fbf/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:36:04 [ayvens.it] INFO: Found listing with ID: 1979746
2026-03-25 16:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979746%27 HTTP/1.1" 200 None
2026-03-25 16:36:04 [ayvens.it] INFO: Scrape type for 1979746: 2
2026-03-25 16:36:04 [ayvens.it] INFO: Extracting data for car ID: 1979746
2026-03-25 16:36:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1a1ffe32-6d91-57cb-9b49-4516eb244ec1 with identifier: 1979746
2026-03-25 16:36:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1a1ffe32-6d91-57cb-9b49-4516eb244ec1 with scrape type 2
2026-03-25 16:36:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1a1ffe32-6d91-57cb-9b49-4516eb244ec1 with scrape type 2
2026-03-25 16:36:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 1a1ffe32-6d91-57cb-9b49-4516eb244ec1, identifier: 1979746
2026-03-25 16:36:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 1a1ffe32-6d91-57cb-9b49-4516eb244ec1 with identifier: 1979746
2026-03-25 16:36:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 1a1ffe32-6d91-57cb-9b49-4516eb244ec1 with identifier: 1979746
2026-03-25 16:36:04 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 1a1ffe32-6d91-57cb-9b49-4516eb244ec1 with identifier: 1979746 to the API
2026-03-25 16:36:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:36:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:36:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Bianco Gelato pastello',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-26T09:30:00Z',
'fuel_type': 'hybrid',
'id': '1a1ffe32-6d91-57cb-9b49-4516eb244ec1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40968',
'listing': 'auction',
'location': None,
'make': 'FIAT',
'model': 'FIAT PANDA 1.0 FireFly 70cv S&S Hybrid City Life',
'odometer': 140389,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-01-28',
'seats_number': 5,
'seller_name': None,
'title': 'FIAT FIAT PANDA 1.0 FireFly 70cv S&S Hybrid City Life -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-25 16:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979746%27 HTTP/1.1" 200 None
2026-03-25 16:36:05 [ayvens.it] INFO: Saving data for 1979746: {'auction_closing_time': 1774517400.0, 'created_time': 1774370041.502281, 'last_price_update_time': 1774456565.179517}
2026-03-25 16:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1979746') HTTP/1.1" 204 0
2026-03-25 16:36:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm1/492184fd70884deea40c7b73c7b31fbf/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:36:05 [ayvens.it] INFO: Found listing with ID: 1979747
2026-03-25 16:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979747%27 HTTP/1.1" 200 None
2026-03-25 16:36:05 [ayvens.it] INFO: Scrape type for 1979747: 2
2026-03-25 16:36:05 [ayvens.it] INFO: Extracting data for car ID: 1979747
2026-03-25 16:36:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c77e5459-e2b5-538c-871b-23b89632c540 with identifier: 1979747
2026-03-25 16:36:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c77e5459-e2b5-538c-871b-23b89632c540 with scrape type 2
2026-03-25 16:36:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c77e5459-e2b5-538c-871b-23b89632c540 with scrape type 2
2026-03-25 16:36:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: c77e5459-e2b5-538c-871b-23b89632c540, identifier: 1979747
2026-03-25 16:36:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm1/492184fd70884deea40c7b73c7b31fbf/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:36:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm1/492184fd70884deea40c7b73c7b31fbf/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:36:05 [scrapy.extensions.logstats] INFO: Crawled 21 pages (at 3 pages/min), scraped 245 items (at 111 items/min)
2026-03-25 16:36:05 [scrapy.extensions.memusage] INFO: Peak memory usage is 182MiB
2026-03-25 16:36:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: c77e5459-e2b5-538c-871b-23b89632c540 with identifier: 1979747
2026-03-25 16:36:05 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:36:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: c77e5459-e2b5-538c-871b-23b89632c540 with identifier: 1979747
2026-03-25 16:36:05 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: c77e5459-e2b5-538c-871b-23b89632c540 with identifier: 1979747 to the API
2026-03-25 16:36:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:36:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:36:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'EIGER GREY',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-26T09:30:00Z',
'fuel_type': 'diesel',
'id': 'c77e5459-e2b5-538c-871b-23b89632c540',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40968',
'listing': 'auction',
'location': None,
'make': 'LAND ROVER',
'model': 'LAND ROVER DISCOVERY SPORT 2.0 TD4 163cv SE 4WD aut. Sport utility '
'vehicle 5-door (Euro 6D)',
'odometer': 76554,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-09-22',
'seats_number': 5,
'seller_name': None,
'title': 'LAND ROVER LAND ROVER DISCOVERY SPORT 2.0 TD4 163cv SE 4WD aut. '
'Sport utility vehicle 5-door (Euro 6D) -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-25 16:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979747%27 HTTP/1.1" 200 None
2026-03-25 16:36:05 [ayvens.it] INFO: Saving data for 1979747: {'auction_closing_time': 1774517400.0, 'created_time': 1774370043.384423, 'last_price_update_time': 1774456565.640152}
2026-03-25 16:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1979747') HTTP/1.1" 204 0
2026-03-25 16:36:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:36:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dca219d0>
2026-03-25 16:36:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:36:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:36:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:36:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26b1193f-e118-54b6-8b74-27b4a9c6ffe3/26b1193f-e118-54b6-8b74-27b4a9c6ffe3_image_9.jpg HTTP/1.1" 201 0
2026-03-25 16:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj9%252Fd1d8bfde47a1408d85f60ec645375bff%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 16:36:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj9/d1d8bfde47a1408d85f60ec645375bff/images/large/10.jpg saved to cache
2026-03-25 16:36:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 26b1193f-e118-54b6-8b74-27b4a9c6ffe3
2026-03-25 16:36:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 26b1193f-e118-54b6-8b74-27b4a9c6ffe3, skipping ID generation
2026-03-25 16:36:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 26b1193f-e118-54b6-8b74-27b4a9c6ffe3 with scrape type 1
2026-03-25 16:36:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 26b1193f-e118-54b6-8b74-27b4a9c6ffe3 sending to next pipeline
2026-03-25 16:36:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 26b1193f-e118-54b6-8b74-27b4a9c6ffe3, identifier: 1983559
2026-03-25 16:36:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:36:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc9a4410>
2026-03-25 16:36:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:36:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:36:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:36:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f12ed7e7-f76c-5668-84c9-19e1fefd4177/f12ed7e7-f76c-5668-84c9-19e1fefd4177_image_7.jpg HTTP/1.1" 201 0
2026-03-25 16:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp0%252Fe3e09c04425f4cd7b932ca3a8a47e10c%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 16:36:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp0/e3e09c04425f4cd7b932ca3a8a47e10c/images/large/8.jpg saved to cache
2026-03-25 16:36:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f12ed7e7-f76c-5668-84c9-19e1fefd4177
2026-03-25 16:36:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:36:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc354b90>
2026-03-25 16:36:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:36:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:36:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:36:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f12ed7e7-f76c-5668-84c9-19e1fefd4177/f12ed7e7-f76c-5668-84c9-19e1fefd4177_image_8.jpg HTTP/1.1" 201 0
2026-03-25 16:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp0%252Fe3e09c04425f4cd7b932ca3a8a47e10c%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 16:36:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp0/e3e09c04425f4cd7b932ca3a8a47e10c/images/large/9.jpg saved to cache
2026-03-25 16:36:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f12ed7e7-f76c-5668-84c9-19e1fefd4177
2026-03-25 16:36:06 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f12ed7e7-f76c-5668-84c9-19e1fefd4177, skipping ID generation
2026-03-25 16:36:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f12ed7e7-f76c-5668-84c9-19e1fefd4177 with scrape type 1
2026-03-25 16:36:06 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f12ed7e7-f76c-5668-84c9-19e1fefd4177 sending to next pipeline
2026-03-25 16:36:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: f12ed7e7-f76c-5668-84c9-19e1fefd4177, identifier: 1983546
2026-03-25 16:36:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:36:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc940650>
2026-03-25 16:36:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:36:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:36:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:36:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0945dfc6-2df7-5464-9f57-8072d914912d/0945dfc6-2df7-5464-9f57-8072d914912d_image_6.jpg HTTP/1.1" 201 0
2026-03-25 16:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm1%252F492184fd70884deea40c7b73c7b31fbf%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 16:36:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm1/492184fd70884deea40c7b73c7b31fbf/images/large/7.jpg saved to cache
2026-03-25 16:36:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0945dfc6-2df7-5464-9f57-8072d914912d
2026-03-25 16:36:06 [ayvens.it] INFO: Found listing with ID: 1979748
2026-03-25 16:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979748%27 HTTP/1.1" 200 None
2026-03-25 16:36:06 [ayvens.it] INFO: Scrape type for 1979748: 0
2026-03-25 16:36:06 [ayvens.it] INFO: Found listing with ID: 1979749
2026-03-25 16:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979749%27 HTTP/1.1" 200 None
2026-03-25 16:36:06 [ayvens.it] INFO: Scrape type for 1979749: 0
2026-03-25 16:36:06 [ayvens.it] INFO: Found listing with ID: 1979750
2026-03-25 16:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979750%27 HTTP/1.1" 200 None
2026-03-25 16:36:06 [ayvens.it] INFO: Scrape type for 1979750: 2
2026-03-25 16:36:06 [ayvens.it] INFO: Extracting data for car ID: 1979750
2026-03-25 16:36:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 295ab22f-cbd6-5fa5-88a7-64a6633517b2 with identifier: 1979750
2026-03-25 16:36:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 295ab22f-cbd6-5fa5-88a7-64a6633517b2 with scrape type 2
2026-03-25 16:36:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 295ab22f-cbd6-5fa5-88a7-64a6633517b2 with scrape type 2
2026-03-25 16:36:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 295ab22f-cbd6-5fa5-88a7-64a6633517b2, identifier: 1979750
2026-03-25 16:36:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 26b1193f-e118-54b6-8b74-27b4a9c6ffe3 with identifier: 1983559
2026-03-25 16:36:06 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:36:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 26b1193f-e118-54b6-8b74-27b4a9c6ffe3 with identifier: 1983559
2026-03-25 16:36:06 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 26b1193f-e118-54b6-8b74-27b4a9c6ffe3 with identifier: 1983559 to the API
2026-03-25 16:36:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:36:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:36:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gj9/d1d8bfde47a1408d85f60ec645375bff/images/large/10.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Grigio Mangano metall',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-27T09:30:00Z',
'fuel_type': 'diesel',
'id': '26b1193f-e118-54b6-8b74-27b4a9c6ffe3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41025',
'listing': 'auction',
'location': None,
'make': 'VOLKSWAGEN',
'model': 'VOLKSWAGEN PASSAT Var. 2.0TDI SCR EVO 110kW Business DSG SW 5-door '
'(Euro 6.2)',
'odometer': 205060,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 19,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26b1193f-e118-54b6-8b74-27b4a9c6ffe3/26b1193f-e118-54b6-8b74-27b4a9c6ffe3_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 742299,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj9/d1d8bfde47a1408d85f60ec645375bff/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26b1193f-e118-54b6-8b74-27b4a9c6ffe3/26b1193f-e118-54b6-8b74-27b4a9c6ffe3_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 682011,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj9/d1d8bfde47a1408d85f60ec645375bff/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26b1193f-e118-54b6-8b74-27b4a9c6ffe3/26b1193f-e118-54b6-8b74-27b4a9c6ffe3_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 559394,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj9/d1d8bfde47a1408d85f60ec645375bff/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26b1193f-e118-54b6-8b74-27b4a9c6ffe3/26b1193f-e118-54b6-8b74-27b4a9c6ffe3_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 508478,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj9/d1d8bfde47a1408d85f60ec645375bff/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26b1193f-e118-54b6-8b74-27b4a9c6ffe3/26b1193f-e118-54b6-8b74-27b4a9c6ffe3_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 642971,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj9/d1d8bfde47a1408d85f60ec645375bff/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26b1193f-e118-54b6-8b74-27b4a9c6ffe3/26b1193f-e118-54b6-8b74-27b4a9c6ffe3_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 742299,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj9/d1d8bfde47a1408d85f60ec645375bff/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26b1193f-e118-54b6-8b74-27b4a9c6ffe3/26b1193f-e118-54b6-8b74-27b4a9c6ffe3_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 811679,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj9/d1d8bfde47a1408d85f60ec645375bff/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26b1193f-e118-54b6-8b74-27b4a9c6ffe3/26b1193f-e118-54b6-8b74-27b4a9c6ffe3_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 376198,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj9/d1d8bfde47a1408d85f60ec645375bff/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26b1193f-e118-54b6-8b74-27b4a9c6ffe3/26b1193f-e118-54b6-8b74-27b4a9c6ffe3_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 416413,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj9/d1d8bfde47a1408d85f60ec645375bff/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26b1193f-e118-54b6-8b74-27b4a9c6ffe3/26b1193f-e118-54b6-8b74-27b4a9c6ffe3_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 607627,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj9/d1d8bfde47a1408d85f60ec645375bff/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-01-19',
'seats_number': 5,
'seller_name': None,
'title': 'VOLKSWAGEN VOLKSWAGEN PASSAT Var. 2.0TDI SCR EVO 110kW Business DSG '
'SW 5-door (Euro 6.2) -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-25 16:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983559%27 HTTP/1.1" 200 None
2026-03-25 16:36:06 [ayvens.it] INFO: Saving data for 1983559: {'created_time': 1774456566.797841, 'last_price_update_time': 1774456566.797854, 'auction_closing_time': 1774603800.0}
2026-03-25 16:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1983559') HTTP/1.1" 204 0
2026-03-25 16:36:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: f12ed7e7-f76c-5668-84c9-19e1fefd4177 with identifier: 1983546
2026-03-25 16:36:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: f12ed7e7-f76c-5668-84c9-19e1fefd4177 with identifier: 1983546
2026-03-25 16:36:07 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: f12ed7e7-f76c-5668-84c9-19e1fefd4177 with identifier: 1983546 to the API
2026-03-25 16:36:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:36:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:36:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gp0/e3e09c04425f4cd7b932ca3a8a47e10c/images/large/9.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'BLUE CELEBES METALLIZZATO',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-27T09:30:00Z',
'fuel_type': 'diesel',
'id': 'f12ed7e7-f76c-5668-84c9-19e1fefd4177',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41025',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': 'PEUGEOT 5008 (PC) BLUEHDI 130 ALLURE EAT8 S/S AUT. FP',
'odometer': 173820,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f12ed7e7-f76c-5668-84c9-19e1fefd4177/f12ed7e7-f76c-5668-84c9-19e1fefd4177_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 878525,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp0/e3e09c04425f4cd7b932ca3a8a47e10c/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f12ed7e7-f76c-5668-84c9-19e1fefd4177/f12ed7e7-f76c-5668-84c9-19e1fefd4177_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 871135,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp0/e3e09c04425f4cd7b932ca3a8a47e10c/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f12ed7e7-f76c-5668-84c9-19e1fefd4177/f12ed7e7-f76c-5668-84c9-19e1fefd4177_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 878525,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp0/e3e09c04425f4cd7b932ca3a8a47e10c/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f12ed7e7-f76c-5668-84c9-19e1fefd4177/f12ed7e7-f76c-5668-84c9-19e1fefd4177_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 737903,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp0/e3e09c04425f4cd7b932ca3a8a47e10c/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f12ed7e7-f76c-5668-84c9-19e1fefd4177/f12ed7e7-f76c-5668-84c9-19e1fefd4177_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 794025,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp0/e3e09c04425f4cd7b932ca3a8a47e10c/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f12ed7e7-f76c-5668-84c9-19e1fefd4177/f12ed7e7-f76c-5668-84c9-19e1fefd4177_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 698179,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp0/e3e09c04425f4cd7b932ca3a8a47e10c/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f12ed7e7-f76c-5668-84c9-19e1fefd4177/f12ed7e7-f76c-5668-84c9-19e1fefd4177_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 506717,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp0/e3e09c04425f4cd7b932ca3a8a47e10c/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f12ed7e7-f76c-5668-84c9-19e1fefd4177/f12ed7e7-f76c-5668-84c9-19e1fefd4177_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 506717,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp0/e3e09c04425f4cd7b932ca3a8a47e10c/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f12ed7e7-f76c-5668-84c9-19e1fefd4177/f12ed7e7-f76c-5668-84c9-19e1fefd4177_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 694536,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp0/e3e09c04425f4cd7b932ca3a8a47e10c/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f12ed7e7-f76c-5668-84c9-19e1fefd4177/f12ed7e7-f76c-5668-84c9-19e1fefd4177_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 636066,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp0/e3e09c04425f4cd7b932ca3a8a47e10c/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-06-13',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT PEUGEOT 5008 (PC) BLUEHDI 130 ALLURE EAT8 S/S AUT. FP -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2023}
2026-03-25 16:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983546%27 HTTP/1.1" 200 None
2026-03-25 16:36:07 [ayvens.it] INFO: Saving data for 1983546: {'created_time': 1774456567.461829, 'last_price_update_time': 1774456567.461842, 'auction_closing_time': 1774603800.0}
2026-03-25 16:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1983546') HTTP/1.1" 204 0
2026-03-25 16:36:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm4/9b4b55c1b7ee46d697d2b2fe00705b84/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:36:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 295ab22f-cbd6-5fa5-88a7-64a6633517b2 with identifier: 1979750
2026-03-25 16:36:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 295ab22f-cbd6-5fa5-88a7-64a6633517b2 with identifier: 1979750
2026-03-25 16:36:07 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 295ab22f-cbd6-5fa5-88a7-64a6633517b2 with identifier: 1979750 to the API
2026-03-25 16:36:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:36:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:36:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'ARGENTO RIFLESSO MTZ',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-26T09:30:00Z',
'fuel_type': 'diesel',
'id': '295ab22f-cbd6-5fa5-88a7-64a6633517b2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40968',
'listing': 'auction',
'location': None,
'make': 'VOLKSWAGEN',
'model': 'VOLKSWAGEN TIGUAN (PC) 2.0 TDI SCR 110KW LIFE DSG FP',
'odometer': 190586,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-11-25',
'seats_number': 5,
'seller_name': None,
'title': 'VOLKSWAGEN VOLKSWAGEN TIGUAN (PC) 2.0 TDI SCR 110KW LIFE DSG FP -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-25 16:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979750%27 HTTP/1.1" 200 None
2026-03-25 16:36:07 [ayvens.it] INFO: Saving data for 1979750: {'auction_closing_time': 1774517400.0, 'created_time': 1774370107.585067, 'last_price_update_time': 1774456567.749826}
2026-03-25 16:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1979750') HTTP/1.1" 204 0
2026-03-25 16:36:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:36:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc941710>
2026-03-25 16:36:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:36:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:36:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:36:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0945dfc6-2df7-5464-9f57-8072d914912d/0945dfc6-2df7-5464-9f57-8072d914912d_image_4.jpg HTTP/1.1" 201 0
2026-03-25 16:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm1%252F492184fd70884deea40c7b73c7b31fbf%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 16:36:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm1/492184fd70884deea40c7b73c7b31fbf/images/large/5.jpg saved to cache
2026-03-25 16:36:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0945dfc6-2df7-5464-9f57-8072d914912d
2026-03-25 16:36:07 [ayvens.it] INFO: Found listing with ID: 1979751
2026-03-25 16:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979751%27 HTTP/1.1" 200 None
2026-03-25 16:36:07 [ayvens.it] INFO: Scrape type for 1979751: 2
2026-03-25 16:36:07 [ayvens.it] INFO: Extracting data for car ID: 1979751
2026-03-25 16:36:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9bb4ce70-2cda-5bdf-b6f5-1b4156b9b0cf with identifier: 1979751
2026-03-25 16:36:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9bb4ce70-2cda-5bdf-b6f5-1b4156b9b0cf with scrape type 2
2026-03-25 16:36:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9bb4ce70-2cda-5bdf-b6f5-1b4156b9b0cf with scrape type 2
2026-03-25 16:36:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 9bb4ce70-2cda-5bdf-b6f5-1b4156b9b0cf, identifier: 1979751
2026-03-25 16:36:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 9bb4ce70-2cda-5bdf-b6f5-1b4156b9b0cf with identifier: 1979751
2026-03-25 16:36:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 9bb4ce70-2cda-5bdf-b6f5-1b4156b9b0cf with identifier: 1979751
2026-03-25 16:36:08 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 9bb4ce70-2cda-5bdf-b6f5-1b4156b9b0cf with identifier: 1979751 to the API
2026-03-25 16:36:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:36:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:36:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Deep Black perla',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-26T09:30:00Z',
'fuel_type': 'diesel',
'id': '9bb4ce70-2cda-5bdf-b6f5-1b4156b9b0cf',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40968',
'listing': 'auction',
'location': None,
'make': 'VOLKSWAGEN',
'model': 'VOLKSWAGEN TIGUAN 2.0 TDI SCR 110KW Life DSG',
'odometer': 150070,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-01-23',
'seats_number': 5,
'seller_name': None,
'title': 'VOLKSWAGEN VOLKSWAGEN TIGUAN 2.0 TDI SCR 110KW Life DSG -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2023}
2026-03-25 16:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979751%27 HTTP/1.1" 200 None
2026-03-25 16:36:08 [ayvens.it] INFO: Saving data for 1979751: {'auction_closing_time': 1774517400.0, 'created_time': 1774370067.740269, 'last_price_update_time': 1774456568.438815}
2026-03-25 16:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1979751') HTTP/1.1" 204 0
2026-03-25 16:36:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:36:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc92c510>
2026-03-25 16:36:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:36:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:36:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:36:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0945dfc6-2df7-5464-9f57-8072d914912d/0945dfc6-2df7-5464-9f57-8072d914912d_image_5.jpg HTTP/1.1" 201 0
2026-03-25 16:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm1%252F492184fd70884deea40c7b73c7b31fbf%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 16:36:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm1/492184fd70884deea40c7b73c7b31fbf/images/large/6.jpg saved to cache
2026-03-25 16:36:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0945dfc6-2df7-5464-9f57-8072d914912d
2026-03-25 16:36:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:36:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34d74cc590>
2026-03-25 16:36:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:36:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:36:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:36:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0945dfc6-2df7-5464-9f57-8072d914912d/0945dfc6-2df7-5464-9f57-8072d914912d_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm1%252F492184fd70884deea40c7b73c7b31fbf%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 16:36:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm1/492184fd70884deea40c7b73c7b31fbf/images/large/1.jpg saved to cache
2026-03-25 16:36:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0945dfc6-2df7-5464-9f57-8072d914912d
2026-03-25 16:36:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0945dfc6-2df7-5464-9f57-8072d914912d, skipping ID generation
2026-03-25 16:36:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0945dfc6-2df7-5464-9f57-8072d914912d with scrape type 1
2026-03-25 16:36:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0945dfc6-2df7-5464-9f57-8072d914912d sending to next pipeline
2026-03-25 16:36:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 0945dfc6-2df7-5464-9f57-8072d914912d, identifier: 1983545
2026-03-25 16:36:08 [ayvens.it] INFO: Found listing with ID: 1979752
2026-03-25 16:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979752%27 HTTP/1.1" 200 None
2026-03-25 16:36:08 [ayvens.it] INFO: Scrape type for 1979752: 2
2026-03-25 16:36:08 [ayvens.it] INFO: Extracting data for car ID: 1979752
2026-03-25 16:36:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 96c6eee4-4097-5e2e-b42a-2d0e8d393346 with identifier: 1979752
2026-03-25 16:36:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 96c6eee4-4097-5e2e-b42a-2d0e8d393346 with scrape type 2
2026-03-25 16:36:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 96c6eee4-4097-5e2e-b42a-2d0e8d393346 with scrape type 2
2026-03-25 16:36:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 96c6eee4-4097-5e2e-b42a-2d0e8d393346, identifier: 1979752
2026-03-25 16:36:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 0945dfc6-2df7-5464-9f57-8072d914912d with identifier: 1983545
2026-03-25 16:36:08 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:36:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 0945dfc6-2df7-5464-9f57-8072d914912d with identifier: 1983545
2026-03-25 16:36:08 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 0945dfc6-2df7-5464-9f57-8072d914912d with identifier: 1983545 to the API
2026-03-25 16:36:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:36:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:36:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gm1/492184fd70884deea40c7b73c7b31fbf/images/large/1.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Bianco carrara metall',
'currency': 'EUR',
'doors_number': 4,
'engine': '',
'expiration_date': '2026-03-27T09:30:00Z',
'fuel_type': 'electric',
'id': '0945dfc6-2df7-5464-9f57-8072d914912d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41025',
'listing': 'auction',
'location': None,
'make': 'PORSCHE',
'model': 'PORSCHE TAYCAN 79kWh Coupé 4-door',
'odometer': 102149,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 25,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0945dfc6-2df7-5464-9f57-8072d914912d/0945dfc6-2df7-5464-9f57-8072d914912d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 749541,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm1/492184fd70884deea40c7b73c7b31fbf/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0945dfc6-2df7-5464-9f57-8072d914912d/0945dfc6-2df7-5464-9f57-8072d914912d_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 749541,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm1/492184fd70884deea40c7b73c7b31fbf/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0945dfc6-2df7-5464-9f57-8072d914912d/0945dfc6-2df7-5464-9f57-8072d914912d_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 730915,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm1/492184fd70884deea40c7b73c7b31fbf/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0945dfc6-2df7-5464-9f57-8072d914912d/0945dfc6-2df7-5464-9f57-8072d914912d_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 761649,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm1/492184fd70884deea40c7b73c7b31fbf/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0945dfc6-2df7-5464-9f57-8072d914912d/0945dfc6-2df7-5464-9f57-8072d914912d_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 700988,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm1/492184fd70884deea40c7b73c7b31fbf/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0945dfc6-2df7-5464-9f57-8072d914912d/0945dfc6-2df7-5464-9f57-8072d914912d_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 733130,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm1/492184fd70884deea40c7b73c7b31fbf/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0945dfc6-2df7-5464-9f57-8072d914912d/0945dfc6-2df7-5464-9f57-8072d914912d_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 711987,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm1/492184fd70884deea40c7b73c7b31fbf/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0945dfc6-2df7-5464-9f57-8072d914912d/0945dfc6-2df7-5464-9f57-8072d914912d_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 684202,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm1/492184fd70884deea40c7b73c7b31fbf/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0945dfc6-2df7-5464-9f57-8072d914912d/0945dfc6-2df7-5464-9f57-8072d914912d_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 720116,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm1/492184fd70884deea40c7b73c7b31fbf/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0945dfc6-2df7-5464-9f57-8072d914912d/0945dfc6-2df7-5464-9f57-8072d914912d_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 668057,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm1/492184fd70884deea40c7b73c7b31fbf/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-01-31',
'seats_number': 5,
'seller_name': None,
'title': 'PORSCHE PORSCHE TAYCAN 79kWh Coupé 4-door -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2023}
2026-03-25 16:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983545%27 HTTP/1.1" 200 None
2026-03-25 16:36:09 [ayvens.it] INFO: Saving data for 1983545: {'created_time': 1774456569.155304, 'last_price_update_time': 1774456569.155315, 'auction_closing_time': 1774603800.0}
2026-03-25 16:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1983545') HTTP/1.1" 204 0
2026-03-25 16:36:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 96c6eee4-4097-5e2e-b42a-2d0e8d393346 with identifier: 1979752
2026-03-25 16:36:09 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:36:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 96c6eee4-4097-5e2e-b42a-2d0e8d393346 with identifier: 1979752
2026-03-25 16:36:09 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 96c6eee4-4097-5e2e-b42a-2d0e8d393346 with identifier: 1979752 to the API
2026-03-25 16:36:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:36:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:36:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Frozen white pastello',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.5L',
'expiration_date': '2026-03-26T09:30:00Z',
'fuel_type': 'hybrid',
'id': '96c6eee4-4097-5e2e-b42a-2d0e8d393346',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40968',
'listing': 'auction',
'location': None,
'make': 'FORD',
'model': 'FORD KUGA 2.5 Benzina FHEV 190CV 2WD ST-Line X Aut Sport utility '
'vehicle 5-door (Euro 6.2)',
'odometer': 125557,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-01-20',
'seats_number': 5,
'seller_name': None,
'title': 'FORD FORD KUGA 2.5 Benzina FHEV 190CV 2WD ST-Line X Aut Sport '
'utility vehicle 5-door (Euro 6.2) -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2023}
2026-03-25 16:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979752%27 HTTP/1.1" 200 None
2026-03-25 16:36:09 [ayvens.it] INFO: Saving data for 1979752: {'auction_closing_time': 1774517400.0, 'created_time': 1774370064.145646, 'last_price_update_time': 1774456569.423179}
2026-03-25 16:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1979752') HTTP/1.1" 204 0
2026-03-25 16:36:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm4/9b4b55c1b7ee46d697d2b2fe00705b84/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:36:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm4/9b4b55c1b7ee46d697d2b2fe00705b84/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:36:09 [ayvens.it] INFO: Found listing with ID: 1979753
2026-03-25 16:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979753%27 HTTP/1.1" 200 None
2026-03-25 16:36:09 [ayvens.it] INFO: Scrape type for 1979753: 2
2026-03-25 16:36:09 [ayvens.it] INFO: Extracting data for car ID: 1979753
2026-03-25 16:36:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5e8e7627-842b-5407-a7e8-1d55ef161bd8 with identifier: 1979753
2026-03-25 16:36:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5e8e7627-842b-5407-a7e8-1d55ef161bd8 with scrape type 2
2026-03-25 16:36:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5e8e7627-842b-5407-a7e8-1d55ef161bd8 with scrape type 2
2026-03-25 16:36:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 5e8e7627-842b-5407-a7e8-1d55ef161bd8, identifier: 1979753
2026-03-25 16:36:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:36:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcd9f810>
2026-03-25 16:36:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:36:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:36:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:36:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_edf771e6-c374-5dcf-8d7b-3b45762549ba/edf771e6-c374-5dcf-8d7b-3b45762549ba_image_9.jpg HTTP/1.1" 201 0
2026-03-25 16:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm4%252F9b4b55c1b7ee46d697d2b2fe00705b84%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 16:36:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm4/9b4b55c1b7ee46d697d2b2fe00705b84/images/large/10.jpg saved to cache
2026-03-25 16:36:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item edf771e6-c374-5dcf-8d7b-3b45762549ba
2026-03-25 16:36:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm4/9b4b55c1b7ee46d697d2b2fe00705b84/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:36:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 5e8e7627-842b-5407-a7e8-1d55ef161bd8 with identifier: 1979753
2026-03-25 16:36:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 5e8e7627-842b-5407-a7e8-1d55ef161bd8 with identifier: 1979753
2026-03-25 16:36:09 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 5e8e7627-842b-5407-a7e8-1d55ef161bd8 with identifier: 1979753 to the API
2026-03-25 16:36:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:36:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:36:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'CHROME BLUE METALLIZZATO',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-26T09:30:00Z',
'fuel_type': 'hybrid',
'id': '5e8e7627-842b-5407-a7e8-1d55ef161bd8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40968',
'listing': 'auction',
'location': None,
'make': 'FORD',
'model': 'FORD FOCUS SW (PC) 1.0 ECOB. HYBR. 125CV ST-LINE DES.AUTOSW',
'odometer': 55914,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-06-29',
'seats_number': 5,
'seller_name': None,
'title': 'FORD FORD FOCUS SW (PC) 1.0 ECOB. HYBR. 125CV ST-LINE DES.AUTOSW -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2023}
2026-03-25 16:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979753%27 HTTP/1.1" 200 None
2026-03-25 16:36:09 [ayvens.it] INFO: Saving data for 1979753: {'auction_closing_time': 1774517400.0, 'created_time': 1774370051.059302, 'last_price_update_time': 1774456569.910588}
2026-03-25 16:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1979753') HTTP/1.1" 204 0
2026-03-25 16:36:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm4/9b4b55c1b7ee46d697d2b2fe00705b84/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:36:09 [ayvens.it] INFO: Found listing with ID: 1979754
2026-03-25 16:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979754%27 HTTP/1.1" 200 None
2026-03-25 16:36:09 [ayvens.it] INFO: Scrape type for 1979754: 2
2026-03-25 16:36:09 [ayvens.it] INFO: Extracting data for car ID: 1979754
2026-03-25 16:36:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4b6ee4c1-e67e-5316-9853-91ab939aebb6 with identifier: 1979754
2026-03-25 16:36:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4b6ee4c1-e67e-5316-9853-91ab939aebb6 with scrape type 2
2026-03-25 16:36:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4b6ee4c1-e67e-5316-9853-91ab939aebb6 with scrape type 2
2026-03-25 16:36:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 4b6ee4c1-e67e-5316-9853-91ab939aebb6, identifier: 1979754
2026-03-25 16:36:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk7/60ebaa7fe8c540359e0822b23b3a264e/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:36:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 4b6ee4c1-e67e-5316-9853-91ab939aebb6 with identifier: 1979754
2026-03-25 16:36:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 4b6ee4c1-e67e-5316-9853-91ab939aebb6 with identifier: 1979754
2026-03-25 16:36:10 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 4b6ee4c1-e67e-5316-9853-91ab939aebb6 with identifier: 1979754 to the API
2026-03-25 16:36:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:36:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:36:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'SUPER RED',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.8L',
'expiration_date': '2026-03-26T09:30:00Z',
'fuel_type': 'hybrid',
'id': '4b6ee4c1-e67e-5316-9853-91ab939aebb6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40968',
'listing': 'auction',
'location': None,
'make': 'TOYOTA',
'model': 'TOYOTA COROLLA SW N1 TS HYBRID BUSINESS TECH FP',
'odometer': 83571,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-01-28',
'seats_number': 5,
'seller_name': None,
'title': 'TOYOTA TOYOTA COROLLA SW N1 TS HYBRID BUSINESS TECH FP -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-25 16:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979754%27 HTTP/1.1" 200 None
2026-03-25 16:36:10 [ayvens.it] INFO: Saving data for 1979754: {'auction_closing_time': 1774517400.0, 'created_time': 1774370057.123342, 'last_price_update_time': 1774456570.258117}
2026-03-25 16:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1979754') HTTP/1.1" 204 0
2026-03-25 16:36:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk7/60ebaa7fe8c540359e0822b23b3a264e/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:36:10 [ayvens.it] INFO: Found listing with ID: 1979755
2026-03-25 16:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979755%27 HTTP/1.1" 200 None
2026-03-25 16:36:10 [ayvens.it] INFO: Scrape type for 1979755: 2
2026-03-25 16:36:10 [ayvens.it] INFO: Extracting data for car ID: 1979755
2026-03-25 16:36:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 74aae599-a965-5314-9169-3d35699ca227 with identifier: 1979755
2026-03-25 16:36:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 74aae599-a965-5314-9169-3d35699ca227 with scrape type 2
2026-03-25 16:36:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 74aae599-a965-5314-9169-3d35699ca227 with scrape type 2
2026-03-25 16:36:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 74aae599-a965-5314-9169-3d35699ca227, identifier: 1979755
2026-03-25 16:36:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 74aae599-a965-5314-9169-3d35699ca227 with identifier: 1979755
2026-03-25 16:36:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 74aae599-a965-5314-9169-3d35699ca227 with identifier: 1979755
2026-03-25 16:36:10 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 74aae599-a965-5314-9169-3d35699ca227 with identifier: 1979755 to the API
2026-03-25 16:36:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:36:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:36:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'GENERIC COLOR',
'currency': 'EUR',
'doors_number': 3,
'engine': '2.2L',
'expiration_date': '2026-03-26T09:30:00Z',
'fuel_type': 'diesel',
'id': '74aae599-a965-5314-9169-3d35699ca227',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40968',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': 'PEUGEOT BOXER 335 L3 2.2 BLUEHDI 140+FURG.+P.DX FP',
'odometer': 25,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2025-03-21',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT PEUGEOT BOXER 335 L3 2.2 BLUEHDI 140+FURG.+P.DX FP -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2025}
2026-03-25 16:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979755%27 HTTP/1.1" 200 None
2026-03-25 16:36:10 [ayvens.it] INFO: Saving data for 1979755: {'auction_closing_time': 1774517400.0, 'created_time': 1774370055.24618, 'last_price_update_time': 1774456570.638942}
2026-03-25 16:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1979755') HTTP/1.1" 204 0
2026-03-25 16:36:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:36:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc9447d0>
2026-03-25 16:36:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:36:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:36:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:36:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_edf771e6-c374-5dcf-8d7b-3b45762549ba/edf771e6-c374-5dcf-8d7b-3b45762549ba_image_7.jpg HTTP/1.1" 201 0
2026-03-25 16:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm4%252F9b4b55c1b7ee46d697d2b2fe00705b84%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 16:36:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm4/9b4b55c1b7ee46d697d2b2fe00705b84/images/large/8.jpg saved to cache
2026-03-25 16:36:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item edf771e6-c374-5dcf-8d7b-3b45762549ba
2026-03-25 16:36:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:36:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc355510>
2026-03-25 16:36:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:36:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:36:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:36:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_edf771e6-c374-5dcf-8d7b-3b45762549ba/edf771e6-c374-5dcf-8d7b-3b45762549ba_image_6.jpg HTTP/1.1" 201 0
2026-03-25 16:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm4%252F9b4b55c1b7ee46d697d2b2fe00705b84%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 16:36:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm4/9b4b55c1b7ee46d697d2b2fe00705b84/images/large/7.jpg saved to cache
2026-03-25 16:36:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item edf771e6-c374-5dcf-8d7b-3b45762549ba
2026-03-25 16:36:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:36:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc94eb10>
2026-03-25 16:36:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:36:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:36:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:36:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_edf771e6-c374-5dcf-8d7b-3b45762549ba/edf771e6-c374-5dcf-8d7b-3b45762549ba_image_8.jpg HTTP/1.1" 201 0
2026-03-25 16:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm4%252F9b4b55c1b7ee46d697d2b2fe00705b84%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 16:36:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm4/9b4b55c1b7ee46d697d2b2fe00705b84/images/large/9.jpg saved to cache
2026-03-25 16:36:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item edf771e6-c374-5dcf-8d7b-3b45762549ba
2026-03-25 16:36:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk7/60ebaa7fe8c540359e0822b23b3a264e/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:36:11 [ayvens.it] INFO: Found listing with ID: 1979756
2026-03-25 16:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979756%27 HTTP/1.1" 200 None
2026-03-25 16:36:11 [ayvens.it] INFO: Scrape type for 1979756: 2
2026-03-25 16:36:11 [ayvens.it] INFO: Extracting data for car ID: 1979756
2026-03-25 16:36:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e856ce68-1a31-5e29-b1a3-060989b7bdc5 with identifier: 1979756
2026-03-25 16:36:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e856ce68-1a31-5e29-b1a3-060989b7bdc5 with scrape type 2
2026-03-25 16:36:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e856ce68-1a31-5e29-b1a3-060989b7bdc5 with scrape type 2
2026-03-25 16:36:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: e856ce68-1a31-5e29-b1a3-060989b7bdc5, identifier: 1979756
2026-03-25 16:36:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm2/e029dc1663e944dba28903fe885c6924/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:36:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: e856ce68-1a31-5e29-b1a3-060989b7bdc5 with identifier: 1979756
2026-03-25 16:36:11 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:36:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: e856ce68-1a31-5e29-b1a3-060989b7bdc5 with identifier: 1979756
2026-03-25 16:36:11 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: e856ce68-1a31-5e29-b1a3-060989b7bdc5 with identifier: 1979756 to the API
2026-03-25 16:36:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:36:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:36:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'SUMMIT WHITE BRILLIANT',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-26T09:30:00Z',
'fuel_type': 'petrol',
'id': 'e856ce68-1a31-5e29-b1a3-060989b7bdc5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40968',
'listing': 'auction',
'location': None,
'make': 'OPEL',
'model': 'OPEL CROSSLAND X 1.2 130cv Innovation S&S AT6 Cross over 5-door '
'(Euro 6D)',
'odometer': 48774,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-07-27',
'seats_number': 5,
'seller_name': None,
'title': 'OPEL OPEL CROSSLAND X 1.2 130cv Innovation S&S AT6 Cross over '
'5-door (Euro 6D) -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2020}
2026-03-25 16:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979756%27 HTTP/1.1" 200 None
2026-03-25 16:36:11 [ayvens.it] INFO: Saving data for 1979756: {'auction_closing_time': 1774517400.0, 'created_time': 1774370056.330251, 'last_price_update_time': 1774456571.448906}
2026-03-25 16:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1979756') HTTP/1.1" 204 0
2026-03-25 16:36:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:36:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc58bd10>
2026-03-25 16:36:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:36:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:36:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:36:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_edf771e6-c374-5dcf-8d7b-3b45762549ba/edf771e6-c374-5dcf-8d7b-3b45762549ba_image_5.jpg HTTP/1.1" 201 0
2026-03-25 16:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm4%252F9b4b55c1b7ee46d697d2b2fe00705b84%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 16:36:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm4/9b4b55c1b7ee46d697d2b2fe00705b84/images/large/6.jpg saved to cache
2026-03-25 16:36:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item edf771e6-c374-5dcf-8d7b-3b45762549ba
2026-03-25 16:36:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: edf771e6-c374-5dcf-8d7b-3b45762549ba, skipping ID generation
2026-03-25 16:36:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item edf771e6-c374-5dcf-8d7b-3b45762549ba with scrape type 1
2026-03-25 16:36:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item edf771e6-c374-5dcf-8d7b-3b45762549ba sending to next pipeline
2026-03-25 16:36:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: edf771e6-c374-5dcf-8d7b-3b45762549ba, identifier: 1983544
2026-03-25 16:36:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:36:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc9298d0>
2026-03-25 16:36:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:36:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:36:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:36:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ebeabe6b-950d-5cfc-a056-e46d82352ba1/ebeabe6b-950d-5cfc-a056-e46d82352ba1_image_5.jpg HTTP/1.1" 201 0
2026-03-25 16:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk7%252F60ebaa7fe8c540359e0822b23b3a264e%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 16:36:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk7/60ebaa7fe8c540359e0822b23b3a264e/images/large/6.jpg saved to cache
2026-03-25 16:36:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ebeabe6b-950d-5cfc-a056-e46d82352ba1
2026-03-25 16:36:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:36:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcd9c450>
2026-03-25 16:36:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:36:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:36:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:36:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ebeabe6b-950d-5cfc-a056-e46d82352ba1/ebeabe6b-950d-5cfc-a056-e46d82352ba1_image_4.jpg HTTP/1.1" 201 0
2026-03-25 16:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk7%252F60ebaa7fe8c540359e0822b23b3a264e%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 16:36:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk7/60ebaa7fe8c540359e0822b23b3a264e/images/large/5.jpg saved to cache
2026-03-25 16:36:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ebeabe6b-950d-5cfc-a056-e46d82352ba1
2026-03-25 16:36:11 [ayvens.it] INFO: Found listing with ID: 1979757
2026-03-25 16:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979757%27 HTTP/1.1" 200 None
2026-03-25 16:36:11 [ayvens.it] INFO: Scrape type for 1979757: 2
2026-03-25 16:36:11 [ayvens.it] INFO: Extracting data for car ID: 1979757
2026-03-25 16:36:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 91c83730-6fc1-5118-99c5-29b5b988560b with identifier: 1979757
2026-03-25 16:36:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 91c83730-6fc1-5118-99c5-29b5b988560b with scrape type 2
2026-03-25 16:36:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 91c83730-6fc1-5118-99c5-29b5b988560b with scrape type 2
2026-03-25 16:36:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 91c83730-6fc1-5118-99c5-29b5b988560b, identifier: 1979757
2026-03-25 16:36:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: edf771e6-c374-5dcf-8d7b-3b45762549ba with identifier: 1983544
2026-03-25 16:36:11 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:36:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: edf771e6-c374-5dcf-8d7b-3b45762549ba with identifier: 1983544
2026-03-25 16:36:11 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: edf771e6-c374-5dcf-8d7b-3b45762549ba with identifier: 1983544 to the API
2026-03-25 16:36:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:36:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:36:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gm4/9b4b55c1b7ee46d697d2b2fe00705b84/images/large/6.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'DEEP BLACK PEARL',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-27T09:30:00Z',
'fuel_type': 'diesel',
'id': 'edf771e6-c374-5dcf-8d7b-3b45762549ba',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41025',
'listing': 'auction',
'location': None,
'make': 'VOLKSWAGEN',
'model': 'VOLKSWAGEN T-ROC (PC) 2.0 TDI SCR LIFE DSG FP',
'odometer': 155428,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 33,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_edf771e6-c374-5dcf-8d7b-3b45762549ba/edf771e6-c374-5dcf-8d7b-3b45762549ba_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 803474,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm4/9b4b55c1b7ee46d697d2b2fe00705b84/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_edf771e6-c374-5dcf-8d7b-3b45762549ba/edf771e6-c374-5dcf-8d7b-3b45762549ba_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 803474,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm4/9b4b55c1b7ee46d697d2b2fe00705b84/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_edf771e6-c374-5dcf-8d7b-3b45762549ba/edf771e6-c374-5dcf-8d7b-3b45762549ba_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 859595,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm4/9b4b55c1b7ee46d697d2b2fe00705b84/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_edf771e6-c374-5dcf-8d7b-3b45762549ba/edf771e6-c374-5dcf-8d7b-3b45762549ba_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 821621,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm4/9b4b55c1b7ee46d697d2b2fe00705b84/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_edf771e6-c374-5dcf-8d7b-3b45762549ba/edf771e6-c374-5dcf-8d7b-3b45762549ba_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 767963,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm4/9b4b55c1b7ee46d697d2b2fe00705b84/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_edf771e6-c374-5dcf-8d7b-3b45762549ba/edf771e6-c374-5dcf-8d7b-3b45762549ba_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 653368,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm4/9b4b55c1b7ee46d697d2b2fe00705b84/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_edf771e6-c374-5dcf-8d7b-3b45762549ba/edf771e6-c374-5dcf-8d7b-3b45762549ba_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 485877,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm4/9b4b55c1b7ee46d697d2b2fe00705b84/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_edf771e6-c374-5dcf-8d7b-3b45762549ba/edf771e6-c374-5dcf-8d7b-3b45762549ba_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 599589,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm4/9b4b55c1b7ee46d697d2b2fe00705b84/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_edf771e6-c374-5dcf-8d7b-3b45762549ba/edf771e6-c374-5dcf-8d7b-3b45762549ba_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 699101,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm4/9b4b55c1b7ee46d697d2b2fe00705b84/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_edf771e6-c374-5dcf-8d7b-3b45762549ba/edf771e6-c374-5dcf-8d7b-3b45762549ba_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 600049,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm4/9b4b55c1b7ee46d697d2b2fe00705b84/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-12-20',
'seats_number': 5,
'seller_name': None,
'title': 'VOLKSWAGEN VOLKSWAGEN T-ROC (PC) 2.0 TDI SCR LIFE DSG FP -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-25 16:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983544%27 HTTP/1.1" 200 None
2026-03-25 16:36:12 [ayvens.it] INFO: Saving data for 1983544: {'created_time': 1774456572.16478, 'last_price_update_time': 1774456572.164793, 'auction_closing_time': 1774603800.0}
2026-03-25 16:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1983544') HTTP/1.1" 204 0
2026-03-25 16:36:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 91c83730-6fc1-5118-99c5-29b5b988560b with identifier: 1979757
2026-03-25 16:36:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 91c83730-6fc1-5118-99c5-29b5b988560b with identifier: 1979757
2026-03-25 16:36:12 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 91c83730-6fc1-5118-99c5-29b5b988560b with identifier: 1979757 to the API
2026-03-25 16:36:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:36:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:36:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'r Comment',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-26T09:30:00Z',
'fuel_type': 'petrol',
'id': '91c83730-6fc1-5118-99c5-29b5b988560b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40968',
'listing': 'auction',
'location': None,
'make': 'SUZUKI',
'model': 'SUZUKI SX4 S-CROSS 1.0 Boosterjet 2WD Cool Sport utility vehicle '
'5-door (Euro 6.2)',
'odometer': 185159,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-02-21',
'seats_number': 5,
'seller_name': None,
'title': 'SUZUKI SUZUKI SX4 S-CROSS 1.0 Boosterjet 2WD Cool Sport utility '
'vehicle 5-door (Euro 6.2) -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2019}
2026-03-25 16:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979757%27 HTTP/1.1" 200 None
2026-03-25 16:36:12 [ayvens.it] INFO: Saving data for 1979757: {'auction_closing_time': 1774517400.0, 'created_time': 1774370059.229393, 'last_price_update_time': 1774456572.423223}
2026-03-25 16:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1979757') HTTP/1.1" 204 0
2026-03-25 16:36:12 [ayvens.it] INFO: Found listing with ID: 1979758
2026-03-25 16:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979758%27 HTTP/1.1" 200 None
2026-03-25 16:36:12 [ayvens.it] INFO: Scrape type for 1979758: 2
2026-03-25 16:36:12 [ayvens.it] INFO: Extracting data for car ID: 1979758
2026-03-25 16:36:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f978f14b-961f-563e-9630-405344a6a317 with identifier: 1979758
2026-03-25 16:36:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f978f14b-961f-563e-9630-405344a6a317 with scrape type 2
2026-03-25 16:36:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f978f14b-961f-563e-9630-405344a6a317 with scrape type 2
2026-03-25 16:36:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: f978f14b-961f-563e-9630-405344a6a317, identifier: 1979758
2026-03-25 16:36:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:36:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc787350>
2026-03-25 16:36:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:36:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:36:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:36:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ebeabe6b-950d-5cfc-a056-e46d82352ba1/ebeabe6b-950d-5cfc-a056-e46d82352ba1_image_3.jpg HTTP/1.1" 201 0
2026-03-25 16:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk7%252F60ebaa7fe8c540359e0822b23b3a264e%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 16:36:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk7/60ebaa7fe8c540359e0822b23b3a264e/images/large/4.jpg saved to cache
2026-03-25 16:36:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ebeabe6b-950d-5cfc-a056-e46d82352ba1
2026-03-25 16:36:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ebeabe6b-950d-5cfc-a056-e46d82352ba1, skipping ID generation
2026-03-25 16:36:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ebeabe6b-950d-5cfc-a056-e46d82352ba1 with scrape type 1
2026-03-25 16:36:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ebeabe6b-950d-5cfc-a056-e46d82352ba1 sending to next pipeline
2026-03-25 16:36:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: ebeabe6b-950d-5cfc-a056-e46d82352ba1, identifier: 1983542
2026-03-25 16:36:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:36:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dca96190>
2026-03-25 16:36:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:36:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:36:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:36:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e19f760-9e22-5009-a59c-17be54bc2a87/8e19f760-9e22-5009-a59c-17be54bc2a87_image_4.jpg HTTP/1.1" 201 0
2026-03-25 16:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm2%252Fe029dc1663e944dba28903fe885c6924%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 16:36:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm2/e029dc1663e944dba28903fe885c6924/images/large/5.jpg saved to cache
2026-03-25 16:36:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8e19f760-9e22-5009-a59c-17be54bc2a87
2026-03-25 16:36:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8e19f760-9e22-5009-a59c-17be54bc2a87, skipping ID generation
2026-03-25 16:36:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8e19f760-9e22-5009-a59c-17be54bc2a87 with scrape type 1
2026-03-25 16:36:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8e19f760-9e22-5009-a59c-17be54bc2a87 sending to next pipeline
2026-03-25 16:36:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 8e19f760-9e22-5009-a59c-17be54bc2a87, identifier: 1983543
2026-03-25 16:36:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj9/143635fb2f8c4029a7d15e1ce5340fc3/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:36:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj9/58500f54b0e64f9c8a573a8cc9ab2e77/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:36:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: f978f14b-961f-563e-9630-405344a6a317 with identifier: 1979758
2026-03-25 16:36:13 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:36:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: f978f14b-961f-563e-9630-405344a6a317 with identifier: 1979758
2026-03-25 16:36:13 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: f978f14b-961f-563e-9630-405344a6a317 with identifier: 1979758 to the API
2026-03-25 16:36:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:36:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:36:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'MINERAL WHITE SOLIDO',
'currency': 'EUR',
'doors_number': 4,
'engine': '1.5L',
'expiration_date': '2026-03-26T09:30:00Z',
'fuel_type': 'diesel',
'id': 'f978f14b-961f-563e-9630-405344a6a317',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40968',
'listing': 'auction',
'location': None,
'make': 'NISSAN',
'model': 'NISSAN NV250 1.5 dCi 115cv L2 Van Vettura Furgonata 4-door (Euro '
'6.2)',
'odometer': 112043,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-12-23',
'seats_number': 5,
'seller_name': None,
'title': 'NISSAN NISSAN NV250 1.5 dCi 115cv L2 Van Vettura Furgonata 4-door '
'(Euro 6.2) -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2021}
2026-03-25 16:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979758%27 HTTP/1.1" 200 None
2026-03-25 16:36:13 [ayvens.it] INFO: Saving data for 1979758: {'auction_closing_time': 1774517400.0, 'created_time': 1774370061.3404, 'last_price_update_time': 1774456573.319048}
2026-03-25 16:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1979758') HTTP/1.1" 204 0
2026-03-25 16:36:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: ebeabe6b-950d-5cfc-a056-e46d82352ba1 with identifier: 1983542
2026-03-25 16:36:13 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:36:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: ebeabe6b-950d-5cfc-a056-e46d82352ba1 with identifier: 1983542
2026-03-25 16:36:13 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: ebeabe6b-950d-5cfc-a056-e46d82352ba1 with identifier: 1983542 to the API
2026-03-25 16:36:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:36:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:36:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gk7/60ebaa7fe8c540359e0822b23b3a264e/images/large/4.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'GRIGIO NANO',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-27T09:30:00Z',
'fuel_type': 'diesel',
'id': 'ebeabe6b-950d-5cfc-a056-e46d82352ba1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41025',
'listing': 'auction',
'location': None,
'make': 'AUDI',
'model': 'AUDI Q3 35 TDI S tronic Sport utility vehicle 5-door (Euro 6D)',
'odometer': 72443,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 41,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ebeabe6b-950d-5cfc-a056-e46d82352ba1/ebeabe6b-950d-5cfc-a056-e46d82352ba1_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 597758,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk7/60ebaa7fe8c540359e0822b23b3a264e/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ebeabe6b-950d-5cfc-a056-e46d82352ba1/ebeabe6b-950d-5cfc-a056-e46d82352ba1_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 597758,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk7/60ebaa7fe8c540359e0822b23b3a264e/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ebeabe6b-950d-5cfc-a056-e46d82352ba1/ebeabe6b-950d-5cfc-a056-e46d82352ba1_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 565462,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk7/60ebaa7fe8c540359e0822b23b3a264e/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ebeabe6b-950d-5cfc-a056-e46d82352ba1/ebeabe6b-950d-5cfc-a056-e46d82352ba1_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 510659,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk7/60ebaa7fe8c540359e0822b23b3a264e/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ebeabe6b-950d-5cfc-a056-e46d82352ba1/ebeabe6b-950d-5cfc-a056-e46d82352ba1_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 557907,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk7/60ebaa7fe8c540359e0822b23b3a264e/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ebeabe6b-950d-5cfc-a056-e46d82352ba1/ebeabe6b-950d-5cfc-a056-e46d82352ba1_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 508730,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk7/60ebaa7fe8c540359e0822b23b3a264e/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ebeabe6b-950d-5cfc-a056-e46d82352ba1/ebeabe6b-950d-5cfc-a056-e46d82352ba1_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 520101,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk7/60ebaa7fe8c540359e0822b23b3a264e/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ebeabe6b-950d-5cfc-a056-e46d82352ba1/ebeabe6b-950d-5cfc-a056-e46d82352ba1_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 524942,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk7/60ebaa7fe8c540359e0822b23b3a264e/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ebeabe6b-950d-5cfc-a056-e46d82352ba1/ebeabe6b-950d-5cfc-a056-e46d82352ba1_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 492764,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk7/60ebaa7fe8c540359e0822b23b3a264e/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ebeabe6b-950d-5cfc-a056-e46d82352ba1/ebeabe6b-950d-5cfc-a056-e46d82352ba1_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 435489,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk7/60ebaa7fe8c540359e0822b23b3a264e/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-06-28',
'seats_number': 5,
'seller_name': None,
'title': 'AUDI AUDI Q3 35 TDI S tronic Sport utility vehicle 5-door (Euro 6D) '
'-',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-25 16:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983542%27 HTTP/1.1" 200 None
2026-03-25 16:36:13 [ayvens.it] INFO: Saving data for 1983542: {'created_time': 1774456573.678668, 'last_price_update_time': 1774456573.67868, 'auction_closing_time': 1774603800.0}
2026-03-25 16:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1983542') HTTP/1.1" 204 0
2026-03-25 16:36:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 8e19f760-9e22-5009-a59c-17be54bc2a87 with identifier: 1983543
2026-03-25 16:36:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 8e19f760-9e22-5009-a59c-17be54bc2a87 with identifier: 1983543
2026-03-25 16:36:13 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 8e19f760-9e22-5009-a59c-17be54bc2a87 with identifier: 1983543 to the API
2026-03-25 16:36:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:36:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:36:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gm2/e029dc1663e944dba28903fe885c6924/images/large/5.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'CHROME BLUE METALLIZZATO',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.1L',
'expiration_date': '2026-03-27T09:30:00Z',
'fuel_type': 'petrol',
'id': '8e19f760-9e22-5009-a59c-17be54bc2a87',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41025',
'listing': 'auction',
'location': None,
'make': 'FORD',
'model': 'FORD FIESTA (PC) 1.1 75CV TITANIUM FP',
'odometer': 56612,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 45,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e19f760-9e22-5009-a59c-17be54bc2a87/8e19f760-9e22-5009-a59c-17be54bc2a87_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 835506,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm2/e029dc1663e944dba28903fe885c6924/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e19f760-9e22-5009-a59c-17be54bc2a87/8e19f760-9e22-5009-a59c-17be54bc2a87_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 779968,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm2/e029dc1663e944dba28903fe885c6924/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e19f760-9e22-5009-a59c-17be54bc2a87/8e19f760-9e22-5009-a59c-17be54bc2a87_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 835506,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm2/e029dc1663e944dba28903fe885c6924/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e19f760-9e22-5009-a59c-17be54bc2a87/8e19f760-9e22-5009-a59c-17be54bc2a87_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 731509,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm2/e029dc1663e944dba28903fe885c6924/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e19f760-9e22-5009-a59c-17be54bc2a87/8e19f760-9e22-5009-a59c-17be54bc2a87_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 777880,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm2/e029dc1663e944dba28903fe885c6924/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e19f760-9e22-5009-a59c-17be54bc2a87/8e19f760-9e22-5009-a59c-17be54bc2a87_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 710604,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm2/e029dc1663e944dba28903fe885c6924/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e19f760-9e22-5009-a59c-17be54bc2a87/8e19f760-9e22-5009-a59c-17be54bc2a87_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 525101,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm2/e029dc1663e944dba28903fe885c6924/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e19f760-9e22-5009-a59c-17be54bc2a87/8e19f760-9e22-5009-a59c-17be54bc2a87_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 546071,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm2/e029dc1663e944dba28903fe885c6924/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e19f760-9e22-5009-a59c-17be54bc2a87/8e19f760-9e22-5009-a59c-17be54bc2a87_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 692728,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm2/e029dc1663e944dba28903fe885c6924/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e19f760-9e22-5009-a59c-17be54bc2a87/8e19f760-9e22-5009-a59c-17be54bc2a87_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 585945,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm2/e029dc1663e944dba28903fe885c6924/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-01-30',
'seats_number': 5,
'seller_name': None,
'title': 'FORD FORD FIESTA (PC) 1.1 75CV TITANIUM FP -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2023}
2026-03-25 16:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983543%27 HTTP/1.1" 200 None
2026-03-25 16:36:14 [ayvens.it] INFO: Saving data for 1983543: {'created_time': 1774456574.032888, 'last_price_update_time': 1774456574.032898, 'auction_closing_time': 1774603800.0}
2026-03-25 16:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1983543') HTTP/1.1" 204 0
2026-03-25 16:36:14 [ayvens.it] INFO: Found listing with ID: 1979759
2026-03-25 16:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979759%27 HTTP/1.1" 200 None
2026-03-25 16:36:14 [ayvens.it] INFO: Scrape type for 1979759: 2
2026-03-25 16:36:14 [ayvens.it] INFO: Extracting data for car ID: 1979759
2026-03-25 16:36:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 33d07540-f6c7-581b-a8dd-75316bc09b7a with identifier: 1979759
2026-03-25 16:36:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 33d07540-f6c7-581b-a8dd-75316bc09b7a with scrape type 2
2026-03-25 16:36:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 33d07540-f6c7-581b-a8dd-75316bc09b7a with scrape type 2
2026-03-25 16:36:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 33d07540-f6c7-581b-a8dd-75316bc09b7a, identifier: 1979759
2026-03-25 16:36:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 33d07540-f6c7-581b-a8dd-75316bc09b7a with identifier: 1979759
2026-03-25 16:36:14 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:36:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 33d07540-f6c7-581b-a8dd-75316bc09b7a with identifier: 1979759
2026-03-25 16:36:14 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 33d07540-f6c7-581b-a8dd-75316bc09b7a with identifier: 1979759 to the API
2026-03-25 16:36:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:36:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:36:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Bianco Frozen pastello',
'currency': 'EUR',
'doors_number': 4,
'engine': '1.5L',
'expiration_date': '2026-03-26T09:30:00Z',
'fuel_type': 'diesel',
'id': '33d07540-f6c7-581b-a8dd-75316bc09b7a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40968',
'listing': 'auction',
'location': None,
'make': 'FORD',
'model': 'FORD TRANSIT CONNECT 1.5 TDCi 100cv S&S Trend 210 L2H1 Vettura '
'Furgonata 4-door (Euro 6.2)',
'odometer': 177571,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-09-14',
'seats_number': 5,
'seller_name': None,
'title': 'FORD FORD TRANSIT CONNECT 1.5 TDCi 100cv S&S Trend 210 L2H1 Vettura '
'Furgonata 4-door (Euro 6.2) -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2021}
2026-03-25 16:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979759%27 HTTP/1.1" 200 None
2026-03-25 16:36:14 [ayvens.it] INFO: Saving data for 1979759: {'auction_closing_time': 1774517400.0, 'created_time': 1774370062.944988, 'last_price_update_time': 1774456574.389838}
2026-03-25 16:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1979759') HTTP/1.1" 204 0
2026-03-25 16:36:14 [ayvens.it] INFO: Found listing with ID: 1979760
2026-03-25 16:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979760%27 HTTP/1.1" 200 None
2026-03-25 16:36:14 [ayvens.it] INFO: Scrape type for 1979760: 2
2026-03-25 16:36:14 [ayvens.it] INFO: Extracting data for car ID: 1979760
2026-03-25 16:36:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7d600f53-8c6d-55fb-bf53-273adb4df12d with identifier: 1979760
2026-03-25 16:36:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7d600f53-8c6d-55fb-bf53-273adb4df12d with scrape type 2
2026-03-25 16:36:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7d600f53-8c6d-55fb-bf53-273adb4df12d with scrape type 2
2026-03-25 16:36:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 7d600f53-8c6d-55fb-bf53-273adb4df12d, identifier: 1979760
2026-03-25 16:36:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj9/143635fb2f8c4029a7d15e1ce5340fc3/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:36:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj9/143635fb2f8c4029a7d15e1ce5340fc3/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:36:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 7d600f53-8c6d-55fb-bf53-273adb4df12d with identifier: 1979760
2026-03-25 16:36:14 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:36:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 7d600f53-8c6d-55fb-bf53-273adb4df12d with identifier: 1979760
2026-03-25 16:36:14 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 7d600f53-8c6d-55fb-bf53-273adb4df12d with identifier: 1979760 to the API
2026-03-25 16:36:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:36:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:36:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'GLACIERSILBER MTZ',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-26T09:30:00Z',
'fuel_type': 'diesel',
'id': '7d600f53-8c6d-55fb-bf53-273adb4df12d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40968',
'listing': 'auction',
'location': None,
'make': 'BMW',
'model': 'BMW SERIES 3 SW 320D XDRIVE 48V BUS.ADV. TOURING AUT FP',
'odometer': 11943,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-08-26',
'seats_number': 5,
'seller_name': None,
'title': 'BMW BMW SERIES 3 SW 320D XDRIVE 48V BUS.ADV. TOURING AUT FP -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2021}
2026-03-25 16:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979760%27 HTTP/1.1" 200 None
2026-03-25 16:36:14 [ayvens.it] INFO: Saving data for 1979760: {'auction_closing_time': 1774517400.0, 'created_time': 1774370066.823231, 'last_price_update_time': 1774456574.781595}
2026-03-25 16:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1979760') HTTP/1.1" 204 0
2026-03-25 16:36:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:36:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc38ea90>
2026-03-25 16:36:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:36:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:36:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:36:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27d7a78c-5def-545b-b6d3-8c2262a0cd32/27d7a78c-5def-545b-b6d3-8c2262a0cd32_image_7.jpg HTTP/1.1" 201 0
2026-03-25 16:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj9%252F143635fb2f8c4029a7d15e1ce5340fc3%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 16:36:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj9/143635fb2f8c4029a7d15e1ce5340fc3/images/large/8.jpg saved to cache
2026-03-25 16:36:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 27d7a78c-5def-545b-b6d3-8c2262a0cd32
2026-03-25 16:36:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:36:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcc0b950>
2026-03-25 16:36:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:36:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:36:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:36:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45ed853b-25a6-5af4-afc2-4c9b6f8210ee/45ed853b-25a6-5af4-afc2-4c9b6f8210ee_image_6.jpg HTTP/1.1" 201 0
2026-03-25 16:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj9%252F58500f54b0e64f9c8a573a8cc9ab2e77%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 16:36:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj9/58500f54b0e64f9c8a573a8cc9ab2e77/images/large/7.jpg saved to cache
2026-03-25 16:36:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 45ed853b-25a6-5af4-afc2-4c9b6f8210ee
2026-03-25 16:36:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 45ed853b-25a6-5af4-afc2-4c9b6f8210ee, skipping ID generation
2026-03-25 16:36:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 45ed853b-25a6-5af4-afc2-4c9b6f8210ee with scrape type 1
2026-03-25 16:36:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 45ed853b-25a6-5af4-afc2-4c9b6f8210ee sending to next pipeline
2026-03-25 16:36:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 45ed853b-25a6-5af4-afc2-4c9b6f8210ee, identifier: 1983541
2026-03-25 16:36:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj9/143635fb2f8c4029a7d15e1ce5340fc3/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:36:15 [ayvens.it] INFO: Found listing with ID: 1979761
2026-03-25 16:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979761%27 HTTP/1.1" 200 None
2026-03-25 16:36:15 [ayvens.it] INFO: Scrape type for 1979761: 2
2026-03-25 16:36:15 [ayvens.it] INFO: Extracting data for car ID: 1979761
2026-03-25 16:36:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3c683476-1885-5b1e-bb12-b3c96362b1a2 with identifier: 1979761
2026-03-25 16:36:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3c683476-1885-5b1e-bb12-b3c96362b1a2 with scrape type 2
2026-03-25 16:36:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3c683476-1885-5b1e-bb12-b3c96362b1a2 with scrape type 2
2026-03-25 16:36:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 3c683476-1885-5b1e-bb12-b3c96362b1a2, identifier: 1979761
2026-03-25 16:36:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 45ed853b-25a6-5af4-afc2-4c9b6f8210ee with identifier: 1983541
2026-03-25 16:36:15 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:36:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 45ed853b-25a6-5af4-afc2-4c9b6f8210ee with identifier: 1983541
2026-03-25 16:36:15 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 45ed853b-25a6-5af4-afc2-4c9b6f8210ee with identifier: 1983541 to the API
2026-03-25 16:36:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:36:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:36:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gj9/58500f54b0e64f9c8a573a8cc9ab2e77/images/large/7.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Bianco ghiacciaio pastello',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-27T09:30:00Z',
'fuel_type': 'hybrid',
'id': '45ed853b-25a6-5af4-afc2-4c9b6f8210ee',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41025',
'listing': 'auction',
'location': None,
'make': 'VOLVO',
'model': 'VOLVO XC40 B4 AWD automatico Momentum Pro Sport utility vehicle '
'5-door (Euro 6D)',
'odometer': 68471,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 27,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45ed853b-25a6-5af4-afc2-4c9b6f8210ee/45ed853b-25a6-5af4-afc2-4c9b6f8210ee_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 597691,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj9/58500f54b0e64f9c8a573a8cc9ab2e77/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45ed853b-25a6-5af4-afc2-4c9b6f8210ee/45ed853b-25a6-5af4-afc2-4c9b6f8210ee_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 597691,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj9/58500f54b0e64f9c8a573a8cc9ab2e77/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45ed853b-25a6-5af4-afc2-4c9b6f8210ee/45ed853b-25a6-5af4-afc2-4c9b6f8210ee_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 561488,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj9/58500f54b0e64f9c8a573a8cc9ab2e77/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45ed853b-25a6-5af4-afc2-4c9b6f8210ee/45ed853b-25a6-5af4-afc2-4c9b6f8210ee_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 578340,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj9/58500f54b0e64f9c8a573a8cc9ab2e77/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45ed853b-25a6-5af4-afc2-4c9b6f8210ee/45ed853b-25a6-5af4-afc2-4c9b6f8210ee_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 635057,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj9/58500f54b0e64f9c8a573a8cc9ab2e77/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45ed853b-25a6-5af4-afc2-4c9b6f8210ee/45ed853b-25a6-5af4-afc2-4c9b6f8210ee_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 527370,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj9/58500f54b0e64f9c8a573a8cc9ab2e77/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45ed853b-25a6-5af4-afc2-4c9b6f8210ee/45ed853b-25a6-5af4-afc2-4c9b6f8210ee_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 555463,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj9/58500f54b0e64f9c8a573a8cc9ab2e77/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45ed853b-25a6-5af4-afc2-4c9b6f8210ee/45ed853b-25a6-5af4-afc2-4c9b6f8210ee_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 663364,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj9/58500f54b0e64f9c8a573a8cc9ab2e77/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45ed853b-25a6-5af4-afc2-4c9b6f8210ee/45ed853b-25a6-5af4-afc2-4c9b6f8210ee_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 518333,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj9/58500f54b0e64f9c8a573a8cc9ab2e77/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45ed853b-25a6-5af4-afc2-4c9b6f8210ee/45ed853b-25a6-5af4-afc2-4c9b6f8210ee_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 462269,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj9/58500f54b0e64f9c8a573a8cc9ab2e77/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-01-26',
'seats_number': 5,
'seller_name': None,
'title': 'VOLVO VOLVO XC40 B4 AWD automatico Momentum Pro Sport utility '
'vehicle 5-door (Euro 6D) -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-25 16:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983541%27 HTTP/1.1" 200 None
2026-03-25 16:36:15 [ayvens.it] INFO: Saving data for 1983541: {'created_time': 1774456575.539264, 'last_price_update_time': 1774456575.539274, 'auction_closing_time': 1774603800.0}
2026-03-25 16:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1983541') HTTP/1.1" 204 0
2026-03-25 16:36:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 3c683476-1885-5b1e-bb12-b3c96362b1a2 with identifier: 1979761
2026-03-25 16:36:15 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:36:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 3c683476-1885-5b1e-bb12-b3c96362b1a2 with identifier: 1979761
2026-03-25 16:36:15 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 3c683476-1885-5b1e-bb12-b3c96362b1a2 with identifier: 1979761 to the API
2026-03-25 16:36:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:36:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:36:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'GRIGIO TERRA METALLIZZATO',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-26T09:30:00Z',
'fuel_type': 'diesel',
'id': '3c683476-1885-5b1e-bb12-b3c96362b1a2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40968',
'listing': 'auction',
'location': None,
'make': 'AUDI',
'model': 'AUDI A4 SW 2.0 40 TDI QUAT. BUSINESS S TRONIC FP',
'odometer': 227665,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-02-11',
'seats_number': 5,
'seller_name': None,
'title': 'AUDI AUDI A4 SW 2.0 40 TDI QUAT. BUSINESS S TRONIC FP -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-25 16:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979761%27 HTTP/1.1" 200 None
2026-03-25 16:36:15 [ayvens.it] INFO: Saving data for 1979761: {'auction_closing_time': 1774517400.0, 'created_time': 1774370070.125314, 'last_price_update_time': 1774456575.883159}
2026-03-25 16:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1979761') HTTP/1.1" 204 0
2026-03-25 16:36:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj1/f1be48883f6047a2ad216a992130481c/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:36:15 [ayvens.it] INFO: Found listing with ID: 1979762
2026-03-25 16:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979762%27 HTTP/1.1" 200 None
2026-03-25 16:36:15 [ayvens.it] INFO: Scrape type for 1979762: 2
2026-03-25 16:36:15 [ayvens.it] INFO: Extracting data for car ID: 1979762
2026-03-25 16:36:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e39426ff-210f-5420-965e-466a686e6135 with identifier: 1979762
2026-03-25 16:36:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e39426ff-210f-5420-965e-466a686e6135 with scrape type 2
2026-03-25 16:36:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e39426ff-210f-5420-965e-466a686e6135 with scrape type 2
2026-03-25 16:36:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: e39426ff-210f-5420-965e-466a686e6135, identifier: 1979762
2026-03-25 16:36:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj1/f1be48883f6047a2ad216a992130481c/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:36:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: e39426ff-210f-5420-965e-466a686e6135 with identifier: 1979762
2026-03-25 16:36:16 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:36:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: e39426ff-210f-5420-965e-466a686e6135 with identifier: 1979762
2026-03-25 16:36:16 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: e39426ff-210f-5420-965e-466a686e6135 with identifier: 1979762 to the API
2026-03-25 16:36:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:36:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:36:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'HOT RED MTZ',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-26T09:30:00Z',
'fuel_type': 'diesel',
'id': 'e39426ff-210f-5420-965e-466a686e6135',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40968',
'listing': 'auction',
'location': None,
'make': 'OPEL',
'model': 'OPEL CROSSLAND (PC) 1.5 DIESEL 120CV ELEGANCE S&S AT6 FP',
'odometer': 170128,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-01-24',
'seats_number': 5,
'seller_name': None,
'title': 'OPEL OPEL CROSSLAND (PC) 1.5 DIESEL 120CV ELEGANCE S&S AT6 FP -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-25 16:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979762%27 HTTP/1.1" 200 None
2026-03-25 16:36:16 [ayvens.it] INFO: Saving data for 1979762: {'auction_closing_time': 1774517400.0, 'created_time': 1774370106.760699, 'last_price_update_time': 1774456576.252769}
2026-03-25 16:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1979762') HTTP/1.1" 204 0
2026-03-25 16:36:16 [ayvens.it] INFO: Found listing with ID: 1979763
2026-03-25 16:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979763%27 HTTP/1.1" 200 None
2026-03-25 16:36:16 [ayvens.it] INFO: Scrape type for 1979763: 2
2026-03-25 16:36:16 [ayvens.it] INFO: Extracting data for car ID: 1979763
2026-03-25 16:36:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3a84edd0-05fc-559c-bdfe-468e591abf29 with identifier: 1979763
2026-03-25 16:36:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3a84edd0-05fc-559c-bdfe-468e591abf29 with scrape type 2
2026-03-25 16:36:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3a84edd0-05fc-559c-bdfe-468e591abf29 with scrape type 2
2026-03-25 16:36:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 3a84edd0-05fc-559c-bdfe-468e591abf29, identifier: 1979763
2026-03-25 16:36:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:36:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcdd2ed0>
2026-03-25 16:36:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:36:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:36:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:36:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27d7a78c-5def-545b-b6d3-8c2262a0cd32/27d7a78c-5def-545b-b6d3-8c2262a0cd32_image_5.jpg HTTP/1.1" 201 0
2026-03-25 16:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj9%252F143635fb2f8c4029a7d15e1ce5340fc3%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 16:36:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj9/143635fb2f8c4029a7d15e1ce5340fc3/images/large/6.jpg saved to cache
2026-03-25 16:36:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 27d7a78c-5def-545b-b6d3-8c2262a0cd32
2026-03-25 16:36:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:36:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcc68a90>
2026-03-25 16:36:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:36:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:36:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:36:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27d7a78c-5def-545b-b6d3-8c2262a0cd32/27d7a78c-5def-545b-b6d3-8c2262a0cd32_image_6.jpg HTTP/1.1" 201 0
2026-03-25 16:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj9%252F143635fb2f8c4029a7d15e1ce5340fc3%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 16:36:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj9/143635fb2f8c4029a7d15e1ce5340fc3/images/large/7.jpg saved to cache
2026-03-25 16:36:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 27d7a78c-5def-545b-b6d3-8c2262a0cd32
2026-03-25 16:36:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:36:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34d74425d0>
2026-03-25 16:36:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:36:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:36:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:36:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27d7a78c-5def-545b-b6d3-8c2262a0cd32/27d7a78c-5def-545b-b6d3-8c2262a0cd32_image_4.jpg HTTP/1.1" 201 0
2026-03-25 16:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj9%252F143635fb2f8c4029a7d15e1ce5340fc3%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 16:36:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj9/143635fb2f8c4029a7d15e1ce5340fc3/images/large/5.jpg saved to cache
2026-03-25 16:36:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 27d7a78c-5def-545b-b6d3-8c2262a0cd32
2026-03-25 16:36:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 27d7a78c-5def-545b-b6d3-8c2262a0cd32, skipping ID generation
2026-03-25 16:36:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 27d7a78c-5def-545b-b6d3-8c2262a0cd32 with scrape type 1
2026-03-25 16:36:16 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 27d7a78c-5def-545b-b6d3-8c2262a0cd32 sending to next pipeline
2026-03-25 16:36:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 27d7a78c-5def-545b-b6d3-8c2262a0cd32, identifier: 1983540
2026-03-25 16:36:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj1/f1be48883f6047a2ad216a992130481c/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:36:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm1/a5b319b34ed74ba88bbc82ee979ca843/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:36:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 3a84edd0-05fc-559c-bdfe-468e591abf29 with identifier: 1979763
2026-03-25 16:36:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 3a84edd0-05fc-559c-bdfe-468e591abf29 with identifier: 1979763
2026-03-25 16:36:16 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 3a84edd0-05fc-559c-bdfe-468e591abf29 with identifier: 1979763 to the API
2026-03-25 16:36:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:36:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:36:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'BLU NAVARRA METALLIZZATO',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.4L',
'expiration_date': '2026-03-26T09:30:00Z',
'fuel_type': 'hybrid',
'id': '3a84edd0-05fc-559c-bdfe-468e591abf29',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40968',
'listing': 'auction',
'location': None,
'make': 'AUDI',
'model': 'AUDI Q3 SPORTBACK PC 45 TFSI E S TRONIC BUSINESS PLUS FP',
'odometer': 113288,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-08-16',
'seats_number': 5,
'seller_name': None,
'title': 'AUDI AUDI Q3 SPORTBACK PC 45 TFSI E S TRONIC BUSINESS PLUS FP -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-25 16:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979763%27 HTTP/1.1" 200 None
2026-03-25 16:36:16 [ayvens.it] INFO: Saving data for 1979763: {'auction_closing_time': 1774517400.0, 'created_time': 1774370099.120973, 'last_price_update_time': 1774456576.965047}
2026-03-25 16:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1979763') HTTP/1.1" 204 0
2026-03-25 16:36:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 27d7a78c-5def-545b-b6d3-8c2262a0cd32 with identifier: 1983540
2026-03-25 16:36:16 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:36:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 27d7a78c-5def-545b-b6d3-8c2262a0cd32 with identifier: 1983540
2026-03-25 16:36:17 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 27d7a78c-5def-545b-b6d3-8c2262a0cd32 with identifier: 1983540 to the API
2026-03-25 16:36:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:36:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:36:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gj9/143635fb2f8c4029a7d15e1ce5340fc3/images/large/5.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'MAGNETIC GREY',
'currency': 'EUR',
'doors_number': 4,
'engine': '2.0L',
'expiration_date': '2026-03-27T09:30:00Z',
'fuel_type': 'diesel',
'id': '27d7a78c-5def-545b-b6d3-8c2262a0cd32',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41025',
'listing': 'auction',
'location': None,
'make': 'FORD',
'model': 'FORD TRANSIT CUSTOM 320 L1H1 Trend 2.0 EcoBlue 170 Cv Auto Combi '
'4-door (Euro 6.2)',
'odometer': 38445,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 31,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27d7a78c-5def-545b-b6d3-8c2262a0cd32/27d7a78c-5def-545b-b6d3-8c2262a0cd32_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 677114,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj9/143635fb2f8c4029a7d15e1ce5340fc3/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27d7a78c-5def-545b-b6d3-8c2262a0cd32/27d7a78c-5def-545b-b6d3-8c2262a0cd32_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 677114,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj9/143635fb2f8c4029a7d15e1ce5340fc3/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27d7a78c-5def-545b-b6d3-8c2262a0cd32/27d7a78c-5def-545b-b6d3-8c2262a0cd32_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 789857,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj9/143635fb2f8c4029a7d15e1ce5340fc3/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27d7a78c-5def-545b-b6d3-8c2262a0cd32/27d7a78c-5def-545b-b6d3-8c2262a0cd32_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 713883,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj9/143635fb2f8c4029a7d15e1ce5340fc3/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27d7a78c-5def-545b-b6d3-8c2262a0cd32/27d7a78c-5def-545b-b6d3-8c2262a0cd32_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 697565,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj9/143635fb2f8c4029a7d15e1ce5340fc3/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27d7a78c-5def-545b-b6d3-8c2262a0cd32/27d7a78c-5def-545b-b6d3-8c2262a0cd32_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 656539,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj9/143635fb2f8c4029a7d15e1ce5340fc3/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27d7a78c-5def-545b-b6d3-8c2262a0cd32/27d7a78c-5def-545b-b6d3-8c2262a0cd32_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 664281,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj9/143635fb2f8c4029a7d15e1ce5340fc3/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27d7a78c-5def-545b-b6d3-8c2262a0cd32/27d7a78c-5def-545b-b6d3-8c2262a0cd32_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 554148,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj9/143635fb2f8c4029a7d15e1ce5340fc3/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27d7a78c-5def-545b-b6d3-8c2262a0cd32/27d7a78c-5def-545b-b6d3-8c2262a0cd32_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 663708,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj9/143635fb2f8c4029a7d15e1ce5340fc3/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27d7a78c-5def-545b-b6d3-8c2262a0cd32/27d7a78c-5def-545b-b6d3-8c2262a0cd32_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 562891,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj9/143635fb2f8c4029a7d15e1ce5340fc3/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-02-15',
'seats_number': 5,
'seller_name': None,
'title': 'FORD FORD TRANSIT CUSTOM 320 L1H1 Trend 2.0 EcoBlue 170 Cv Auto '
'Combi 4-door (Euro 6.2) -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-25 16:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983540%27 HTTP/1.1" 200 None
2026-03-25 16:36:17 [ayvens.it] INFO: Saving data for 1983540: {'created_time': 1774456577.400206, 'last_price_update_time': 1774456577.400217, 'auction_closing_time': 1774603800.0}
2026-03-25 16:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1983540') HTTP/1.1" 204 0
2026-03-25 16:36:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm1/a5b319b34ed74ba88bbc82ee979ca843/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:36:17 [ayvens.it] INFO: Fetching listings with token: 3b2cc62fd26c4e29a762db3de181266b and skip: 300
2026-03-25 16:36:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:36:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc57ad50>
2026-03-25 16:36:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:36:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:36:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:36:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_483367a7-9424-5972-b06a-1bbfe0906820/483367a7-9424-5972-b06a-1bbfe0906820_image_6.jpg HTTP/1.1" 201 0
2026-03-25 16:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj1%252Ff1be48883f6047a2ad216a992130481c%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 16:36:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj1/f1be48883f6047a2ad216a992130481c/images/large/7.jpg saved to cache
2026-03-25 16:36:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 483367a7-9424-5972-b06a-1bbfe0906820
2026-03-25 16:36:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:36:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dca9e650>
2026-03-25 16:36:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:36:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:36:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:36:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_483367a7-9424-5972-b06a-1bbfe0906820/483367a7-9424-5972-b06a-1bbfe0906820_image_5.jpg HTTP/1.1" 201 0
2026-03-25 16:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj1%252Ff1be48883f6047a2ad216a992130481c%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 16:36:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj1/f1be48883f6047a2ad216a992130481c/images/large/6.jpg saved to cache
2026-03-25 16:36:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 483367a7-9424-5972-b06a-1bbfe0906820
2026-03-25 16:36:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh2/fa34f88aad8942da835070feaf318c10/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:36:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-25 16:36:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:36:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34de1611d0>
2026-03-25 16:36:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:36:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:36:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:36:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_483367a7-9424-5972-b06a-1bbfe0906820/483367a7-9424-5972-b06a-1bbfe0906820_image_4.jpg HTTP/1.1" 201 0
2026-03-25 16:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj1%252Ff1be48883f6047a2ad216a992130481c%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 16:36:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj1/f1be48883f6047a2ad216a992130481c/images/large/5.jpg saved to cache
2026-03-25 16:36:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 483367a7-9424-5972-b06a-1bbfe0906820
2026-03-25 16:36:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 483367a7-9424-5972-b06a-1bbfe0906820, skipping ID generation
2026-03-25 16:36:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 483367a7-9424-5972-b06a-1bbfe0906820 with scrape type 1
2026-03-25 16:36:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 483367a7-9424-5972-b06a-1bbfe0906820 sending to next pipeline
2026-03-25 16:36:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 483367a7-9424-5972-b06a-1bbfe0906820, identifier: 1983539
2026-03-25 16:36:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:36:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34d7dad6d0>
2026-03-25 16:36:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:36:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:36:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:36:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_03db467f-43df-5654-99f7-934086cbc3af/03db467f-43df-5654-99f7-934086cbc3af_image_8.jpg HTTP/1.1" 201 0
2026-03-25 16:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm1%252Fa5b319b34ed74ba88bbc82ee979ca843%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 16:36:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm1/a5b319b34ed74ba88bbc82ee979ca843/images/large/9.jpg saved to cache
2026-03-25 16:36:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 03db467f-43df-5654-99f7-934086cbc3af
2026-03-25 16:36:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:36:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc54f850>
2026-03-25 16:36:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:36:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:36:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:36:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_03db467f-43df-5654-99f7-934086cbc3af/03db467f-43df-5654-99f7-934086cbc3af_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm1%252Fa5b319b34ed74ba88bbc82ee979ca843%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 16:36:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm1/a5b319b34ed74ba88bbc82ee979ca843/images/large/1.jpg saved to cache
2026-03-25 16:36:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 03db467f-43df-5654-99f7-934086cbc3af
2026-03-25 16:36:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 03db467f-43df-5654-99f7-934086cbc3af, skipping ID generation
2026-03-25 16:36:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 03db467f-43df-5654-99f7-934086cbc3af with scrape type 1
2026-03-25 16:36:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 03db467f-43df-5654-99f7-934086cbc3af sending to next pipeline
2026-03-25 16:36:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 03db467f-43df-5654-99f7-934086cbc3af, identifier: 1983537
2026-03-25 16:36:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm2/366ce01643ef4f14ad5c9a03d4b2e727/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:36:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 483367a7-9424-5972-b06a-1bbfe0906820 with identifier: 1983539
2026-03-25 16:36:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 483367a7-9424-5972-b06a-1bbfe0906820 with identifier: 1983539
2026-03-25 16:36:18 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 483367a7-9424-5972-b06a-1bbfe0906820 with identifier: 1983539 to the API
2026-03-25 16:36:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:36:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:36:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gj1/f1be48883f6047a2ad216a992130481c/images/large/5.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'SCHWARZ PASTELLO',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-27T09:30:00Z',
'fuel_type': 'diesel',
'id': '483367a7-9424-5972-b06a-1bbfe0906820',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41025',
'listing': 'auction',
'location': None,
'make': 'BMW',
'model': 'BMW SERIES 3 SW 320D XDRIVE 48V BUS.ADV. TOURING AUT FP',
'odometer': 130806,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 35,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_483367a7-9424-5972-b06a-1bbfe0906820/483367a7-9424-5972-b06a-1bbfe0906820_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 813113,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj1/f1be48883f6047a2ad216a992130481c/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_483367a7-9424-5972-b06a-1bbfe0906820/483367a7-9424-5972-b06a-1bbfe0906820_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 813113,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj1/f1be48883f6047a2ad216a992130481c/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_483367a7-9424-5972-b06a-1bbfe0906820/483367a7-9424-5972-b06a-1bbfe0906820_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 747896,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj1/f1be48883f6047a2ad216a992130481c/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_483367a7-9424-5972-b06a-1bbfe0906820/483367a7-9424-5972-b06a-1bbfe0906820_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 673928,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj1/f1be48883f6047a2ad216a992130481c/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_483367a7-9424-5972-b06a-1bbfe0906820/483367a7-9424-5972-b06a-1bbfe0906820_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 737261,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj1/f1be48883f6047a2ad216a992130481c/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_483367a7-9424-5972-b06a-1bbfe0906820/483367a7-9424-5972-b06a-1bbfe0906820_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 617099,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj1/f1be48883f6047a2ad216a992130481c/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_483367a7-9424-5972-b06a-1bbfe0906820/483367a7-9424-5972-b06a-1bbfe0906820_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 625152,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj1/f1be48883f6047a2ad216a992130481c/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_483367a7-9424-5972-b06a-1bbfe0906820/483367a7-9424-5972-b06a-1bbfe0906820_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 528673,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj1/f1be48883f6047a2ad216a992130481c/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_483367a7-9424-5972-b06a-1bbfe0906820/483367a7-9424-5972-b06a-1bbfe0906820_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 682413,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj1/f1be48883f6047a2ad216a992130481c/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_483367a7-9424-5972-b06a-1bbfe0906820/483367a7-9424-5972-b06a-1bbfe0906820_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 639948,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj1/f1be48883f6047a2ad216a992130481c/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-01-17',
'seats_number': 5,
'seller_name': None,
'title': 'BMW BMW SERIES 3 SW 320D XDRIVE 48V BUS.ADV. TOURING AUT FP -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-25 16:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983539%27 HTTP/1.1" 200 None
2026-03-25 16:36:18 [ayvens.it] INFO: Saving data for 1983539: {'created_time': 1774456578.546162, 'last_price_update_time': 1774456578.546172, 'auction_closing_time': 1774603800.0}
2026-03-25 16:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1983539') HTTP/1.1" 204 0
2026-03-25 16:36:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 03db467f-43df-5654-99f7-934086cbc3af with identifier: 1983537
2026-03-25 16:36:18 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:36:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 03db467f-43df-5654-99f7-934086cbc3af with identifier: 1983537
2026-03-25 16:36:18 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 03db467f-43df-5654-99f7-934086cbc3af with identifier: 1983537 to the API
2026-03-25 16:36:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:36:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:36:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gm1/a5b319b34ed74ba88bbc82ee979ca843/images/large/1.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'GRIGIO SELENITE METALLIZZATO',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-27T09:30:00Z',
'fuel_type': 'diesel',
'id': '03db467f-43df-5654-99f7-934086cbc3af',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41025',
'listing': 'auction',
'location': None,
'make': 'MERCEDES-BENZ',
'model': 'MERCEDES C-CLASS SW (PC) 220D MILD HYBRID BUSINESS EXTRA AUTO SW',
'odometer': 111872,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 33,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03db467f-43df-5654-99f7-934086cbc3af/03db467f-43df-5654-99f7-934086cbc3af_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 527610,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm1/a5b319b34ed74ba88bbc82ee979ca843/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03db467f-43df-5654-99f7-934086cbc3af/03db467f-43df-5654-99f7-934086cbc3af_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 527610,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm1/a5b319b34ed74ba88bbc82ee979ca843/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03db467f-43df-5654-99f7-934086cbc3af/03db467f-43df-5654-99f7-934086cbc3af_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 510905,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm1/a5b319b34ed74ba88bbc82ee979ca843/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03db467f-43df-5654-99f7-934086cbc3af/03db467f-43df-5654-99f7-934086cbc3af_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 605536,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm1/a5b319b34ed74ba88bbc82ee979ca843/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03db467f-43df-5654-99f7-934086cbc3af/03db467f-43df-5654-99f7-934086cbc3af_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 555206,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm1/a5b319b34ed74ba88bbc82ee979ca843/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03db467f-43df-5654-99f7-934086cbc3af/03db467f-43df-5654-99f7-934086cbc3af_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 379986,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm1/a5b319b34ed74ba88bbc82ee979ca843/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03db467f-43df-5654-99f7-934086cbc3af/03db467f-43df-5654-99f7-934086cbc3af_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 388781,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm1/a5b319b34ed74ba88bbc82ee979ca843/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03db467f-43df-5654-99f7-934086cbc3af/03db467f-43df-5654-99f7-934086cbc3af_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 369741,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm1/a5b319b34ed74ba88bbc82ee979ca843/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03db467f-43df-5654-99f7-934086cbc3af/03db467f-43df-5654-99f7-934086cbc3af_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 431610,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm1/a5b319b34ed74ba88bbc82ee979ca843/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03db467f-43df-5654-99f7-934086cbc3af/03db467f-43df-5654-99f7-934086cbc3af_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 352959,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm1/a5b319b34ed74ba88bbc82ee979ca843/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-02-27',
'seats_number': 5,
'seller_name': None,
'title': 'MERCEDES-BENZ MERCEDES C-CLASS SW (PC) 220D MILD HYBRID BUSINESS '
'EXTRA AUTO SW -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2023}
2026-03-25 16:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983537%27 HTTP/1.1" 200 None
2026-03-25 16:36:18 [ayvens.it] INFO: Saving data for 1983537: {'created_time': 1774456578.902041, 'last_price_update_time': 1774456578.902053, 'auction_closing_time': 1774603800.0}
2026-03-25 16:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1983537') HTTP/1.1" 204 0
2026-03-25 16:36:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm2/366ce01643ef4f14ad5c9a03d4b2e727/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:36:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh2/fa34f88aad8942da835070feaf318c10/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:36:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:36:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc64be90>
2026-03-25 16:36:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:36:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:36:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:36:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75bec01e-91fa-50ed-ad7e-b7c43b81a0f6/75bec01e-91fa-50ed-ad7e-b7c43b81a0f6_image_9.jpg HTTP/1.1" 201 0
2026-03-25 16:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh2%252Ffa34f88aad8942da835070feaf318c10%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 16:36:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh2/fa34f88aad8942da835070feaf318c10/images/large/10.jpg saved to cache
2026-03-25 16:36:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 75bec01e-91fa-50ed-ad7e-b7c43b81a0f6
2026-03-25 16:36:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj6/711f6153f8b540088cd306cb3f7e4a30/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:36:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:36:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc54c0d0>
2026-03-25 16:36:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:36:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:36:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:36:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fdd0122e-d0e5-564b-894a-8b39d1a44fd3/fdd0122e-d0e5-564b-894a-8b39d1a44fd3_image_7.jpg HTTP/1.1" 201 0
2026-03-25 16:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm2%252F366ce01643ef4f14ad5c9a03d4b2e727%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 16:36:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm2/366ce01643ef4f14ad5c9a03d4b2e727/images/large/8.jpg saved to cache
2026-03-25 16:36:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item fdd0122e-d0e5-564b-894a-8b39d1a44fd3
2026-03-25 16:36:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:36:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc366590>
2026-03-25 16:36:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:36:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:36:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:36:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fdd0122e-d0e5-564b-894a-8b39d1a44fd3/fdd0122e-d0e5-564b-894a-8b39d1a44fd3_image_8.jpg HTTP/1.1" 201 0
2026-03-25 16:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm2%252F366ce01643ef4f14ad5c9a03d4b2e727%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 16:36:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm2/366ce01643ef4f14ad5c9a03d4b2e727/images/large/9.jpg saved to cache
2026-03-25 16:36:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item fdd0122e-d0e5-564b-894a-8b39d1a44fd3
2026-03-25 16:36:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fdd0122e-d0e5-564b-894a-8b39d1a44fd3, skipping ID generation
2026-03-25 16:36:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fdd0122e-d0e5-564b-894a-8b39d1a44fd3 with scrape type 1
2026-03-25 16:36:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fdd0122e-d0e5-564b-894a-8b39d1a44fd3 sending to next pipeline
2026-03-25 16:36:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: fdd0122e-d0e5-564b-894a-8b39d1a44fd3, identifier: 1983536
2026-03-25 16:36:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:36:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc9e45d0>
2026-03-25 16:36:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:36:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:36:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:36:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75bec01e-91fa-50ed-ad7e-b7c43b81a0f6/75bec01e-91fa-50ed-ad7e-b7c43b81a0f6_image_8.jpg HTTP/1.1" 201 0
2026-03-25 16:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh2%252Ffa34f88aad8942da835070feaf318c10%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 16:36:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh2/fa34f88aad8942da835070feaf318c10/images/large/9.jpg saved to cache
2026-03-25 16:36:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 75bec01e-91fa-50ed-ad7e-b7c43b81a0f6
2026-03-25 16:36:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 75bec01e-91fa-50ed-ad7e-b7c43b81a0f6, skipping ID generation
2026-03-25 16:36:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 75bec01e-91fa-50ed-ad7e-b7c43b81a0f6 with scrape type 1
2026-03-25 16:36:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 75bec01e-91fa-50ed-ad7e-b7c43b81a0f6 sending to next pipeline
2026-03-25 16:36:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 75bec01e-91fa-50ed-ad7e-b7c43b81a0f6, identifier: 1983535
2026-03-25 16:36:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: fdd0122e-d0e5-564b-894a-8b39d1a44fd3 with identifier: 1983536
2026-03-25 16:36:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: fdd0122e-d0e5-564b-894a-8b39d1a44fd3 with identifier: 1983536
2026-03-25 16:36:19 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: fdd0122e-d0e5-564b-894a-8b39d1a44fd3 with identifier: 1983536 to the API
2026-03-25 16:36:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:36:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:36:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gm2/366ce01643ef4f14ad5c9a03d4b2e727/images/large/9.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'BIANCO PASTELLO',
'currency': 'EUR',
'doors_number': 3,
'engine': '1.6L',
'expiration_date': '2026-03-27T09:30:00Z',
'fuel_type': 'diesel',
'id': 'fdd0122e-d0e5-564b-894a-8b39d1a44fd3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41025',
'listing': 'auction',
'location': None,
'make': 'FIAT',
'model': 'FIAT DOBLÃ’ CARGO CH1 LOUNGE 1.6 Mjet 105cv E6D-f N1 Combi 5-door '
'(Euro 6D)',
'odometer': 165494,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 39,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fdd0122e-d0e5-564b-894a-8b39d1a44fd3/fdd0122e-d0e5-564b-894a-8b39d1a44fd3_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 590297,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm2/366ce01643ef4f14ad5c9a03d4b2e727/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fdd0122e-d0e5-564b-894a-8b39d1a44fd3/fdd0122e-d0e5-564b-894a-8b39d1a44fd3_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 584730,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm2/366ce01643ef4f14ad5c9a03d4b2e727/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fdd0122e-d0e5-564b-894a-8b39d1a44fd3/fdd0122e-d0e5-564b-894a-8b39d1a44fd3_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 590297,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm2/366ce01643ef4f14ad5c9a03d4b2e727/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fdd0122e-d0e5-564b-894a-8b39d1a44fd3/fdd0122e-d0e5-564b-894a-8b39d1a44fd3_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 600626,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm2/366ce01643ef4f14ad5c9a03d4b2e727/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fdd0122e-d0e5-564b-894a-8b39d1a44fd3/fdd0122e-d0e5-564b-894a-8b39d1a44fd3_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 581212,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm2/366ce01643ef4f14ad5c9a03d4b2e727/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fdd0122e-d0e5-564b-894a-8b39d1a44fd3/fdd0122e-d0e5-564b-894a-8b39d1a44fd3_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 562053,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm2/366ce01643ef4f14ad5c9a03d4b2e727/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fdd0122e-d0e5-564b-894a-8b39d1a44fd3/fdd0122e-d0e5-564b-894a-8b39d1a44fd3_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 514433,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm2/366ce01643ef4f14ad5c9a03d4b2e727/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fdd0122e-d0e5-564b-894a-8b39d1a44fd3/fdd0122e-d0e5-564b-894a-8b39d1a44fd3_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 561230,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm2/366ce01643ef4f14ad5c9a03d4b2e727/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fdd0122e-d0e5-564b-894a-8b39d1a44fd3/fdd0122e-d0e5-564b-894a-8b39d1a44fd3_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 597743,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm2/366ce01643ef4f14ad5c9a03d4b2e727/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fdd0122e-d0e5-564b-894a-8b39d1a44fd3/fdd0122e-d0e5-564b-894a-8b39d1a44fd3_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 504500,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm2/366ce01643ef4f14ad5c9a03d4b2e727/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-01-20',
'seats_number': 5,
'seller_name': None,
'title': 'FIAT FIAT DOBLÃ’ CARGO CH1 LOUNGE 1.6 Mjet 105cv E6D-f N1 Combi '
'5-door (Euro 6D) -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2023}
2026-03-25 16:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983536%27 HTTP/1.1" 200 None
2026-03-25 16:36:19 [ayvens.it] INFO: Saving data for 1983536: {'created_time': 1774456579.805197, 'last_price_update_time': 1774456579.805207, 'auction_closing_time': 1774603800.0}
2026-03-25 16:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1983536') HTTP/1.1" 204 0
2026-03-25 16:36:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 75bec01e-91fa-50ed-ad7e-b7c43b81a0f6 with identifier: 1983535
2026-03-25 16:36:19 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:36:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 75bec01e-91fa-50ed-ad7e-b7c43b81a0f6 with identifier: 1983535
2026-03-25 16:36:19 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 75bec01e-91fa-50ed-ad7e-b7c43b81a0f6 with identifier: 1983535 to the API
2026-03-25 16:36:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:36:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:36:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gh2/fa34f88aad8942da835070feaf318c10/images/large/9.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Argento mezzanotte',
'currency': 'EUR',
'doors_number': 5,
'engine': '',
'expiration_date': '2026-03-27T09:30:00Z',
'fuel_type': 'electric',
'id': '75bec01e-91fa-50ed-ad7e-b7c43b81a0f6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41025',
'listing': 'auction',
'location': None,
'make': 'TESLA',
'model': 'TESLA MODEL Y 75 kWh Dual Motor Long Range 4WD aut. Sport utility '
'vehicle 5-door',
'odometer': 112930,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 41,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75bec01e-91fa-50ed-ad7e-b7c43b81a0f6/75bec01e-91fa-50ed-ad7e-b7c43b81a0f6_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 731309,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh2/fa34f88aad8942da835070feaf318c10/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75bec01e-91fa-50ed-ad7e-b7c43b81a0f6/75bec01e-91fa-50ed-ad7e-b7c43b81a0f6_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 731309,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh2/fa34f88aad8942da835070feaf318c10/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75bec01e-91fa-50ed-ad7e-b7c43b81a0f6/75bec01e-91fa-50ed-ad7e-b7c43b81a0f6_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 703896,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh2/fa34f88aad8942da835070feaf318c10/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75bec01e-91fa-50ed-ad7e-b7c43b81a0f6/75bec01e-91fa-50ed-ad7e-b7c43b81a0f6_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 809195,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh2/fa34f88aad8942da835070feaf318c10/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75bec01e-91fa-50ed-ad7e-b7c43b81a0f6/75bec01e-91fa-50ed-ad7e-b7c43b81a0f6_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 807093,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh2/fa34f88aad8942da835070feaf318c10/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75bec01e-91fa-50ed-ad7e-b7c43b81a0f6/75bec01e-91fa-50ed-ad7e-b7c43b81a0f6_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 510512,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh2/fa34f88aad8942da835070feaf318c10/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75bec01e-91fa-50ed-ad7e-b7c43b81a0f6/75bec01e-91fa-50ed-ad7e-b7c43b81a0f6_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 483753,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh2/fa34f88aad8942da835070feaf318c10/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75bec01e-91fa-50ed-ad7e-b7c43b81a0f6/75bec01e-91fa-50ed-ad7e-b7c43b81a0f6_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 485201,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh2/fa34f88aad8942da835070feaf318c10/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75bec01e-91fa-50ed-ad7e-b7c43b81a0f6/75bec01e-91fa-50ed-ad7e-b7c43b81a0f6_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 516524,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh2/fa34f88aad8942da835070feaf318c10/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75bec01e-91fa-50ed-ad7e-b7c43b81a0f6/75bec01e-91fa-50ed-ad7e-b7c43b81a0f6_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 366194,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh2/fa34f88aad8942da835070feaf318c10/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-12-06',
'seats_number': 5,
'seller_name': None,
'title': 'TESLA TESLA MODEL Y 75 kWh Dual Motor Long Range 4WD aut. Sport '
'utility vehicle 5-door -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2021}
2026-03-25 16:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983535%27 HTTP/1.1" 200 None
2026-03-25 16:36:20 [ayvens.it] INFO: Saving data for 1983535: {'created_time': 1774456580.661016, 'last_price_update_time': 1774456580.661028, 'auction_closing_time': 1774603800.0}
2026-03-25 16:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1983535') HTTP/1.1" 204 0
2026-03-25 16:36:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj6/711f6153f8b540088cd306cb3f7e4a30/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:36:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk2/320cdccf462b48a8bf6363e34a5a1ac5/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:36:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:36:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34d6b3ed50>
2026-03-25 16:36:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:36:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:36:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:36:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37d4646d-a37d-5f42-ae38-314944b69880/37d4646d-a37d-5f42-ae38-314944b69880_image_9.jpg HTTP/1.1" 201 0
2026-03-25 16:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj6%252F711f6153f8b540088cd306cb3f7e4a30%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 16:36:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj6/711f6153f8b540088cd306cb3f7e4a30/images/large/10.jpg saved to cache
2026-03-25 16:36:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 37d4646d-a37d-5f42-ae38-314944b69880
2026-03-25 16:36:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj6/711f6153f8b540088cd306cb3f7e4a30/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:36:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj5/c90e8392b0d2431cb709805b7f1f4616/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:36:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj5/c90e8392b0d2431cb709805b7f1f4616/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:36:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj5/c90e8392b0d2431cb709805b7f1f4616/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:36:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:36:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcd9d910>
2026-03-25 16:36:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:36:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:36:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:36:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37d4646d-a37d-5f42-ae38-314944b69880/37d4646d-a37d-5f42-ae38-314944b69880_image_7.jpg HTTP/1.1" 201 0
2026-03-25 16:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj6%252F711f6153f8b540088cd306cb3f7e4a30%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 16:36:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj6/711f6153f8b540088cd306cb3f7e4a30/images/large/8.jpg saved to cache
2026-03-25 16:36:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 37d4646d-a37d-5f42-ae38-314944b69880
2026-03-25 16:36:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:36:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc5a0390>
2026-03-25 16:36:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:36:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:36:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:36:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9a73218-f66c-5a83-a8ea-fa64869e0144/d9a73218-f66c-5a83-a8ea-fa64869e0144_image_7.jpg HTTP/1.1" 201 0
2026-03-25 16:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk2%252F320cdccf462b48a8bf6363e34a5a1ac5%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 16:36:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk2/320cdccf462b48a8bf6363e34a5a1ac5/images/large/8.jpg saved to cache
2026-03-25 16:36:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d9a73218-f66c-5a83-a8ea-fa64869e0144
2026-03-25 16:36:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d9a73218-f66c-5a83-a8ea-fa64869e0144, skipping ID generation
2026-03-25 16:36:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d9a73218-f66c-5a83-a8ea-fa64869e0144 with scrape type 1
2026-03-25 16:36:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d9a73218-f66c-5a83-a8ea-fa64869e0144 sending to next pipeline
2026-03-25 16:36:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: d9a73218-f66c-5a83-a8ea-fa64869e0144, identifier: 1983533
2026-03-25 16:36:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: d9a73218-f66c-5a83-a8ea-fa64869e0144 with identifier: 1983533
2026-03-25 16:36:21 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:36:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: d9a73218-f66c-5a83-a8ea-fa64869e0144 with identifier: 1983533
2026-03-25 16:36:21 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: d9a73218-f66c-5a83-a8ea-fa64869e0144 with identifier: 1983533 to the API
2026-03-25 16:36:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:36:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:36:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gk2/320cdccf462b48a8bf6363e34a5a1ac5/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Grigio graphite metallizzato',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-27T09:30:00Z',
'fuel_type': 'petrol',
'id': 'd9a73218-f66c-5a83-a8ea-fa64869e0144',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41025',
'listing': 'auction',
'location': None,
'make': 'SKODA',
'model': 'SKODA KAMIQ 1.0 TSI 81KW STYLE DSG Sport utility vehicle 5-door '
'(Euro 6D)',
'odometer': 51773,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 14,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9a73218-f66c-5a83-a8ea-fa64869e0144/d9a73218-f66c-5a83-a8ea-fa64869e0144_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 693140,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk2/320cdccf462b48a8bf6363e34a5a1ac5/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9a73218-f66c-5a83-a8ea-fa64869e0144/d9a73218-f66c-5a83-a8ea-fa64869e0144_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 693140,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk2/320cdccf462b48a8bf6363e34a5a1ac5/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9a73218-f66c-5a83-a8ea-fa64869e0144/d9a73218-f66c-5a83-a8ea-fa64869e0144_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 661856,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk2/320cdccf462b48a8bf6363e34a5a1ac5/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9a73218-f66c-5a83-a8ea-fa64869e0144/d9a73218-f66c-5a83-a8ea-fa64869e0144_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 584402,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk2/320cdccf462b48a8bf6363e34a5a1ac5/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9a73218-f66c-5a83-a8ea-fa64869e0144/d9a73218-f66c-5a83-a8ea-fa64869e0144_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 650782,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk2/320cdccf462b48a8bf6363e34a5a1ac5/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9a73218-f66c-5a83-a8ea-fa64869e0144/d9a73218-f66c-5a83-a8ea-fa64869e0144_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 651209,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk2/320cdccf462b48a8bf6363e34a5a1ac5/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9a73218-f66c-5a83-a8ea-fa64869e0144/d9a73218-f66c-5a83-a8ea-fa64869e0144_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 495344,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk2/320cdccf462b48a8bf6363e34a5a1ac5/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9a73218-f66c-5a83-a8ea-fa64869e0144/d9a73218-f66c-5a83-a8ea-fa64869e0144_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 548063,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk2/320cdccf462b48a8bf6363e34a5a1ac5/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9a73218-f66c-5a83-a8ea-fa64869e0144/d9a73218-f66c-5a83-a8ea-fa64869e0144_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 651631,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk2/320cdccf462b48a8bf6363e34a5a1ac5/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9a73218-f66c-5a83-a8ea-fa64869e0144/d9a73218-f66c-5a83-a8ea-fa64869e0144_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 628339,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk2/320cdccf462b48a8bf6363e34a5a1ac5/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-07-06',
'seats_number': 5,
'seller_name': None,
'title': 'SKODA SKODA KAMIQ 1.0 TSI 81KW STYLE DSG Sport utility vehicle '
'5-door (Euro 6D) -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-25 16:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983533%27 HTTP/1.1" 200 None
2026-03-25 16:36:21 [ayvens.it] INFO: Saving data for 1983533: {'created_time': 1774456581.58306, 'last_price_update_time': 1774456581.583071, 'auction_closing_time': 1774603800.0}
2026-03-25 16:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1983533') HTTP/1.1" 204 0
2026-03-25 16:36:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh3/a0e901441c134d389858d8b128bf99d3/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:36:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh3/a0e901441c134d389858d8b128bf99d3/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:36:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:36:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcd9e9d0>
2026-03-25 16:36:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:36:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:36:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:36:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37d4646d-a37d-5f42-ae38-314944b69880/37d4646d-a37d-5f42-ae38-314944b69880_image_8.jpg HTTP/1.1" 201 0
2026-03-25 16:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj6%252F711f6153f8b540088cd306cb3f7e4a30%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 16:36:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj6/711f6153f8b540088cd306cb3f7e4a30/images/large/9.jpg saved to cache
2026-03-25 16:36:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 37d4646d-a37d-5f42-ae38-314944b69880
2026-03-25 16:36:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 37d4646d-a37d-5f42-ae38-314944b69880, skipping ID generation
2026-03-25 16:36:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 37d4646d-a37d-5f42-ae38-314944b69880 with scrape type 1
2026-03-25 16:36:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 37d4646d-a37d-5f42-ae38-314944b69880 sending to next pipeline
2026-03-25 16:36:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 37d4646d-a37d-5f42-ae38-314944b69880, identifier: 1983534
2026-03-25 16:36:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:36:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc9a6950>
2026-03-25 16:36:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:36:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:36:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:36:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_90b7cd71-97b3-5904-a37d-7882f072bf3b/90b7cd71-97b3-5904-a37d-7882f072bf3b_image_8.jpg HTTP/1.1" 201 0
2026-03-25 16:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj5%252Fc90e8392b0d2431cb709805b7f1f4616%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 16:36:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj5/c90e8392b0d2431cb709805b7f1f4616/images/large/9.jpg saved to cache
2026-03-25 16:36:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 90b7cd71-97b3-5904-a37d-7882f072bf3b
2026-03-25 16:36:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:36:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34d6b4be10>
2026-03-25 16:36:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:36:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:36:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:36:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_90b7cd71-97b3-5904-a37d-7882f072bf3b/90b7cd71-97b3-5904-a37d-7882f072bf3b_image_6.jpg HTTP/1.1" 201 0
2026-03-25 16:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj5%252Fc90e8392b0d2431cb709805b7f1f4616%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 16:36:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj5/c90e8392b0d2431cb709805b7f1f4616/images/large/7.jpg saved to cache
2026-03-25 16:36:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 90b7cd71-97b3-5904-a37d-7882f072bf3b
2026-03-25 16:36:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:36:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34d7437e10>
2026-03-25 16:36:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:36:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:36:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:36:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_90b7cd71-97b3-5904-a37d-7882f072bf3b/90b7cd71-97b3-5904-a37d-7882f072bf3b_image_7.jpg HTTP/1.1" 201 0
2026-03-25 16:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj5%252Fc90e8392b0d2431cb709805b7f1f4616%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 16:36:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj5/c90e8392b0d2431cb709805b7f1f4616/images/large/8.jpg saved to cache
2026-03-25 16:36:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 90b7cd71-97b3-5904-a37d-7882f072bf3b
2026-03-25 16:36:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 90b7cd71-97b3-5904-a37d-7882f072bf3b, skipping ID generation
2026-03-25 16:36:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 90b7cd71-97b3-5904-a37d-7882f072bf3b with scrape type 1
2026-03-25 16:36:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 90b7cd71-97b3-5904-a37d-7882f072bf3b sending to next pipeline
2026-03-25 16:36:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 90b7cd71-97b3-5904-a37d-7882f072bf3b, identifier: 1983532
2026-03-25 16:36:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 37d4646d-a37d-5f42-ae38-314944b69880 with identifier: 1983534
2026-03-25 16:36:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 37d4646d-a37d-5f42-ae38-314944b69880 with identifier: 1983534
2026-03-25 16:36:22 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 37d4646d-a37d-5f42-ae38-314944b69880 with identifier: 1983534 to the API
2026-03-25 16:36:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:36:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:36:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gj6/711f6153f8b540088cd306cb3f7e4a30/images/large/9.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'BIANCO PASTELLO',
'currency': 'EUR',
'doors_number': 4,
'engine': '1.2L',
'expiration_date': '2026-03-27T09:30:00Z',
'fuel_type': 'diesel',
'id': '37d4646d-a37d-5f42-ae38-314944b69880',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41025',
'listing': 'auction',
'location': None,
'make': 'FIAT',
'model': 'FIAT FIORINO (PC) COMBI 1.3 MJET 80 CV E6D-FINAL FP',
'odometer': 82916,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 50,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37d4646d-a37d-5f42-ae38-314944b69880/37d4646d-a37d-5f42-ae38-314944b69880_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 728838,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj6/711f6153f8b540088cd306cb3f7e4a30/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37d4646d-a37d-5f42-ae38-314944b69880/37d4646d-a37d-5f42-ae38-314944b69880_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 777541,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj6/711f6153f8b540088cd306cb3f7e4a30/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37d4646d-a37d-5f42-ae38-314944b69880/37d4646d-a37d-5f42-ae38-314944b69880_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 728838,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj6/711f6153f8b540088cd306cb3f7e4a30/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37d4646d-a37d-5f42-ae38-314944b69880/37d4646d-a37d-5f42-ae38-314944b69880_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 644953,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj6/711f6153f8b540088cd306cb3f7e4a30/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37d4646d-a37d-5f42-ae38-314944b69880/37d4646d-a37d-5f42-ae38-314944b69880_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 754861,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj6/711f6153f8b540088cd306cb3f7e4a30/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37d4646d-a37d-5f42-ae38-314944b69880/37d4646d-a37d-5f42-ae38-314944b69880_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 538888,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj6/711f6153f8b540088cd306cb3f7e4a30/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37d4646d-a37d-5f42-ae38-314944b69880/37d4646d-a37d-5f42-ae38-314944b69880_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 614647,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj6/711f6153f8b540088cd306cb3f7e4a30/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37d4646d-a37d-5f42-ae38-314944b69880/37d4646d-a37d-5f42-ae38-314944b69880_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 502965,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj6/711f6153f8b540088cd306cb3f7e4a30/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37d4646d-a37d-5f42-ae38-314944b69880/37d4646d-a37d-5f42-ae38-314944b69880_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 604975,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj6/711f6153f8b540088cd306cb3f7e4a30/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37d4646d-a37d-5f42-ae38-314944b69880/37d4646d-a37d-5f42-ae38-314944b69880_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 472284,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj6/711f6153f8b540088cd306cb3f7e4a30/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-01-28',
'seats_number': 5,
'seller_name': None,
'title': 'FIAT FIAT FIORINO (PC) COMBI 1.3 MJET 80 CV E6D-FINAL FP -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-25 16:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983534%27 HTTP/1.1" 200 None
2026-03-25 16:36:22 [ayvens.it] INFO: Saving data for 1983534: {'created_time': 1774456582.48764, 'last_price_update_time': 1774456582.48765, 'auction_closing_time': 1774603800.0}
2026-03-25 16:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1983534') HTTP/1.1" 204 0
2026-03-25 16:36:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 90b7cd71-97b3-5904-a37d-7882f072bf3b with identifier: 1983532
2026-03-25 16:36:22 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:36:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 90b7cd71-97b3-5904-a37d-7882f072bf3b with identifier: 1983532
2026-03-25 16:36:22 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 90b7cd71-97b3-5904-a37d-7882f072bf3b with identifier: 1983532 to the API
2026-03-25 16:36:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:36:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:36:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gj5/c90e8392b0d2431cb709805b7f1f4616/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'ALPINE WHITE PASTELLO',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-27T09:30:00Z',
'fuel_type': 'diesel',
'id': '90b7cd71-97b3-5904-a37d-7882f072bf3b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41025',
'listing': 'auction',
'location': None,
'make': 'BMW',
'model': 'BMW X3 (PC) XDRIVE 20D MH48V FP',
'odometer': 97223,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_90b7cd71-97b3-5904-a37d-7882f072bf3b/90b7cd71-97b3-5904-a37d-7882f072bf3b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 543277,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj5/c90e8392b0d2431cb709805b7f1f4616/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_90b7cd71-97b3-5904-a37d-7882f072bf3b/90b7cd71-97b3-5904-a37d-7882f072bf3b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 543277,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj5/c90e8392b0d2431cb709805b7f1f4616/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_90b7cd71-97b3-5904-a37d-7882f072bf3b/90b7cd71-97b3-5904-a37d-7882f072bf3b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 544342,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj5/c90e8392b0d2431cb709805b7f1f4616/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_90b7cd71-97b3-5904-a37d-7882f072bf3b/90b7cd71-97b3-5904-a37d-7882f072bf3b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 533930,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj5/c90e8392b0d2431cb709805b7f1f4616/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_90b7cd71-97b3-5904-a37d-7882f072bf3b/90b7cd71-97b3-5904-a37d-7882f072bf3b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 573829,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj5/c90e8392b0d2431cb709805b7f1f4616/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_90b7cd71-97b3-5904-a37d-7882f072bf3b/90b7cd71-97b3-5904-a37d-7882f072bf3b_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 481584,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj5/c90e8392b0d2431cb709805b7f1f4616/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_90b7cd71-97b3-5904-a37d-7882f072bf3b/90b7cd71-97b3-5904-a37d-7882f072bf3b_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 508756,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj5/c90e8392b0d2431cb709805b7f1f4616/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_90b7cd71-97b3-5904-a37d-7882f072bf3b/90b7cd71-97b3-5904-a37d-7882f072bf3b_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 518144,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj5/c90e8392b0d2431cb709805b7f1f4616/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_90b7cd71-97b3-5904-a37d-7882f072bf3b/90b7cd71-97b3-5904-a37d-7882f072bf3b_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 559538,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj5/c90e8392b0d2431cb709805b7f1f4616/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_90b7cd71-97b3-5904-a37d-7882f072bf3b/90b7cd71-97b3-5904-a37d-7882f072bf3b_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 539936,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj5/c90e8392b0d2431cb709805b7f1f4616/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-02-08',
'seats_number': 5,
'seller_name': None,
'title': 'BMW BMW X3 (PC) XDRIVE 20D MH48V FP -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-25 16:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983532%27 HTTP/1.1" 200 None
2026-03-25 16:36:22 [ayvens.it] INFO: Saving data for 1983532: {'created_time': 1774456582.833208, 'last_price_update_time': 1774456582.833223, 'auction_closing_time': 1774603800.0}
2026-03-25 16:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1983532') HTTP/1.1" 204 0
2026-03-25 16:36:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh3/a0e901441c134d389858d8b128bf99d3/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:36:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge2/72e741275e1345cbb0c1e6b40e1fef0c/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:36:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:36:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34d6b48750>
2026-03-25 16:36:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:36:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:36:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:36:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c42a761d-f342-5525-82fc-f02240b53738/c42a761d-f342-5525-82fc-f02240b53738_image_9.jpg HTTP/1.1" 201 0
2026-03-25 16:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh3%252Fa0e901441c134d389858d8b128bf99d3%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 16:36:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh3/a0e901441c134d389858d8b128bf99d3/images/large/10.jpg saved to cache
2026-03-25 16:36:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c42a761d-f342-5525-82fc-f02240b53738
2026-03-25 16:36:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:36:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc946350>
2026-03-25 16:36:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:36:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:36:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:36:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c42a761d-f342-5525-82fc-f02240b53738/c42a761d-f342-5525-82fc-f02240b53738_image_8.jpg HTTP/1.1" 201 0
2026-03-25 16:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh3%252Fa0e901441c134d389858d8b128bf99d3%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 16:36:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh3/a0e901441c134d389858d8b128bf99d3/images/large/9.jpg saved to cache
2026-03-25 16:36:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c42a761d-f342-5525-82fc-f02240b53738
2026-03-25 16:36:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge2/72e741275e1345cbb0c1e6b40e1fef0c/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:36:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh1/5fa5989f7a1941a78396c5e6485e3e96/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:36:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge2/72e741275e1345cbb0c1e6b40e1fef0c/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:36:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge2/72e741275e1345cbb0c1e6b40e1fef0c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:36:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh1/5fa5989f7a1941a78396c5e6485e3e96/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:36:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:36:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34de983810>
2026-03-25 16:36:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:36:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:36:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:36:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c42a761d-f342-5525-82fc-f02240b53738/c42a761d-f342-5525-82fc-f02240b53738_image_7.jpg HTTP/1.1" 201 0
2026-03-25 16:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh3%252Fa0e901441c134d389858d8b128bf99d3%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 16:36:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh3/a0e901441c134d389858d8b128bf99d3/images/large/8.jpg saved to cache
2026-03-25 16:36:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c42a761d-f342-5525-82fc-f02240b53738
2026-03-25 16:36:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c42a761d-f342-5525-82fc-f02240b53738, skipping ID generation
2026-03-25 16:36:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c42a761d-f342-5525-82fc-f02240b53738 with scrape type 1
2026-03-25 16:36:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c42a761d-f342-5525-82fc-f02240b53738 sending to next pipeline
2026-03-25 16:36:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: c42a761d-f342-5525-82fc-f02240b53738, identifier: 1983531
2026-03-25 16:36:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:36:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dca966d0>
2026-03-25 16:36:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:36:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:36:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:36:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22e95673-3e1e-5a1b-a53d-30c1fa432ef7/22e95673-3e1e-5a1b-a53d-30c1fa432ef7_image_9.jpg HTTP/1.1" 201 0
2026-03-25 16:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge2%252F72e741275e1345cbb0c1e6b40e1fef0c%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 16:36:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge2/72e741275e1345cbb0c1e6b40e1fef0c/images/large/10.jpg saved to cache
2026-03-25 16:36:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 22e95673-3e1e-5a1b-a53d-30c1fa432ef7
2026-03-25 16:36:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh1/5fa5989f7a1941a78396c5e6485e3e96/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:36:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: c42a761d-f342-5525-82fc-f02240b53738 with identifier: 1983531
2026-03-25 16:36:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: c42a761d-f342-5525-82fc-f02240b53738 with identifier: 1983531
2026-03-25 16:36:23 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: c42a761d-f342-5525-82fc-f02240b53738 with identifier: 1983531 to the API
2026-03-25 16:36:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:36:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:36:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gh3/a0e901441c134d389858d8b128bf99d3/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'BIANCO BANQUISE PASTELLO',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-27T09:30:00Z',
'fuel_type': 'diesel',
'id': 'c42a761d-f342-5525-82fc-f02240b53738',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41025',
'listing': 'auction',
'location': None,
'make': 'CITROËN',
'model': 'CITROEN C3 (PC) BLUEHDI 100 S&S FEEL VAN',
'odometer': 107954,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 23,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c42a761d-f342-5525-82fc-f02240b53738/c42a761d-f342-5525-82fc-f02240b53738_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 776371,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh3/a0e901441c134d389858d8b128bf99d3/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c42a761d-f342-5525-82fc-f02240b53738/c42a761d-f342-5525-82fc-f02240b53738_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 776371,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh3/a0e901441c134d389858d8b128bf99d3/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c42a761d-f342-5525-82fc-f02240b53738/c42a761d-f342-5525-82fc-f02240b53738_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 837665,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh3/a0e901441c134d389858d8b128bf99d3/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c42a761d-f342-5525-82fc-f02240b53738/c42a761d-f342-5525-82fc-f02240b53738_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 820472,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh3/a0e901441c134d389858d8b128bf99d3/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c42a761d-f342-5525-82fc-f02240b53738/c42a761d-f342-5525-82fc-f02240b53738_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 789023,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh3/a0e901441c134d389858d8b128bf99d3/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c42a761d-f342-5525-82fc-f02240b53738/c42a761d-f342-5525-82fc-f02240b53738_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 660426,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh3/a0e901441c134d389858d8b128bf99d3/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c42a761d-f342-5525-82fc-f02240b53738/c42a761d-f342-5525-82fc-f02240b53738_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 527225,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh3/a0e901441c134d389858d8b128bf99d3/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c42a761d-f342-5525-82fc-f02240b53738/c42a761d-f342-5525-82fc-f02240b53738_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 485393,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh3/a0e901441c134d389858d8b128bf99d3/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c42a761d-f342-5525-82fc-f02240b53738/c42a761d-f342-5525-82fc-f02240b53738_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 674542,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh3/a0e901441c134d389858d8b128bf99d3/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c42a761d-f342-5525-82fc-f02240b53738/c42a761d-f342-5525-82fc-f02240b53738_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 548140,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh3/a0e901441c134d389858d8b128bf99d3/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-11-29',
'seats_number': 5,
'seller_name': None,
'title': 'CITROËN CITROEN C3 (PC) BLUEHDI 100 S&S FEEL VAN -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2021}
2026-03-25 16:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983531%27 HTTP/1.1" 200 None
2026-03-25 16:36:23 [ayvens.it] INFO: Saving data for 1983531: {'created_time': 1774456583.630458, 'last_price_update_time': 1774456583.63047, 'auction_closing_time': 1774603800.0}
2026-03-25 16:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1983531') HTTP/1.1" 204 0
2026-03-25 16:36:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:36:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc54ee10>
2026-03-25 16:36:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:36:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:36:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:36:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22e95673-3e1e-5a1b-a53d-30c1fa432ef7/22e95673-3e1e-5a1b-a53d-30c1fa432ef7_image_7.jpg HTTP/1.1" 201 0
2026-03-25 16:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge2%252F72e741275e1345cbb0c1e6b40e1fef0c%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 16:36:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge2/72e741275e1345cbb0c1e6b40e1fef0c/images/large/8.jpg saved to cache
2026-03-25 16:36:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 22e95673-3e1e-5a1b-a53d-30c1fa432ef7
2026-03-25 16:36:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:36:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc5ae290>
2026-03-25 16:36:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:36:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:36:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:36:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a975a62e-0bec-51a8-b8b4-9d6385e3554b/a975a62e-0bec-51a8-b8b4-9d6385e3554b_image_8.jpg HTTP/1.1" 201 0
2026-03-25 16:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh1%252F5fa5989f7a1941a78396c5e6485e3e96%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 16:36:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh1/5fa5989f7a1941a78396c5e6485e3e96/images/large/9.jpg saved to cache
2026-03-25 16:36:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a975a62e-0bec-51a8-b8b4-9d6385e3554b
2026-03-25 16:36:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:36:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc91c190>
2026-03-25 16:36:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:36:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:36:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:36:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22e95673-3e1e-5a1b-a53d-30c1fa432ef7/22e95673-3e1e-5a1b-a53d-30c1fa432ef7_image_8.jpg HTTP/1.1" 201 0
2026-03-25 16:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge2%252F72e741275e1345cbb0c1e6b40e1fef0c%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 16:36:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge2/72e741275e1345cbb0c1e6b40e1fef0c/images/large/9.jpg saved to cache
2026-03-25 16:36:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 22e95673-3e1e-5a1b-a53d-30c1fa432ef7
2026-03-25 16:36:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:36:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc766bd0>
2026-03-25 16:36:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:36:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:36:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:36:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22e95673-3e1e-5a1b-a53d-30c1fa432ef7/22e95673-3e1e-5a1b-a53d-30c1fa432ef7_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge2%252F72e741275e1345cbb0c1e6b40e1fef0c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 16:36:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge2/72e741275e1345cbb0c1e6b40e1fef0c/images/large/1.jpg saved to cache
2026-03-25 16:36:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 22e95673-3e1e-5a1b-a53d-30c1fa432ef7
2026-03-25 16:36:24 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 22e95673-3e1e-5a1b-a53d-30c1fa432ef7, skipping ID generation
2026-03-25 16:36:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 22e95673-3e1e-5a1b-a53d-30c1fa432ef7 with scrape type 1
2026-03-25 16:36:24 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 22e95673-3e1e-5a1b-a53d-30c1fa432ef7 sending to next pipeline
2026-03-25 16:36:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 22e95673-3e1e-5a1b-a53d-30c1fa432ef7, identifier: 1983530
2026-03-25 16:36:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:36:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc579e50>
2026-03-25 16:36:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:36:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:36:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:36:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a975a62e-0bec-51a8-b8b4-9d6385e3554b/a975a62e-0bec-51a8-b8b4-9d6385e3554b_image_7.jpg HTTP/1.1" 201 0
2026-03-25 16:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh1%252F5fa5989f7a1941a78396c5e6485e3e96%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 16:36:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh1/5fa5989f7a1941a78396c5e6485e3e96/images/large/8.jpg saved to cache
2026-03-25 16:36:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a975a62e-0bec-51a8-b8b4-9d6385e3554b
2026-03-25 16:36:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:36:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc5ad050>
2026-03-25 16:36:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:36:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:36:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:36:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a975a62e-0bec-51a8-b8b4-9d6385e3554b/a975a62e-0bec-51a8-b8b4-9d6385e3554b_image_6.jpg HTTP/1.1" 201 0
2026-03-25 16:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh1%252F5fa5989f7a1941a78396c5e6485e3e96%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 16:36:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh1/5fa5989f7a1941a78396c5e6485e3e96/images/large/7.jpg saved to cache
2026-03-25 16:36:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a975a62e-0bec-51a8-b8b4-9d6385e3554b
2026-03-25 16:36:24 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a975a62e-0bec-51a8-b8b4-9d6385e3554b, skipping ID generation
2026-03-25 16:36:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a975a62e-0bec-51a8-b8b4-9d6385e3554b with scrape type 1
2026-03-25 16:36:24 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a975a62e-0bec-51a8-b8b4-9d6385e3554b sending to next pipeline
2026-03-25 16:36:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: a975a62e-0bec-51a8-b8b4-9d6385e3554b, identifier: 1983529
2026-03-25 16:36:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 22e95673-3e1e-5a1b-a53d-30c1fa432ef7 with identifier: 1983530
2026-03-25 16:36:24 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:36:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 22e95673-3e1e-5a1b-a53d-30c1fa432ef7 with identifier: 1983530
2026-03-25 16:36:24 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 22e95673-3e1e-5a1b-a53d-30c1fa432ef7 with identifier: 1983530 to the API
2026-03-25 16:36:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:36:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:36:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/ge2/72e741275e1345cbb0c1e6b40e1fef0c/images/large/1.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Bianco Nevada metallizzato',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-27T09:30:00Z',
'fuel_type': 'diesel',
'id': '22e95673-3e1e-5a1b-a53d-30c1fa432ef7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41025',
'listing': 'auction',
'location': None,
'make': 'SEAT',
'model': 'SEAT ATECA 2.0 TDI BUSINESS 4DRIVE DSG Sport utility vehicle 5-door '
'(Euro 6.2)',
'odometer': 86908,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 12,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22e95673-3e1e-5a1b-a53d-30c1fa432ef7/22e95673-3e1e-5a1b-a53d-30c1fa432ef7_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 839445,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge2/72e741275e1345cbb0c1e6b40e1fef0c/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22e95673-3e1e-5a1b-a53d-30c1fa432ef7/22e95673-3e1e-5a1b-a53d-30c1fa432ef7_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 839445,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge2/72e741275e1345cbb0c1e6b40e1fef0c/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22e95673-3e1e-5a1b-a53d-30c1fa432ef7/22e95673-3e1e-5a1b-a53d-30c1fa432ef7_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 785265,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge2/72e741275e1345cbb0c1e6b40e1fef0c/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22e95673-3e1e-5a1b-a53d-30c1fa432ef7/22e95673-3e1e-5a1b-a53d-30c1fa432ef7_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 765869,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge2/72e741275e1345cbb0c1e6b40e1fef0c/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22e95673-3e1e-5a1b-a53d-30c1fa432ef7/22e95673-3e1e-5a1b-a53d-30c1fa432ef7_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 765869,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge2/72e741275e1345cbb0c1e6b40e1fef0c/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22e95673-3e1e-5a1b-a53d-30c1fa432ef7/22e95673-3e1e-5a1b-a53d-30c1fa432ef7_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 640358,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge2/72e741275e1345cbb0c1e6b40e1fef0c/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22e95673-3e1e-5a1b-a53d-30c1fa432ef7/22e95673-3e1e-5a1b-a53d-30c1fa432ef7_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 649043,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge2/72e741275e1345cbb0c1e6b40e1fef0c/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22e95673-3e1e-5a1b-a53d-30c1fa432ef7/22e95673-3e1e-5a1b-a53d-30c1fa432ef7_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 631231,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge2/72e741275e1345cbb0c1e6b40e1fef0c/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22e95673-3e1e-5a1b-a53d-30c1fa432ef7/22e95673-3e1e-5a1b-a53d-30c1fa432ef7_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 691879,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge2/72e741275e1345cbb0c1e6b40e1fef0c/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22e95673-3e1e-5a1b-a53d-30c1fa432ef7/22e95673-3e1e-5a1b-a53d-30c1fa432ef7_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 544734,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge2/72e741275e1345cbb0c1e6b40e1fef0c/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-03-05',
'seats_number': 5,
'seller_name': None,
'title': 'SEAT SEAT ATECA 2.0 TDI BUSINESS 4DRIVE DSG Sport utility vehicle '
'5-door (Euro 6.2) -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2021}
2026-03-25 16:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983530%27 HTTP/1.1" 200 None
2026-03-25 16:36:24 [ayvens.it] INFO: Saving data for 1983530: {'created_time': 1774456584.72854, 'last_price_update_time': 1774456584.728551, 'auction_closing_time': 1774603800.0}
2026-03-25 16:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1983530') HTTP/1.1" 204 0
2026-03-25 16:36:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: a975a62e-0bec-51a8-b8b4-9d6385e3554b with identifier: 1983529
2026-03-25 16:36:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: a975a62e-0bec-51a8-b8b4-9d6385e3554b with identifier: 1983529
2026-03-25 16:36:24 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: a975a62e-0bec-51a8-b8b4-9d6385e3554b with identifier: 1983529 to the API
2026-03-25 16:36:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:36:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:36:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gh1/5fa5989f7a1941a78396c5e6485e3e96/images/large/7.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Bianco Ghiaccio metallizzato',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-27T09:30:00Z',
'fuel_type': 'hybrid',
'id': 'a975a62e-0bec-51a8-b8b4-9d6385e3554b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41025',
'listing': 'auction',
'location': None,
'make': 'AUDI',
'model': 'AUDI Q3 SPORTBACK 45 TFSI e S tronic Business Plus Sport utility '
'vehicle 5-door (Euro 6D)',
'odometer': 88387,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 28,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a975a62e-0bec-51a8-b8b4-9d6385e3554b/a975a62e-0bec-51a8-b8b4-9d6385e3554b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 557136,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh1/5fa5989f7a1941a78396c5e6485e3e96/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a975a62e-0bec-51a8-b8b4-9d6385e3554b/a975a62e-0bec-51a8-b8b4-9d6385e3554b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 557136,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh1/5fa5989f7a1941a78396c5e6485e3e96/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a975a62e-0bec-51a8-b8b4-9d6385e3554b/a975a62e-0bec-51a8-b8b4-9d6385e3554b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 578563,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh1/5fa5989f7a1941a78396c5e6485e3e96/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a975a62e-0bec-51a8-b8b4-9d6385e3554b/a975a62e-0bec-51a8-b8b4-9d6385e3554b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 635858,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh1/5fa5989f7a1941a78396c5e6485e3e96/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a975a62e-0bec-51a8-b8b4-9d6385e3554b/a975a62e-0bec-51a8-b8b4-9d6385e3554b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 575265,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh1/5fa5989f7a1941a78396c5e6485e3e96/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a975a62e-0bec-51a8-b8b4-9d6385e3554b/a975a62e-0bec-51a8-b8b4-9d6385e3554b_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 527407,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh1/5fa5989f7a1941a78396c5e6485e3e96/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a975a62e-0bec-51a8-b8b4-9d6385e3554b/a975a62e-0bec-51a8-b8b4-9d6385e3554b_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 581740,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh1/5fa5989f7a1941a78396c5e6485e3e96/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a975a62e-0bec-51a8-b8b4-9d6385e3554b/a975a62e-0bec-51a8-b8b4-9d6385e3554b_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 562302,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh1/5fa5989f7a1941a78396c5e6485e3e96/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a975a62e-0bec-51a8-b8b4-9d6385e3554b/a975a62e-0bec-51a8-b8b4-9d6385e3554b_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 530074,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh1/5fa5989f7a1941a78396c5e6485e3e96/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a975a62e-0bec-51a8-b8b4-9d6385e3554b/a975a62e-0bec-51a8-b8b4-9d6385e3554b_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 487865,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh1/5fa5989f7a1941a78396c5e6485e3e96/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-11-26',
'seats_number': 5,
'seller_name': None,
'title': 'AUDI AUDI Q3 SPORTBACK 45 TFSI e S tronic Business Plus Sport '
'utility vehicle 5-door (Euro 6D) -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2021}
2026-03-25 16:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983529%27 HTTP/1.1" 200 None
2026-03-25 16:36:25 [ayvens.it] INFO: Saving data for 1983529: {'created_time': 1774456585.099405, 'last_price_update_time': 1774456585.099415, 'auction_closing_time': 1774603800.0}
2026-03-25 16:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1983529') HTTP/1.1" 204 0
2026-03-25 16:36:25 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.aldcarmarket.com/graphql/saleevents> (referer: https://carmarket.ayvens.com/) ['zyte-api']
2026-03-25 16:36:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh1/7f6b54621abf4b2f882a8346d33293ee/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:36:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh1/7f6b54621abf4b2f882a8346d33293ee/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:36:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh1/7f6b54621abf4b2f882a8346d33293ee/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:36:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh1/7f6b54621abf4b2f882a8346d33293ee/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:36:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh1/7f6b54621abf4b2f882a8346d33293ee/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:36:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr9/d30b2863678e432ab88d8780a2a7ad1a/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:36:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr9/d30b2863678e432ab88d8780a2a7ad1a/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:36:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr9/d30b2863678e432ab88d8780a2a7ad1a/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:36:25 [ayvens.it] INFO: Found listing with ID: 1979764
2026-03-25 16:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979764%27 HTTP/1.1" 200 None
2026-03-25 16:36:25 [ayvens.it] INFO: Scrape type for 1979764: 2
2026-03-25 16:36:25 [ayvens.it] INFO: Extracting data for car ID: 1979764
2026-03-25 16:36:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 51449472-d92f-567b-91fa-ba75149a2266 with identifier: 1979764
2026-03-25 16:36:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 51449472-d92f-567b-91fa-ba75149a2266 with scrape type 2
2026-03-25 16:36:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 51449472-d92f-567b-91fa-ba75149a2266 with scrape type 2
2026-03-25 16:36:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 51449472-d92f-567b-91fa-ba75149a2266, identifier: 1979764
2026-03-25 16:36:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 51449472-d92f-567b-91fa-ba75149a2266 with identifier: 1979764
2026-03-25 16:36:25 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:36:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 51449472-d92f-567b-91fa-ba75149a2266 with identifier: 1979764
2026-03-25 16:36:25 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 51449472-d92f-567b-91fa-ba75149a2266 with identifier: 1979764 to the API
2026-03-25 16:36:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:36:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:36:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'GRIGIO MANHATTAN METALLIZZATO',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-26T09:30:00Z',
'fuel_type': 'diesel',
'id': '51449472-d92f-567b-91fa-ba75149a2266',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40968',
'listing': 'auction',
'location': None,
'make': 'AUDI',
'model': 'AUDI Q5 SPORTBACK PC 40 TDI BUSIN. ADVANCED QUATTRO S TRONIC FP',
'odometer': 183687,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-04-26',
'seats_number': 5,
'seller_name': None,
'title': 'AUDI AUDI Q5 SPORTBACK PC 40 TDI BUSIN. ADVANCED QUATTRO S TRONIC '
'FP -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2023}
2026-03-25 16:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979764%27 HTTP/1.1" 200 None
2026-03-25 16:36:25 [ayvens.it] INFO: Saving data for 1979764: {'auction_closing_time': 1774517400.0, 'created_time': 1774370096.822907, 'last_price_update_time': 1774456585.593367}
2026-03-25 16:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1979764') HTTP/1.1" 204 0
2026-03-25 16:36:25 [ayvens.it] INFO: Found listing with ID: 1979765
2026-03-25 16:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979765%27 HTTP/1.1" 200 None
2026-03-25 16:36:25 [ayvens.it] INFO: Scrape type for 1979765: 2
2026-03-25 16:36:25 [ayvens.it] INFO: Extracting data for car ID: 1979765
2026-03-25 16:36:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1b528e2a-8476-5c86-b923-494b901cd5e8 with identifier: 1979765
2026-03-25 16:36:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1b528e2a-8476-5c86-b923-494b901cd5e8 with scrape type 2
2026-03-25 16:36:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1b528e2a-8476-5c86-b923-494b901cd5e8 with scrape type 2
2026-03-25 16:36:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 1b528e2a-8476-5c86-b923-494b901cd5e8, identifier: 1979765
2026-03-25 16:36:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 1b528e2a-8476-5c86-b923-494b901cd5e8 with identifier: 1979765
2026-03-25 16:36:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 1b528e2a-8476-5c86-b923-494b901cd5e8 with identifier: 1979765
2026-03-25 16:36:25 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 1b528e2a-8476-5c86-b923-494b901cd5e8 with identifier: 1979765 to the API
2026-03-25 16:36:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:36:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:36:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'BIANCO ICY PASTELLO',
'currency': 'EUR',
'doors_number': 2,
'engine': '2.2L',
'expiration_date': '2026-03-26T09:30:00Z',
'fuel_type': 'diesel',
'id': '1b528e2a-8476-5c86-b923-494b901cd5e8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40968',
'listing': 'auction',
'location': None,
'make': 'OPEL',
'model': 'OPEL MOVANO CAB (PC) AUTOT. EDIT 35 HEAVY L3 BLUEHDI 140 S&S FP',
'odometer': 68404,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-03-28',
'seats_number': 5,
'seller_name': None,
'title': 'OPEL OPEL MOVANO CAB (PC) AUTOT. EDIT 35 HEAVY L3 BLUEHDI 140 S&S '
'FP -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2023}
2026-03-25 16:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979765%27 HTTP/1.1" 200 None
2026-03-25 16:36:25 [ayvens.it] INFO: Saving data for 1979765: {'auction_closing_time': 1774517400.0, 'created_time': 1774370078.223813, 'last_price_update_time': 1774456585.945237}
2026-03-25 16:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1979765') HTTP/1.1" 204 0
2026-03-25 16:36:25 [ayvens.it] INFO: Found listing with ID: 1979766
2026-03-25 16:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979766%27 HTTP/1.1" 200 None
2026-03-25 16:36:25 [ayvens.it] INFO: Scrape type for 1979766: 2
2026-03-25 16:36:25 [ayvens.it] INFO: Extracting data for car ID: 1979766
2026-03-25 16:36:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a0eb5260-e4fd-57dc-ae05-ab444d7811d9 with identifier: 1979766
2026-03-25 16:36:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a0eb5260-e4fd-57dc-ae05-ab444d7811d9 with scrape type 2
2026-03-25 16:36:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a0eb5260-e4fd-57dc-ae05-ab444d7811d9 with scrape type 2
2026-03-25 16:36:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: a0eb5260-e4fd-57dc-ae05-ab444d7811d9, identifier: 1979766
2026-03-25 16:36:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: a0eb5260-e4fd-57dc-ae05-ab444d7811d9 with identifier: 1979766
2026-03-25 16:36:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: a0eb5260-e4fd-57dc-ae05-ab444d7811d9 with identifier: 1979766
2026-03-25 16:36:26 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: a0eb5260-e4fd-57dc-ae05-ab444d7811d9 with identifier: 1979766 to the API
2026-03-25 16:36:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:36:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:36:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'AGATE BLACK METALLIZZATO',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-26T09:30:00Z',
'fuel_type': 'diesel',
'id': 'a0eb5260-e4fd-57dc-ae05-ab444d7811d9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40968',
'listing': 'auction',
'location': None,
'make': 'FORD',
'model': 'FORD FOCUS 1.5 Ecoblue 120cv Business Auto SW SW 5-door (Euro 6.2)',
'odometer': 163578,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-01-17',
'seats_number': 5,
'seller_name': None,
'title': 'FORD FORD FOCUS 1.5 Ecoblue 120cv Business Auto SW SW 5-door (Euro '
'6.2) -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2023}
2026-03-25 16:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979766%27 HTTP/1.1" 200 None
2026-03-25 16:36:26 [ayvens.it] INFO: Saving data for 1979766: {'auction_closing_time': 1774517400.0, 'created_time': 1774370076.633752, 'last_price_update_time': 1774456586.325859}
2026-03-25 16:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1979766') HTTP/1.1" 204 0
2026-03-25 16:36:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:36:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc2fc590>
2026-03-25 16:36:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:36:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:36:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:36:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d46e9d87-218d-517b-b7f3-56f47d1410fe/d46e9d87-218d-517b-b7f3-56f47d1410fe_image_7.jpg HTTP/1.1" 201 0
2026-03-25 16:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh1%252F7f6b54621abf4b2f882a8346d33293ee%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 16:36:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh1/7f6b54621abf4b2f882a8346d33293ee/images/large/8.jpg saved to cache
2026-03-25 16:36:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d46e9d87-218d-517b-b7f3-56f47d1410fe
2026-03-25 16:36:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:36:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc592c90>
2026-03-25 16:36:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:36:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:36:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:36:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d46e9d87-218d-517b-b7f3-56f47d1410fe/d46e9d87-218d-517b-b7f3-56f47d1410fe_image_6.jpg HTTP/1.1" 201 0
2026-03-25 16:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh1%252F7f6b54621abf4b2f882a8346d33293ee%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 16:36:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh1/7f6b54621abf4b2f882a8346d33293ee/images/large/7.jpg saved to cache
2026-03-25 16:36:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d46e9d87-218d-517b-b7f3-56f47d1410fe
2026-03-25 16:36:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:36:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcae9910>
2026-03-25 16:36:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:36:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:36:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:36:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d46e9d87-218d-517b-b7f3-56f47d1410fe/d46e9d87-218d-517b-b7f3-56f47d1410fe_image_9.jpg HTTP/1.1" 201 0
2026-03-25 16:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh1%252F7f6b54621abf4b2f882a8346d33293ee%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 16:36:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh1/7f6b54621abf4b2f882a8346d33293ee/images/large/10.jpg saved to cache
2026-03-25 16:36:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d46e9d87-218d-517b-b7f3-56f47d1410fe
2026-03-25 16:36:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:36:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc935910>
2026-03-25 16:36:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:36:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:36:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:36:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d46e9d87-218d-517b-b7f3-56f47d1410fe/d46e9d87-218d-517b-b7f3-56f47d1410fe_image_8.jpg HTTP/1.1" 201 0
2026-03-25 16:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh1%252F7f6b54621abf4b2f882a8346d33293ee%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 16:36:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh1/7f6b54621abf4b2f882a8346d33293ee/images/large/9.jpg saved to cache
2026-03-25 16:36:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d46e9d87-218d-517b-b7f3-56f47d1410fe
2026-03-25 16:36:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:36:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dca1a710>
2026-03-25 16:36:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:36:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:36:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:36:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d46e9d87-218d-517b-b7f3-56f47d1410fe/d46e9d87-218d-517b-b7f3-56f47d1410fe_image_5.jpg HTTP/1.1" 201 0
2026-03-25 16:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh1%252F7f6b54621abf4b2f882a8346d33293ee%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 16:36:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh1/7f6b54621abf4b2f882a8346d33293ee/images/large/6.jpg saved to cache
2026-03-25 16:36:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d46e9d87-218d-517b-b7f3-56f47d1410fe
2026-03-25 16:36:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d46e9d87-218d-517b-b7f3-56f47d1410fe, skipping ID generation
2026-03-25 16:36:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d46e9d87-218d-517b-b7f3-56f47d1410fe with scrape type 1
2026-03-25 16:36:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d46e9d87-218d-517b-b7f3-56f47d1410fe sending to next pipeline
2026-03-25 16:36:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: d46e9d87-218d-517b-b7f3-56f47d1410fe, identifier: 1983528
2026-03-25 16:36:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:36:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc86b290>
2026-03-25 16:36:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:36:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:36:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:36:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a1e0aad-b591-5079-a611-ab9a172a5b26/6a1e0aad-b591-5079-a611-ab9a172a5b26_image_6.jpg HTTP/1.1" 201 0
2026-03-25 16:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr9%252Fd30b2863678e432ab88d8780a2a7ad1a%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 16:36:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr9/d30b2863678e432ab88d8780a2a7ad1a/images/large/7.jpg saved to cache
2026-03-25 16:36:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6a1e0aad-b591-5079-a611-ab9a172a5b26
2026-03-25 16:36:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:36:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc591950>
2026-03-25 16:36:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:36:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:36:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:36:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a1e0aad-b591-5079-a611-ab9a172a5b26/6a1e0aad-b591-5079-a611-ab9a172a5b26_image_7.jpg HTTP/1.1" 201 0
2026-03-25 16:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr9%252Fd30b2863678e432ab88d8780a2a7ad1a%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 16:36:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr9/d30b2863678e432ab88d8780a2a7ad1a/images/large/8.jpg saved to cache
2026-03-25 16:36:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6a1e0aad-b591-5079-a611-ab9a172a5b26
2026-03-25 16:36:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:36:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dccc0d90>
2026-03-25 16:36:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:36:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:36:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:36:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a1e0aad-b591-5079-a611-ab9a172a5b26/6a1e0aad-b591-5079-a611-ab9a172a5b26_image_5.jpg HTTP/1.1" 201 0
2026-03-25 16:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr9%252Fd30b2863678e432ab88d8780a2a7ad1a%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 16:36:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr9/d30b2863678e432ab88d8780a2a7ad1a/images/large/6.jpg saved to cache
2026-03-25 16:36:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6a1e0aad-b591-5079-a611-ab9a172a5b26
2026-03-25 16:36:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6a1e0aad-b591-5079-a611-ab9a172a5b26, skipping ID generation
2026-03-25 16:36:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6a1e0aad-b591-5079-a611-ab9a172a5b26 with scrape type 1
2026-03-25 16:36:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6a1e0aad-b591-5079-a611-ab9a172a5b26 sending to next pipeline
2026-03-25 16:36:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 6a1e0aad-b591-5079-a611-ab9a172a5b26, identifier: 1983527
2026-03-25 16:36:27 [ayvens.it] INFO: Found listing with ID: 1979767
2026-03-25 16:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979767%27 HTTP/1.1" 200 None
2026-03-25 16:36:27 [ayvens.it] INFO: Scrape type for 1979767: 2
2026-03-25 16:36:27 [ayvens.it] INFO: Extracting data for car ID: 1979767
2026-03-25 16:36:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ff99a601-cd42-5ed8-b6f6-f1b67a01b178 with identifier: 1979767
2026-03-25 16:36:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ff99a601-cd42-5ed8-b6f6-f1b67a01b178 with scrape type 2
2026-03-25 16:36:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ff99a601-cd42-5ed8-b6f6-f1b67a01b178 with scrape type 2
2026-03-25 16:36:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: ff99a601-cd42-5ed8-b6f6-f1b67a01b178, identifier: 1979767
2026-03-25 16:36:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: d46e9d87-218d-517b-b7f3-56f47d1410fe with identifier: 1983528
2026-03-25 16:36:27 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:36:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: d46e9d87-218d-517b-b7f3-56f47d1410fe with identifier: 1983528
2026-03-25 16:36:27 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: d46e9d87-218d-517b-b7f3-56f47d1410fe with identifier: 1983528 to the API
2026-03-25 16:36:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:36:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:36:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gh1/7f6b54621abf4b2f882a8346d33293ee/images/large/6.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'CARBON BLACK',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.3L',
'expiration_date': '2026-03-27T09:30:00Z',
'fuel_type': 'hybrid',
'id': 'd46e9d87-218d-517b-b7f3-56f47d1410fe',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41025',
'listing': 'auction',
'location': None,
'make': 'JEEP',
'model': 'JEEP COMPASS (PC) 1.3 T4 PHEV 190CV BUSINESS 4XE AUTO FP',
'odometer': 124405,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 28,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d46e9d87-218d-517b-b7f3-56f47d1410fe/d46e9d87-218d-517b-b7f3-56f47d1410fe_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 844309,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh1/7f6b54621abf4b2f882a8346d33293ee/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d46e9d87-218d-517b-b7f3-56f47d1410fe/d46e9d87-218d-517b-b7f3-56f47d1410fe_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 844309,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh1/7f6b54621abf4b2f882a8346d33293ee/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d46e9d87-218d-517b-b7f3-56f47d1410fe/d46e9d87-218d-517b-b7f3-56f47d1410fe_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 859207,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh1/7f6b54621abf4b2f882a8346d33293ee/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d46e9d87-218d-517b-b7f3-56f47d1410fe/d46e9d87-218d-517b-b7f3-56f47d1410fe_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 848310,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh1/7f6b54621abf4b2f882a8346d33293ee/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d46e9d87-218d-517b-b7f3-56f47d1410fe/d46e9d87-218d-517b-b7f3-56f47d1410fe_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 832010,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh1/7f6b54621abf4b2f882a8346d33293ee/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d46e9d87-218d-517b-b7f3-56f47d1410fe/d46e9d87-218d-517b-b7f3-56f47d1410fe_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 664464,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh1/7f6b54621abf4b2f882a8346d33293ee/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d46e9d87-218d-517b-b7f3-56f47d1410fe/d46e9d87-218d-517b-b7f3-56f47d1410fe_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 538309,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh1/7f6b54621abf4b2f882a8346d33293ee/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d46e9d87-218d-517b-b7f3-56f47d1410fe/d46e9d87-218d-517b-b7f3-56f47d1410fe_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 538309,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh1/7f6b54621abf4b2f882a8346d33293ee/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d46e9d87-218d-517b-b7f3-56f47d1410fe/d46e9d87-218d-517b-b7f3-56f47d1410fe_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 667919,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh1/7f6b54621abf4b2f882a8346d33293ee/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d46e9d87-218d-517b-b7f3-56f47d1410fe/d46e9d87-218d-517b-b7f3-56f47d1410fe_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 600128,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh1/7f6b54621abf4b2f882a8346d33293ee/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-11-30',
'seats_number': 5,
'seller_name': None,
'title': 'JEEP JEEP COMPASS (PC) 1.3 T4 PHEV 190CV BUSINESS 4XE AUTO FP -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2021}
2026-03-25 16:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983528%27 HTTP/1.1" 200 None
2026-03-25 16:36:30 [ayvens.it] INFO: Saving data for 1983528: {'created_time': 1774456590.9356, 'last_price_update_time': 1774456590.935615, 'auction_closing_time': 1774603800.0}
2026-03-25 16:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1983528') HTTP/1.1" 204 0
2026-03-25 16:36:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 6a1e0aad-b591-5079-a611-ab9a172a5b26 with identifier: 1983527
2026-03-25 16:36:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 6a1e0aad-b591-5079-a611-ab9a172a5b26 with identifier: 1983527
2026-03-25 16:36:31 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 6a1e0aad-b591-5079-a611-ab9a172a5b26 with identifier: 1983527 to the API
2026-03-25 16:36:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:36:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:36:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gr9/d30b2863678e432ab88d8780a2a7ad1a/images/large/6.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'MAGNETIC GREY METALLIZZATO',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.5L',
'expiration_date': '2026-03-27T09:30:00Z',
'fuel_type': 'hybrid',
'id': '6a1e0aad-b591-5079-a611-ab9a172a5b26',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41025',
'listing': 'auction',
'location': None,
'make': 'FORD',
'model': 'FORD KUGA 2.5 BENZINA FHEV 190CV AWD ST-LINE AUT',
'odometer': 106370,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 62,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a1e0aad-b591-5079-a611-ab9a172a5b26/6a1e0aad-b591-5079-a611-ab9a172a5b26_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 778648,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr9/d30b2863678e432ab88d8780a2a7ad1a/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a1e0aad-b591-5079-a611-ab9a172a5b26/6a1e0aad-b591-5079-a611-ab9a172a5b26_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 778648,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr9/d30b2863678e432ab88d8780a2a7ad1a/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a1e0aad-b591-5079-a611-ab9a172a5b26/6a1e0aad-b591-5079-a611-ab9a172a5b26_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 787634,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr9/d30b2863678e432ab88d8780a2a7ad1a/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a1e0aad-b591-5079-a611-ab9a172a5b26/6a1e0aad-b591-5079-a611-ab9a172a5b26_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 755200,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr9/d30b2863678e432ab88d8780a2a7ad1a/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a1e0aad-b591-5079-a611-ab9a172a5b26/6a1e0aad-b591-5079-a611-ab9a172a5b26_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 768873,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr9/d30b2863678e432ab88d8780a2a7ad1a/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a1e0aad-b591-5079-a611-ab9a172a5b26/6a1e0aad-b591-5079-a611-ab9a172a5b26_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 680697,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr9/d30b2863678e432ab88d8780a2a7ad1a/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a1e0aad-b591-5079-a611-ab9a172a5b26/6a1e0aad-b591-5079-a611-ab9a172a5b26_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 588334,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr9/d30b2863678e432ab88d8780a2a7ad1a/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a1e0aad-b591-5079-a611-ab9a172a5b26/6a1e0aad-b591-5079-a611-ab9a172a5b26_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 652088,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr9/d30b2863678e432ab88d8780a2a7ad1a/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a1e0aad-b591-5079-a611-ab9a172a5b26/6a1e0aad-b591-5079-a611-ab9a172a5b26_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 654506,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr9/d30b2863678e432ab88d8780a2a7ad1a/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a1e0aad-b591-5079-a611-ab9a172a5b26/6a1e0aad-b591-5079-a611-ab9a172a5b26_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 651506,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr9/d30b2863678e432ab88d8780a2a7ad1a/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-08-31',
'seats_number': 5,
'seller_name': None,
'title': 'FORD FORD KUGA 2.5 BENZINA FHEV 190CV AWD ST-LINE AUT -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2023}
2026-03-25 16:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983527%27 HTTP/1.1" 200 None
2026-03-25 16:36:32 [ayvens.it] INFO: Saving data for 1983527: {'created_time': 1774456592.431128, 'last_price_update_time': 1774456592.431141, 'auction_closing_time': 1774603800.0}
2026-03-25 16:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1983527') HTTP/1.1" 204 0
2026-03-25 16:36:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: ff99a601-cd42-5ed8-b6f6-f1b67a01b178 with identifier: 1979767
2026-03-25 16:36:32 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:36:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: ff99a601-cd42-5ed8-b6f6-f1b67a01b178 with identifier: 1979767
2026-03-25 16:36:32 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: ff99a601-cd42-5ed8-b6f6-f1b67a01b178 with identifier: 1979767 to the API
2026-03-25 16:36:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:36:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:36:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Metallic Blue Chrome Blue meta',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-26T09:30:00Z',
'fuel_type': 'diesel',
'id': 'ff99a601-cd42-5ed8-b6f6-f1b67a01b178',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40968',
'listing': 'auction',
'location': None,
'make': 'FORD',
'model': 'FORD FOCUS 1.5 Ecoblue 120cv ST-Line X Auto Hatchback 5-door (Euro '
'6.2)',
'odometer': 168969,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-11-16',
'seats_number': 5,
'seller_name': None,
'title': 'FORD FORD FOCUS 1.5 Ecoblue 120cv ST-Line X Auto Hatchback 5-door '
'(Euro 6.2) -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-25 16:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979767%27 HTTP/1.1" 200 None
2026-03-25 16:36:32 [ayvens.it] INFO: Saving data for 1979767: {'auction_closing_time': 1774517400.0, 'created_time': 1774370079.416728, 'last_price_update_time': 1774456592.709528}
2026-03-25 16:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1979767') HTTP/1.1" 204 0
2026-03-25 16:36:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm3/1c561b1a28a0440e9b4cf48e58fc8ca3/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:36:32 [ayvens.it] INFO: Found listing with ID: 1979768
2026-03-25 16:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979768%27 HTTP/1.1" 200 None
2026-03-25 16:36:32 [ayvens.it] INFO: Scrape type for 1979768: 2
2026-03-25 16:36:32 [ayvens.it] INFO: Extracting data for car ID: 1979768
2026-03-25 16:36:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c0e77d2e-8155-50c4-ae2e-b3e85ff8c0db with identifier: 1979768
2026-03-25 16:36:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c0e77d2e-8155-50c4-ae2e-b3e85ff8c0db with scrape type 2
2026-03-25 16:36:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c0e77d2e-8155-50c4-ae2e-b3e85ff8c0db with scrape type 2
2026-03-25 16:36:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: c0e77d2e-8155-50c4-ae2e-b3e85ff8c0db, identifier: 1979768
2026-03-25 16:36:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm3/1c561b1a28a0440e9b4cf48e58fc8ca3/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:36:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: c0e77d2e-8155-50c4-ae2e-b3e85ff8c0db with identifier: 1979768
2026-03-25 16:36:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: c0e77d2e-8155-50c4-ae2e-b3e85ff8c0db with identifier: 1979768
2026-03-25 16:36:32 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: c0e77d2e-8155-50c4-ae2e-b3e85ff8c0db with identifier: 1979768 to the API
2026-03-25 16:36:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:36:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:36:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'NERO VULCANO METALLIZZATO',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.1L',
'expiration_date': '2026-03-26T09:30:00Z',
'fuel_type': 'diesel',
'id': 'c0e77d2e-8155-50c4-ae2e-b3e85ff8c0db',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40968',
'listing': 'auction',
'location': None,
'make': 'ALFA ROMEO',
'model': 'ALFA ROMEO STELVIO (PC) 2.2 TD 190 CV SPRINT AT8 Q4 FP',
'odometer': 161358,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-09-30',
'seats_number': 5,
'seller_name': None,
'title': 'ALFA ROMEO ALFA ROMEO STELVIO (PC) 2.2 TD 190 CV SPRINT AT8 Q4 FP -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-25 16:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979768%27 HTTP/1.1" 200 None
2026-03-25 16:36:33 [ayvens.it] INFO: Saving data for 1979768: {'auction_closing_time': 1774517400.0, 'created_time': 1774370081.962487, 'last_price_update_time': 1774456593.144549}
2026-03-25 16:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1979768') HTTP/1.1" 204 0
2026-03-25 16:36:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn8/af105d03dada454eb63bae555a500620/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:36:33 [ayvens.it] INFO: Found listing with ID: 1979769
2026-03-25 16:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979769%27 HTTP/1.1" 200 None
2026-03-25 16:36:33 [ayvens.it] INFO: Scrape type for 1979769: 2
2026-03-25 16:36:33 [ayvens.it] INFO: Extracting data for car ID: 1979769
2026-03-25 16:36:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9ec2a24d-9f86-5910-be5e-bf0fd7214d43 with identifier: 1979769
2026-03-25 16:36:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9ec2a24d-9f86-5910-be5e-bf0fd7214d43 with scrape type 2
2026-03-25 16:36:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9ec2a24d-9f86-5910-be5e-bf0fd7214d43 with scrape type 2
2026-03-25 16:36:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 9ec2a24d-9f86-5910-be5e-bf0fd7214d43, identifier: 1979769
2026-03-25 16:36:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm0/a5df3ca0bac54cd9bff0b2be397de3bf/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:36:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 9ec2a24d-9f86-5910-be5e-bf0fd7214d43 with identifier: 1979769
2026-03-25 16:36:33 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:36:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 9ec2a24d-9f86-5910-be5e-bf0fd7214d43 with identifier: 1979769
2026-03-25 16:36:33 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 9ec2a24d-9f86-5910-be5e-bf0fd7214d43 with identifier: 1979769 to the API
2026-03-25 16:36:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:36:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:36:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'ORANGE FUSION METALLIZZATO',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-26T09:30:00Z',
'fuel_type': 'diesel',
'id': '9ec2a24d-9f86-5910-be5e-bf0fd7214d43',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40968',
'listing': 'auction',
'location': None,
'make': 'KIA',
'model': 'KIA SPORTAGE 1.6 CRDI MHEV BUSINESS 2WD DCT',
'odometer': 37264,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-08-31',
'seats_number': 5,
'seller_name': None,
'title': 'KIA KIA SPORTAGE 1.6 CRDI MHEV BUSINESS 2WD DCT -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2023}
2026-03-25 16:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979769%27 HTTP/1.1" 200 None
2026-03-25 16:36:33 [ayvens.it] INFO: Saving data for 1979769: {'auction_closing_time': 1774517400.0, 'created_time': 1774370088.111073, 'last_price_update_time': 1774456593.595094}
2026-03-25 16:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1979769') HTTP/1.1" 204 0
2026-03-25 16:36:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg3/61178f53f61d4e5e8249863493ede44b/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:36:33 [ayvens.it] INFO: Found listing with ID: 1979770
2026-03-25 16:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979770%27 HTTP/1.1" 200 None
2026-03-25 16:36:33 [ayvens.it] INFO: Scrape type for 1979770: 2
2026-03-25 16:36:33 [ayvens.it] INFO: Extracting data for car ID: 1979770
2026-03-25 16:36:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7fc249fe-1aeb-5c94-b3e7-86d3135bdbd9 with identifier: 1979770
2026-03-25 16:36:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7fc249fe-1aeb-5c94-b3e7-86d3135bdbd9 with scrape type 2
2026-03-25 16:36:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7fc249fe-1aeb-5c94-b3e7-86d3135bdbd9 with scrape type 2
2026-03-25 16:36:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 7fc249fe-1aeb-5c94-b3e7-86d3135bdbd9, identifier: 1979770
2026-03-25 16:36:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:36:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc9361d0>
2026-03-25 16:36:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:36:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:36:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:36:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_50ecbe9d-4888-5140-beae-b470a63cd3cc/50ecbe9d-4888-5140-beae-b470a63cd3cc_image_9.jpg HTTP/1.1" 201 0
2026-03-25 16:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm3%252F1c561b1a28a0440e9b4cf48e58fc8ca3%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 16:36:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm3/1c561b1a28a0440e9b4cf48e58fc8ca3/images/large/10.jpg saved to cache
2026-03-25 16:36:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 50ecbe9d-4888-5140-beae-b470a63cd3cc
2026-03-25 16:36:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:36:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc592090>
2026-03-25 16:36:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:36:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:36:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:36:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_50ecbe9d-4888-5140-beae-b470a63cd3cc/50ecbe9d-4888-5140-beae-b470a63cd3cc_image_8.jpg HTTP/1.1" 201 0
2026-03-25 16:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm3%252F1c561b1a28a0440e9b4cf48e58fc8ca3%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 16:36:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm3/1c561b1a28a0440e9b4cf48e58fc8ca3/images/large/9.jpg saved to cache
2026-03-25 16:36:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 50ecbe9d-4888-5140-beae-b470a63cd3cc
2026-03-25 16:36:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 50ecbe9d-4888-5140-beae-b470a63cd3cc, skipping ID generation
2026-03-25 16:36:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 50ecbe9d-4888-5140-beae-b470a63cd3cc with scrape type 1
2026-03-25 16:36:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 50ecbe9d-4888-5140-beae-b470a63cd3cc sending to next pipeline
2026-03-25 16:36:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 50ecbe9d-4888-5140-beae-b470a63cd3cc, identifier: 1983524
2026-03-25 16:36:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn3/614ed32e4c9440c883de6371709ed178/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:36:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm0/a5df3ca0bac54cd9bff0b2be397de3bf/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:36:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 7fc249fe-1aeb-5c94-b3e7-86d3135bdbd9 with identifier: 1979770
2026-03-25 16:36:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 7fc249fe-1aeb-5c94-b3e7-86d3135bdbd9 with identifier: 1979770
2026-03-25 16:36:34 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 7fc249fe-1aeb-5c94-b3e7-86d3135bdbd9 with identifier: 1979770 to the API
2026-03-25 16:36:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:36:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:36:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'POLAR WHITE PASTELLO',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-26T09:30:00Z',
'fuel_type': 'diesel',
'id': '7fc249fe-1aeb-5c94-b3e7-86d3135bdbd9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40968',
'listing': 'auction',
'location': None,
'make': 'CITROËN',
'model': 'CITROEN C3 (PC) BLUEHDI 100 S&S FEEL VAN',
'odometer': 157498,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-07-28',
'seats_number': 5,
'seller_name': None,
'title': 'CITROËN CITROEN C3 (PC) BLUEHDI 100 S&S FEEL VAN -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-25 16:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979770%27 HTTP/1.1" 200 None
2026-03-25 16:36:34 [ayvens.it] INFO: Saving data for 1979770: {'auction_closing_time': 1774517400.0, 'created_time': 1774370086.637074, 'last_price_update_time': 1774456594.328036}
2026-03-25 16:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1979770') HTTP/1.1" 204 0
2026-03-25 16:36:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 50ecbe9d-4888-5140-beae-b470a63cd3cc with identifier: 1983524
2026-03-25 16:36:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 50ecbe9d-4888-5140-beae-b470a63cd3cc with identifier: 1983524
2026-03-25 16:36:34 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 50ecbe9d-4888-5140-beae-b470a63cd3cc with identifier: 1983524 to the API
2026-03-25 16:36:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:36:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:36:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gm3/1c561b1a28a0440e9b4cf48e58fc8ca3/images/large/9.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Deep Black perla',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-27T09:30:00Z',
'fuel_type': 'diesel',
'id': '50ecbe9d-4888-5140-beae-b470a63cd3cc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41025',
'listing': 'auction',
'location': None,
'make': 'VOLKSWAGEN',
'model': 'VOLKSWAGEN TIGUAN 2.0 TDI SCR 110KW Life DSG Sport utility vehicle '
'5-door (Euro 6D)',
'odometer': 124066,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 25,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_50ecbe9d-4888-5140-beae-b470a63cd3cc/50ecbe9d-4888-5140-beae-b470a63cd3cc_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 635667,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm3/1c561b1a28a0440e9b4cf48e58fc8ca3/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_50ecbe9d-4888-5140-beae-b470a63cd3cc/50ecbe9d-4888-5140-beae-b470a63cd3cc_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 644531,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm3/1c561b1a28a0440e9b4cf48e58fc8ca3/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_50ecbe9d-4888-5140-beae-b470a63cd3cc/50ecbe9d-4888-5140-beae-b470a63cd3cc_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 635667,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm3/1c561b1a28a0440e9b4cf48e58fc8ca3/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_50ecbe9d-4888-5140-beae-b470a63cd3cc/50ecbe9d-4888-5140-beae-b470a63cd3cc_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 677402,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm3/1c561b1a28a0440e9b4cf48e58fc8ca3/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_50ecbe9d-4888-5140-beae-b470a63cd3cc/50ecbe9d-4888-5140-beae-b470a63cd3cc_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 670149,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm3/1c561b1a28a0440e9b4cf48e58fc8ca3/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_50ecbe9d-4888-5140-beae-b470a63cd3cc/50ecbe9d-4888-5140-beae-b470a63cd3cc_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 535456,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm3/1c561b1a28a0440e9b4cf48e58fc8ca3/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_50ecbe9d-4888-5140-beae-b470a63cd3cc/50ecbe9d-4888-5140-beae-b470a63cd3cc_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 434579,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm3/1c561b1a28a0440e9b4cf48e58fc8ca3/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_50ecbe9d-4888-5140-beae-b470a63cd3cc/50ecbe9d-4888-5140-beae-b470a63cd3cc_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 480329,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm3/1c561b1a28a0440e9b4cf48e58fc8ca3/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_50ecbe9d-4888-5140-beae-b470a63cd3cc/50ecbe9d-4888-5140-beae-b470a63cd3cc_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 484160,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm3/1c561b1a28a0440e9b4cf48e58fc8ca3/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_50ecbe9d-4888-5140-beae-b470a63cd3cc/50ecbe9d-4888-5140-beae-b470a63cd3cc_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 452586,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm3/1c561b1a28a0440e9b4cf48e58fc8ca3/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-12-29',
'seats_number': 5,
'seller_name': None,
'title': 'VOLKSWAGEN VOLKSWAGEN TIGUAN 2.0 TDI SCR 110KW Life DSG Sport '
'utility vehicle 5-door (Euro 6D) -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-25 16:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983524%27 HTTP/1.1" 200 None
2026-03-25 16:36:34 [ayvens.it] INFO: Saving data for 1983524: {'created_time': 1774456594.632124, 'last_price_update_time': 1774456594.632133, 'auction_closing_time': 1774603800.0}
2026-03-25 16:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1983524') HTTP/1.1" 204 0
2026-03-25 16:36:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn3/614ed32e4c9440c883de6371709ed178/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:36:34 [ayvens.it] INFO: Found listing with ID: 1979771
2026-03-25 16:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979771%27 HTTP/1.1" 200 None
2026-03-25 16:36:34 [ayvens.it] INFO: Scrape type for 1979771: 2
2026-03-25 16:36:34 [ayvens.it] INFO: Extracting data for car ID: 1979771
2026-03-25 16:36:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 369b264d-ed09-5696-980d-9d8e1c951414 with identifier: 1979771
2026-03-25 16:36:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 369b264d-ed09-5696-980d-9d8e1c951414 with scrape type 2
2026-03-25 16:36:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 369b264d-ed09-5696-980d-9d8e1c951414 with scrape type 2
2026-03-25 16:36:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 369b264d-ed09-5696-980d-9d8e1c951414, identifier: 1979771
2026-03-25 16:36:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:36:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc89d9d0>
2026-03-25 16:36:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:36:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:36:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:36:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49c42cb4-9bec-539c-bce9-e64e706a7783/49c42cb4-9bec-539c-bce9-e64e706a7783_image_8.jpg HTTP/1.1" 201 0
2026-03-25 16:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn8%252Faf105d03dada454eb63bae555a500620%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 16:36:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn8/af105d03dada454eb63bae555a500620/images/large/9.jpg saved to cache
2026-03-25 16:36:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 49c42cb4-9bec-539c-bce9-e64e706a7783
2026-03-25 16:36:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 49c42cb4-9bec-539c-bce9-e64e706a7783, skipping ID generation
2026-03-25 16:36:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 49c42cb4-9bec-539c-bce9-e64e706a7783 with scrape type 1
2026-03-25 16:36:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 49c42cb4-9bec-539c-bce9-e64e706a7783 sending to next pipeline
2026-03-25 16:36:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 49c42cb4-9bec-539c-bce9-e64e706a7783, identifier: 1983525
2026-03-25 16:36:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:36:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34de1bb210>
2026-03-25 16:36:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:36:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:36:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:36:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74b9dd4c-1b53-5593-9ffd-d77d29d6b5c3/74b9dd4c-1b53-5593-9ffd-d77d29d6b5c3_image_1.jpg HTTP/1.1" 201 0
2026-03-25 16:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm0%252Fa5df3ca0bac54cd9bff0b2be397de3bf%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 16:36:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm0/a5df3ca0bac54cd9bff0b2be397de3bf/images/large/2.jpg saved to cache
2026-03-25 16:36:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 74b9dd4c-1b53-5593-9ffd-d77d29d6b5c3
2026-03-25 16:36:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 369b264d-ed09-5696-980d-9d8e1c951414 with identifier: 1979771
2026-03-25 16:36:35 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:36:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 369b264d-ed09-5696-980d-9d8e1c951414 with identifier: 1979771
2026-03-25 16:36:35 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 369b264d-ed09-5696-980d-9d8e1c951414 with identifier: 1979771 to the API
2026-03-25 16:36:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:36:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:36:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'NERO MYTHOS METALLIZZATO',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-26T09:30:00Z',
'fuel_type': 'diesel',
'id': '369b264d-ed09-5696-980d-9d8e1c951414',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40968',
'listing': 'auction',
'location': None,
'make': 'AUDI',
'model': 'AUDI Q5 40 TDI Business quattro S tronic Sport utility vehicle '
'5-door (Euro 6D) mild hybrid',
'odometer': 87927,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-02-18',
'seats_number': 5,
'seller_name': None,
'title': 'AUDI AUDI Q5 40 TDI Business quattro S tronic Sport utility vehicle '
'5-door (Euro 6D) mild hybrid -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-25 16:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979771%27 HTTP/1.1" 200 None
2026-03-25 16:36:35 [ayvens.it] INFO: Saving data for 1979771: {'auction_closing_time': 1774517400.0, 'created_time': 1774370090.028337, 'last_price_update_time': 1774456595.292218}
2026-03-25 16:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1979771') HTTP/1.1" 204 0
2026-03-25 16:36:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 49c42cb4-9bec-539c-bce9-e64e706a7783 with identifier: 1983525
2026-03-25 16:36:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 49c42cb4-9bec-539c-bce9-e64e706a7783 with identifier: 1983525
2026-03-25 16:36:35 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 49c42cb4-9bec-539c-bce9-e64e706a7783 with identifier: 1983525 to the API
2026-03-25 16:36:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:36:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:36:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gn8/af105d03dada454eb63bae555a500620/images/large/9.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'NERO MYTHOS METALLIZZATO',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-27T09:30:00Z',
'fuel_type': 'hybrid',
'id': '49c42cb4-9bec-539c-bce9-e64e706a7783',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41025',
'listing': 'auction',
'location': None,
'make': 'AUDI',
'model': 'AUDI Q5 50 TFSI e Business quattro S tronic Sport utility vehicle '
'5-door (Euro 6D)',
'odometer': 56056,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49c42cb4-9bec-539c-bce9-e64e706a7783/49c42cb4-9bec-539c-bce9-e64e706a7783_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 636575,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn8/af105d03dada454eb63bae555a500620/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49c42cb4-9bec-539c-bce9-e64e706a7783/49c42cb4-9bec-539c-bce9-e64e706a7783_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 633533,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn8/af105d03dada454eb63bae555a500620/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49c42cb4-9bec-539c-bce9-e64e706a7783/49c42cb4-9bec-539c-bce9-e64e706a7783_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 636575,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn8/af105d03dada454eb63bae555a500620/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49c42cb4-9bec-539c-bce9-e64e706a7783/49c42cb4-9bec-539c-bce9-e64e706a7783_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 652582,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn8/af105d03dada454eb63bae555a500620/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49c42cb4-9bec-539c-bce9-e64e706a7783/49c42cb4-9bec-539c-bce9-e64e706a7783_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 664877,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn8/af105d03dada454eb63bae555a500620/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49c42cb4-9bec-539c-bce9-e64e706a7783/49c42cb4-9bec-539c-bce9-e64e706a7783_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 579700,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn8/af105d03dada454eb63bae555a500620/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49c42cb4-9bec-539c-bce9-e64e706a7783/49c42cb4-9bec-539c-bce9-e64e706a7783_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 583834,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn8/af105d03dada454eb63bae555a500620/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49c42cb4-9bec-539c-bce9-e64e706a7783/49c42cb4-9bec-539c-bce9-e64e706a7783_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 627395,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn8/af105d03dada454eb63bae555a500620/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49c42cb4-9bec-539c-bce9-e64e706a7783/49c42cb4-9bec-539c-bce9-e64e706a7783_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 615484,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn8/af105d03dada454eb63bae555a500620/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49c42cb4-9bec-539c-bce9-e64e706a7783/49c42cb4-9bec-539c-bce9-e64e706a7783_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 560586,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn8/af105d03dada454eb63bae555a500620/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-04-13',
'seats_number': 5,
'seller_name': None,
'title': 'AUDI AUDI Q5 50 TFSI e Business quattro S tronic Sport utility '
'vehicle 5-door (Euro 6D) -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2023}
2026-03-25 16:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983525%27 HTTP/1.1" 200 None
2026-03-25 16:36:35 [ayvens.it] INFO: Saving data for 1983525: {'created_time': 1774456595.577065, 'last_price_update_time': 1774456595.577079, 'auction_closing_time': 1774603800.0}
2026-03-25 16:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1983525') HTTP/1.1" 204 0
2026-03-25 16:36:35 [ayvens.it] INFO: Found listing with ID: 1979772
2026-03-25 16:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979772%27 HTTP/1.1" 200 None
2026-03-25 16:36:35 [ayvens.it] INFO: Scrape type for 1979772: 2
2026-03-25 16:36:35 [ayvens.it] INFO: Extracting data for car ID: 1979772
2026-03-25 16:36:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5c177257-1c73-51bb-b806-938c6ae3fc43 with identifier: 1979772
2026-03-25 16:36:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5c177257-1c73-51bb-b806-938c6ae3fc43 with scrape type 2
2026-03-25 16:36:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5c177257-1c73-51bb-b806-938c6ae3fc43 with scrape type 2
2026-03-25 16:36:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 5c177257-1c73-51bb-b806-938c6ae3fc43, identifier: 1979772
2026-03-25 16:36:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 5c177257-1c73-51bb-b806-938c6ae3fc43 with identifier: 1979772
2026-03-25 16:36:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 5c177257-1c73-51bb-b806-938c6ae3fc43 with identifier: 1979772
2026-03-25 16:36:35 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 5c177257-1c73-51bb-b806-938c6ae3fc43 with identifier: 1979772 to the API
2026-03-25 16:36:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:36:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:36:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'CHROME BLUE METALLIZZATO',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-26T09:30:00Z',
'fuel_type': 'hybrid',
'id': '5c177257-1c73-51bb-b806-938c6ae3fc43',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40968',
'listing': 'auction',
'location': None,
'make': 'FORD',
'model': 'FORD FOCUS SW (PC) 1.0 ECOB. HYBR. 125CV ST-LINE DES.AUTOSW',
'odometer': 123905,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-06-28',
'seats_number': 5,
'seller_name': None,
'title': 'FORD FORD FOCUS SW (PC) 1.0 ECOB. HYBR. 125CV ST-LINE DES.AUTOSW -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2023}
2026-03-25 16:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979772%27 HTTP/1.1" 200 None
2026-03-25 16:36:35 [ayvens.it] INFO: Saving data for 1979772: {'auction_closing_time': 1774517400.0, 'created_time': 1774370091.62009, 'last_price_update_time': 1774456595.935415}
2026-03-25 16:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1979772') HTTP/1.1" 204 0
2026-03-25 16:36:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:36:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc91f8d0>
2026-03-25 16:36:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:36:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:36:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:36:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea3eeccf-11a9-5b84-97ef-580000195f65/ea3eeccf-11a9-5b84-97ef-580000195f65_image_4.jpg HTTP/1.1" 201 0
2026-03-25 16:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg3%252F61178f53f61d4e5e8249863493ede44b%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 16:36:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg3/61178f53f61d4e5e8249863493ede44b/images/large/5.jpg saved to cache
2026-03-25 16:36:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ea3eeccf-11a9-5b84-97ef-580000195f65
2026-03-25 16:36:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ea3eeccf-11a9-5b84-97ef-580000195f65, skipping ID generation
2026-03-25 16:36:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ea3eeccf-11a9-5b84-97ef-580000195f65 with scrape type 1
2026-03-25 16:36:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ea3eeccf-11a9-5b84-97ef-580000195f65 sending to next pipeline
2026-03-25 16:36:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: ea3eeccf-11a9-5b84-97ef-580000195f65, identifier: 1983526
2026-03-25 16:36:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:36:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcd9c6d0>
2026-03-25 16:36:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:36:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:36:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:36:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7bdf5de7-25e5-5224-98be-306b66c3e43d/7bdf5de7-25e5-5224-98be-306b66c3e43d_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn3%252F614ed32e4c9440c883de6371709ed178%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 16:36:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn3/614ed32e4c9440c883de6371709ed178/images/large/1.jpg saved to cache
2026-03-25 16:36:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7bdf5de7-25e5-5224-98be-306b66c3e43d
2026-03-25 16:36:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:36:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc579e50>
2026-03-25 16:36:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:36:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:36:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:36:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74b9dd4c-1b53-5593-9ffd-d77d29d6b5c3/74b9dd4c-1b53-5593-9ffd-d77d29d6b5c3_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm0%252Fa5df3ca0bac54cd9bff0b2be397de3bf%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 16:36:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm0/a5df3ca0bac54cd9bff0b2be397de3bf/images/large/1.jpg saved to cache
2026-03-25 16:36:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 74b9dd4c-1b53-5593-9ffd-d77d29d6b5c3
2026-03-25 16:36:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 74b9dd4c-1b53-5593-9ffd-d77d29d6b5c3, skipping ID generation
2026-03-25 16:36:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 74b9dd4c-1b53-5593-9ffd-d77d29d6b5c3 with scrape type 1
2026-03-25 16:36:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 74b9dd4c-1b53-5593-9ffd-d77d29d6b5c3 sending to next pipeline
2026-03-25 16:36:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 74b9dd4c-1b53-5593-9ffd-d77d29d6b5c3, identifier: 1983522
2026-03-25 16:36:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:36:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc57ae10>
2026-03-25 16:36:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:36:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:36:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:36:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7bdf5de7-25e5-5224-98be-306b66c3e43d/7bdf5de7-25e5-5224-98be-306b66c3e43d_image_1.jpg HTTP/1.1" 201 0
2026-03-25 16:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn3%252F614ed32e4c9440c883de6371709ed178%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 16:36:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn3/614ed32e4c9440c883de6371709ed178/images/large/2.jpg saved to cache
2026-03-25 16:36:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7bdf5de7-25e5-5224-98be-306b66c3e43d
2026-03-25 16:36:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7bdf5de7-25e5-5224-98be-306b66c3e43d, skipping ID generation
2026-03-25 16:36:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7bdf5de7-25e5-5224-98be-306b66c3e43d with scrape type 1
2026-03-25 16:36:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7bdf5de7-25e5-5224-98be-306b66c3e43d sending to next pipeline
2026-03-25 16:36:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 7bdf5de7-25e5-5224-98be-306b66c3e43d, identifier: 1983523
2026-03-25 16:36:36 [ayvens.it] INFO: Found listing with ID: 1979773
2026-03-25 16:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979773%27 HTTP/1.1" 200 None
2026-03-25 16:36:36 [ayvens.it] INFO: Scrape type for 1979773: 2
2026-03-25 16:36:36 [ayvens.it] INFO: Extracting data for car ID: 1979773
2026-03-25 16:36:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9a1615da-5a09-5550-a05a-9b75485b46f9 with identifier: 1979773
2026-03-25 16:36:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9a1615da-5a09-5550-a05a-9b75485b46f9 with scrape type 2
2026-03-25 16:36:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9a1615da-5a09-5550-a05a-9b75485b46f9 with scrape type 2
2026-03-25 16:36:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 9a1615da-5a09-5550-a05a-9b75485b46f9, identifier: 1979773
2026-03-25 16:36:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: ea3eeccf-11a9-5b84-97ef-580000195f65 with identifier: 1983526
2026-03-25 16:36:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: ea3eeccf-11a9-5b84-97ef-580000195f65 with identifier: 1983526
2026-03-25 16:36:36 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: ea3eeccf-11a9-5b84-97ef-580000195f65 with identifier: 1983526 to the API
2026-03-25 16:36:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:36:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:36:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gg3/61178f53f61d4e5e8249863493ede44b/images/large/5.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'OXIDE BRONZE MET',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-27T09:30:00Z',
'fuel_type': 'hybrid',
'id': 'ea3eeccf-11a9-5b84-97ef-580000195f65',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41025',
'listing': 'auction',
'location': None,
'make': 'TOYOTA',
'model': 'TOYOTA COROLLA SW TS 2.0 HYBRID BUSINESS FP',
'odometer': 86057,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 20,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea3eeccf-11a9-5b84-97ef-580000195f65/ea3eeccf-11a9-5b84-97ef-580000195f65_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 623692,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg3/61178f53f61d4e5e8249863493ede44b/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea3eeccf-11a9-5b84-97ef-580000195f65/ea3eeccf-11a9-5b84-97ef-580000195f65_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 717383,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg3/61178f53f61d4e5e8249863493ede44b/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea3eeccf-11a9-5b84-97ef-580000195f65/ea3eeccf-11a9-5b84-97ef-580000195f65_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 623692,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg3/61178f53f61d4e5e8249863493ede44b/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea3eeccf-11a9-5b84-97ef-580000195f65/ea3eeccf-11a9-5b84-97ef-580000195f65_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 653411,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg3/61178f53f61d4e5e8249863493ede44b/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea3eeccf-11a9-5b84-97ef-580000195f65/ea3eeccf-11a9-5b84-97ef-580000195f65_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 763532,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg3/61178f53f61d4e5e8249863493ede44b/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea3eeccf-11a9-5b84-97ef-580000195f65/ea3eeccf-11a9-5b84-97ef-580000195f65_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 552919,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg3/61178f53f61d4e5e8249863493ede44b/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea3eeccf-11a9-5b84-97ef-580000195f65/ea3eeccf-11a9-5b84-97ef-580000195f65_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 557065,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg3/61178f53f61d4e5e8249863493ede44b/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea3eeccf-11a9-5b84-97ef-580000195f65/ea3eeccf-11a9-5b84-97ef-580000195f65_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 520909,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg3/61178f53f61d4e5e8249863493ede44b/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea3eeccf-11a9-5b84-97ef-580000195f65/ea3eeccf-11a9-5b84-97ef-580000195f65_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 587131,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg3/61178f53f61d4e5e8249863493ede44b/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea3eeccf-11a9-5b84-97ef-580000195f65/ea3eeccf-11a9-5b84-97ef-580000195f65_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 518496,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg3/61178f53f61d4e5e8249863493ede44b/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-10-25',
'seats_number': 5,
'seller_name': None,
'title': 'TOYOTA TOYOTA COROLLA SW TS 2.0 HYBRID BUSINESS FP -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2021}
2026-03-25 16:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983526%27 HTTP/1.1" 200 None
2026-03-25 16:36:37 [ayvens.it] INFO: Saving data for 1983526: {'created_time': 1774456597.109912, 'last_price_update_time': 1774456597.109923, 'auction_closing_time': 1774603800.0}
2026-03-25 16:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1983526') HTTP/1.1" 204 0
2026-03-25 16:36:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 74b9dd4c-1b53-5593-9ffd-d77d29d6b5c3 with identifier: 1983522
2026-03-25 16:36:37 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:36:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 74b9dd4c-1b53-5593-9ffd-d77d29d6b5c3 with identifier: 1983522
2026-03-25 16:36:37 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 74b9dd4c-1b53-5593-9ffd-d77d29d6b5c3 with identifier: 1983522 to the API
2026-03-25 16:36:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:36:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:36:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gm0/a5df3ca0bac54cd9bff0b2be397de3bf/images/large/1.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'ROSSO RUBINO MTZ',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-27T09:30:00Z',
'fuel_type': 'diesel',
'id': '74b9dd4c-1b53-5593-9ffd-d77d29d6b5c3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41025',
'listing': 'auction',
'location': None,
'make': 'CITROËN',
'model': 'CITROEN C3 (PC) BLUEHDI 100 S&S FEEL VAN',
'odometer': 159547,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 49,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74b9dd4c-1b53-5593-9ffd-d77d29d6b5c3/74b9dd4c-1b53-5593-9ffd-d77d29d6b5c3_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 660588,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm0/a5df3ca0bac54cd9bff0b2be397de3bf/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74b9dd4c-1b53-5593-9ffd-d77d29d6b5c3/74b9dd4c-1b53-5593-9ffd-d77d29d6b5c3_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 649031,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm0/a5df3ca0bac54cd9bff0b2be397de3bf/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74b9dd4c-1b53-5593-9ffd-d77d29d6b5c3/74b9dd4c-1b53-5593-9ffd-d77d29d6b5c3_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 644260,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm0/a5df3ca0bac54cd9bff0b2be397de3bf/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74b9dd4c-1b53-5593-9ffd-d77d29d6b5c3/74b9dd4c-1b53-5593-9ffd-d77d29d6b5c3_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 686519,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm0/a5df3ca0bac54cd9bff0b2be397de3bf/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74b9dd4c-1b53-5593-9ffd-d77d29d6b5c3/74b9dd4c-1b53-5593-9ffd-d77d29d6b5c3_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 676438,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm0/a5df3ca0bac54cd9bff0b2be397de3bf/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74b9dd4c-1b53-5593-9ffd-d77d29d6b5c3/74b9dd4c-1b53-5593-9ffd-d77d29d6b5c3_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 628905,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm0/a5df3ca0bac54cd9bff0b2be397de3bf/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74b9dd4c-1b53-5593-9ffd-d77d29d6b5c3/74b9dd4c-1b53-5593-9ffd-d77d29d6b5c3_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 540843,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm0/a5df3ca0bac54cd9bff0b2be397de3bf/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74b9dd4c-1b53-5593-9ffd-d77d29d6b5c3/74b9dd4c-1b53-5593-9ffd-d77d29d6b5c3_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 545950,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm0/a5df3ca0bac54cd9bff0b2be397de3bf/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74b9dd4c-1b53-5593-9ffd-d77d29d6b5c3/74b9dd4c-1b53-5593-9ffd-d77d29d6b5c3_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 591903,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm0/a5df3ca0bac54cd9bff0b2be397de3bf/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74b9dd4c-1b53-5593-9ffd-d77d29d6b5c3/74b9dd4c-1b53-5593-9ffd-d77d29d6b5c3_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 522773,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm0/a5df3ca0bac54cd9bff0b2be397de3bf/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-12-21',
'seats_number': 5,
'seller_name': None,
'title': 'CITROËN CITROEN C3 (PC) BLUEHDI 100 S&S FEEL VAN -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-25 16:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983522%27 HTTP/1.1" 200 None
2026-03-25 16:36:37 [ayvens.it] INFO: Saving data for 1983522: {'created_time': 1774456597.42425, 'last_price_update_time': 1774456597.424262, 'auction_closing_time': 1774603800.0}
2026-03-25 16:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1983522') HTTP/1.1" 204 0
2026-03-25 16:36:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 7bdf5de7-25e5-5224-98be-306b66c3e43d with identifier: 1983523
2026-03-25 16:36:37 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:36:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 7bdf5de7-25e5-5224-98be-306b66c3e43d with identifier: 1983523
2026-03-25 16:36:37 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 7bdf5de7-25e5-5224-98be-306b66c3e43d with identifier: 1983523 to the API
2026-03-25 16:36:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:36:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:36:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gn3/614ed32e4c9440c883de6371709ed178/images/large/2.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'FROZEN WHITE PASTELLO',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-27T09:30:00Z',
'fuel_type': 'diesel',
'id': '7bdf5de7-25e5-5224-98be-306b66c3e43d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41025',
'listing': 'auction',
'location': None,
'make': 'FORD',
'model': 'FORD FOCUS SW 1.5 ECOBLUE 120CV ACTIVE AUTO SW FP',
'odometer': 9377,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 54,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7bdf5de7-25e5-5224-98be-306b66c3e43d/7bdf5de7-25e5-5224-98be-306b66c3e43d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 755732,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn3/614ed32e4c9440c883de6371709ed178/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7bdf5de7-25e5-5224-98be-306b66c3e43d/7bdf5de7-25e5-5224-98be-306b66c3e43d_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 848128,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn3/614ed32e4c9440c883de6371709ed178/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7bdf5de7-25e5-5224-98be-306b66c3e43d/7bdf5de7-25e5-5224-98be-306b66c3e43d_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 755732,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn3/614ed32e4c9440c883de6371709ed178/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7bdf5de7-25e5-5224-98be-306b66c3e43d/7bdf5de7-25e5-5224-98be-306b66c3e43d_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 761659,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn3/614ed32e4c9440c883de6371709ed178/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7bdf5de7-25e5-5224-98be-306b66c3e43d/7bdf5de7-25e5-5224-98be-306b66c3e43d_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 801095,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn3/614ed32e4c9440c883de6371709ed178/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7bdf5de7-25e5-5224-98be-306b66c3e43d/7bdf5de7-25e5-5224-98be-306b66c3e43d_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 607481,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn3/614ed32e4c9440c883de6371709ed178/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7bdf5de7-25e5-5224-98be-306b66c3e43d/7bdf5de7-25e5-5224-98be-306b66c3e43d_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 660276,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn3/614ed32e4c9440c883de6371709ed178/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7bdf5de7-25e5-5224-98be-306b66c3e43d/7bdf5de7-25e5-5224-98be-306b66c3e43d_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 502992,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn3/614ed32e4c9440c883de6371709ed178/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7bdf5de7-25e5-5224-98be-306b66c3e43d/7bdf5de7-25e5-5224-98be-306b66c3e43d_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 616546,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn3/614ed32e4c9440c883de6371709ed178/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7bdf5de7-25e5-5224-98be-306b66c3e43d/7bdf5de7-25e5-5224-98be-306b66c3e43d_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 560237,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn3/614ed32e4c9440c883de6371709ed178/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-04-20',
'seats_number': 5,
'seller_name': None,
'title': 'FORD FORD FOCUS SW 1.5 ECOBLUE 120CV ACTIVE AUTO SW FP -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2023}
2026-03-25 16:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983523%27 HTTP/1.1" 200 None
2026-03-25 16:36:37 [ayvens.it] INFO: Saving data for 1983523: {'created_time': 1774456597.72508, 'last_price_update_time': 1774456597.725092, 'auction_closing_time': 1774603800.0}
2026-03-25 16:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1983523') HTTP/1.1" 204 0
2026-03-25 16:36:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 9a1615da-5a09-5550-a05a-9b75485b46f9 with identifier: 1979773
2026-03-25 16:36:37 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:36:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 9a1615da-5a09-5550-a05a-9b75485b46f9 with identifier: 1979773
2026-03-25 16:36:37 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 9a1615da-5a09-5550-a05a-9b75485b46f9 with identifier: 1979773 to the API
2026-03-25 16:36:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:36:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:36:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'DEEP CRYSTAL BLUE MICALIZZATO',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-26T09:30:00Z',
'fuel_type': 'petrol',
'id': '9a1615da-5a09-5550-a05a-9b75485b46f9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40968',
'listing': 'auction',
'location': None,
'make': 'MAZDA',
'model': 'MAZDA CX-30 2.0L Skyactiv-X 186cv M Hybrid Exclusive Sport utility '
'vehicle 5-door (Euro 6D) mild hybrid',
'odometer': 101458,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-04-13',
'seats_number': 5,
'seller_name': None,
'title': 'MAZDA MAZDA CX-30 2.0L Skyactiv-X 186cv M Hybrid Exclusive Sport '
'utility vehicle 5-door (Euro 6D) mild hybrid -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2021}
2026-03-25 16:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979773%27 HTTP/1.1" 200 None
2026-03-25 16:36:37 [ayvens.it] INFO: Saving data for 1979773: {'auction_closing_time': 1774517400.0, 'created_time': 1774370093.146866, 'last_price_update_time': 1774456597.986639}
2026-03-25 16:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1979773') HTTP/1.1" 204 0
2026-03-25 16:36:38 [ayvens.it] INFO: Found listing with ID: 1979774
2026-03-25 16:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979774%27 HTTP/1.1" 200 None
2026-03-25 16:36:38 [ayvens.it] INFO: Scrape type for 1979774: 2
2026-03-25 16:36:38 [ayvens.it] INFO: Extracting data for car ID: 1979774
2026-03-25 16:36:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d776a665-e08d-547a-97fb-5199afb9e69e with identifier: 1979774
2026-03-25 16:36:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d776a665-e08d-547a-97fb-5199afb9e69e with scrape type 2
2026-03-25 16:36:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d776a665-e08d-547a-97fb-5199afb9e69e with scrape type 2
2026-03-25 16:36:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: d776a665-e08d-547a-97fb-5199afb9e69e, identifier: 1979774
2026-03-25 16:36:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk4/9ba2b33483494b6e8aa9557f4ce82987/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:36:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: d776a665-e08d-547a-97fb-5199afb9e69e with identifier: 1979774
2026-03-25 16:36:38 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:36:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: d776a665-e08d-547a-97fb-5199afb9e69e with identifier: 1979774
2026-03-25 16:36:38 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: d776a665-e08d-547a-97fb-5199afb9e69e with identifier: 1979774 to the API
2026-03-25 16:36:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:36:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:36:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'SILVER METALLIZZATO',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.8L',
'expiration_date': '2026-03-26T09:30:00Z',
'fuel_type': 'hybrid',
'id': 'd776a665-e08d-547a-97fb-5199afb9e69e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40968',
'listing': 'auction',
'location': None,
'make': 'TOYOTA',
'model': 'TOYOTA COROLLA SW (PC) TS HYBRID BUSINESS FP',
'odometer': 184837,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-01-25',
'seats_number': 5,
'seller_name': None,
'title': 'TOYOTA TOYOTA COROLLA SW (PC) TS HYBRID BUSINESS FP -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-25 16:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979774%27 HTTP/1.1" 200 None
2026-03-25 16:36:39 [ayvens.it] INFO: Saving data for 1979774: {'auction_closing_time': 1774517400.0, 'created_time': 1774370095.824009, 'last_price_update_time': 1774456599.361651}
2026-03-25 16:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1979774') HTTP/1.1" 204 0
2026-03-25 16:36:39 [ayvens.it] INFO: Found listing with ID: 1979775
2026-03-25 16:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979775%27 HTTP/1.1" 200 None
2026-03-25 16:36:39 [ayvens.it] INFO: Scrape type for 1979775: 2
2026-03-25 16:36:39 [ayvens.it] INFO: Extracting data for car ID: 1979775
2026-03-25 16:36:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 52cdae72-d376-5224-8d2f-5e0c702385b3 with identifier: 1979775
2026-03-25 16:36:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 52cdae72-d376-5224-8d2f-5e0c702385b3 with scrape type 2
2026-03-25 16:36:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 52cdae72-d376-5224-8d2f-5e0c702385b3 with scrape type 2
2026-03-25 16:36:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 52cdae72-d376-5224-8d2f-5e0c702385b3, identifier: 1979775
2026-03-25 16:36:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga4/07ac3bf3f570405b996339a4dc9f4b8b/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:36:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk4/9ba2b33483494b6e8aa9557f4ce82987/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:36:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga9/507aeb10cabf4d8ba026cc7a570c4b73/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:36:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga9/507aeb10cabf4d8ba026cc7a570c4b73/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:36:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 52cdae72-d376-5224-8d2f-5e0c702385b3 with identifier: 1979775
2026-03-25 16:36:39 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:36:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 52cdae72-d376-5224-8d2f-5e0c702385b3 with identifier: 1979775
2026-03-25 16:36:39 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 52cdae72-d376-5224-8d2f-5e0c702385b3 with identifier: 1979775 to the API
2026-03-25 16:36:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:36:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:36:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Portofino Blue metallizzato',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-26T09:30:00Z',
'fuel_type': 'diesel',
'id': '52cdae72-d376-5224-8d2f-5e0c702385b3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40968',
'listing': 'auction',
'location': None,
'make': 'LAND ROVER',
'model': 'LAND ROVER RANGE ROVER VELAR 2.0 D I4 204 SE 4WD Auto Sport utility '
'vehicle 5-door (Euro 6D)',
'odometer': 87583,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-06-01',
'seats_number': 5,
'seller_name': None,
'title': 'LAND ROVER LAND ROVER RANGE ROVER VELAR 2.0 D I4 204 SE 4WD Auto '
'Sport utility vehicle 5-door (Euro 6D) -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2021}
2026-03-25 16:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979775%27 HTTP/1.1" 200 None
2026-03-25 16:36:39 [ayvens.it] INFO: Saving data for 1979775: {'auction_closing_time': 1774517400.0, 'created_time': 1774370100.034464, 'last_price_update_time': 1774456599.756935}
2026-03-25 16:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1979775') HTTP/1.1" 204 0
2026-03-25 16:36:39 [ayvens.it] INFO: Found listing with ID: 1979776
2026-03-25 16:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979776%27 HTTP/1.1" 200 None
2026-03-25 16:36:39 [ayvens.it] INFO: Scrape type for 1979776: 2
2026-03-25 16:36:39 [ayvens.it] INFO: Extracting data for car ID: 1979776
2026-03-25 16:36:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dd76b57c-f569-581b-a2ce-beeaec6a270b with identifier: 1979776
2026-03-25 16:36:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dd76b57c-f569-581b-a2ce-beeaec6a270b with scrape type 2
2026-03-25 16:36:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dd76b57c-f569-581b-a2ce-beeaec6a270b with scrape type 2
2026-03-25 16:36:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: dd76b57c-f569-581b-a2ce-beeaec6a270b, identifier: 1979776
2026-03-25 16:36:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:36:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc373110>
2026-03-25 16:36:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:36:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:36:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:36:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_799a1ab9-9082-5ba3-bb6b-5bf6d4bb3144/799a1ab9-9082-5ba3-bb6b-5bf6d4bb3144_image_3.jpg HTTP/1.1" 201 0
2026-03-25 16:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk4%252F9ba2b33483494b6e8aa9557f4ce82987%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 16:36:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk4/9ba2b33483494b6e8aa9557f4ce82987/images/large/4.jpg saved to cache
2026-03-25 16:36:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 799a1ab9-9082-5ba3-bb6b-5bf6d4bb3144
2026-03-25 16:36:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga9/507aeb10cabf4d8ba026cc7a570c4b73/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:36:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: dd76b57c-f569-581b-a2ce-beeaec6a270b with identifier: 1979776
2026-03-25 16:36:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: dd76b57c-f569-581b-a2ce-beeaec6a270b with identifier: 1979776
2026-03-25 16:36:40 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: dd76b57c-f569-581b-a2ce-beeaec6a270b with identifier: 1979776 to the API
2026-03-25 16:36:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:36:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:36:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Unknown',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.5L',
'expiration_date': '2026-03-26T09:30:00Z',
'fuel_type': 'hybrid',
'id': 'dd76b57c-f569-581b-a2ce-beeaec6a270b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40968',
'listing': 'auction',
'location': None,
'make': 'FORD',
'model': 'FORD KUGA 2.5 Benzina FHEV 190CV 2WD ST-Line X Aut Sport utility '
'vehicle 5-door (Euro 6.2)',
'odometer': 85211,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-11-11',
'seats_number': 5,
'seller_name': None,
'title': 'FORD FORD KUGA 2.5 Benzina FHEV 190CV 2WD ST-Line X Aut Sport '
'utility vehicle 5-door (Euro 6.2) -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2021}
2026-03-25 16:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979776%27 HTTP/1.1" 200 None
2026-03-25 16:36:40 [ayvens.it] INFO: Saving data for 1979776: {'auction_closing_time': 1774517400.0, 'created_time': 1774370103.154151, 'last_price_update_time': 1774456600.211276}
2026-03-25 16:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1979776') HTTP/1.1" 204 0
2026-03-25 16:36:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl4/367794af31bf48d491bd243293843b96/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:36:40 [ayvens.it] INFO: Found listing with ID: 1979777
2026-03-25 16:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979777%27 HTTP/1.1" 200 None
2026-03-25 16:36:40 [ayvens.it] INFO: Scrape type for 1979777: 2
2026-03-25 16:36:40 [ayvens.it] INFO: Extracting data for car ID: 1979777
2026-03-25 16:36:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7e22c749-e371-5fc3-b316-d7f4730175f7 with identifier: 1979777
2026-03-25 16:36:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7e22c749-e371-5fc3-b316-d7f4730175f7 with scrape type 2
2026-03-25 16:36:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7e22c749-e371-5fc3-b316-d7f4730175f7 with scrape type 2
2026-03-25 16:36:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 7e22c749-e371-5fc3-b316-d7f4730175f7, identifier: 1979777
2026-03-25 16:36:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:36:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34de186f50>
2026-03-25 16:36:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:36:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:36:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:36:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_312f756d-b76b-5bd7-9f78-3b8d0b0acfee/312f756d-b76b-5bd7-9f78-3b8d0b0acfee_image_2.jpg HTTP/1.1" 201 0
2026-03-25 16:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga4%252F07ac3bf3f570405b996339a4dc9f4b8b%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 16:36:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga4/07ac3bf3f570405b996339a4dc9f4b8b/images/large/3.jpg saved to cache
2026-03-25 16:36:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 312f756d-b76b-5bd7-9f78-3b8d0b0acfee
2026-03-25 16:36:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 312f756d-b76b-5bd7-9f78-3b8d0b0acfee, skipping ID generation
2026-03-25 16:36:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 312f756d-b76b-5bd7-9f78-3b8d0b0acfee with scrape type 1
2026-03-25 16:36:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 312f756d-b76b-5bd7-9f78-3b8d0b0acfee sending to next pipeline
2026-03-25 16:36:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 312f756d-b76b-5bd7-9f78-3b8d0b0acfee, identifier: 1983519
2026-03-25 16:36:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:36:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc7dddd0>
2026-03-25 16:36:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:36:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:36:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:36:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_799a1ab9-9082-5ba3-bb6b-5bf6d4bb3144/799a1ab9-9082-5ba3-bb6b-5bf6d4bb3144_image_2.jpg HTTP/1.1" 201 0
2026-03-25 16:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk4%252F9ba2b33483494b6e8aa9557f4ce82987%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 16:36:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk4/9ba2b33483494b6e8aa9557f4ce82987/images/large/3.jpg saved to cache
2026-03-25 16:36:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 799a1ab9-9082-5ba3-bb6b-5bf6d4bb3144
2026-03-25 16:36:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 799a1ab9-9082-5ba3-bb6b-5bf6d4bb3144, skipping ID generation
2026-03-25 16:36:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 799a1ab9-9082-5ba3-bb6b-5bf6d4bb3144 with scrape type 1
2026-03-25 16:36:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 799a1ab9-9082-5ba3-bb6b-5bf6d4bb3144 sending to next pipeline
2026-03-25 16:36:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 799a1ab9-9082-5ba3-bb6b-5bf6d4bb3144, identifier: 1983521
2026-03-25 16:36:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:36:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dce01f10>
2026-03-25 16:36:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:36:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:36:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:36:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91bf1031-019b-58c8-991e-9e1a90bc1bea/91bf1031-019b-58c8-991e-9e1a90bc1bea_image_6.jpg HTTP/1.1" 201 0
2026-03-25 16:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga9%252F507aeb10cabf4d8ba026cc7a570c4b73%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 16:36:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga9/507aeb10cabf4d8ba026cc7a570c4b73/images/large/7.jpg saved to cache
2026-03-25 16:36:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 91bf1031-019b-58c8-991e-9e1a90bc1bea
2026-03-25 16:36:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:36:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dca24290>
2026-03-25 16:36:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:36:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:36:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:36:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91bf1031-019b-58c8-991e-9e1a90bc1bea/91bf1031-019b-58c8-991e-9e1a90bc1bea_image_5.jpg HTTP/1.1" 201 0
2026-03-25 16:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga9%252F507aeb10cabf4d8ba026cc7a570c4b73%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 16:36:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga9/507aeb10cabf4d8ba026cc7a570c4b73/images/large/6.jpg saved to cache
2026-03-25 16:36:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 91bf1031-019b-58c8-991e-9e1a90bc1bea
2026-03-25 16:36:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl4/367794af31bf48d491bd243293843b96/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:36:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 7e22c749-e371-5fc3-b316-d7f4730175f7 with identifier: 1979777
2026-03-25 16:36:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 7e22c749-e371-5fc3-b316-d7f4730175f7 with identifier: 1979777
2026-03-25 16:36:40 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 7e22c749-e371-5fc3-b316-d7f4730175f7 with identifier: 1979777 to the API
2026-03-25 16:36:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:36:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:36:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'PYRIT SILVER METALLIC',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-26T09:30:00Z',
'fuel_type': 'diesel',
'id': '7e22c749-e371-5fc3-b316-d7f4730175f7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40968',
'listing': 'auction',
'location': None,
'make': 'VOLKSWAGEN',
'model': 'VOLKSWAGEN PASSAT SW VAR. 2.0TDI SCR 147KW DSG 4MOT ALLTRACK FP',
'odometer': 106393,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-05-07',
'seats_number': 5,
'seller_name': None,
'title': 'VOLKSWAGEN VOLKSWAGEN PASSAT SW VAR. 2.0TDI SCR 147KW DSG 4MOT '
'ALLTRACK FP -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2021}
2026-03-25 16:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979777%27 HTTP/1.1" 200 None
2026-03-25 16:36:41 [ayvens.it] INFO: Saving data for 1979777: {'auction_closing_time': 1774517400.0, 'created_time': 1774370104.191234, 'last_price_update_time': 1774456601.124148}
2026-03-25 16:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1979777') HTTP/1.1" 204 0
2026-03-25 16:36:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 312f756d-b76b-5bd7-9f78-3b8d0b0acfee with identifier: 1983519
2026-03-25 16:36:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 312f756d-b76b-5bd7-9f78-3b8d0b0acfee with identifier: 1983519
2026-03-25 16:36:41 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 312f756d-b76b-5bd7-9f78-3b8d0b0acfee with identifier: 1983519 to the API
2026-03-25 16:36:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:36:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:36:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/ga4/07ac3bf3f570405b996339a4dc9f4b8b/images/large/3.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'MAGNETIC GREY',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-27T09:30:00Z',
'fuel_type': 'petrol',
'id': '312f756d-b76b-5bd7-9f78-3b8d0b0acfee',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41025',
'listing': 'auction',
'location': None,
'make': 'FORD',
'model': 'FORD FOCUS SW 1.0 ECOBOOST 125CV ST LINE SW FP',
'odometer': 83994,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 34,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_312f756d-b76b-5bd7-9f78-3b8d0b0acfee/312f756d-b76b-5bd7-9f78-3b8d0b0acfee_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 681276,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga4/07ac3bf3f570405b996339a4dc9f4b8b/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_312f756d-b76b-5bd7-9f78-3b8d0b0acfee/312f756d-b76b-5bd7-9f78-3b8d0b0acfee_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 734504,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga4/07ac3bf3f570405b996339a4dc9f4b8b/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_312f756d-b76b-5bd7-9f78-3b8d0b0acfee/312f756d-b76b-5bd7-9f78-3b8d0b0acfee_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 681276,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga4/07ac3bf3f570405b996339a4dc9f4b8b/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_312f756d-b76b-5bd7-9f78-3b8d0b0acfee/312f756d-b76b-5bd7-9f78-3b8d0b0acfee_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 706519,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga4/07ac3bf3f570405b996339a4dc9f4b8b/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_312f756d-b76b-5bd7-9f78-3b8d0b0acfee/312f756d-b76b-5bd7-9f78-3b8d0b0acfee_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 683355,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga4/07ac3bf3f570405b996339a4dc9f4b8b/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_312f756d-b76b-5bd7-9f78-3b8d0b0acfee/312f756d-b76b-5bd7-9f78-3b8d0b0acfee_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 597105,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga4/07ac3bf3f570405b996339a4dc9f4b8b/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_312f756d-b76b-5bd7-9f78-3b8d0b0acfee/312f756d-b76b-5bd7-9f78-3b8d0b0acfee_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 535973,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga4/07ac3bf3f570405b996339a4dc9f4b8b/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_312f756d-b76b-5bd7-9f78-3b8d0b0acfee/312f756d-b76b-5bd7-9f78-3b8d0b0acfee_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 457549,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga4/07ac3bf3f570405b996339a4dc9f4b8b/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_312f756d-b76b-5bd7-9f78-3b8d0b0acfee/312f756d-b76b-5bd7-9f78-3b8d0b0acfee_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 558988,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga4/07ac3bf3f570405b996339a4dc9f4b8b/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_312f756d-b76b-5bd7-9f78-3b8d0b0acfee/312f756d-b76b-5bd7-9f78-3b8d0b0acfee_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 527155,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga4/07ac3bf3f570405b996339a4dc9f4b8b/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-02-25',
'seats_number': 5,
'seller_name': None,
'title': 'FORD FORD FOCUS SW 1.0 ECOBOOST 125CV ST LINE SW FP -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2020}
2026-03-25 16:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983519%27 HTTP/1.1" 200 None
2026-03-25 16:36:41 [ayvens.it] INFO: Saving data for 1983519: {'created_time': 1774456601.432546, 'last_price_update_time': 1774456601.432556, 'auction_closing_time': 1774603800.0}
2026-03-25 16:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1983519') HTTP/1.1" 204 0
2026-03-25 16:36:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 799a1ab9-9082-5ba3-bb6b-5bf6d4bb3144 with identifier: 1983521
2026-03-25 16:36:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 799a1ab9-9082-5ba3-bb6b-5bf6d4bb3144 with identifier: 1983521
2026-03-25 16:36:41 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 799a1ab9-9082-5ba3-bb6b-5bf6d4bb3144 with identifier: 1983521 to the API
2026-03-25 16:36:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:36:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:36:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gk4/9ba2b33483494b6e8aa9557f4ce82987/images/large/3.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Unknown',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-27T09:30:00Z',
'fuel_type': 'hybrid',
'id': '799a1ab9-9082-5ba3-bb6b-5bf6d4bb3144',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41025',
'listing': 'auction',
'location': None,
'make': 'FORD',
'model': 'FORD PUMA 1.0 Ecoboost Hybrid 125CV Tit. Des. Auto Sport utility '
'vehicle 5-door (Euro 6.2)',
'odometer': 76166,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 111,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_799a1ab9-9082-5ba3-bb6b-5bf6d4bb3144/799a1ab9-9082-5ba3-bb6b-5bf6d4bb3144_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 655613,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk4/9ba2b33483494b6e8aa9557f4ce82987/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_799a1ab9-9082-5ba3-bb6b-5bf6d4bb3144/799a1ab9-9082-5ba3-bb6b-5bf6d4bb3144_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 655613,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk4/9ba2b33483494b6e8aa9557f4ce82987/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_799a1ab9-9082-5ba3-bb6b-5bf6d4bb3144/799a1ab9-9082-5ba3-bb6b-5bf6d4bb3144_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 665078,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk4/9ba2b33483494b6e8aa9557f4ce82987/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_799a1ab9-9082-5ba3-bb6b-5bf6d4bb3144/799a1ab9-9082-5ba3-bb6b-5bf6d4bb3144_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 657296,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk4/9ba2b33483494b6e8aa9557f4ce82987/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_799a1ab9-9082-5ba3-bb6b-5bf6d4bb3144/799a1ab9-9082-5ba3-bb6b-5bf6d4bb3144_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 663753,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk4/9ba2b33483494b6e8aa9557f4ce82987/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_799a1ab9-9082-5ba3-bb6b-5bf6d4bb3144/799a1ab9-9082-5ba3-bb6b-5bf6d4bb3144_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 531866,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk4/9ba2b33483494b6e8aa9557f4ce82987/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_799a1ab9-9082-5ba3-bb6b-5bf6d4bb3144/799a1ab9-9082-5ba3-bb6b-5bf6d4bb3144_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 498965,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk4/9ba2b33483494b6e8aa9557f4ce82987/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_799a1ab9-9082-5ba3-bb6b-5bf6d4bb3144/799a1ab9-9082-5ba3-bb6b-5bf6d4bb3144_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 471535,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk4/9ba2b33483494b6e8aa9557f4ce82987/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_799a1ab9-9082-5ba3-bb6b-5bf6d4bb3144/799a1ab9-9082-5ba3-bb6b-5bf6d4bb3144_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 558965,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk4/9ba2b33483494b6e8aa9557f4ce82987/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_799a1ab9-9082-5ba3-bb6b-5bf6d4bb3144/799a1ab9-9082-5ba3-bb6b-5bf6d4bb3144_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 466584,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk4/9ba2b33483494b6e8aa9557f4ce82987/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-06-29',
'seats_number': 5,
'seller_name': None,
'title': 'FORD FORD PUMA 1.0 Ecoboost Hybrid 125CV Tit. Des. Auto Sport '
'utility vehicle 5-door (Euro 6.2) -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-25 16:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983521%27 HTTP/1.1" 200 None
2026-03-25 16:36:41 [ayvens.it] INFO: Saving data for 1983521: {'created_time': 1774456601.857345, 'last_price_update_time': 1774456601.857356, 'auction_closing_time': 1774603800.0}
2026-03-25 16:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1983521') HTTP/1.1" 204 0
2026-03-25 16:36:41 [ayvens.it] INFO: Found listing with ID: 1979778
2026-03-25 16:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979778%27 HTTP/1.1" 200 None
2026-03-25 16:36:41 [ayvens.it] INFO: Scrape type for 1979778: 2
2026-03-25 16:36:41 [ayvens.it] INFO: Extracting data for car ID: 1979778
2026-03-25 16:36:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 20c2fb98-1a27-5669-9812-8ac73582be0d with identifier: 1979778
2026-03-25 16:36:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 20c2fb98-1a27-5669-9812-8ac73582be0d with scrape type 2
2026-03-25 16:36:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 20c2fb98-1a27-5669-9812-8ac73582be0d with scrape type 2
2026-03-25 16:36:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 20c2fb98-1a27-5669-9812-8ac73582be0d, identifier: 1979778
2026-03-25 16:36:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 20c2fb98-1a27-5669-9812-8ac73582be0d with identifier: 1979778
2026-03-25 16:36:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 20c2fb98-1a27-5669-9812-8ac73582be0d with identifier: 1979778
2026-03-25 16:36:42 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 20c2fb98-1a27-5669-9812-8ac73582be0d with identifier: 1979778 to the API
2026-03-25 16:36:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:36:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:36:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'DEEP BLACK PERLA',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-26T09:30:00Z',
'fuel_type': 'diesel',
'id': '20c2fb98-1a27-5669-9812-8ac73582be0d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40968',
'listing': 'auction',
'location': None,
'make': 'VOLKSWAGEN',
'model': 'VOLKSWAGEN TIGUAN (PC) 2.0 TDI SCR 110KW BUSINESS BMT DSG FP',
'odometer': 122726,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-06-23',
'seats_number': 5,
'seller_name': None,
'title': 'VOLKSWAGEN VOLKSWAGEN TIGUAN (PC) 2.0 TDI SCR 110KW BUSINESS BMT '
'DSG FP -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2020}
2026-03-25 16:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979778%27 HTTP/1.1" 200 None
2026-03-25 16:36:42 [ayvens.it] INFO: Saving data for 1979778: {'auction_closing_time': 1774517400.0, 'created_time': 1774370105.513741, 'last_price_update_time': 1774456602.459028}
2026-03-25 16:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1979778') HTTP/1.1" 204 0
2026-03-25 16:36:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:36:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc87a290>
2026-03-25 16:36:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:36:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:36:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:36:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91bf1031-019b-58c8-991e-9e1a90bc1bea/91bf1031-019b-58c8-991e-9e1a90bc1bea_image_4.jpg HTTP/1.1" 201 0
2026-03-25 16:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga9%252F507aeb10cabf4d8ba026cc7a570c4b73%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 16:36:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga9/507aeb10cabf4d8ba026cc7a570c4b73/images/large/5.jpg saved to cache
2026-03-25 16:36:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 91bf1031-019b-58c8-991e-9e1a90bc1bea
2026-03-25 16:36:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 91bf1031-019b-58c8-991e-9e1a90bc1bea, skipping ID generation
2026-03-25 16:36:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 91bf1031-019b-58c8-991e-9e1a90bc1bea with scrape type 1
2026-03-25 16:36:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 91bf1031-019b-58c8-991e-9e1a90bc1bea sending to next pipeline
2026-03-25 16:36:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 91bf1031-019b-58c8-991e-9e1a90bc1bea, identifier: 1983518
2026-03-25 16:36:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:36:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc80ca10>
2026-03-25 16:36:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:36:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:36:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:36:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92894306-eabc-56a1-afdc-298c40030e71/92894306-eabc-56a1-afdc-298c40030e71_image_5.jpg HTTP/1.1" 201 0
2026-03-25 16:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl4%252F367794af31bf48d491bd243293843b96%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 16:36:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl4/367794af31bf48d491bd243293843b96/images/large/6.jpg saved to cache
2026-03-25 16:36:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 92894306-eabc-56a1-afdc-298c40030e71
2026-03-25 16:36:42 [ayvens.it] INFO: Found listing with ID: 1979779
2026-03-25 16:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979779%27 HTTP/1.1" 200 None
2026-03-25 16:36:42 [ayvens.it] INFO: Scrape type for 1979779: 2
2026-03-25 16:36:42 [ayvens.it] INFO: Extracting data for car ID: 1979779
2026-03-25 16:36:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 560aef10-cdf5-5275-888a-337f4a24edf5 with identifier: 1979779
2026-03-25 16:36:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 560aef10-cdf5-5275-888a-337f4a24edf5 with scrape type 2
2026-03-25 16:36:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 560aef10-cdf5-5275-888a-337f4a24edf5 with scrape type 2
2026-03-25 16:36:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 560aef10-cdf5-5275-888a-337f4a24edf5, identifier: 1979779
2026-03-25 16:36:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 91bf1031-019b-58c8-991e-9e1a90bc1bea with identifier: 1983518
2026-03-25 16:36:42 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:36:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 91bf1031-019b-58c8-991e-9e1a90bc1bea with identifier: 1983518
2026-03-25 16:36:42 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 91bf1031-019b-58c8-991e-9e1a90bc1bea with identifier: 1983518 to the API
2026-03-25 16:36:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:36:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:36:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/ga9/507aeb10cabf4d8ba026cc7a570c4b73/images/large/5.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Unknown',
'currency': 'EUR',
'doors_number': 4,
'engine': '1.5L',
'expiration_date': '2026-03-27T09:30:00Z',
'fuel_type': 'diesel',
'id': '91bf1031-019b-58c8-991e-9e1a90bc1bea',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41025',
'listing': 'auction',
'location': None,
'make': 'FORD',
'model': 'FORD TRANSIT CONNECT 1.5 TDCi 100cv S&S Trend 200 L1H1 Vettura '
'Furgonata 4-door (Euro 6.2)',
'odometer': 113189,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 66,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91bf1031-019b-58c8-991e-9e1a90bc1bea/91bf1031-019b-58c8-991e-9e1a90bc1bea_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 619670,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga9/507aeb10cabf4d8ba026cc7a570c4b73/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91bf1031-019b-58c8-991e-9e1a90bc1bea/91bf1031-019b-58c8-991e-9e1a90bc1bea_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 587380,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga9/507aeb10cabf4d8ba026cc7a570c4b73/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91bf1031-019b-58c8-991e-9e1a90bc1bea/91bf1031-019b-58c8-991e-9e1a90bc1bea_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 619670,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga9/507aeb10cabf4d8ba026cc7a570c4b73/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91bf1031-019b-58c8-991e-9e1a90bc1bea/91bf1031-019b-58c8-991e-9e1a90bc1bea_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 529113,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga9/507aeb10cabf4d8ba026cc7a570c4b73/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91bf1031-019b-58c8-991e-9e1a90bc1bea/91bf1031-019b-58c8-991e-9e1a90bc1bea_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 532529,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga9/507aeb10cabf4d8ba026cc7a570c4b73/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91bf1031-019b-58c8-991e-9e1a90bc1bea/91bf1031-019b-58c8-991e-9e1a90bc1bea_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 568628,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga9/507aeb10cabf4d8ba026cc7a570c4b73/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91bf1031-019b-58c8-991e-9e1a90bc1bea/91bf1031-019b-58c8-991e-9e1a90bc1bea_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 524910,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga9/507aeb10cabf4d8ba026cc7a570c4b73/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91bf1031-019b-58c8-991e-9e1a90bc1bea/91bf1031-019b-58c8-991e-9e1a90bc1bea_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 521685,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga9/507aeb10cabf4d8ba026cc7a570c4b73/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91bf1031-019b-58c8-991e-9e1a90bc1bea/91bf1031-019b-58c8-991e-9e1a90bc1bea_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 540649,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga9/507aeb10cabf4d8ba026cc7a570c4b73/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91bf1031-019b-58c8-991e-9e1a90bc1bea/91bf1031-019b-58c8-991e-9e1a90bc1bea_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 472737,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga9/507aeb10cabf4d8ba026cc7a570c4b73/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-03-04',
'seats_number': 5,
'seller_name': None,
'title': 'FORD FORD TRANSIT CONNECT 1.5 TDCi 100cv S&S Trend 200 L1H1 Vettura '
'Furgonata 4-door (Euro 6.2) -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2020}
2026-03-25 16:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983518%27 HTTP/1.1" 200 None
2026-03-25 16:36:43 [ayvens.it] INFO: Saving data for 1983518: {'created_time': 1774456603.133388, 'last_price_update_time': 1774456603.133401, 'auction_closing_time': 1774603800.0}
2026-03-25 16:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1983518') HTTP/1.1" 204 0
2026-03-25 16:36:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt1/2543eca7d44346b584da76cdcf10ae1c/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:36:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp0/854ed155bbc04992b4ae22744a224d6a/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:36:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 560aef10-cdf5-5275-888a-337f4a24edf5 with identifier: 1979779
2026-03-25 16:36:43 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:36:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 560aef10-cdf5-5275-888a-337f4a24edf5 with identifier: 1979779
2026-03-25 16:36:43 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 560aef10-cdf5-5275-888a-337f4a24edf5 with identifier: 1979779 to the API
2026-03-25 16:36:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:36:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:36:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'PLATINUM SILVER MET',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-26T09:30:00Z',
'fuel_type': 'diesel',
'id': '560aef10-cdf5-5275-888a-337f4a24edf5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40968',
'listing': 'auction',
'location': None,
'make': 'NISSAN',
'model': 'NISSAN MICRA dCi 90 Acenta Hatchback 5-door (Euro 6)',
'odometer': 203345,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-06-29',
'seats_number': 5,
'seller_name': None,
'title': 'NISSAN NISSAN MICRA dCi 90 Acenta Hatchback 5-door (Euro 6) -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2018}
2026-03-25 16:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979779%27 HTTP/1.1" 200 None
2026-03-25 16:36:43 [ayvens.it] INFO: Saving data for 1979779: {'auction_closing_time': 1774517400.0, 'created_time': 1774370108.735008, 'last_price_update_time': 1774456603.397301}
2026-03-25 16:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1979779') HTTP/1.1" 204 0
2026-03-25 16:36:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:36:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34d6b3f0d0>
2026-03-25 16:36:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:36:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:36:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:36:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92894306-eabc-56a1-afdc-298c40030e71/92894306-eabc-56a1-afdc-298c40030e71_image_4.jpg HTTP/1.1" 201 0
2026-03-25 16:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl4%252F367794af31bf48d491bd243293843b96%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 16:36:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl4/367794af31bf48d491bd243293843b96/images/large/5.jpg saved to cache
2026-03-25 16:36:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 92894306-eabc-56a1-afdc-298c40030e71
2026-03-25 16:36:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 92894306-eabc-56a1-afdc-298c40030e71, skipping ID generation
2026-03-25 16:36:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 92894306-eabc-56a1-afdc-298c40030e71 with scrape type 1
2026-03-25 16:36:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 92894306-eabc-56a1-afdc-298c40030e71 sending to next pipeline
2026-03-25 16:36:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 92894306-eabc-56a1-afdc-298c40030e71, identifier: 1983517
2026-03-25 16:36:43 [ayvens.it] INFO: Found listing with ID: 1979780
2026-03-25 16:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979780%27 HTTP/1.1" 200 None
2026-03-25 16:36:43 [ayvens.it] INFO: Scrape type for 1979780: 2
2026-03-25 16:36:43 [ayvens.it] INFO: Extracting data for car ID: 1979780
2026-03-25 16:36:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f4d69182-7a5c-59ec-8858-77380a1a4c90 with identifier: 1979780
2026-03-25 16:36:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f4d69182-7a5c-59ec-8858-77380a1a4c90 with scrape type 2
2026-03-25 16:36:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f4d69182-7a5c-59ec-8858-77380a1a4c90 with scrape type 2
2026-03-25 16:36:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: f4d69182-7a5c-59ec-8858-77380a1a4c90, identifier: 1979780
2026-03-25 16:36:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 92894306-eabc-56a1-afdc-298c40030e71 with identifier: 1983517
2026-03-25 16:36:43 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:36:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 92894306-eabc-56a1-afdc-298c40030e71 with identifier: 1983517
2026-03-25 16:36:43 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 92894306-eabc-56a1-afdc-298c40030e71 with identifier: 1983517 to the API
2026-03-25 16:36:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:36:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:36:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gl4/367794af31bf48d491bd243293843b96/images/large/5.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Unknown',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.5L',
'expiration_date': '2026-03-27T09:30:00Z',
'fuel_type': 'hybrid',
'id': '92894306-eabc-56a1-afdc-298c40030e71',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41025',
'listing': 'auction',
'location': None,
'make': 'FORD',
'model': 'FORD KUGA 2.5 Benzina FHEV 190CV 4WD Vignale Auto Sport utility '
'vehicle 5-door (Euro 6.2)',
'odometer': 52522,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 23,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92894306-eabc-56a1-afdc-298c40030e71/92894306-eabc-56a1-afdc-298c40030e71_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 678122,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl4/367794af31bf48d491bd243293843b96/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92894306-eabc-56a1-afdc-298c40030e71/92894306-eabc-56a1-afdc-298c40030e71_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 712324,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl4/367794af31bf48d491bd243293843b96/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92894306-eabc-56a1-afdc-298c40030e71/92894306-eabc-56a1-afdc-298c40030e71_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 678122,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl4/367794af31bf48d491bd243293843b96/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92894306-eabc-56a1-afdc-298c40030e71/92894306-eabc-56a1-afdc-298c40030e71_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 696799,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl4/367794af31bf48d491bd243293843b96/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92894306-eabc-56a1-afdc-298c40030e71/92894306-eabc-56a1-afdc-298c40030e71_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 696282,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl4/367794af31bf48d491bd243293843b96/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92894306-eabc-56a1-afdc-298c40030e71/92894306-eabc-56a1-afdc-298c40030e71_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 640376,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl4/367794af31bf48d491bd243293843b96/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92894306-eabc-56a1-afdc-298c40030e71/92894306-eabc-56a1-afdc-298c40030e71_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 571273,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl4/367794af31bf48d491bd243293843b96/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92894306-eabc-56a1-afdc-298c40030e71/92894306-eabc-56a1-afdc-298c40030e71_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 507167,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl4/367794af31bf48d491bd243293843b96/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92894306-eabc-56a1-afdc-298c40030e71/92894306-eabc-56a1-afdc-298c40030e71_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 640796,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl4/367794af31bf48d491bd243293843b96/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92894306-eabc-56a1-afdc-298c40030e71/92894306-eabc-56a1-afdc-298c40030e71_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 539973,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl4/367794af31bf48d491bd243293843b96/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-11-23',
'seats_number': 5,
'seller_name': None,
'title': 'FORD FORD KUGA 2.5 Benzina FHEV 190CV 4WD Vignale Auto Sport '
'utility vehicle 5-door (Euro 6.2) -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-25 16:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983517%27 HTTP/1.1" 200 None
2026-03-25 16:36:44 [ayvens.it] INFO: Saving data for 1983517: {'created_time': 1774456604.021151, 'last_price_update_time': 1774456604.021159, 'auction_closing_time': 1774603800.0}
2026-03-25 16:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1983517') HTTP/1.1" 204 0
2026-03-25 16:36:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: f4d69182-7a5c-59ec-8858-77380a1a4c90 with identifier: 1979780
2026-03-25 16:36:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: f4d69182-7a5c-59ec-8858-77380a1a4c90 with identifier: 1979780
2026-03-25 16:36:44 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: f4d69182-7a5c-59ec-8858-77380a1a4c90 with identifier: 1979780 to the API
2026-03-25 16:36:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:36:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:36:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'BIANCO PASTELLO',
'currency': 'EUR',
'doors_number': 3,
'engine': '1.6L',
'expiration_date': '2026-03-26T09:30:00Z',
'fuel_type': 'diesel',
'id': 'f4d69182-7a5c-59ec-8858-77380a1a4c90',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40968',
'listing': 'auction',
'location': None,
'make': 'FIAT',
'model': 'FIAT DOBLÃ’ CARGO CH1 BUSINESS 1.6 Mjet 105cv E6D-f S&S Vettura '
'Furgonata 4-door (Euro 6D)',
'odometer': 162416,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-12-30',
'seats_number': 5,
'seller_name': None,
'title': 'FIAT FIAT DOBLÃ’ CARGO CH1 BUSINESS 1.6 Mjet 105cv E6D-f S&S Vettura '
'Furgonata 4-door (Euro 6D) -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2021}
2026-03-25 16:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979780%27 HTTP/1.1" 200 None
2026-03-25 16:36:44 [ayvens.it] INFO: Saving data for 1979780: {'auction_closing_time': 1774517400.0, 'created_time': 1774370111.55433, 'last_price_update_time': 1774456604.279456}
2026-03-25 16:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1979780') HTTP/1.1" 204 0
2026-03-25 16:36:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp2/5f254401a449415e9b19e693067aa410/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:36:44 [ayvens.it] INFO: Found listing with ID: 1979781
2026-03-25 16:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979781%27 HTTP/1.1" 200 None
2026-03-25 16:36:44 [ayvens.it] INFO: Scrape type for 1979781: 2
2026-03-25 16:36:44 [ayvens.it] INFO: Extracting data for car ID: 1979781
2026-03-25 16:36:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4cd637bd-3f6f-5ac0-aaf1-0fb749b9b568 with identifier: 1979781
2026-03-25 16:36:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4cd637bd-3f6f-5ac0-aaf1-0fb749b9b568 with scrape type 2
2026-03-25 16:36:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4cd637bd-3f6f-5ac0-aaf1-0fb749b9b568 with scrape type 2
2026-03-25 16:36:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 4cd637bd-3f6f-5ac0-aaf1-0fb749b9b568, identifier: 1979781
2026-03-25 16:36:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:36:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dca27710>
2026-03-25 16:36:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:36:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:36:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:36:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5ceaa04c-246a-55ae-bcd3-69360150fb1d/5ceaa04c-246a-55ae-bcd3-69360150fb1d_image_5.jpg HTTP/1.1" 201 0
2026-03-25 16:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt1%252F2543eca7d44346b584da76cdcf10ae1c%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 16:36:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt1/2543eca7d44346b584da76cdcf10ae1c/images/large/6.jpg saved to cache
2026-03-25 16:36:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5ceaa04c-246a-55ae-bcd3-69360150fb1d
2026-03-25 16:36:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5ceaa04c-246a-55ae-bcd3-69360150fb1d, skipping ID generation
2026-03-25 16:36:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5ceaa04c-246a-55ae-bcd3-69360150fb1d with scrape type 1
2026-03-25 16:36:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5ceaa04c-246a-55ae-bcd3-69360150fb1d sending to next pipeline
2026-03-25 16:36:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 5ceaa04c-246a-55ae-bcd3-69360150fb1d, identifier: 1983516
2026-03-25 16:36:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:36:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc373dd0>
2026-03-25 16:36:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:36:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:36:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:36:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5acd321c-4a5a-5b6c-9bb3-c1c0f3b07ce1/5acd321c-4a5a-5b6c-9bb3-c1c0f3b07ce1_image_3.jpg HTTP/1.1" 201 0
2026-03-25 16:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp0%252F854ed155bbc04992b4ae22744a224d6a%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 16:36:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp0/854ed155bbc04992b4ae22744a224d6a/images/large/4.jpg saved to cache
2026-03-25 16:36:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5acd321c-4a5a-5b6c-9bb3-c1c0f3b07ce1
2026-03-25 16:36:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp2/5f254401a449415e9b19e693067aa410/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:36:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 4cd637bd-3f6f-5ac0-aaf1-0fb749b9b568 with identifier: 1979781
2026-03-25 16:36:44 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:36:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 4cd637bd-3f6f-5ac0-aaf1-0fb749b9b568 with identifier: 1979781
2026-03-25 16:36:44 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 4cd637bd-3f6f-5ac0-aaf1-0fb749b9b568 with identifier: 1979781 to the API
2026-03-25 16:36:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:36:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:36:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'FLUX GREY METALLIC SATIN MATTE',
'currency': 'EUR',
'doors_number': 5,
'engine': '3.0L',
'expiration_date': '2026-03-26T09:30:00Z',
'fuel_type': 'diesel',
'id': '4cd637bd-3f6f-5ac0-aaf1-0fb749b9b568',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40968',
'listing': 'auction',
'location': None,
'make': 'LAND ROVER',
'model': 'LAND ROVER RANGE ROVER SPORT 3.0 SDV6 MHEV 300cv HSE Dynamic aut. '
'Sport utility vehicle 5-door (Euro 6D)',
'odometer': 88611,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-05-31',
'seats_number': 5,
'seller_name': None,
'title': 'LAND ROVER LAND ROVER RANGE ROVER SPORT 3.0 SDV6 MHEV 300cv HSE '
'Dynamic aut. Sport utility vehicle 5-door (Euro 6D) -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2021}
2026-03-25 16:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979781%27 HTTP/1.1" 200 None
2026-03-25 16:36:44 [ayvens.it] INFO: Saving data for 1979781: {'auction_closing_time': 1774517400.0, 'created_time': 1774370175.85428, 'last_price_update_time': 1774456604.852192}
2026-03-25 16:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1979781') HTTP/1.1" 204 0
2026-03-25 16:36:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 5ceaa04c-246a-55ae-bcd3-69360150fb1d with identifier: 1983516
2026-03-25 16:36:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 5ceaa04c-246a-55ae-bcd3-69360150fb1d with identifier: 1983516
2026-03-25 16:36:44 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 5ceaa04c-246a-55ae-bcd3-69360150fb1d with identifier: 1983516 to the API
2026-03-25 16:36:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:36:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:36:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gt1/2543eca7d44346b584da76cdcf10ae1c/images/large/6.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'GENERIC COLOR',
'currency': 'EUR',
'doors_number': 5,
'engine': '5.0L',
'expiration_date': '2026-03-27T09:30:00Z',
'fuel_type': 'electric',
'id': '5ceaa04c-246a-55ae-bcd3-69360150fb1d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41025',
'listing': 'auction',
'location': None,
'make': 'FORD',
'model': 'FORD MUSTANG MACH-E 294CV EXTENDED RANGE PREMIUM',
'odometer': 25,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 23,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ceaa04c-246a-55ae-bcd3-69360150fb1d/5ceaa04c-246a-55ae-bcd3-69360150fb1d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 673226,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt1/2543eca7d44346b584da76cdcf10ae1c/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ceaa04c-246a-55ae-bcd3-69360150fb1d/5ceaa04c-246a-55ae-bcd3-69360150fb1d_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 664248,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt1/2543eca7d44346b584da76cdcf10ae1c/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ceaa04c-246a-55ae-bcd3-69360150fb1d/5ceaa04c-246a-55ae-bcd3-69360150fb1d_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 383653,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt1/2543eca7d44346b584da76cdcf10ae1c/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ceaa04c-246a-55ae-bcd3-69360150fb1d/5ceaa04c-246a-55ae-bcd3-69360150fb1d_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 613035,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt1/2543eca7d44346b584da76cdcf10ae1c/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ceaa04c-246a-55ae-bcd3-69360150fb1d/5ceaa04c-246a-55ae-bcd3-69360150fb1d_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 388900,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt1/2543eca7d44346b584da76cdcf10ae1c/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ceaa04c-246a-55ae-bcd3-69360150fb1d/5ceaa04c-246a-55ae-bcd3-69360150fb1d_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 440409,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt1/2543eca7d44346b584da76cdcf10ae1c/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ceaa04c-246a-55ae-bcd3-69360150fb1d/5ceaa04c-246a-55ae-bcd3-69360150fb1d_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 652998,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt1/2543eca7d44346b584da76cdcf10ae1c/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ceaa04c-246a-55ae-bcd3-69360150fb1d/5ceaa04c-246a-55ae-bcd3-69360150fb1d_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 673226,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt1/2543eca7d44346b584da76cdcf10ae1c/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ceaa04c-246a-55ae-bcd3-69360150fb1d/5ceaa04c-246a-55ae-bcd3-69360150fb1d_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 419527,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt1/2543eca7d44346b584da76cdcf10ae1c/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ceaa04c-246a-55ae-bcd3-69360150fb1d/5ceaa04c-246a-55ae-bcd3-69360150fb1d_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 638685,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt1/2543eca7d44346b584da76cdcf10ae1c/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-03-20',
'seats_number': 5,
'seller_name': None,
'title': 'FORD FORD MUSTANG MACH-E 294CV EXTENDED RANGE PREMIUM -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2024}
2026-03-25 16:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983516%27 HTTP/1.1" 200 None
2026-03-25 16:36:45 [ayvens.it] INFO: Saving data for 1983516: {'created_time': 1774456605.240478, 'last_price_update_time': 1774456605.240488, 'auction_closing_time': 1774603800.0}
2026-03-25 16:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1983516') HTTP/1.1" 204 0
2026-03-25 16:36:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp0/854ed155bbc04992b4ae22744a224d6a/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:36:45 [ayvens.it] INFO: Found listing with ID: 1979782
2026-03-25 16:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979782%27 HTTP/1.1" 200 None
2026-03-25 16:36:45 [ayvens.it] INFO: Scrape type for 1979782: 2
2026-03-25 16:36:45 [ayvens.it] INFO: Extracting data for car ID: 1979782
2026-03-25 16:36:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2952b0ba-71b3-508f-b125-ea38d7ce8352 with identifier: 1979782
2026-03-25 16:36:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2952b0ba-71b3-508f-b125-ea38d7ce8352 with scrape type 2
2026-03-25 16:36:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2952b0ba-71b3-508f-b125-ea38d7ce8352 with scrape type 2
2026-03-25 16:36:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 2952b0ba-71b3-508f-b125-ea38d7ce8352, identifier: 1979782
2026-03-25 16:36:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh6/106a200b436e4ad197fe602bb0788915/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:36:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 2952b0ba-71b3-508f-b125-ea38d7ce8352 with identifier: 1979782
2026-03-25 16:36:45 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:36:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 2952b0ba-71b3-508f-b125-ea38d7ce8352 with identifier: 1979782
2026-03-25 16:36:45 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 2952b0ba-71b3-508f-b125-ea38d7ce8352 with identifier: 1979782 to the API
2026-03-25 16:36:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:36:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:36:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'WHITE PASTELLO',
'currency': 'EUR',
'doors_number': 4,
'engine': '1.5L',
'expiration_date': '2026-03-26T09:30:00Z',
'fuel_type': 'diesel',
'id': '2952b0ba-71b3-508f-b125-ea38d7ce8352',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40968',
'listing': 'auction',
'location': None,
'make': 'TOYOTA',
'model': 'TOYOTA PROACE CITY (PC 1.5D 100CV S&S MT L1 S ACTIVE FP',
'odometer': 188843,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-11-18',
'seats_number': 5,
'seller_name': None,
'title': 'TOYOTA TOYOTA PROACE CITY (PC 1.5D 100CV S&S MT L1 S ACTIVE FP -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2021}
2026-03-25 16:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979782%27 HTTP/1.1" 200 None
2026-03-25 16:36:46 [ayvens.it] INFO: Saving data for 1979782: {'auction_closing_time': 1774517400.0, 'created_time': 1774370175.272097, 'last_price_update_time': 1774456606.68536}
2026-03-25 16:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1979782') HTTP/1.1" 204 0
2026-03-25 16:36:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh6/106a200b436e4ad197fe602bb0788915/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:36:46 [ayvens.it] INFO: Found listing with ID: 1979783
2026-03-25 16:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979783%27 HTTP/1.1" 200 None
2026-03-25 16:36:46 [ayvens.it] INFO: Scrape type for 1979783: 2
2026-03-25 16:36:46 [ayvens.it] INFO: Extracting data for car ID: 1979783
2026-03-25 16:36:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0def6868-7bd9-530c-8e54-f07a5d61e0d7 with identifier: 1979783
2026-03-25 16:36:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0def6868-7bd9-530c-8e54-f07a5d61e0d7 with scrape type 2
2026-03-25 16:36:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0def6868-7bd9-530c-8e54-f07a5d61e0d7 with scrape type 2
2026-03-25 16:36:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 0def6868-7bd9-530c-8e54-f07a5d61e0d7, identifier: 1979783
2026-03-25 16:36:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fs4/e02b3ef8971245959c29dd28ec0d6b62/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:36:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 0def6868-7bd9-530c-8e54-f07a5d61e0d7 with identifier: 1979783
2026-03-25 16:36:46 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:36:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 0def6868-7bd9-530c-8e54-f07a5d61e0d7 with identifier: 1979783
2026-03-25 16:36:46 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 0def6868-7bd9-530c-8e54-f07a5d61e0d7 with identifier: 1979783 to the API
2026-03-25 16:36:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:36:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:36:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'BLU SEPANG EFFETTO PERLA',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-26T09:30:00Z',
'fuel_type': 'hybrid',
'id': '0def6868-7bd9-530c-8e54-f07a5d61e0d7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40968',
'listing': 'auction',
'location': None,
'make': 'AUDI',
'model': 'AUDI Q5 SPORTBACK 45 TFSI S LINE QUATTRO S TRONIC FP',
'odometer': 32755,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-08-26',
'seats_number': 5,
'seller_name': None,
'title': 'AUDI AUDI Q5 SPORTBACK 45 TFSI S LINE QUATTRO S TRONIC FP -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2021}
2026-03-25 16:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979783%27 HTTP/1.1" 200 None
2026-03-25 16:36:47 [ayvens.it] INFO: Saving data for 1979783: {'auction_closing_time': 1774517400.0, 'created_time': 1774370173.955133, 'last_price_update_time': 1774456607.078933}
2026-03-25 16:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1979783') HTTP/1.1" 204 0
2026-03-25 16:36:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:36:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc935590>
2026-03-25 16:36:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:36:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:36:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:36:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_378ffb94-f0ac-5fbd-b6eb-d3d9e6f9fcee/378ffb94-f0ac-5fbd-b6eb-d3d9e6f9fcee_image_6.jpg HTTP/1.1" 201 0
2026-03-25 16:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp2%252F5f254401a449415e9b19e693067aa410%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 16:36:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp2/5f254401a449415e9b19e693067aa410/images/large/7.jpg saved to cache
2026-03-25 16:36:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 378ffb94-f0ac-5fbd-b6eb-d3d9e6f9fcee
2026-03-25 16:36:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:36:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc89f5d0>
2026-03-25 16:36:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:36:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:36:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:36:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_378ffb94-f0ac-5fbd-b6eb-d3d9e6f9fcee/378ffb94-f0ac-5fbd-b6eb-d3d9e6f9fcee_image_5.jpg HTTP/1.1" 201 0
2026-03-25 16:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp2%252F5f254401a449415e9b19e693067aa410%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 16:36:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp2/5f254401a449415e9b19e693067aa410/images/large/6.jpg saved to cache
2026-03-25 16:36:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 378ffb94-f0ac-5fbd-b6eb-d3d9e6f9fcee
2026-03-25 16:36:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 378ffb94-f0ac-5fbd-b6eb-d3d9e6f9fcee, skipping ID generation
2026-03-25 16:36:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 378ffb94-f0ac-5fbd-b6eb-d3d9e6f9fcee with scrape type 1
2026-03-25 16:36:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 378ffb94-f0ac-5fbd-b6eb-d3d9e6f9fcee sending to next pipeline
2026-03-25 16:36:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 378ffb94-f0ac-5fbd-b6eb-d3d9e6f9fcee, identifier: 1983515
2026-03-25 16:36:47 [ayvens.it] INFO: Found listing with ID: 1979784
2026-03-25 16:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979784%27 HTTP/1.1" 200 None
2026-03-25 16:36:47 [ayvens.it] INFO: Scrape type for 1979784: 2
2026-03-25 16:36:47 [ayvens.it] INFO: Extracting data for car ID: 1979784
2026-03-25 16:36:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9c8babdf-a91e-5dc7-a32f-a39678b13e8a with identifier: 1979784
2026-03-25 16:36:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9c8babdf-a91e-5dc7-a32f-a39678b13e8a with scrape type 2
2026-03-25 16:36:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9c8babdf-a91e-5dc7-a32f-a39678b13e8a with scrape type 2
2026-03-25 16:36:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 9c8babdf-a91e-5dc7-a32f-a39678b13e8a, identifier: 1979784
2026-03-25 16:36:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 378ffb94-f0ac-5fbd-b6eb-d3d9e6f9fcee with identifier: 1983515
2026-03-25 16:36:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 378ffb94-f0ac-5fbd-b6eb-d3d9e6f9fcee with identifier: 1983515
2026-03-25 16:36:47 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 378ffb94-f0ac-5fbd-b6eb-d3d9e6f9fcee with identifier: 1983515 to the API
2026-03-25 16:36:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:36:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:36:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gp2/5f254401a449415e9b19e693067aa410/images/large/6.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'CHROME BLUE METALLIZZATO',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-27T09:30:00Z',
'fuel_type': 'hybrid',
'id': '378ffb94-f0ac-5fbd-b6eb-d3d9e6f9fcee',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41025',
'listing': 'auction',
'location': None,
'make': 'FORD',
'model': 'FORD FOCUS SW (PC) 1.0 ECOB. HYBR. 125CV ST-LINE DES.AUTOSW',
'odometer': 114795,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 50,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_378ffb94-f0ac-5fbd-b6eb-d3d9e6f9fcee/378ffb94-f0ac-5fbd-b6eb-d3d9e6f9fcee_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 696705,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp2/5f254401a449415e9b19e693067aa410/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_378ffb94-f0ac-5fbd-b6eb-d3d9e6f9fcee/378ffb94-f0ac-5fbd-b6eb-d3d9e6f9fcee_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 354516,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp2/5f254401a449415e9b19e693067aa410/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_378ffb94-f0ac-5fbd-b6eb-d3d9e6f9fcee/378ffb94-f0ac-5fbd-b6eb-d3d9e6f9fcee_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 445555,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp2/5f254401a449415e9b19e693067aa410/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_378ffb94-f0ac-5fbd-b6eb-d3d9e6f9fcee/378ffb94-f0ac-5fbd-b6eb-d3d9e6f9fcee_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 543889,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp2/5f254401a449415e9b19e693067aa410/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_378ffb94-f0ac-5fbd-b6eb-d3d9e6f9fcee/378ffb94-f0ac-5fbd-b6eb-d3d9e6f9fcee_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 288177,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp2/5f254401a449415e9b19e693067aa410/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_378ffb94-f0ac-5fbd-b6eb-d3d9e6f9fcee/378ffb94-f0ac-5fbd-b6eb-d3d9e6f9fcee_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 544218,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp2/5f254401a449415e9b19e693067aa410/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_378ffb94-f0ac-5fbd-b6eb-d3d9e6f9fcee/378ffb94-f0ac-5fbd-b6eb-d3d9e6f9fcee_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 483425,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp2/5f254401a449415e9b19e693067aa410/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_378ffb94-f0ac-5fbd-b6eb-d3d9e6f9fcee/378ffb94-f0ac-5fbd-b6eb-d3d9e6f9fcee_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 456945,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp2/5f254401a449415e9b19e693067aa410/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_378ffb94-f0ac-5fbd-b6eb-d3d9e6f9fcee/378ffb94-f0ac-5fbd-b6eb-d3d9e6f9fcee_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 433460,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp2/5f254401a449415e9b19e693067aa410/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_378ffb94-f0ac-5fbd-b6eb-d3d9e6f9fcee/378ffb94-f0ac-5fbd-b6eb-d3d9e6f9fcee_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 496286,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp2/5f254401a449415e9b19e693067aa410/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-06-28',
'seats_number': 5,
'seller_name': None,
'title': 'FORD FORD FOCUS SW (PC) 1.0 ECOB. HYBR. 125CV ST-LINE DES.AUTOSW -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2023}
2026-03-25 16:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983515%27 HTTP/1.1" 200 None
2026-03-25 16:36:47 [ayvens.it] INFO: Saving data for 1983515: {'created_time': 1774456607.768609, 'last_price_update_time': 1774456607.76862, 'auction_closing_time': 1774603800.0}
2026-03-25 16:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1983515') HTTP/1.1" 204 0
2026-03-25 16:36:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh6/106a200b436e4ad197fe602bb0788915/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:36:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 9c8babdf-a91e-5dc7-a32f-a39678b13e8a with identifier: 1979784
2026-03-25 16:36:47 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:36:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 9c8babdf-a91e-5dc7-a32f-a39678b13e8a with identifier: 1979784
2026-03-25 16:36:47 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 9c8babdf-a91e-5dc7-a32f-a39678b13e8a with identifier: 1979784 to the API
2026-03-25 16:36:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:36:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:36:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'CARPATHIAN GREY METALLIZZATO PREMIUM',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-26T09:30:00Z',
'fuel_type': 'diesel',
'id': '9c8babdf-a91e-5dc7-a32f-a39678b13e8a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40968',
'listing': 'auction',
'location': None,
'make': 'LAND ROVER',
'model': 'LAND ROVER DISCOVERY SPORT 2.0 TD4 150CV R-DYNAMIC S 4WD AUT. FP',
'odometer': 110289,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-11-06',
'seats_number': 5,
'seller_name': None,
'title': 'LAND ROVER LAND ROVER DISCOVERY SPORT 2.0 TD4 150CV R-DYNAMIC S 4WD '
'AUT. FP -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2020}
2026-03-25 16:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979784%27 HTTP/1.1" 200 None
2026-03-25 16:36:48 [ayvens.it] INFO: Saving data for 1979784: {'auction_closing_time': 1774517400.0, 'created_time': 1774370173.579706, 'last_price_update_time': 1774456608.033954}
2026-03-25 16:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1979784') HTTP/1.1" 204 0
2026-03-25 16:36:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:36:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcdd2290>
2026-03-25 16:36:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:36:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:36:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:36:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5acd321c-4a5a-5b6c-9bb3-c1c0f3b07ce1/5acd321c-4a5a-5b6c-9bb3-c1c0f3b07ce1_image_4.jpg HTTP/1.1" 201 0
2026-03-25 16:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp0%252F854ed155bbc04992b4ae22744a224d6a%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 16:36:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp0/854ed155bbc04992b4ae22744a224d6a/images/large/5.jpg saved to cache
2026-03-25 16:36:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5acd321c-4a5a-5b6c-9bb3-c1c0f3b07ce1
2026-03-25 16:36:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5acd321c-4a5a-5b6c-9bb3-c1c0f3b07ce1, skipping ID generation
2026-03-25 16:36:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5acd321c-4a5a-5b6c-9bb3-c1c0f3b07ce1 with scrape type 1
2026-03-25 16:36:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5acd321c-4a5a-5b6c-9bb3-c1c0f3b07ce1 sending to next pipeline
2026-03-25 16:36:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 5acd321c-4a5a-5b6c-9bb3-c1c0f3b07ce1, identifier: 1983513
2026-03-25 16:36:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:36:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34d7dd8290>
2026-03-25 16:36:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:36:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:36:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:36:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad2c32b9-5578-5fd3-9993-08aa9305e9e0/ad2c32b9-5578-5fd3-9993-08aa9305e9e0_image_8.jpg HTTP/1.1" 201 0
2026-03-25 16:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh6%252F106a200b436e4ad197fe602bb0788915%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 16:36:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh6/106a200b436e4ad197fe602bb0788915/images/large/9.jpg saved to cache
2026-03-25 16:36:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ad2c32b9-5578-5fd3-9993-08aa9305e9e0
2026-03-25 16:36:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:36:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc89ec90>
2026-03-25 16:36:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:36:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:36:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:36:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad2c32b9-5578-5fd3-9993-08aa9305e9e0/ad2c32b9-5578-5fd3-9993-08aa9305e9e0_image_5.jpg HTTP/1.1" 201 0
2026-03-25 16:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh6%252F106a200b436e4ad197fe602bb0788915%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 16:36:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh6/106a200b436e4ad197fe602bb0788915/images/large/6.jpg saved to cache
2026-03-25 16:36:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ad2c32b9-5578-5fd3-9993-08aa9305e9e0
2026-03-25 16:36:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl6/7d95e6721221477bb945ba499e92f351/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:36:48 [ayvens.it] INFO: Found listing with ID: 1979785
2026-03-25 16:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979785%27 HTTP/1.1" 200 None
2026-03-25 16:36:48 [ayvens.it] INFO: Scrape type for 1979785: 2
2026-03-25 16:36:48 [ayvens.it] INFO: Extracting data for car ID: 1979785
2026-03-25 16:36:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b63896e2-9541-5806-a1d8-87a686b520e9 with identifier: 1979785
2026-03-25 16:36:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b63896e2-9541-5806-a1d8-87a686b520e9 with scrape type 2
2026-03-25 16:36:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b63896e2-9541-5806-a1d8-87a686b520e9 with scrape type 2
2026-03-25 16:36:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: b63896e2-9541-5806-a1d8-87a686b520e9, identifier: 1979785
2026-03-25 16:36:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 5acd321c-4a5a-5b6c-9bb3-c1c0f3b07ce1 with identifier: 1983513
2026-03-25 16:36:48 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:36:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 5acd321c-4a5a-5b6c-9bb3-c1c0f3b07ce1 with identifier: 1983513
2026-03-25 16:36:48 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 5acd321c-4a5a-5b6c-9bb3-c1c0f3b07ce1 with identifier: 1983513 to the API
2026-03-25 16:36:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:36:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:36:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gp0/854ed155bbc04992b4ae22744a224d6a/images/large/5.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'GRIGIO PLATINUM MET',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-27T09:30:00Z',
'fuel_type': 'diesel',
'id': '5acd321c-4a5a-5b6c-9bb3-c1c0f3b07ce1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41025',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': 'PEUGEOT 3008 (PC) BLUEHDI 130 EAT8 S&S ALLURE PACK FP',
'odometer': 71306,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 38,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5acd321c-4a5a-5b6c-9bb3-c1c0f3b07ce1/5acd321c-4a5a-5b6c-9bb3-c1c0f3b07ce1_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 653342,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp0/854ed155bbc04992b4ae22744a224d6a/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5acd321c-4a5a-5b6c-9bb3-c1c0f3b07ce1/5acd321c-4a5a-5b6c-9bb3-c1c0f3b07ce1_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 630295,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp0/854ed155bbc04992b4ae22744a224d6a/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5acd321c-4a5a-5b6c-9bb3-c1c0f3b07ce1/5acd321c-4a5a-5b6c-9bb3-c1c0f3b07ce1_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 407167,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp0/854ed155bbc04992b4ae22744a224d6a/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5acd321c-4a5a-5b6c-9bb3-c1c0f3b07ce1/5acd321c-4a5a-5b6c-9bb3-c1c0f3b07ce1_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 287522,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp0/854ed155bbc04992b4ae22744a224d6a/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5acd321c-4a5a-5b6c-9bb3-c1c0f3b07ce1/5acd321c-4a5a-5b6c-9bb3-c1c0f3b07ce1_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 618701,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp0/854ed155bbc04992b4ae22744a224d6a/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5acd321c-4a5a-5b6c-9bb3-c1c0f3b07ce1/5acd321c-4a5a-5b6c-9bb3-c1c0f3b07ce1_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 291968,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp0/854ed155bbc04992b4ae22744a224d6a/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5acd321c-4a5a-5b6c-9bb3-c1c0f3b07ce1/5acd321c-4a5a-5b6c-9bb3-c1c0f3b07ce1_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 599439,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp0/854ed155bbc04992b4ae22744a224d6a/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5acd321c-4a5a-5b6c-9bb3-c1c0f3b07ce1/5acd321c-4a5a-5b6c-9bb3-c1c0f3b07ce1_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 296672,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp0/854ed155bbc04992b4ae22744a224d6a/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5acd321c-4a5a-5b6c-9bb3-c1c0f3b07ce1/5acd321c-4a5a-5b6c-9bb3-c1c0f3b07ce1_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 363102,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp0/854ed155bbc04992b4ae22744a224d6a/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5acd321c-4a5a-5b6c-9bb3-c1c0f3b07ce1/5acd321c-4a5a-5b6c-9bb3-c1c0f3b07ce1_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 561390,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp0/854ed155bbc04992b4ae22744a224d6a/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-05-30',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT PEUGEOT 3008 (PC) BLUEHDI 130 EAT8 S&S ALLURE PACK FP -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2023}
2026-03-25 16:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983513%27 HTTP/1.1" 200 None
2026-03-25 16:36:48 [ayvens.it] INFO: Saving data for 1983513: {'created_time': 1774456608.944825, 'last_price_update_time': 1774456608.944835, 'auction_closing_time': 1774603800.0}
2026-03-25 16:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1983513') HTTP/1.1" 204 0
2026-03-25 16:36:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: b63896e2-9541-5806-a1d8-87a686b520e9 with identifier: 1979785
2026-03-25 16:36:48 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:36:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: b63896e2-9541-5806-a1d8-87a686b520e9 with identifier: 1979785
2026-03-25 16:36:49 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: b63896e2-9541-5806-a1d8-87a686b520e9 with identifier: 1979785 to the API
2026-03-25 16:36:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:36:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:36:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Dark Metal Grey metallic',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.3L',
'expiration_date': '2026-03-26T09:30:00Z',
'fuel_type': 'hybrid',
'id': 'b63896e2-9541-5806-a1d8-87a686b520e9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40968',
'listing': 'auction',
'location': None,
'make': 'NISSAN',
'model': 'NISSAN QASHQAI 1.3 MHEV 158 Business Xtronic Cross over 5-door '
'(Euro 6D)',
'odometer': 36935,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-08-24',
'seats_number': 5,
'seller_name': None,
'title': 'NISSAN NISSAN QASHQAI 1.3 MHEV 158 Business Xtronic Cross over '
'5-door (Euro 6D) -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-25 16:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979785%27 HTTP/1.1" 200 None
2026-03-25 16:36:49 [ayvens.it] INFO: Saving data for 1979785: {'auction_closing_time': 1774517400.0, 'created_time': 1774370167.986171, 'last_price_update_time': 1774456609.593944}
2026-03-25 16:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1979785') HTTP/1.1" 204 0
2026-03-25 16:36:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:36:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34de317fd0>
2026-03-25 16:36:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:36:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:36:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:36:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_723c298a-81fe-5fcb-afb6-bcffcd868fb7/723c298a-81fe-5fcb-afb6-bcffcd868fb7_image_2.jpg HTTP/1.1" 201 0
2026-03-25 16:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs4%252Fe02b3ef8971245959c29dd28ec0d6b62%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 16:36:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs4/e02b3ef8971245959c29dd28ec0d6b62/images/large/3.jpg saved to cache
2026-03-25 16:36:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 723c298a-81fe-5fcb-afb6-bcffcd868fb7
2026-03-25 16:36:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 723c298a-81fe-5fcb-afb6-bcffcd868fb7, skipping ID generation
2026-03-25 16:36:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 723c298a-81fe-5fcb-afb6-bcffcd868fb7 with scrape type 1
2026-03-25 16:36:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 723c298a-81fe-5fcb-afb6-bcffcd868fb7 sending to next pipeline
2026-03-25 16:36:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 723c298a-81fe-5fcb-afb6-bcffcd868fb7, identifier: 1983508
2026-03-25 16:36:49 [ayvens.it] INFO: Found listing with ID: 1979786
2026-03-25 16:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979786%27 HTTP/1.1" 200 None
2026-03-25 16:36:49 [ayvens.it] INFO: Scrape type for 1979786: 2
2026-03-25 16:36:49 [ayvens.it] INFO: Extracting data for car ID: 1979786
2026-03-25 16:36:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 13829733-6c69-5956-b062-ed987de09caf with identifier: 1979786
2026-03-25 16:36:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 13829733-6c69-5956-b062-ed987de09caf with scrape type 2
2026-03-25 16:36:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 13829733-6c69-5956-b062-ed987de09caf with scrape type 2
2026-03-25 16:36:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 13829733-6c69-5956-b062-ed987de09caf, identifier: 1979786
2026-03-25 16:36:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 723c298a-81fe-5fcb-afb6-bcffcd868fb7 with identifier: 1983508
2026-03-25 16:36:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 723c298a-81fe-5fcb-afb6-bcffcd868fb7 with identifier: 1983508
2026-03-25 16:36:49 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 723c298a-81fe-5fcb-afb6-bcffcd868fb7 with identifier: 1983508 to the API
2026-03-25 16:36:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:36:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:36:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fs4/e02b3ef8971245959c29dd28ec0d6b62/images/large/3.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'BIANCO PASTELLO',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-27T09:30:00Z',
'fuel_type': 'diesel',
'id': '723c298a-81fe-5fcb-afb6-bcffcd868fb7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41025',
'listing': 'auction',
'location': None,
'make': 'FIAT',
'model': 'FIAT DOBLÃ’ CARGO COMBI 1.3 Mijet 16v 95CV (cat. N1) Euro6 Combi '
'5-door',
'odometer': 202341,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 34,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_723c298a-81fe-5fcb-afb6-bcffcd868fb7/723c298a-81fe-5fcb-afb6-bcffcd868fb7_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 640254,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs4/e02b3ef8971245959c29dd28ec0d6b62/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_723c298a-81fe-5fcb-afb6-bcffcd868fb7/723c298a-81fe-5fcb-afb6-bcffcd868fb7_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 396984,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs4/e02b3ef8971245959c29dd28ec0d6b62/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_723c298a-81fe-5fcb-afb6-bcffcd868fb7/723c298a-81fe-5fcb-afb6-bcffcd868fb7_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 368870,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs4/e02b3ef8971245959c29dd28ec0d6b62/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_723c298a-81fe-5fcb-afb6-bcffcd868fb7/723c298a-81fe-5fcb-afb6-bcffcd868fb7_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 405396,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs4/e02b3ef8971245959c29dd28ec0d6b62/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_723c298a-81fe-5fcb-afb6-bcffcd868fb7/723c298a-81fe-5fcb-afb6-bcffcd868fb7_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 606768,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs4/e02b3ef8971245959c29dd28ec0d6b62/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_723c298a-81fe-5fcb-afb6-bcffcd868fb7/723c298a-81fe-5fcb-afb6-bcffcd868fb7_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 286821,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs4/e02b3ef8971245959c29dd28ec0d6b62/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_723c298a-81fe-5fcb-afb6-bcffcd868fb7/723c298a-81fe-5fcb-afb6-bcffcd868fb7_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 492807,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs4/e02b3ef8971245959c29dd28ec0d6b62/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_723c298a-81fe-5fcb-afb6-bcffcd868fb7/723c298a-81fe-5fcb-afb6-bcffcd868fb7_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 314000,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs4/e02b3ef8971245959c29dd28ec0d6b62/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_723c298a-81fe-5fcb-afb6-bcffcd868fb7/723c298a-81fe-5fcb-afb6-bcffcd868fb7_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 417244,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs4/e02b3ef8971245959c29dd28ec0d6b62/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_723c298a-81fe-5fcb-afb6-bcffcd868fb7/723c298a-81fe-5fcb-afb6-bcffcd868fb7_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 345915,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs4/e02b3ef8971245959c29dd28ec0d6b62/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-09-14',
'seats_number': 5,
'seller_name': None,
'title': 'FIAT FIAT DOBLÃ’ CARGO COMBI 1.3 Mijet 16v 95CV (cat. N1) Euro6 '
'Combi 5-door -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2018}
2026-03-25 16:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983508%27 HTTP/1.1" 200 None
2026-03-25 16:36:53 [ayvens.it] INFO: Saving data for 1983508: {'created_time': 1774456613.427282, 'last_price_update_time': 1774456613.427292, 'auction_closing_time': 1774603800.0}
2026-03-25 16:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1983508') HTTP/1.1" 204 0
2026-03-25 16:36:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 13829733-6c69-5956-b062-ed987de09caf with identifier: 1979786
2026-03-25 16:36:53 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:36:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 13829733-6c69-5956-b062-ed987de09caf with identifier: 1979786
2026-03-25 16:36:53 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 13829733-6c69-5956-b062-ed987de09caf with identifier: 1979786 to the API
2026-03-25 16:36:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:36:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:36:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'BLU MEDITERRANEO METALLIZZATO',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-26T09:30:00Z',
'fuel_type': 'diesel',
'id': '13829733-6c69-5956-b062-ed987de09caf',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40968',
'listing': 'auction',
'location': None,
'make': 'FIAT',
'model': 'FIAT TIPO (PC) 1.3 MJT 95CV S&S BUSINESS FP',
'odometer': 182613,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-01-13',
'seats_number': 5,
'seller_name': None,
'title': 'FIAT FIAT TIPO (PC) 1.3 MJT 95CV S&S BUSINESS FP -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-25 16:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979786%27 HTTP/1.1" 200 None
2026-03-25 16:36:54 [ayvens.it] INFO: Saving data for 1979786: {'auction_closing_time': 1774517400.0, 'created_time': 1774370162.939181, 'last_price_update_time': 1774456614.614642}
2026-03-25 16:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1979786') HTTP/1.1" 204 0
2026-03-25 16:36:54 [ayvens.it] INFO: Found listing with ID: 1979787
2026-03-25 16:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979787%27 HTTP/1.1" 200 None
2026-03-25 16:36:54 [ayvens.it] INFO: Scrape type for 1979787: 2
2026-03-25 16:36:54 [ayvens.it] INFO: Extracting data for car ID: 1979787
2026-03-25 16:36:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f34605d6-b8e5-5c0b-a2ae-dde5df991128 with identifier: 1979787
2026-03-25 16:36:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f34605d6-b8e5-5c0b-a2ae-dde5df991128 with scrape type 2
2026-03-25 16:36:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f34605d6-b8e5-5c0b-a2ae-dde5df991128 with scrape type 2
2026-03-25 16:36:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: f34605d6-b8e5-5c0b-a2ae-dde5df991128, identifier: 1979787
2026-03-25 16:36:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:36:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc325c90>
2026-03-25 16:36:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:36:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:36:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:36:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad2c32b9-5578-5fd3-9993-08aa9305e9e0/ad2c32b9-5578-5fd3-9993-08aa9305e9e0_image_4.jpg HTTP/1.1" 201 0
2026-03-25 16:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh6%252F106a200b436e4ad197fe602bb0788915%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 16:36:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh6/106a200b436e4ad197fe602bb0788915/images/large/5.jpg saved to cache
2026-03-25 16:36:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ad2c32b9-5578-5fd3-9993-08aa9305e9e0
2026-03-25 16:36:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ad2c32b9-5578-5fd3-9993-08aa9305e9e0, skipping ID generation
2026-03-25 16:36:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ad2c32b9-5578-5fd3-9993-08aa9305e9e0 with scrape type 1
2026-03-25 16:36:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ad2c32b9-5578-5fd3-9993-08aa9305e9e0 sending to next pipeline
2026-03-25 16:36:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: ad2c32b9-5578-5fd3-9993-08aa9305e9e0, identifier: 1983512
2026-03-25 16:36:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:36:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc5e9a10>
2026-03-25 16:36:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:36:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:36:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:36:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3e0a7ab-98de-54e3-9a43-eae4518a239d/c3e0a7ab-98de-54e3-9a43-eae4518a239d_image_6.jpg HTTP/1.1" 201 0
2026-03-25 16:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl6%252F7d95e6721221477bb945ba499e92f351%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 16:36:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl6/7d95e6721221477bb945ba499e92f351/images/large/7.jpg saved to cache
2026-03-25 16:36:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c3e0a7ab-98de-54e3-9a43-eae4518a239d
2026-03-25 16:36:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c3e0a7ab-98de-54e3-9a43-eae4518a239d, skipping ID generation
2026-03-25 16:36:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c3e0a7ab-98de-54e3-9a43-eae4518a239d with scrape type 1
2026-03-25 16:36:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c3e0a7ab-98de-54e3-9a43-eae4518a239d sending to next pipeline
2026-03-25 16:36:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: c3e0a7ab-98de-54e3-9a43-eae4518a239d, identifier: 1983510
2026-03-25 16:36:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp3/caf420a2f36047519d16362f0026ffed/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:36:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ft3/9b8e5509bc6a4834b2cacd5bdbe5132c/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:36:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: f34605d6-b8e5-5c0b-a2ae-dde5df991128 with identifier: 1979787
2026-03-25 16:36:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: f34605d6-b8e5-5c0b-a2ae-dde5df991128 with identifier: 1979787
2026-03-25 16:36:55 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: f34605d6-b8e5-5c0b-a2ae-dde5df991128 with identifier: 1979787 to the API
2026-03-25 16:36:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:36:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:36:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'BLU NAVARRA METALLIZZATO',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-26T09:30:00Z',
'fuel_type': 'diesel',
'id': 'f34605d6-b8e5-5c0b-a2ae-dde5df991128',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40968',
'listing': 'auction',
'location': None,
'make': 'AUDI',
'model': 'AUDI Q3 (PC) 35 TDI S TRONIC BUSINESS FP',
'odometer': 162600,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-10-13',
'seats_number': 5,
'seller_name': None,
'title': 'AUDI AUDI Q3 (PC) 35 TDI S TRONIC BUSINESS FP -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-25 16:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979787%27 HTTP/1.1" 200 None
2026-03-25 16:36:55 [ayvens.it] INFO: Saving data for 1979787: {'auction_closing_time': 1774517400.0, 'created_time': 1774370161.635012, 'last_price_update_time': 1774456615.885262}
2026-03-25 16:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1979787') HTTP/1.1" 204 0
2026-03-25 16:36:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: ad2c32b9-5578-5fd3-9993-08aa9305e9e0 with identifier: 1983512
2026-03-25 16:36:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: ad2c32b9-5578-5fd3-9993-08aa9305e9e0 with identifier: 1983512
2026-03-25 16:36:56 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: ad2c32b9-5578-5fd3-9993-08aa9305e9e0 with identifier: 1983512 to the API
2026-03-25 16:36:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:36:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:36:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gh6/106a200b436e4ad197fe602bb0788915/images/large/5.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'GRIGIO ARTENSE METALLIZZATO',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-27T09:30:00Z',
'fuel_type': 'diesel',
'id': 'ad2c32b9-5578-5fd3-9993-08aa9305e9e0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41025',
'listing': 'auction',
'location': None,
'make': 'CITROËN',
'model': 'CITROEN DS 7 CROSSBACK BLUEHDI 130 AUTOMATICA GRAND CHIC FP (PC)',
'odometer': 102867,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 55,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad2c32b9-5578-5fd3-9993-08aa9305e9e0/ad2c32b9-5578-5fd3-9993-08aa9305e9e0_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 700029,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh6/106a200b436e4ad197fe602bb0788915/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad2c32b9-5578-5fd3-9993-08aa9305e9e0/ad2c32b9-5578-5fd3-9993-08aa9305e9e0_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 700029,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh6/106a200b436e4ad197fe602bb0788915/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad2c32b9-5578-5fd3-9993-08aa9305e9e0/ad2c32b9-5578-5fd3-9993-08aa9305e9e0_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 702468,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh6/106a200b436e4ad197fe602bb0788915/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad2c32b9-5578-5fd3-9993-08aa9305e9e0/ad2c32b9-5578-5fd3-9993-08aa9305e9e0_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 740421,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh6/106a200b436e4ad197fe602bb0788915/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad2c32b9-5578-5fd3-9993-08aa9305e9e0/ad2c32b9-5578-5fd3-9993-08aa9305e9e0_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 754480,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh6/106a200b436e4ad197fe602bb0788915/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad2c32b9-5578-5fd3-9993-08aa9305e9e0/ad2c32b9-5578-5fd3-9993-08aa9305e9e0_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 607713,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh6/106a200b436e4ad197fe602bb0788915/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad2c32b9-5578-5fd3-9993-08aa9305e9e0/ad2c32b9-5578-5fd3-9993-08aa9305e9e0_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 542407,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh6/106a200b436e4ad197fe602bb0788915/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad2c32b9-5578-5fd3-9993-08aa9305e9e0/ad2c32b9-5578-5fd3-9993-08aa9305e9e0_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 577537,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh6/106a200b436e4ad197fe602bb0788915/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad2c32b9-5578-5fd3-9993-08aa9305e9e0/ad2c32b9-5578-5fd3-9993-08aa9305e9e0_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 571331,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh6/106a200b436e4ad197fe602bb0788915/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad2c32b9-5578-5fd3-9993-08aa9305e9e0/ad2c32b9-5578-5fd3-9993-08aa9305e9e0_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 531700,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh6/106a200b436e4ad197fe602bb0788915/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-12-30',
'seats_number': 5,
'seller_name': None,
'title': 'CITROËN CITROEN DS 7 CROSSBACK BLUEHDI 130 AUTOMATICA GRAND CHIC FP '
'(PC) -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2021}
2026-03-25 16:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983512%27 HTTP/1.1" 200 None
2026-03-25 16:36:56 [ayvens.it] INFO: Saving data for 1983512: {'created_time': 1774456616.464365, 'last_price_update_time': 1774456616.464376, 'auction_closing_time': 1774603800.0}
2026-03-25 16:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1983512') HTTP/1.1" 204 0
2026-03-25 16:36:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: c3e0a7ab-98de-54e3-9a43-eae4518a239d with identifier: 1983510
2026-03-25 16:36:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: c3e0a7ab-98de-54e3-9a43-eae4518a239d with identifier: 1983510
2026-03-25 16:36:56 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: c3e0a7ab-98de-54e3-9a43-eae4518a239d with identifier: 1983510 to the API
2026-03-25 16:36:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:36:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:36:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gl6/7d95e6721221477bb945ba499e92f351/images/large/7.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'MAGNETIC GREY METALLIZZATO',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.5L',
'expiration_date': '2026-03-27T09:30:00Z',
'fuel_type': 'hybrid',
'id': 'c3e0a7ab-98de-54e3-9a43-eae4518a239d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41025',
'listing': 'auction',
'location': None,
'make': 'FORD',
'model': 'FORD KUGA 2.5 BENZINA FHEV 190CV AWD ST-LINE X AUT FP',
'odometer': 85605,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 23,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3e0a7ab-98de-54e3-9a43-eae4518a239d/c3e0a7ab-98de-54e3-9a43-eae4518a239d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 606061,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl6/7d95e6721221477bb945ba499e92f351/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3e0a7ab-98de-54e3-9a43-eae4518a239d/c3e0a7ab-98de-54e3-9a43-eae4518a239d_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 613466,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl6/7d95e6721221477bb945ba499e92f351/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3e0a7ab-98de-54e3-9a43-eae4518a239d/c3e0a7ab-98de-54e3-9a43-eae4518a239d_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 606061,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl6/7d95e6721221477bb945ba499e92f351/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3e0a7ab-98de-54e3-9a43-eae4518a239d/c3e0a7ab-98de-54e3-9a43-eae4518a239d_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 631696,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl6/7d95e6721221477bb945ba499e92f351/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3e0a7ab-98de-54e3-9a43-eae4518a239d/c3e0a7ab-98de-54e3-9a43-eae4518a239d_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 628510,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl6/7d95e6721221477bb945ba499e92f351/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3e0a7ab-98de-54e3-9a43-eae4518a239d/c3e0a7ab-98de-54e3-9a43-eae4518a239d_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 584038,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl6/7d95e6721221477bb945ba499e92f351/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3e0a7ab-98de-54e3-9a43-eae4518a239d/c3e0a7ab-98de-54e3-9a43-eae4518a239d_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 570545,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl6/7d95e6721221477bb945ba499e92f351/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3e0a7ab-98de-54e3-9a43-eae4518a239d/c3e0a7ab-98de-54e3-9a43-eae4518a239d_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 622168,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl6/7d95e6721221477bb945ba499e92f351/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3e0a7ab-98de-54e3-9a43-eae4518a239d/c3e0a7ab-98de-54e3-9a43-eae4518a239d_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 588397,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl6/7d95e6721221477bb945ba499e92f351/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3e0a7ab-98de-54e3-9a43-eae4518a239d/c3e0a7ab-98de-54e3-9a43-eae4518a239d_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 523260,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl6/7d95e6721221477bb945ba499e92f351/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-10-26',
'seats_number': 5,
'seller_name': None,
'title': 'FORD FORD KUGA 2.5 BENZINA FHEV 190CV AWD ST-LINE X AUT FP -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-25 16:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983510%27 HTTP/1.1" 200 None
2026-03-25 16:36:56 [ayvens.it] INFO: Saving data for 1983510: {'created_time': 1774456616.761588, 'last_price_update_time': 1774456616.761601, 'auction_closing_time': 1774603800.0}
2026-03-25 16:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1983510') HTTP/1.1" 204 0
2026-03-25 16:36:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl2/fb7565b99e9244cc8ec74937258f687e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:36:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ft3/9b8e5509bc6a4834b2cacd5bdbe5132c/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:36:56 [ayvens.it] INFO: Found listing with ID: 1979788
2026-03-25 16:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979788%27 HTTP/1.1" 200 None
2026-03-25 16:36:56 [ayvens.it] INFO: Scrape type for 1979788: 2
2026-03-25 16:36:56 [ayvens.it] INFO: Extracting data for car ID: 1979788
2026-03-25 16:36:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4f8f8b5b-a257-5001-9698-620edb753611 with identifier: 1979788
2026-03-25 16:36:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4f8f8b5b-a257-5001-9698-620edb753611 with scrape type 2
2026-03-25 16:36:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4f8f8b5b-a257-5001-9698-620edb753611 with scrape type 2
2026-03-25 16:36:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 4f8f8b5b-a257-5001-9698-620edb753611, identifier: 1979788
2026-03-25 16:36:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 4f8f8b5b-a257-5001-9698-620edb753611 with identifier: 1979788
2026-03-25 16:36:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 4f8f8b5b-a257-5001-9698-620edb753611 with identifier: 1979788
2026-03-25 16:36:56 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 4f8f8b5b-a257-5001-9698-620edb753611 with identifier: 1979788 to the API
2026-03-25 16:36:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:36:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:36:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'SANTORINI BLACK MTZ',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-26T09:30:00Z',
'fuel_type': 'diesel',
'id': '4f8f8b5b-a257-5001-9698-620edb753611',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40968',
'listing': 'auction',
'location': None,
'make': 'LAND ROVER',
'model': 'LAND ROVER RANGE ROVER EVO 2.0D I4 204 MHEV DYNAMIC SE AWD AUTO FP',
'odometer': 31919,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-03-22',
'seats_number': 5,
'seller_name': None,
'title': 'LAND ROVER LAND ROVER RANGE ROVER EVO 2.0D I4 204 MHEV DYNAMIC SE '
'AWD AUTO FP -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2024}
2026-03-25 16:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979788%27 HTTP/1.1" 200 None
2026-03-25 16:36:57 [ayvens.it] INFO: Saving data for 1979788: {'auction_closing_time': 1774517400.0, 'created_time': 1774370159.956014, 'last_price_update_time': 1774456617.307096}
2026-03-25 16:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1979788') HTTP/1.1" 204 0
2026-03-25 16:36:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ft3/9b8e5509bc6a4834b2cacd5bdbe5132c/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:36:57 [ayvens.it] INFO: Found listing with ID: 1979789
2026-03-25 16:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979789%27 HTTP/1.1" 200 None
2026-03-25 16:36:57 [ayvens.it] INFO: Scrape type for 1979789: 2
2026-03-25 16:36:57 [ayvens.it] INFO: Extracting data for car ID: 1979789
2026-03-25 16:36:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3abea8f0-8acd-52f6-bc60-f84db4aa841d with identifier: 1979789
2026-03-25 16:36:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3abea8f0-8acd-52f6-bc60-f84db4aa841d with scrape type 2
2026-03-25 16:36:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3abea8f0-8acd-52f6-bc60-f84db4aa841d with scrape type 2
2026-03-25 16:36:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 3abea8f0-8acd-52f6-bc60-f84db4aa841d, identifier: 1979789
2026-03-25 16:36:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 3abea8f0-8acd-52f6-bc60-f84db4aa841d with identifier: 1979789
2026-03-25 16:36:57 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:36:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 3abea8f0-8acd-52f6-bc60-f84db4aa841d with identifier: 1979789
2026-03-25 16:36:57 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 3abea8f0-8acd-52f6-bc60-f84db4aa841d with identifier: 1979789 to the API
2026-03-25 16:36:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:36:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:36:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'ONYX BLACK METALLIZZATO',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-26T09:30:00Z',
'fuel_type': 'hybrid',
'id': '3abea8f0-8acd-52f6-bc60-f84db4aa841d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40968',
'listing': 'auction',
'location': None,
'make': 'VOLVO',
'model': 'VOLVO XC40 T4 Recharge Plug-in auto Plus Bright Sport utility '
'vehicle 5-door (Euro 6D)',
'odometer': 162465,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-01-17',
'seats_number': 5,
'seller_name': None,
'title': 'VOLVO VOLVO XC40 T4 Recharge Plug-in auto Plus Bright Sport utility '
'vehicle 5-door (Euro 6D) -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2023}
2026-03-25 16:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979789%27 HTTP/1.1" 200 None
2026-03-25 16:36:57 [ayvens.it] INFO: Saving data for 1979789: {'auction_closing_time': 1774517400.0, 'created_time': 1774370155.731356, 'last_price_update_time': 1774456617.683223}
2026-03-25 16:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1979789') HTTP/1.1" 204 0
2026-03-25 16:36:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:36:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc309690>
2026-03-25 16:36:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:36:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:36:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:36:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd022ee5-c4cf-57f0-af02-793863899334/fd022ee5-c4cf-57f0-af02-793863899334_image_3.jpg HTTP/1.1" 201 0
2026-03-25 16:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp3%252Fcaf420a2f36047519d16362f0026ffed%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 16:36:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp3/caf420a2f36047519d16362f0026ffed/images/large/4.jpg saved to cache
2026-03-25 16:36:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item fd022ee5-c4cf-57f0-af02-793863899334
2026-03-25 16:36:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fd022ee5-c4cf-57f0-af02-793863899334, skipping ID generation
2026-03-25 16:36:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fd022ee5-c4cf-57f0-af02-793863899334 with scrape type 1
2026-03-25 16:36:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fd022ee5-c4cf-57f0-af02-793863899334 sending to next pipeline
2026-03-25 16:36:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: fd022ee5-c4cf-57f0-af02-793863899334, identifier: 1983507
2026-03-25 16:36:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:36:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dcaf5c90>
2026-03-25 16:36:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:36:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:36:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:36:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b5f6ec2f-600d-5ef5-bb06-514534a30b59/b5f6ec2f-600d-5ef5-bb06-514534a30b59_image_7.jpg HTTP/1.1" 201 0
2026-03-25 16:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft3%252F9b8e5509bc6a4834b2cacd5bdbe5132c%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 16:36:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft3/9b8e5509bc6a4834b2cacd5bdbe5132c/images/large/8.jpg saved to cache
2026-03-25 16:36:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b5f6ec2f-600d-5ef5-bb06-514534a30b59
2026-03-25 16:36:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:36:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc9dc5d0>
2026-03-25 16:36:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:36:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:36:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:36:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ae0e12b4-28af-5149-a440-3211217d2397/ae0e12b4-28af-5149-a440-3211217d2397_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl2%252Ffb7565b99e9244cc8ec74937258f687e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 16:36:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl2/fb7565b99e9244cc8ec74937258f687e/images/large/1.jpg saved to cache
2026-03-25 16:36:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ae0e12b4-28af-5149-a440-3211217d2397
2026-03-25 16:36:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ae0e12b4-28af-5149-a440-3211217d2397, skipping ID generation
2026-03-25 16:36:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ae0e12b4-28af-5149-a440-3211217d2397 with scrape type 1
2026-03-25 16:36:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ae0e12b4-28af-5149-a440-3211217d2397 sending to next pipeline
2026-03-25 16:36:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: ae0e12b4-28af-5149-a440-3211217d2397, identifier: 1983503
2026-03-25 16:36:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:36:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34d6b48210>
2026-03-25 16:36:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:36:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:36:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:36:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b5f6ec2f-600d-5ef5-bb06-514534a30b59/b5f6ec2f-600d-5ef5-bb06-514534a30b59_image_8.jpg HTTP/1.1" 201 0
2026-03-25 16:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft3%252F9b8e5509bc6a4834b2cacd5bdbe5132c%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 16:36:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft3/9b8e5509bc6a4834b2cacd5bdbe5132c/images/large/9.jpg saved to cache
2026-03-25 16:36:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b5f6ec2f-600d-5ef5-bb06-514534a30b59
2026-03-25 16:36:58 [ayvens.it] INFO: Found listing with ID: 1979790
2026-03-25 16:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979790%27 HTTP/1.1" 200 None
2026-03-25 16:36:58 [ayvens.it] INFO: Scrape type for 1979790: 2
2026-03-25 16:36:58 [ayvens.it] INFO: Extracting data for car ID: 1979790
2026-03-25 16:36:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c46f63f9-637d-5874-8d3e-37bf4cc4612b with identifier: 1979790
2026-03-25 16:36:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c46f63f9-637d-5874-8d3e-37bf4cc4612b with scrape type 2
2026-03-25 16:36:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c46f63f9-637d-5874-8d3e-37bf4cc4612b with scrape type 2
2026-03-25 16:36:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: c46f63f9-637d-5874-8d3e-37bf4cc4612b, identifier: 1979790
2026-03-25 16:36:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: fd022ee5-c4cf-57f0-af02-793863899334 with identifier: 1983507
2026-03-25 16:36:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: fd022ee5-c4cf-57f0-af02-793863899334 with identifier: 1983507
2026-03-25 16:36:58 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: fd022ee5-c4cf-57f0-af02-793863899334 with identifier: 1983507 to the API
2026-03-25 16:36:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:36:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:36:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gp3/caf420a2f36047519d16362f0026ffed/images/large/4.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Unknown',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-27T09:30:00Z',
'fuel_type': 'hybrid',
'id': 'fd022ee5-c4cf-57f0-af02-793863899334',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41025',
'listing': 'auction',
'location': None,
'make': 'FORD',
'model': 'FORD PUMA 1.0 Ecoboost Hybrid 125CV ST-Line Auto Sport utility '
'vehicle 5-door (Euro 6.2)',
'odometer': 85812,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 51,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd022ee5-c4cf-57f0-af02-793863899334/fd022ee5-c4cf-57f0-af02-793863899334_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 854668,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp3/caf420a2f36047519d16362f0026ffed/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd022ee5-c4cf-57f0-af02-793863899334/fd022ee5-c4cf-57f0-af02-793863899334_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 626985,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp3/caf420a2f36047519d16362f0026ffed/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd022ee5-c4cf-57f0-af02-793863899334/fd022ee5-c4cf-57f0-af02-793863899334_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 607018,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp3/caf420a2f36047519d16362f0026ffed/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd022ee5-c4cf-57f0-af02-793863899334/fd022ee5-c4cf-57f0-af02-793863899334_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 702667,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp3/caf420a2f36047519d16362f0026ffed/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd022ee5-c4cf-57f0-af02-793863899334/fd022ee5-c4cf-57f0-af02-793863899334_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 675838,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp3/caf420a2f36047519d16362f0026ffed/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd022ee5-c4cf-57f0-af02-793863899334/fd022ee5-c4cf-57f0-af02-793863899334_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 530649,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp3/caf420a2f36047519d16362f0026ffed/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd022ee5-c4cf-57f0-af02-793863899334/fd022ee5-c4cf-57f0-af02-793863899334_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 687836,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp3/caf420a2f36047519d16362f0026ffed/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd022ee5-c4cf-57f0-af02-793863899334/fd022ee5-c4cf-57f0-af02-793863899334_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 596696,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp3/caf420a2f36047519d16362f0026ffed/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd022ee5-c4cf-57f0-af02-793863899334/fd022ee5-c4cf-57f0-af02-793863899334_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 742112,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp3/caf420a2f36047519d16362f0026ffed/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd022ee5-c4cf-57f0-af02-793863899334/fd022ee5-c4cf-57f0-af02-793863899334_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 711110,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp3/caf420a2f36047519d16362f0026ffed/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-05-24',
'seats_number': 5,
'seller_name': None,
'title': 'FORD FORD PUMA 1.0 Ecoboost Hybrid 125CV ST-Line Auto Sport utility '
'vehicle 5-door (Euro 6.2) -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2023}
2026-03-25 16:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983507%27 HTTP/1.1" 200 None
2026-03-25 16:36:58 [ayvens.it] INFO: Saving data for 1983507: {'created_time': 1774456618.549652, 'last_price_update_time': 1774456618.549663, 'auction_closing_time': 1774603800.0}
2026-03-25 16:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1983507') HTTP/1.1" 204 0
2026-03-25 16:36:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: ae0e12b4-28af-5149-a440-3211217d2397 with identifier: 1983503
2026-03-25 16:36:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: ae0e12b4-28af-5149-a440-3211217d2397 with identifier: 1983503
2026-03-25 16:36:58 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: ae0e12b4-28af-5149-a440-3211217d2397 with identifier: 1983503 to the API
2026-03-25 16:36:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:36:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:36:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gl2/fb7565b99e9244cc8ec74937258f687e/images/large/1.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Frozen White pastello',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-27T09:30:00Z',
'fuel_type': 'petrol',
'id': 'ae0e12b4-28af-5149-a440-3211217d2397',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41025',
'listing': 'auction',
'location': None,
'make': 'FORD',
'model': 'FORD PUMA 1.0 Ecoboost 125CV Titanium Auto Sport utility vehicle '
'5-door (Euro 6.2)',
'odometer': 101472,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 19,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae0e12b4-28af-5149-a440-3211217d2397/ae0e12b4-28af-5149-a440-3211217d2397_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 647649,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl2/fb7565b99e9244cc8ec74937258f687e/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae0e12b4-28af-5149-a440-3211217d2397/ae0e12b4-28af-5149-a440-3211217d2397_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 399829,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl2/fb7565b99e9244cc8ec74937258f687e/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae0e12b4-28af-5149-a440-3211217d2397/ae0e12b4-28af-5149-a440-3211217d2397_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 601933,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl2/fb7565b99e9244cc8ec74937258f687e/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae0e12b4-28af-5149-a440-3211217d2397/ae0e12b4-28af-5149-a440-3211217d2397_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 647649,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl2/fb7565b99e9244cc8ec74937258f687e/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae0e12b4-28af-5149-a440-3211217d2397/ae0e12b4-28af-5149-a440-3211217d2397_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 406240,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl2/fb7565b99e9244cc8ec74937258f687e/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae0e12b4-28af-5149-a440-3211217d2397/ae0e12b4-28af-5149-a440-3211217d2397_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 450151,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl2/fb7565b99e9244cc8ec74937258f687e/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae0e12b4-28af-5149-a440-3211217d2397/ae0e12b4-28af-5149-a440-3211217d2397_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 449625,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl2/fb7565b99e9244cc8ec74937258f687e/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae0e12b4-28af-5149-a440-3211217d2397/ae0e12b4-28af-5149-a440-3211217d2397_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 306500,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl2/fb7565b99e9244cc8ec74937258f687e/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae0e12b4-28af-5149-a440-3211217d2397/ae0e12b4-28af-5149-a440-3211217d2397_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 506198,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl2/fb7565b99e9244cc8ec74937258f687e/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae0e12b4-28af-5149-a440-3211217d2397/ae0e12b4-28af-5149-a440-3211217d2397_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 510909,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl2/fb7565b99e9244cc8ec74937258f687e/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-09-27',
'seats_number': 5,
'seller_name': None,
'title': 'FORD FORD PUMA 1.0 Ecoboost 125CV Titanium Auto Sport utility '
'vehicle 5-door (Euro 6.2) -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-25 16:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983503%27 HTTP/1.1" 200 None
2026-03-25 16:36:58 [ayvens.it] INFO: Saving data for 1983503: {'created_time': 1774456618.860654, 'last_price_update_time': 1774456618.860665, 'auction_closing_time': 1774603800.0}
2026-03-25 16:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1983503') HTTP/1.1" 204 0
2026-03-25 16:36:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: c46f63f9-637d-5874-8d3e-37bf4cc4612b with identifier: 1979790
2026-03-25 16:36:58 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:36:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: c46f63f9-637d-5874-8d3e-37bf4cc4612b with identifier: 1979790
2026-03-25 16:36:58 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: c46f63f9-637d-5874-8d3e-37bf4cc4612b with identifier: 1979790 to the API
2026-03-25 16:36:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:36:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:36:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'SMOKY GREY METALLIC',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-26T09:30:00Z',
'fuel_type': 'petrol',
'id': 'c46f63f9-637d-5874-8d3e-37bf4cc4612b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40968',
'listing': 'auction',
'location': None,
'make': 'VOLKSWAGEN',
'model': 'VOLKSWAGEN POLO 1.0 TSI Business Life Hatchback 5-door (Euro 6D)',
'odometer': 196110,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-02-27',
'seats_number': 5,
'seller_name': None,
'title': 'VOLKSWAGEN VOLKSWAGEN POLO 1.0 TSI Business Life Hatchback 5-door '
'(Euro 6D) -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2023}
2026-03-25 16:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979790%27 HTTP/1.1" 200 None
2026-03-25 16:36:59 [ayvens.it] INFO: Saving data for 1979790: {'auction_closing_time': 1774517400.0, 'created_time': 1774370123.900823, 'last_price_update_time': 1774456619.134659}
2026-03-25 16:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1979790') HTTP/1.1" 204 0
2026-03-25 16:36:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ft3/9b8e5509bc6a4834b2cacd5bdbe5132c/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 16:36:59 [ayvens.it] INFO: Found listing with ID: 1979791
2026-03-25 16:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979791%27 HTTP/1.1" 200 None
2026-03-25 16:36:59 [ayvens.it] INFO: Scrape type for 1979791: 2
2026-03-25 16:36:59 [ayvens.it] INFO: Extracting data for car ID: 1979791
2026-03-25 16:36:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cd022ccb-e494-576e-b98e-e2f143823363 with identifier: 1979791
2026-03-25 16:36:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cd022ccb-e494-576e-b98e-e2f143823363 with scrape type 2
2026-03-25 16:36:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cd022ccb-e494-576e-b98e-e2f143823363 with scrape type 2
2026-03-25 16:36:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: cd022ccb-e494-576e-b98e-e2f143823363, identifier: 1979791
2026-03-25 16:36:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: cd022ccb-e494-576e-b98e-e2f143823363 with identifier: 1979791
2026-03-25 16:36:59 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:36:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: cd022ccb-e494-576e-b98e-e2f143823363 with identifier: 1979791
2026-03-25 16:36:59 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: cd022ccb-e494-576e-b98e-e2f143823363 with identifier: 1979791 to the API
2026-03-25 16:36:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:36:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:36:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'BLU NAVARA METALLIZZATO',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-26T09:30:00Z',
'fuel_type': 'diesel',
'id': 'cd022ccb-e494-576e-b98e-e2f143823363',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40968',
'listing': 'auction',
'location': None,
'make': 'AUDI',
'model': 'AUDI A4 SW 2.0 40 TDI QUAT. SLINE EDIT. S TRONIC',
'odometer': 77868,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-05-12',
'seats_number': 5,
'seller_name': None,
'title': 'AUDI AUDI A4 SW 2.0 40 TDI QUAT. SLINE EDIT. S TRONIC -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2023}
2026-03-25 16:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979791%27 HTTP/1.1" 200 None
2026-03-25 16:36:59 [ayvens.it] INFO: Saving data for 1979791: {'auction_closing_time': 1774517400.0, 'created_time': 1774370156.558328, 'last_price_update_time': 1774456619.512103}
2026-03-25 16:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1979791') HTTP/1.1" 204 0
2026-03-25 16:36:59 [ayvens.it] INFO: Found listing with ID: 1979792
2026-03-25 16:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979792%27 HTTP/1.1" 200 None
2026-03-25 16:36:59 [ayvens.it] INFO: Scrape type for 1979792: 2
2026-03-25 16:36:59 [ayvens.it] INFO: Extracting data for car ID: 1979792
2026-03-25 16:36:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5667603b-949a-5274-84ce-b5d3e241fdc2 with identifier: 1979792
2026-03-25 16:36:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5667603b-949a-5274-84ce-b5d3e241fdc2 with scrape type 2
2026-03-25 16:36:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5667603b-949a-5274-84ce-b5d3e241fdc2 with scrape type 2
2026-03-25 16:36:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 5667603b-949a-5274-84ce-b5d3e241fdc2, identifier: 1979792
2026-03-25 16:36:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:36:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34dc9425d0>
2026-03-25 16:36:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:36:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:36:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:36:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b5f6ec2f-600d-5ef5-bb06-514534a30b59/b5f6ec2f-600d-5ef5-bb06-514534a30b59_image_9.jpg HTTP/1.1" 201 0
2026-03-25 16:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft3%252F9b8e5509bc6a4834b2cacd5bdbe5132c%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 16:36:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft3/9b8e5509bc6a4834b2cacd5bdbe5132c/images/large/10.jpg saved to cache
2026-03-25 16:36:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b5f6ec2f-600d-5ef5-bb06-514534a30b59
2026-03-25 16:36:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 5667603b-949a-5274-84ce-b5d3e241fdc2 with identifier: 1979792
2026-03-25 16:36:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 5667603b-949a-5274-84ce-b5d3e241fdc2 with identifier: 1979792
2026-03-25 16:36:59 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 5667603b-949a-5274-84ce-b5d3e241fdc2 with identifier: 1979792 to the API
2026-03-25 16:36:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:36:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:37:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'GRIGIO ARTENSE METALLIZZATO',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-26T09:30:00Z',
'fuel_type': 'diesel',
'id': '5667603b-949a-5274-84ce-b5d3e241fdc2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40968',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': 'PEUGEOT 308 SW SW Allure BlueHDi 130 EAT8 S&S aut. SW 5-door (Euro '
'6D)',
'odometer': 92249,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-12-23',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT PEUGEOT 308 SW SW Allure BlueHDi 130 EAT8 S&S aut. SW '
'5-door (Euro 6D) -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-25 16:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979792%27 HTTP/1.1" 200 None
2026-03-25 16:37:00 [ayvens.it] INFO: Saving data for 1979792: {'auction_closing_time': 1774517400.0, 'created_time': 1774370127.095811, 'last_price_update_time': 1774456620.052769}
2026-03-25 16:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1979792') HTTP/1.1" 204 0
2026-03-25 16:37:00 [ayvens.it] INFO: Found listing with ID: 1979793
2026-03-25 16:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979793%27 HTTP/1.1" 200 None
2026-03-25 16:37:00 [ayvens.it] INFO: Scrape type for 1979793: 2
2026-03-25 16:37:00 [ayvens.it] INFO: Extracting data for car ID: 1979793
2026-03-25 16:37:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6da4c7ce-9078-5ea0-926e-e230dbebc80f with identifier: 1979793
2026-03-25 16:37:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6da4c7ce-9078-5ea0-926e-e230dbebc80f with scrape type 2
2026-03-25 16:37:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6da4c7ce-9078-5ea0-926e-e230dbebc80f with scrape type 2
2026-03-25 16:37:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 6da4c7ce-9078-5ea0-926e-e230dbebc80f, identifier: 1979793
2026-03-25 16:37:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 6da4c7ce-9078-5ea0-926e-e230dbebc80f with identifier: 1979793
2026-03-25 16:37:00 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:37:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 6da4c7ce-9078-5ea0-926e-e230dbebc80f with identifier: 1979793
2026-03-25 16:37:00 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 6da4c7ce-9078-5ea0-926e-e230dbebc80f with identifier: 1979793 to the API
2026-03-25 16:37:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:37:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:37:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'ARGENTO BRILLANTE METALLIZZATO',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-26T09:30:00Z',
'fuel_type': 'diesel',
'id': '6da4c7ce-9078-5ea0-926e-e230dbebc80f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40968',
'listing': 'auction',
'location': None,
'make': 'SKODA',
'model': 'SKODA OCTAVIA 1.6 TDI EXECUTIVE SW 5-door (Euro 6.2)',
'odometer': 221526,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-01-15',
'seats_number': 5,
'seller_name': None,
'title': 'SKODA SKODA OCTAVIA 1.6 TDI EXECUTIVE SW 5-door (Euro 6.2) -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2020}
2026-03-25 16:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979793%27 HTTP/1.1" 200 None
2026-03-25 16:37:00 [ayvens.it] INFO: Saving data for 1979793: {'auction_closing_time': 1774517400.0, 'created_time': 1774370128.484309, 'last_price_update_time': 1774456620.95393}
2026-03-25 16:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1979793') HTTP/1.1" 204 0
2026-03-25 16:37:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:37:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f34d7441a90>
2026-03-25 16:37:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:37:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:37:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:37:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b5f6ec2f-600d-5ef5-bb06-514534a30b59/b5f6ec2f-600d-5ef5-bb06-514534a30b59_image_6.jpg HTTP/1.1" 201 0
2026-03-25 16:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft3%252F9b8e5509bc6a4834b2cacd5bdbe5132c%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 16:37:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft3/9b8e5509bc6a4834b2cacd5bdbe5132c/images/large/7.jpg saved to cache
2026-03-25 16:37:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b5f6ec2f-600d-5ef5-bb06-514534a30b59
2026-03-25 16:37:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b5f6ec2f-600d-5ef5-bb06-514534a30b59, skipping ID generation
2026-03-25 16:37:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b5f6ec2f-600d-5ef5-bb06-514534a30b59 with scrape type 1
2026-03-25 16:37:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b5f6ec2f-600d-5ef5-bb06-514534a30b59 sending to next pipeline
2026-03-25 16:37:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: b5f6ec2f-600d-5ef5-bb06-514534a30b59, identifier: 1983502
2026-03-25 16:37:01 [ayvens.it] INFO: Found listing with ID: 1979794
2026-03-25 16:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979794%27 HTTP/1.1" 200 None
2026-03-25 16:37:01 [ayvens.it] INFO: Scrape type for 1979794: 2
2026-03-25 16:37:01 [ayvens.it] INFO: Extracting data for car ID: 1979794
2026-03-25 16:37:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 68c0c36e-9bd9-5ce0-b5cf-78c407194315 with identifier: 1979794
2026-03-25 16:37:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 68c0c36e-9bd9-5ce0-b5cf-78c407194315 with scrape type 2
2026-03-25 16:37:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 68c0c36e-9bd9-5ce0-b5cf-78c407194315 with scrape type 2
2026-03-25 16:37:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 68c0c36e-9bd9-5ce0-b5cf-78c407194315, identifier: 1979794
2026-03-25 16:37:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: b5f6ec2f-600d-5ef5-bb06-514534a30b59 with identifier: 1983502
2026-03-25 16:37:01 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:37:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: b5f6ec2f-600d-5ef5-bb06-514534a30b59 with identifier: 1983502
2026-03-25 16:37:01 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: b5f6ec2f-600d-5ef5-bb06-514534a30b59 with identifier: 1983502 to the API
2026-03-25 16:37:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:37:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:37:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/ft3/9b8e5509bc6a4834b2cacd5bdbe5132c/images/large/7.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'PLATINUM METALLIC',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-27T09:30:00Z',
'fuel_type': 'hybrid',
'id': 'b5f6ec2f-600d-5ef5-bb06-514534a30b59',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41025',
'listing': 'auction',
'location': None,
'make': 'TOYOTA',
'model': 'TOYOTA YARIS 1.5 Hybrid Business Hatchback 5-door (Euro 6.2)',
'odometer': 118254,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 69,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5f6ec2f-600d-5ef5-bb06-514534a30b59/b5f6ec2f-600d-5ef5-bb06-514534a30b59_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 724039,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ft3/9b8e5509bc6a4834b2cacd5bdbe5132c/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5f6ec2f-600d-5ef5-bb06-514534a30b59/b5f6ec2f-600d-5ef5-bb06-514534a30b59_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 646416,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ft3/9b8e5509bc6a4834b2cacd5bdbe5132c/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5f6ec2f-600d-5ef5-bb06-514534a30b59/b5f6ec2f-600d-5ef5-bb06-514534a30b59_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 715961,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ft3/9b8e5509bc6a4834b2cacd5bdbe5132c/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5f6ec2f-600d-5ef5-bb06-514534a30b59/b5f6ec2f-600d-5ef5-bb06-514534a30b59_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 525893,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ft3/9b8e5509bc6a4834b2cacd5bdbe5132c/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5f6ec2f-600d-5ef5-bb06-514534a30b59/b5f6ec2f-600d-5ef5-bb06-514534a30b59_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 586631,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ft3/9b8e5509bc6a4834b2cacd5bdbe5132c/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5f6ec2f-600d-5ef5-bb06-514534a30b59/b5f6ec2f-600d-5ef5-bb06-514534a30b59_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 691974,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ft3/9b8e5509bc6a4834b2cacd5bdbe5132c/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5f6ec2f-600d-5ef5-bb06-514534a30b59/b5f6ec2f-600d-5ef5-bb06-514534a30b59_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 784679,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ft3/9b8e5509bc6a4834b2cacd5bdbe5132c/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5f6ec2f-600d-5ef5-bb06-514534a30b59/b5f6ec2f-600d-5ef5-bb06-514534a30b59_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 341737,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ft3/9b8e5509bc6a4834b2cacd5bdbe5132c/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5f6ec2f-600d-5ef5-bb06-514534a30b59/b5f6ec2f-600d-5ef5-bb06-514534a30b59_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 517336,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ft3/9b8e5509bc6a4834b2cacd5bdbe5132c/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5f6ec2f-600d-5ef5-bb06-514534a30b59/b5f6ec2f-600d-5ef5-bb06-514534a30b59_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 743824,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ft3/9b8e5509bc6a4834b2cacd5bdbe5132c/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-11-12',
'seats_number': 5,
'seller_name': None,
'title': 'TOYOTA TOYOTA YARIS 1.5 Hybrid Business Hatchback 5-door (Euro 6.2) '
'-',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2018}
2026-03-25 16:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271983502%27 HTTP/1.1" 200 None
2026-03-25 16:37:01 [ayvens.it] INFO: Saving data for 1983502: {'created_time': 1774456621.619986, 'last_price_update_time': 1774456621.619997, 'auction_closing_time': 1774603800.0}
2026-03-25 16:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1983502') HTTP/1.1" 204 0
2026-03-25 16:37:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 68c0c36e-9bd9-5ce0-b5cf-78c407194315 with identifier: 1979794
2026-03-25 16:37:01 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:37:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 68c0c36e-9bd9-5ce0-b5cf-78c407194315 with identifier: 1979794
2026-03-25 16:37:01 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 68c0c36e-9bd9-5ce0-b5cf-78c407194315 with identifier: 1979794 to the API
2026-03-25 16:37:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:37:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:37:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Platinum White metallizzato pr',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-26T09:30:00Z',
'fuel_type': 'diesel',
'id': '68c0c36e-9bd9-5ce0-b5cf-78c407194315',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40968',
'listing': 'auction',
'location': None,
'make': 'FORD',
'model': 'FORD S-MAX 2.0 EcoBlue 190cv Auto AWD Vignale 7p. MPV 5-door (Euro '
'6.2)',
'odometer': 137466,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-09-11',
'seats_number': 5,
'seller_name': None,
'title': 'FORD FORD S-MAX 2.0 EcoBlue 190cv Auto AWD Vignale 7p. MPV 5-door '
'(Euro 6.2) -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2020}
2026-03-25 16:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979794%27 HTTP/1.1" 200 None
2026-03-25 16:37:01 [ayvens.it] INFO: Saving data for 1979794: {'auction_closing_time': 1774517400.0, 'created_time': 1774370154.6785, 'last_price_update_time': 1774456621.957067}
2026-03-25 16:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1979794') HTTP/1.1" 204 0
2026-03-25 16:37:01 [ayvens.it] INFO: Found listing with ID: 1979795
2026-03-25 16:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979795%27 HTTP/1.1" 200 None
2026-03-25 16:37:01 [ayvens.it] INFO: Scrape type for 1979795: 2
2026-03-25 16:37:01 [ayvens.it] INFO: Extracting data for car ID: 1979795
2026-03-25 16:37:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 09595089-ce0c-5942-a357-6c5493b5e715 with identifier: 1979795
2026-03-25 16:37:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 09595089-ce0c-5942-a357-6c5493b5e715 with scrape type 2
2026-03-25 16:37:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 09595089-ce0c-5942-a357-6c5493b5e715 with scrape type 2
2026-03-25 16:37:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 09595089-ce0c-5942-a357-6c5493b5e715, identifier: 1979795
2026-03-25 16:37:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 09595089-ce0c-5942-a357-6c5493b5e715 with identifier: 1979795
2026-03-25 16:37:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 09595089-ce0c-5942-a357-6c5493b5e715 with identifier: 1979795
2026-03-25 16:37:02 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 09595089-ce0c-5942-a357-6c5493b5e715 with identifier: 1979795 to the API
2026-03-25 16:37:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:37:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:37:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'PURE WHITE PASTELLO',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-26T09:30:00Z',
'fuel_type': 'diesel',
'id': '09595089-ce0c-5942-a357-6c5493b5e715',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40968',
'listing': 'auction',
'location': None,
'make': 'VOLKSWAGEN',
'model': 'VOLKSWAGEN TIGUAN ALLSPACE 2.0 TDI SCR 110KW ADVANCED BMT 4MOT DSG',
'odometer': 183130,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-01-20',
'seats_number': 5,
'seller_name': None,
'title': 'VOLKSWAGEN VOLKSWAGEN TIGUAN ALLSPACE 2.0 TDI SCR 110KW ADVANCED '
'BMT 4MOT DSG -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2021}
2026-03-25 16:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979795%27 HTTP/1.1" 200 None
2026-03-25 16:37:02 [ayvens.it] INFO: Saving data for 1979795: {'auction_closing_time': 1774517400.0, 'created_time': 1774370148.080172, 'last_price_update_time': 1774456622.297479}
2026-03-25 16:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1979795') HTTP/1.1" 204 0
2026-03-25 16:37:02 [ayvens.it] INFO: Found listing with ID: 1979796
2026-03-25 16:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979796%27 HTTP/1.1" 200 None
2026-03-25 16:37:02 [ayvens.it] INFO: Scrape type for 1979796: 2
2026-03-25 16:37:02 [ayvens.it] INFO: Extracting data for car ID: 1979796
2026-03-25 16:37:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7874a7bc-99d6-5588-94f4-5040679eb998 with identifier: 1979796
2026-03-25 16:37:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7874a7bc-99d6-5588-94f4-5040679eb998 with scrape type 2
2026-03-25 16:37:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7874a7bc-99d6-5588-94f4-5040679eb998 with scrape type 2
2026-03-25 16:37:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 7874a7bc-99d6-5588-94f4-5040679eb998, identifier: 1979796
2026-03-25 16:37:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 7874a7bc-99d6-5588-94f4-5040679eb998 with identifier: 1979796
2026-03-25 16:37:02 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:37:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 7874a7bc-99d6-5588-94f4-5040679eb998 with identifier: 1979796
2026-03-25 16:37:02 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 7874a7bc-99d6-5588-94f4-5040679eb998 with identifier: 1979796 to the API
2026-03-25 16:37:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:37:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:37:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'METROPOLIS WHITE VERNICE PREMIUM',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-26T09:30:00Z',
'fuel_type': 'diesel',
'id': '7874a7bc-99d6-5588-94f4-5040679eb998',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40968',
'listing': 'auction',
'location': None,
'make': 'FORD',
'model': 'FORD FOCUS SW (PC) 1.5 ECOBLUE 120CV ACTIVE SW FP',
'odometer': 126116,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-10-21',
'seats_number': 5,
'seller_name': None,
'title': 'FORD FORD FOCUS SW (PC) 1.5 ECOBLUE 120CV ACTIVE SW FP -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2021}
2026-03-25 16:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979796%27 HTTP/1.1" 200 None
2026-03-25 16:37:02 [ayvens.it] INFO: Saving data for 1979796: {'auction_closing_time': 1774517400.0, 'created_time': 1774370146.935186, 'last_price_update_time': 1774456622.644225}
2026-03-25 16:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1979796') HTTP/1.1" 204 0
2026-03-25 16:37:02 [ayvens.it] INFO: Found listing with ID: 1979797
2026-03-25 16:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979797%27 HTTP/1.1" 200 None
2026-03-25 16:37:02 [ayvens.it] INFO: Scrape type for 1979797: 2
2026-03-25 16:37:02 [ayvens.it] INFO: Extracting data for car ID: 1979797
2026-03-25 16:37:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 086fc59b-627a-5dbb-9789-ef840fe5912f with identifier: 1979797
2026-03-25 16:37:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 086fc59b-627a-5dbb-9789-ef840fe5912f with scrape type 2
2026-03-25 16:37:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 086fc59b-627a-5dbb-9789-ef840fe5912f with scrape type 2
2026-03-25 16:37:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 086fc59b-627a-5dbb-9789-ef840fe5912f, identifier: 1979797
2026-03-25 16:37:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 086fc59b-627a-5dbb-9789-ef840fe5912f with identifier: 1979797
2026-03-25 16:37:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 086fc59b-627a-5dbb-9789-ef840fe5912f with identifier: 1979797
2026-03-25 16:37:02 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 086fc59b-627a-5dbb-9789-ef840fe5912f with identifier: 1979797 to the API
2026-03-25 16:37:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:37:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:37:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Metal Stream Met',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.8L',
'expiration_date': '2026-03-26T09:30:00Z',
'fuel_type': 'hybrid',
'id': '086fc59b-627a-5dbb-9789-ef840fe5912f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40968',
'listing': 'auction',
'location': None,
'make': 'TOYOTA',
'model': 'TOYOTA C-HR 1.8H (122CV) E-CVT Trend Sport utility vehicle 5-door '
'(Euro 6.2)',
'odometer': 60558,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-10-31',
'seats_number': 5,
'seller_name': None,
'title': 'TOYOTA TOYOTA C-HR 1.8H (122CV) E-CVT Trend Sport utility vehicle '
'5-door (Euro 6.2) -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2019}
2026-03-25 16:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979797%27 HTTP/1.1" 200 None
2026-03-25 16:37:02 [ayvens.it] INFO: Saving data for 1979797: {'auction_closing_time': 1774517400.0, 'created_time': 1774370144.338894, 'last_price_update_time': 1774456622.993264}
2026-03-25 16:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1979797') HTTP/1.1" 204 0
2026-03-25 16:37:03 [ayvens.it] INFO: Found listing with ID: 1979798
2026-03-25 16:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979798%27 HTTP/1.1" 200 None
2026-03-25 16:37:03 [ayvens.it] INFO: Scrape type for 1979798: 2
2026-03-25 16:37:03 [ayvens.it] INFO: Extracting data for car ID: 1979798
2026-03-25 16:37:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 40c203b7-5fe2-50b2-a99d-ca28aefd01ea with identifier: 1979798
2026-03-25 16:37:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 40c203b7-5fe2-50b2-a99d-ca28aefd01ea with scrape type 2
2026-03-25 16:37:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 40c203b7-5fe2-50b2-a99d-ca28aefd01ea with scrape type 2
2026-03-25 16:37:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 40c203b7-5fe2-50b2-a99d-ca28aefd01ea, identifier: 1979798
2026-03-25 16:37:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 40c203b7-5fe2-50b2-a99d-ca28aefd01ea with identifier: 1979798
2026-03-25 16:37:03 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:37:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 40c203b7-5fe2-50b2-a99d-ca28aefd01ea with identifier: 1979798
2026-03-25 16:37:03 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 40c203b7-5fe2-50b2-a99d-ca28aefd01ea with identifier: 1979798 to the API
2026-03-25 16:37:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:37:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:37:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Blu Navarra metallizzato',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-26T09:30:00Z',
'fuel_type': 'diesel',
'id': '40c203b7-5fe2-50b2-a99d-ca28aefd01ea',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40968',
'listing': 'auction',
'location': None,
'make': 'AUDI',
'model': 'AUDI Q5 40 TDI Business quattro S tronic Sport utility vehicle '
'5-door (Euro 6D) mild hybrid',
'odometer': 77009,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-01-14',
'seats_number': 5,
'seller_name': None,
'title': 'AUDI AUDI Q5 40 TDI Business quattro S tronic Sport utility vehicle '
'5-door (Euro 6D) mild hybrid -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2021}
2026-03-25 16:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979798%27 HTTP/1.1" 200 None
2026-03-25 16:37:03 [ayvens.it] INFO: Saving data for 1979798: {'auction_closing_time': 1774517400.0, 'created_time': 1774370136.013502, 'last_price_update_time': 1774456623.354409}
2026-03-25 16:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1979798') HTTP/1.1" 204 0
2026-03-25 16:37:03 [ayvens.it] INFO: Found listing with ID: 1979799
2026-03-25 16:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979799%27 HTTP/1.1" 200 None
2026-03-25 16:37:03 [ayvens.it] INFO: Scrape type for 1979799: 2
2026-03-25 16:37:03 [ayvens.it] INFO: Extracting data for car ID: 1979799
2026-03-25 16:37:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6f87711a-f5c1-5de8-aeca-6cfe121e7ef3 with identifier: 1979799
2026-03-25 16:37:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6f87711a-f5c1-5de8-aeca-6cfe121e7ef3 with scrape type 2
2026-03-25 16:37:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6f87711a-f5c1-5de8-aeca-6cfe121e7ef3 with scrape type 2
2026-03-25 16:37:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 6f87711a-f5c1-5de8-aeca-6cfe121e7ef3, identifier: 1979799
2026-03-25 16:37:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 6f87711a-f5c1-5de8-aeca-6cfe121e7ef3 with identifier: 1979799
2026-03-25 16:37:03 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:37:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 6f87711a-f5c1-5de8-aeca-6cfe121e7ef3 with identifier: 1979799
2026-03-25 16:37:03 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 6f87711a-f5c1-5de8-aeca-6cfe121e7ef3 with identifier: 1979799 to the API
2026-03-25 16:37:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:37:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:37:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'ONYX BLACK MET',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-26T09:30:00Z',
'fuel_type': 'diesel',
'id': '6f87711a-f5c1-5de8-aeca-6cfe121e7ef3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40968',
'listing': 'auction',
'location': None,
'make': 'VOLVO',
'model': 'VOLVO XC60 B4 D AUTOMATICO CORE FP',
'odometer': 86353,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-09-05',
'seats_number': 5,
'seller_name': None,
'title': 'VOLVO VOLVO XC60 B4 D AUTOMATICO CORE FP -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2023}
2026-03-25 16:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979799%27 HTTP/1.1" 200 None
2026-03-25 16:37:03 [ayvens.it] INFO: Saving data for 1979799: {'auction_closing_time': 1774517400.0, 'created_time': 1774370143.635402, 'last_price_update_time': 1774456623.713418}
2026-03-25 16:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1979799') HTTP/1.1" 204 0
2026-03-25 16:37:03 [ayvens.it] INFO: Found listing with ID: 1979800
2026-03-25 16:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979800%27 HTTP/1.1" 200 None
2026-03-25 16:37:03 [ayvens.it] INFO: Scrape type for 1979800: 2
2026-03-25 16:37:03 [ayvens.it] INFO: Extracting data for car ID: 1979800
2026-03-25 16:37:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e80b0ace-f948-5a85-8dc0-871a42f5c0c1 with identifier: 1979800
2026-03-25 16:37:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e80b0ace-f948-5a85-8dc0-871a42f5c0c1 with scrape type 2
2026-03-25 16:37:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e80b0ace-f948-5a85-8dc0-871a42f5c0c1 with scrape type 2
2026-03-25 16:37:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: e80b0ace-f948-5a85-8dc0-871a42f5c0c1, identifier: 1979800
2026-03-25 16:37:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: e80b0ace-f948-5a85-8dc0-871a42f5c0c1 with identifier: 1979800
2026-03-25 16:37:03 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:37:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: e80b0ace-f948-5a85-8dc0-871a42f5c0c1 with identifier: 1979800
2026-03-25 16:37:03 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: e80b0ace-f948-5a85-8dc0-871a42f5c0c1 with identifier: 1979800 to the API
2026-03-25 16:37:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:37:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:37:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Unknown',
'currency': 'EUR',
'doors_number': 5,
'engine': '',
'expiration_date': '2026-03-26T09:30:00Z',
'fuel_type': 'electric',
'id': 'e80b0ace-f948-5a85-8dc0-871a42f5c0c1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40968',
'listing': 'auction',
'location': None,
'make': 'SMART',
'model': 'SMART #3 66 kWh BRABUS Sport utility vehicle 5-door',
'odometer': 10429,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-02-02',
'seats_number': 5,
'seller_name': None,
'title': 'SMART SMART #3 66 kWh BRABUS Sport utility vehicle 5-door -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2024}
2026-03-25 16:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979800%27 HTTP/1.1" 200 None
2026-03-25 16:37:04 [ayvens.it] INFO: Saving data for 1979800: {'auction_closing_time': 1774517400.0, 'created_time': 1774370138.576287, 'last_price_update_time': 1774456624.072712}
2026-03-25 16:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1979800') HTTP/1.1" 204 0
2026-03-25 16:37:04 [ayvens.it] INFO: Found listing with ID: 1979801
2026-03-25 16:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979801%27 HTTP/1.1" 200 None
2026-03-25 16:37:04 [ayvens.it] INFO: Scrape type for 1979801: 2
2026-03-25 16:37:04 [ayvens.it] INFO: Extracting data for car ID: 1979801
2026-03-25 16:37:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 409acdeb-cb86-546d-9976-9ad026afa383 with identifier: 1979801
2026-03-25 16:37:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 409acdeb-cb86-546d-9976-9ad026afa383 with scrape type 2
2026-03-25 16:37:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 409acdeb-cb86-546d-9976-9ad026afa383 with scrape type 2
2026-03-25 16:37:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 409acdeb-cb86-546d-9976-9ad026afa383, identifier: 1979801
2026-03-25 16:37:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 409acdeb-cb86-546d-9976-9ad026afa383 with identifier: 1979801
2026-03-25 16:37:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 409acdeb-cb86-546d-9976-9ad026afa383 with identifier: 1979801
2026-03-25 16:37:04 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 409acdeb-cb86-546d-9976-9ad026afa383 with identifier: 1979801 to the API
2026-03-25 16:37:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:37:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:37:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'BIANCO ICY PASTELLO',
'currency': 'EUR',
'doors_number': 4,
'engine': '2.2L',
'expiration_date': '2026-03-26T09:30:00Z',
'fuel_type': 'diesel',
'id': '409acdeb-cb86-546d-9976-9ad026afa383',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40968',
'listing': 'auction',
'location': None,
'make': 'CITROËN',
'model': 'CITROEN JUMPER 33 L3H2 BLUEHDI 120CV FP',
'odometer': 130021,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-11-21',
'seats_number': 5,
'seller_name': None,
'title': 'CITROËN CITROEN JUMPER 33 L3H2 BLUEHDI 120CV FP -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2023}
2026-03-25 16:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979801%27 HTTP/1.1" 200 None
2026-03-25 16:37:04 [ayvens.it] INFO: Saving data for 1979801: {'auction_closing_time': 1774517400.0, 'created_time': 1774370141.725336, 'last_price_update_time': 1774456624.458819}
2026-03-25 16:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1979801') HTTP/1.1" 204 0
2026-03-25 16:37:04 [ayvens.it] INFO: Found listing with ID: 1979802
2026-03-25 16:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979802%27 HTTP/1.1" 200 None
2026-03-25 16:37:04 [ayvens.it] INFO: Scrape type for 1979802: 2
2026-03-25 16:37:04 [ayvens.it] INFO: Extracting data for car ID: 1979802
2026-03-25 16:37:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 115c0715-a50e-55da-93a0-d0b2a52f5afe with identifier: 1979802
2026-03-25 16:37:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 115c0715-a50e-55da-93a0-d0b2a52f5afe with scrape type 2
2026-03-25 16:37:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 115c0715-a50e-55da-93a0-d0b2a52f5afe with scrape type 2
2026-03-25 16:37:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 115c0715-a50e-55da-93a0-d0b2a52f5afe, identifier: 1979802
2026-03-25 16:37:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 115c0715-a50e-55da-93a0-d0b2a52f5afe with identifier: 1979802
2026-03-25 16:37:04 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:37:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 115c0715-a50e-55da-93a0-d0b2a52f5afe with identifier: 1979802
2026-03-25 16:37:04 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 115c0715-a50e-55da-93a0-d0b2a52f5afe with identifier: 1979802 to the API
2026-03-25 16:37:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:37:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:37:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'SANTORINI BLACK METALLIZZATO',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-26T09:30:00Z',
'fuel_type': 'diesel',
'id': '115c0715-a50e-55da-93a0-d0b2a52f5afe',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40968',
'listing': 'auction',
'location': None,
'make': 'JAGUAR',
'model': 'JAGUAR F-PACE 2.0D i4 132kW R-SPORT AWD AUTO Sport utility vehicle '
'5-door (Euro 6.2)',
'odometer': 69335,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-12-14',
'seats_number': 5,
'seller_name': None,
'title': 'JAGUAR JAGUAR F-PACE 2.0D i4 132kW R-SPORT AWD AUTO Sport utility '
'vehicle 5-door (Euro 6.2) -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2020}
2026-03-25 16:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979802%27 HTTP/1.1" 200 None
2026-03-25 16:37:04 [ayvens.it] INFO: Saving data for 1979802: {'auction_closing_time': 1774517400.0, 'created_time': 1774370142.923867, 'last_price_update_time': 1774456624.806127}
2026-03-25 16:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1979802') HTTP/1.1" 204 0
2026-03-25 16:37:04 [ayvens.it] INFO: Found listing with ID: 1979803
2026-03-25 16:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979803%27 HTTP/1.1" 200 None
2026-03-25 16:37:04 [ayvens.it] INFO: Scrape type for 1979803: 2
2026-03-25 16:37:04 [ayvens.it] INFO: Extracting data for car ID: 1979803
2026-03-25 16:37:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: af00af8c-65dc-51f8-854f-fe35aa83766e with identifier: 1979803
2026-03-25 16:37:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item af00af8c-65dc-51f8-854f-fe35aa83766e with scrape type 2
2026-03-25 16:37:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item af00af8c-65dc-51f8-854f-fe35aa83766e with scrape type 2
2026-03-25 16:37:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: af00af8c-65dc-51f8-854f-fe35aa83766e, identifier: 1979803
2026-03-25 16:37:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: af00af8c-65dc-51f8-854f-fe35aa83766e with identifier: 1979803
2026-03-25 16:37:04 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:37:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: af00af8c-65dc-51f8-854f-fe35aa83766e with identifier: 1979803
2026-03-25 16:37:05 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: af00af8c-65dc-51f8-854f-fe35aa83766e with identifier: 1979803 to the API
2026-03-25 16:37:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:37:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:37:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'BIANCO ASTRO METALLIZZATO',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-26T09:30:00Z',
'fuel_type': 'hybrid',
'id': 'af00af8c-65dc-51f8-854f-fe35aa83766e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40968',
'listing': 'auction',
'location': None,
'make': 'MASERATI',
'model': 'MASERATI GRECALE (PC) 2.0 300CV MHEV GT Q4 AUTO FP',
'odometer': 110928,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-03-08',
'seats_number': 5,
'seller_name': None,
'title': 'MASERATI MASERATI GRECALE (PC) 2.0 300CV MHEV GT Q4 AUTO FP -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2023}
2026-03-25 16:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979803%27 HTTP/1.1" 200 None
2026-03-25 16:37:05 [ayvens.it] INFO: Saving data for 1979803: {'auction_closing_time': 1774517400.0, 'created_time': 1774370145.769724, 'last_price_update_time': 1774456625.219643}
2026-03-25 16:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1979803') HTTP/1.1" 204 0
2026-03-25 16:37:05 [ayvens.it] INFO: Found listing with ID: 1979804
2026-03-25 16:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979804%27 HTTP/1.1" 200 None
2026-03-25 16:37:05 [ayvens.it] INFO: Scrape type for 1979804: 2
2026-03-25 16:37:05 [ayvens.it] INFO: Extracting data for car ID: 1979804
2026-03-25 16:37:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b4ae473b-bc06-5240-90d8-f0855cc5c3d7 with identifier: 1979804
2026-03-25 16:37:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b4ae473b-bc06-5240-90d8-f0855cc5c3d7 with scrape type 2
2026-03-25 16:37:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b4ae473b-bc06-5240-90d8-f0855cc5c3d7 with scrape type 2
2026-03-25 16:37:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: b4ae473b-bc06-5240-90d8-f0855cc5c3d7, identifier: 1979804
2026-03-25 16:37:05 [scrapy.extensions.logstats] INFO: Crawled 15 pages (at -6 pages/min), scraped 338 items (at 93 items/min)
2026-03-25 16:37:05 [scrapy.extensions.memusage] INFO: Peak memory usage is 185MiB
2026-03-25 16:37:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: b4ae473b-bc06-5240-90d8-f0855cc5c3d7 with identifier: 1979804
2026-03-25 16:37:05 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:37:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: b4ae473b-bc06-5240-90d8-f0855cc5c3d7 with identifier: 1979804
2026-03-25 16:37:05 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: b4ae473b-bc06-5240-90d8-f0855cc5c3d7 with identifier: 1979804 to the API
2026-03-25 16:37:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:37:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:37:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Blu Misano metallizzato',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-26T09:30:00Z',
'fuel_type': 'hybrid',
'id': 'b4ae473b-bc06-5240-90d8-f0855cc5c3d7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40968',
'listing': 'auction',
'location': None,
'make': 'ALFA ROMEO',
'model': 'ALFA ROMEO TONALE 1.5 160cv Hybrid TCT7 Veloce Sport utility '
'vehicle 5-door',
'odometer': 39050,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-05-29',
'seats_number': 5,
'seller_name': None,
'title': 'ALFA ROMEO ALFA ROMEO TONALE 1.5 160cv Hybrid TCT7 Veloce Sport '
'utility vehicle 5-door -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2024}
2026-03-25 16:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979804%27 HTTP/1.1" 200 None
2026-03-25 16:37:05 [ayvens.it] INFO: Saving data for 1979804: {'auction_closing_time': 1774517400.0, 'created_time': 1774370148.949108, 'last_price_update_time': 1774456625.583212}
2026-03-25 16:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1979804') HTTP/1.1" 204 0
2026-03-25 16:37:05 [ayvens.it] INFO: Found listing with ID: 1979805
2026-03-25 16:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979805%27 HTTP/1.1" 200 None
2026-03-25 16:37:05 [ayvens.it] INFO: Scrape type for 1979805: 2
2026-03-25 16:37:05 [ayvens.it] INFO: Extracting data for car ID: 1979805
2026-03-25 16:37:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 44f8cd08-5c50-563e-98c3-00e8f515cc96 with identifier: 1979805
2026-03-25 16:37:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 44f8cd08-5c50-563e-98c3-00e8f515cc96 with scrape type 2
2026-03-25 16:37:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 44f8cd08-5c50-563e-98c3-00e8f515cc96 with scrape type 2
2026-03-25 16:37:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 44f8cd08-5c50-563e-98c3-00e8f515cc96, identifier: 1979805
2026-03-25 16:37:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 44f8cd08-5c50-563e-98c3-00e8f515cc96 with identifier: 1979805
2026-03-25 16:37:05 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:37:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 44f8cd08-5c50-563e-98c3-00e8f515cc96 with identifier: 1979805
2026-03-25 16:37:05 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 44f8cd08-5c50-563e-98c3-00e8f515cc96 with identifier: 1979805 to the API
2026-03-25 16:37:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:37:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:37:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'DARK KNIGHT MICALIZZATO',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-26T09:30:00Z',
'fuel_type': 'hybrid',
'id': '44f8cd08-5c50-563e-98c3-00e8f515cc96',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40968',
'listing': 'auction',
'location': None,
'make': 'HYUNDAI',
'model': 'HYUNDAI TUCSON 1.6 PHEV 4wd 265cv Xline Auto Sport utility vehicle '
'5-door (Euro 6D)',
'odometer': 70569,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-01-25',
'seats_number': 5,
'seller_name': None,
'title': 'HYUNDAI HYUNDAI TUCSON 1.6 PHEV 4wd 265cv Xline Auto Sport utility '
'vehicle 5-door (Euro 6D) -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2024}
2026-03-25 16:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979805%27 HTTP/1.1" 200 None
2026-03-25 16:37:05 [ayvens.it] INFO: Saving data for 1979805: {'auction_closing_time': 1774517400.0, 'created_time': 1774370152.542279, 'last_price_update_time': 1774456625.947714}
2026-03-25 16:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1979805') HTTP/1.1" 204 0
2026-03-25 16:37:06 [ayvens.it] INFO: Found listing with ID: 1979806
2026-03-25 16:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979806%27 HTTP/1.1" 200 None
2026-03-25 16:37:06 [ayvens.it] INFO: Scrape type for 1979806: 2
2026-03-25 16:37:06 [ayvens.it] INFO: Extracting data for car ID: 1979806
2026-03-25 16:37:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d870f3f8-32a4-5d1a-8233-d72526cb45f6 with identifier: 1979806
2026-03-25 16:37:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d870f3f8-32a4-5d1a-8233-d72526cb45f6 with scrape type 2
2026-03-25 16:37:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d870f3f8-32a4-5d1a-8233-d72526cb45f6 with scrape type 2
2026-03-25 16:37:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: d870f3f8-32a4-5d1a-8233-d72526cb45f6, identifier: 1979806
2026-03-25 16:37:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: d870f3f8-32a4-5d1a-8233-d72526cb45f6 with identifier: 1979806
2026-03-25 16:37:06 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:37:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: d870f3f8-32a4-5d1a-8233-d72526cb45f6 with identifier: 1979806
2026-03-25 16:37:06 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: d870f3f8-32a4-5d1a-8233-d72526cb45f6 with identifier: 1979806 to the API
2026-03-25 16:37:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:37:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:37:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'BLU ZAFFIRO METALLIZZATO',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-26T09:30:00Z',
'fuel_type': 'diesel',
'id': 'd870f3f8-32a4-5d1a-8233-d72526cb45f6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40968',
'listing': 'auction',
'location': None,
'make': 'CITROËN',
'model': 'CITROEN DS 7 CROSSBACK BLUEHDI 130 AUTOMATICA BUSINESS FP (PC) FP',
'odometer': 112075,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-01-26',
'seats_number': 5,
'seller_name': None,
'title': 'CITROËN CITROEN DS 7 CROSSBACK BLUEHDI 130 AUTOMATICA BUSINESS FP '
'(PC) FP -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2021}
2026-03-25 16:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979806%27 HTTP/1.1" 200 None
2026-03-25 16:37:06 [ayvens.it] INFO: Saving data for 1979806: {'auction_closing_time': 1774517400.0, 'created_time': 1774370154.360834, 'last_price_update_time': 1774456626.427743}
2026-03-25 16:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1979806') HTTP/1.1" 204 0
2026-03-25 16:37:06 [ayvens.it] INFO: Found listing with ID: 1979807
2026-03-25 16:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979807%27 HTTP/1.1" 200 None
2026-03-25 16:37:06 [ayvens.it] INFO: Scrape type for 1979807: 2
2026-03-25 16:37:06 [ayvens.it] INFO: Extracting data for car ID: 1979807
2026-03-25 16:37:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c79fa7f1-f2ab-5966-b31e-db071a88263f with identifier: 1979807
2026-03-25 16:37:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c79fa7f1-f2ab-5966-b31e-db071a88263f with scrape type 2
2026-03-25 16:37:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c79fa7f1-f2ab-5966-b31e-db071a88263f with scrape type 2
2026-03-25 16:37:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: c79fa7f1-f2ab-5966-b31e-db071a88263f, identifier: 1979807
2026-03-25 16:37:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: c79fa7f1-f2ab-5966-b31e-db071a88263f with identifier: 1979807
2026-03-25 16:37:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: c79fa7f1-f2ab-5966-b31e-db071a88263f with identifier: 1979807
2026-03-25 16:37:06 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: c79fa7f1-f2ab-5966-b31e-db071a88263f with identifier: 1979807 to the API
2026-03-25 16:37:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:37:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:37:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'ONYX BLACK MET',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-26T09:30:00Z',
'fuel_type': 'diesel',
'id': 'c79fa7f1-f2ab-5966-b31e-db071a88263f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40968',
'listing': 'auction',
'location': None,
'make': 'VOLVO',
'model': 'VOLVO XC60 (PC) B4 D AWD AUTOMATICO CORE FP',
'odometer': 120348,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-10-06',
'seats_number': 5,
'seller_name': None,
'title': 'VOLVO VOLVO XC60 (PC) B4 D AWD AUTOMATICO CORE FP -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-25 16:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979807%27 HTTP/1.1" 200 None
2026-03-25 16:37:06 [ayvens.it] INFO: Saving data for 1979807: {'auction_closing_time': 1774517400.0, 'created_time': 1774370157.891607, 'last_price_update_time': 1774456626.825321}
2026-03-25 16:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1979807') HTTP/1.1" 204 0
2026-03-25 16:37:06 [ayvens.it] INFO: Found listing with ID: 1979808
2026-03-25 16:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979808%27 HTTP/1.1" 200 None
2026-03-25 16:37:06 [ayvens.it] INFO: Scrape type for 1979808: 2
2026-03-25 16:37:06 [ayvens.it] INFO: Extracting data for car ID: 1979808
2026-03-25 16:37:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c20cfbf4-e7e6-5596-bdbb-65d28585c132 with identifier: 1979808
2026-03-25 16:37:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c20cfbf4-e7e6-5596-bdbb-65d28585c132 with scrape type 2
2026-03-25 16:37:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c20cfbf4-e7e6-5596-bdbb-65d28585c132 with scrape type 2
2026-03-25 16:37:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: c20cfbf4-e7e6-5596-bdbb-65d28585c132, identifier: 1979808
2026-03-25 16:37:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: c20cfbf4-e7e6-5596-bdbb-65d28585c132 with identifier: 1979808
2026-03-25 16:37:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: c20cfbf4-e7e6-5596-bdbb-65d28585c132 with identifier: 1979808
2026-03-25 16:37:07 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: c20cfbf4-e7e6-5596-bdbb-65d28585c132 with identifier: 1979808 to the API
2026-03-25 16:37:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:37:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:37:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Unknown',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-26T09:30:00Z',
'fuel_type': 'petrol',
'id': 'c20cfbf4-e7e6-5596-bdbb-65d28585c132',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40968',
'listing': 'auction',
'location': None,
'make': 'FORD',
'model': 'FORD KUGA 1.5 EcoBoost 150CV 2WD ST-Line EcoBoost Sport utility '
'vehicle 5-door (Euro 6.2)',
'odometer': 137464,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-02-24',
'seats_number': 5,
'seller_name': None,
'title': 'FORD FORD KUGA 1.5 EcoBoost 150CV 2WD ST-Line EcoBoost Sport '
'utility vehicle 5-door (Euro 6.2) -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2023}
2026-03-25 16:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979808%27 HTTP/1.1" 200 None
2026-03-25 16:37:07 [ayvens.it] INFO: Saving data for 1979808: {'auction_closing_time': 1774517400.0, 'created_time': 1774370159.359815, 'last_price_update_time': 1774456627.214075}
2026-03-25 16:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1979808') HTTP/1.1" 204 0
2026-03-25 16:37:07 [ayvens.it] INFO: Found listing with ID: 1979809
2026-03-25 16:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979809%27 HTTP/1.1" 200 None
2026-03-25 16:37:07 [ayvens.it] INFO: Scrape type for 1979809: 2
2026-03-25 16:37:07 [ayvens.it] INFO: Extracting data for car ID: 1979809
2026-03-25 16:37:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 944eea88-39b9-50aa-89f7-cabaa1c40c94 with identifier: 1979809
2026-03-25 16:37:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 944eea88-39b9-50aa-89f7-cabaa1c40c94 with scrape type 2
2026-03-25 16:37:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 944eea88-39b9-50aa-89f7-cabaa1c40c94 with scrape type 2
2026-03-25 16:37:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 944eea88-39b9-50aa-89f7-cabaa1c40c94, identifier: 1979809
2026-03-25 16:37:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 944eea88-39b9-50aa-89f7-cabaa1c40c94 with identifier: 1979809
2026-03-25 16:37:07 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:37:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 944eea88-39b9-50aa-89f7-cabaa1c40c94 with identifier: 1979809
2026-03-25 16:37:07 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 944eea88-39b9-50aa-89f7-cabaa1c40c94 with identifier: 1979809 to the API
2026-03-25 16:37:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:37:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:37:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'BLACK SAPPHIRE MTZ',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-26T09:30:00Z',
'fuel_type': 'diesel',
'id': '944eea88-39b9-50aa-89f7-cabaa1c40c94',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40968',
'listing': 'auction',
'location': None,
'make': 'BMW',
'model': 'BMW X4 XDRIVE 20D MH48V FP',
'odometer': 94282,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-10-14',
'seats_number': 5,
'seller_name': None,
'title': 'BMW BMW X4 XDRIVE 20D MH48V FP -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2021}
2026-03-25 16:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979809%27 HTTP/1.1" 200 None
2026-03-25 16:37:07 [ayvens.it] INFO: Saving data for 1979809: {'auction_closing_time': 1774517400.0, 'created_time': 1774370163.333124, 'last_price_update_time': 1774456627.764647}
2026-03-25 16:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1979809') HTTP/1.1" 204 0
2026-03-25 16:37:07 [ayvens.it] INFO: Found listing with ID: 1979810
2026-03-25 16:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979810%27 HTTP/1.1" 200 None
2026-03-25 16:37:07 [ayvens.it] INFO: Scrape type for 1979810: 2
2026-03-25 16:37:07 [ayvens.it] INFO: Extracting data for car ID: 1979810
2026-03-25 16:37:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d11aa293-bfed-5301-b794-0b9cccc3e7d9 with identifier: 1979810
2026-03-25 16:37:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d11aa293-bfed-5301-b794-0b9cccc3e7d9 with scrape type 2
2026-03-25 16:37:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d11aa293-bfed-5301-b794-0b9cccc3e7d9 with scrape type 2
2026-03-25 16:37:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: d11aa293-bfed-5301-b794-0b9cccc3e7d9, identifier: 1979810
2026-03-25 16:37:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: d11aa293-bfed-5301-b794-0b9cccc3e7d9 with identifier: 1979810
2026-03-25 16:37:07 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:37:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: d11aa293-bfed-5301-b794-0b9cccc3e7d9 with identifier: 1979810
2026-03-25 16:37:07 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: d11aa293-bfed-5301-b794-0b9cccc3e7d9 with identifier: 1979810 to the API
2026-03-25 16:37:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:37:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:37:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'BLU RAVENNA MTZ',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-26T09:30:00Z',
'fuel_type': 'diesel',
'id': 'd11aa293-bfed-5301-b794-0b9cccc3e7d9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40968',
'listing': 'auction',
'location': None,
'make': 'VOLKSWAGEN',
'model': 'VOLKSWAGEN T-ROC 2.0 TDI SCR LIFE DSG FP',
'odometer': 92459,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-05-12',
'seats_number': 5,
'seller_name': None,
'title': 'VOLKSWAGEN VOLKSWAGEN T-ROC 2.0 TDI SCR LIFE DSG FP -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2023}
2026-03-25 16:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979810%27 HTTP/1.1" 200 None
2026-03-25 16:37:08 [ayvens.it] INFO: Saving data for 1979810: {'auction_closing_time': 1774517400.0, 'created_time': 1774370165.624891, 'last_price_update_time': 1774456628.125002}
2026-03-25 16:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1979810') HTTP/1.1" 204 0
2026-03-25 16:37:08 [ayvens.it] INFO: Found listing with ID: 1979811
2026-03-25 16:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979811%27 HTTP/1.1" 200 None
2026-03-25 16:37:08 [ayvens.it] INFO: Scrape type for 1979811: 2
2026-03-25 16:37:08 [ayvens.it] INFO: Extracting data for car ID: 1979811
2026-03-25 16:37:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3c1ff467-c230-538d-99bf-198efe7c734b with identifier: 1979811
2026-03-25 16:37:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3c1ff467-c230-538d-99bf-198efe7c734b with scrape type 2
2026-03-25 16:37:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3c1ff467-c230-538d-99bf-198efe7c734b with scrape type 2
2026-03-25 16:37:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 3c1ff467-c230-538d-99bf-198efe7c734b, identifier: 1979811
2026-03-25 16:37:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 3c1ff467-c230-538d-99bf-198efe7c734b with identifier: 1979811
2026-03-25 16:37:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 3c1ff467-c230-538d-99bf-198efe7c734b with identifier: 1979811
2026-03-25 16:37:08 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 3c1ff467-c230-538d-99bf-198efe7c734b with identifier: 1979811 to the API
2026-03-25 16:37:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:37:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:37:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Frozen White pastello',
'currency': 'EUR',
'doors_number': 4,
'engine': '2.0L',
'expiration_date': '2026-03-26T09:30:00Z',
'fuel_type': 'diesel',
'id': '3c1ff467-c230-538d-99bf-198efe7c734b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40968',
'listing': 'auction',
'location': None,
'make': 'FORD',
'model': 'FORD TRANSIT T/P 350 L4 Trend 2.0 HDT 165 cv Cabinato 2-door',
'odometer': 12173,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2025-02-04',
'seats_number': 5,
'seller_name': None,
'title': 'FORD FORD TRANSIT T/P 350 L4 Trend 2.0 HDT 165 cv Cabinato 2-door -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2025}
2026-03-25 16:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979811%27 HTTP/1.1" 200 None
2026-03-25 16:37:08 [ayvens.it] INFO: Saving data for 1979811: {'auction_closing_time': 1774517400.0, 'created_time': 1774370167.036075, 'last_price_update_time': 1774456628.523703}
2026-03-25 16:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1979811') HTTP/1.1" 204 0
2026-03-25 16:37:08 [ayvens.it] INFO: Found listing with ID: 1979812
2026-03-25 16:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979812%27 HTTP/1.1" 200 None
2026-03-25 16:37:08 [ayvens.it] INFO: Scrape type for 1979812: 2
2026-03-25 16:37:08 [ayvens.it] INFO: Extracting data for car ID: 1979812
2026-03-25 16:37:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a67a04f9-becc-5298-9202-b771e044849b with identifier: 1979812
2026-03-25 16:37:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a67a04f9-becc-5298-9202-b771e044849b with scrape type 2
2026-03-25 16:37:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a67a04f9-becc-5298-9202-b771e044849b with scrape type 2
2026-03-25 16:37:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: a67a04f9-becc-5298-9202-b771e044849b, identifier: 1979812
2026-03-25 16:37:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: a67a04f9-becc-5298-9202-b771e044849b with identifier: 1979812
2026-03-25 16:37:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: a67a04f9-becc-5298-9202-b771e044849b with identifier: 1979812
2026-03-25 16:37:08 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: a67a04f9-becc-5298-9202-b771e044849b with identifier: 1979812 to the API
2026-03-25 16:37:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:37:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:37:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'CHROME BLUE METALLIZZATO',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-26T09:30:00Z',
'fuel_type': 'hybrid',
'id': 'a67a04f9-becc-5298-9202-b771e044849b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40968',
'listing': 'auction',
'location': None,
'make': 'FORD',
'model': 'FORD FOCUS SW (PC) 1.0 ECOB. HYBR. 125CV ST-LINE DES.AUTOSW',
'odometer': 116333,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-06-29',
'seats_number': 5,
'seller_name': None,
'title': 'FORD FORD FOCUS SW (PC) 1.0 ECOB. HYBR. 125CV ST-LINE DES.AUTOSW -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2023}
2026-03-25 16:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979812%27 HTTP/1.1" 200 None
2026-03-25 16:37:08 [ayvens.it] INFO: Saving data for 1979812: {'auction_closing_time': 1774517400.0, 'created_time': 1774370169.325128, 'last_price_update_time': 1774456628.902501}
2026-03-25 16:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1979812') HTTP/1.1" 204 0
2026-03-25 16:37:08 [ayvens.it] INFO: Found listing with ID: 1979813
2026-03-25 16:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979813%27 HTTP/1.1" 200 None
2026-03-25 16:37:08 [ayvens.it] INFO: Scrape type for 1979813: 2
2026-03-25 16:37:08 [ayvens.it] INFO: Extracting data for car ID: 1979813
2026-03-25 16:37:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6f8d48a4-7edd-59d2-ab5d-80a171779e90 with identifier: 1979813
2026-03-25 16:37:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6f8d48a4-7edd-59d2-ab5d-80a171779e90 with scrape type 2
2026-03-25 16:37:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6f8d48a4-7edd-59d2-ab5d-80a171779e90 with scrape type 2
2026-03-25 16:37:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 6f8d48a4-7edd-59d2-ab5d-80a171779e90, identifier: 1979813
2026-03-25 16:37:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 6f8d48a4-7edd-59d2-ab5d-80a171779e90 with identifier: 1979813
2026-03-25 16:37:09 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:37:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 6f8d48a4-7edd-59d2-ab5d-80a171779e90 with identifier: 1979813
2026-03-25 16:37:09 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 6f8d48a4-7edd-59d2-ab5d-80a171779e90 with identifier: 1979813 to the API
2026-03-25 16:37:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:37:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:37:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Black Sapphire metallizzato',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-26T09:30:00Z',
'fuel_type': 'diesel',
'id': '6f8d48a4-7edd-59d2-ab5d-80a171779e90',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40968',
'listing': 'auction',
'location': None,
'make': 'BMW',
'model': 'BMW SERIE 5 520d xDrive Business Auto Touring SW 5-door (Euro 6.2)',
'odometer': 371755,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-02-20',
'seats_number': 5,
'seller_name': None,
'title': 'BMW BMW SERIE 5 520d xDrive Business Auto Touring SW 5-door (Euro '
'6.2) -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2019}
2026-03-25 16:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979813%27 HTTP/1.1" 200 None
2026-03-25 16:37:09 [ayvens.it] INFO: Saving data for 1979813: {'auction_closing_time': 1774517400.0, 'created_time': 1774370170.82785, 'last_price_update_time': 1774456629.350948}
2026-03-25 16:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1979813') HTTP/1.1" 204 0
2026-03-25 16:37:09 [ayvens.it] INFO: Found listing with ID: 1979814
2026-03-25 16:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979814%27 HTTP/1.1" 200 None
2026-03-25 16:37:09 [ayvens.it] INFO: Scrape type for 1979814: 2
2026-03-25 16:37:09 [ayvens.it] INFO: Extracting data for car ID: 1979814
2026-03-25 16:37:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4c31dab5-aff9-59b0-a7e6-899d35bf270c with identifier: 1979814
2026-03-25 16:37:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4c31dab5-aff9-59b0-a7e6-899d35bf270c with scrape type 2
2026-03-25 16:37:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4c31dab5-aff9-59b0-a7e6-899d35bf270c with scrape type 2
2026-03-25 16:37:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 4c31dab5-aff9-59b0-a7e6-899d35bf270c, identifier: 1979814
2026-03-25 16:37:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 4c31dab5-aff9-59b0-a7e6-899d35bf270c with identifier: 1979814
2026-03-25 16:37:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 4c31dab5-aff9-59b0-a7e6-899d35bf270c with identifier: 1979814
2026-03-25 16:37:09 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 4c31dab5-aff9-59b0-a7e6-899d35bf270c with identifier: 1979814 to the API
2026-03-25 16:37:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:37:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:37:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'BIANCO GELATO PASTELLO',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.9L',
'expiration_date': '2026-03-26T09:30:00Z',
'fuel_type': 'petrol',
'id': '4c31dab5-aff9-59b0-a7e6-899d35bf270c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40968',
'listing': 'auction',
'location': None,
'make': 'FIAT',
'model': 'FIAT PANDA CONSIP13 0.9 TWINAIR TURBO 85CV S&S E6-TEMP 4X4 FP',
'odometer': 102926,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-11',
'seats_number': 5,
'seller_name': None,
'title': 'FIAT FIAT PANDA CONSIP13 0.9 TWINAIR TURBO 85CV S&S E6-TEMP 4X4 FP '
'-',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2019}
2026-03-25 16:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979814%27 HTTP/1.1" 200 None
2026-03-25 16:37:09 [ayvens.it] INFO: Saving data for 1979814: {'auction_closing_time': 1774517400.0, 'created_time': 1774370172.668133, 'last_price_update_time': 1774456629.697542}
2026-03-25 16:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1979814') HTTP/1.1" 204 0
2026-03-25 16:37:09 [ayvens.it] INFO: Found listing with ID: 1979815
2026-03-25 16:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979815%27 HTTP/1.1" 200 None
2026-03-25 16:37:09 [ayvens.it] INFO: Scrape type for 1979815: 2
2026-03-25 16:37:09 [ayvens.it] INFO: Extracting data for car ID: 1979815
2026-03-25 16:37:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 77eabdee-00c9-5c34-8760-0a95c812d5e9 with identifier: 1979815
2026-03-25 16:37:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 77eabdee-00c9-5c34-8760-0a95c812d5e9 with scrape type 2
2026-03-25 16:37:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 77eabdee-00c9-5c34-8760-0a95c812d5e9 with scrape type 2
2026-03-25 16:37:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 77eabdee-00c9-5c34-8760-0a95c812d5e9, identifier: 1979815
2026-03-25 16:37:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 77eabdee-00c9-5c34-8760-0a95c812d5e9 with identifier: 1979815
2026-03-25 16:37:09 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:37:09 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:37:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 77eabdee-00c9-5c34-8760-0a95c812d5e9 with identifier: 1979815
2026-03-25 16:37:09 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 77eabdee-00c9-5c34-8760-0a95c812d5e9 with identifier: 1979815 to the API
2026-03-25 16:37:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:37:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:37:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Mineral Black Mineral Black',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.4L',
'expiration_date': '2026-03-26T09:30:00Z',
'fuel_type': 'petrol_cng',
'id': '77eabdee-00c9-5c34-8760-0a95c812d5e9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40968',
'listing': 'auction',
'location': None,
'make': 'OPEL',
'model': 'OPEL ASTRA ST 1.4 Turbo 110cv ecoM Dynamic S&S MT6 SW 5-door (Euro '
'6.2)',
'odometer': 117757,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-03-28',
'seats_number': 5,
'seller_name': None,
'title': 'OPEL OPEL ASTRA ST 1.4 Turbo 110cv ecoM Dynamic S&S MT6 SW 5-door '
'(Euro 6.2) -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2019}
2026-03-25 16:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979815%27 HTTP/1.1" 200 None
2026-03-25 16:37:10 [ayvens.it] INFO: Saving data for 1979815: {'auction_closing_time': 1774517400.0, 'created_time': 1774370181.288104, 'last_price_update_time': 1774456630.071646}
2026-03-25 16:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1979815') HTTP/1.1" 204 0
2026-03-25 16:37:10 [ayvens.it] INFO: Found listing with ID: 1979816
2026-03-25 16:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979816%27 HTTP/1.1" 200 None
2026-03-25 16:37:10 [ayvens.it] INFO: Scrape type for 1979816: 2
2026-03-25 16:37:10 [ayvens.it] INFO: Extracting data for car ID: 1979816
2026-03-25 16:37:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c6db15f0-1a82-53ab-bbc8-370d060bc162 with identifier: 1979816
2026-03-25 16:37:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c6db15f0-1a82-53ab-bbc8-370d060bc162 with scrape type 2
2026-03-25 16:37:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c6db15f0-1a82-53ab-bbc8-370d060bc162 with scrape type 2
2026-03-25 16:37:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: c6db15f0-1a82-53ab-bbc8-370d060bc162, identifier: 1979816
2026-03-25 16:37:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: c6db15f0-1a82-53ab-bbc8-370d060bc162 with identifier: 1979816
2026-03-25 16:37:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: c6db15f0-1a82-53ab-bbc8-370d060bc162 with identifier: 1979816
2026-03-25 16:37:10 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: c6db15f0-1a82-53ab-bbc8-370d060bc162 with identifier: 1979816 to the API
2026-03-25 16:37:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:37:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:37:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'BIANCO GELATO PASTELLO',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-26T09:30:00Z',
'fuel_type': 'diesel',
'id': 'c6db15f0-1a82-53ab-bbc8-370d060bc162',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40968',
'listing': 'auction',
'location': None,
'make': 'FIAT',
'model': 'FIAT TIPO SW (PC) 1.6 MJT 120CV 6M S&S BUSINESS FP',
'odometer': 150741,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-09-27',
'seats_number': 5,
'seller_name': None,
'title': 'FIAT FIAT TIPO SW (PC) 1.6 MJT 120CV 6M S&S BUSINESS FP -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2019}
2026-03-25 16:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979816%27 HTTP/1.1" 200 None
2026-03-25 16:37:10 [ayvens.it] INFO: Saving data for 1979816: {'auction_closing_time': 1774517400.0, 'created_time': 1774370180.878659, 'last_price_update_time': 1774456630.416417}
2026-03-25 16:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1979816') HTTP/1.1" 204 0
2026-03-25 16:37:10 [ayvens.it] INFO: Found listing with ID: 1979817
2026-03-25 16:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979817%27 HTTP/1.1" 200 None
2026-03-25 16:37:10 [ayvens.it] INFO: Scrape type for 1979817: 2
2026-03-25 16:37:10 [ayvens.it] INFO: Extracting data for car ID: 1979817
2026-03-25 16:37:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7d498cdb-c964-5a06-b80e-de43933db299 with identifier: 1979817
2026-03-25 16:37:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7d498cdb-c964-5a06-b80e-de43933db299 with scrape type 2
2026-03-25 16:37:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7d498cdb-c964-5a06-b80e-de43933db299 with scrape type 2
2026-03-25 16:37:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 7d498cdb-c964-5a06-b80e-de43933db299, identifier: 1979817
2026-03-25 16:37:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 7d498cdb-c964-5a06-b80e-de43933db299 with identifier: 1979817
2026-03-25 16:37:10 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:37:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 7d498cdb-c964-5a06-b80e-de43933db299 with identifier: 1979817
2026-03-25 16:37:10 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 7d498cdb-c964-5a06-b80e-de43933db299 with identifier: 1979817 to the API
2026-03-25 16:37:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:37:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:37:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Nero brillante pastello',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-26T09:30:00Z',
'fuel_type': 'diesel',
'id': '7d498cdb-c964-5a06-b80e-de43933db299',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40968',
'listing': 'auction',
'location': None,
'make': 'AUDI',
'model': 'AUDI A3 30 TDI S tronic Business S.Back Hatchback 5-door (Euro 6.2)',
'odometer': 108149,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-09-25',
'seats_number': 5,
'seller_name': None,
'title': 'AUDI AUDI A3 30 TDI S tronic Business S.Back Hatchback 5-door (Euro '
'6.2) -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2019}
2026-03-25 16:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979817%27 HTTP/1.1" 200 None
2026-03-25 16:37:11 [ayvens.it] INFO: Saving data for 1979817: {'auction_closing_time': 1774517400.0, 'created_time': 1774370182.434091, 'last_price_update_time': 1774456631.238268}
2026-03-25 16:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1979817') HTTP/1.1" 204 0
2026-03-25 16:37:11 [ayvens.it] INFO: Found listing with ID: 1979818
2026-03-25 16:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979818%27 HTTP/1.1" 200 None
2026-03-25 16:37:11 [ayvens.it] INFO: Scrape type for 1979818: 2
2026-03-25 16:37:11 [ayvens.it] INFO: Extracting data for car ID: 1979818
2026-03-25 16:37:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fa17e9ca-9cfc-588c-8f2c-cc1a6c3853f1 with identifier: 1979818
2026-03-25 16:37:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fa17e9ca-9cfc-588c-8f2c-cc1a6c3853f1 with scrape type 2
2026-03-25 16:37:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fa17e9ca-9cfc-588c-8f2c-cc1a6c3853f1 with scrape type 2
2026-03-25 16:37:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: fa17e9ca-9cfc-588c-8f2c-cc1a6c3853f1, identifier: 1979818
2026-03-25 16:37:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: fa17e9ca-9cfc-588c-8f2c-cc1a6c3853f1 with identifier: 1979818
2026-03-25 16:37:11 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:37:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: fa17e9ca-9cfc-588c-8f2c-cc1a6c3853f1 with identifier: 1979818
2026-03-25 16:37:11 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: fa17e9ca-9cfc-588c-8f2c-cc1a6c3853f1 with identifier: 1979818 to the API
2026-03-25 16:37:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:37:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:37:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Blue Calvi metallizzato',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-26T09:30:00Z',
'fuel_type': 'petrol',
'id': 'fa17e9ca-9cfc-588c-8f2c-cc1a6c3853f1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40968',
'listing': 'auction',
'location': None,
'make': 'CITROËN',
'model': 'CITROËN C1 1.0 VTi72 S&S Feel Micro car 5-door (Euro 6.2)',
'odometer': 124819,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-10-31',
'seats_number': 5,
'seller_name': None,
'title': 'CITROËN CITROËN C1 1.0 VTi72 S&S Feel Micro car 5-door (Euro 6.2) -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2019}
2026-03-25 16:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979818%27 HTTP/1.1" 200 None
2026-03-25 16:37:11 [ayvens.it] INFO: Saving data for 1979818: {'auction_closing_time': 1774517400.0, 'created_time': 1774370184.060863, 'last_price_update_time': 1774456631.831023}
2026-03-25 16:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1979818') HTTP/1.1" 204 0
2026-03-25 16:37:11 [ayvens.it] INFO: Found listing with ID: 1979819
2026-03-25 16:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979819%27 HTTP/1.1" 200 None
2026-03-25 16:37:11 [ayvens.it] INFO: Scrape type for 1979819: 2
2026-03-25 16:37:11 [ayvens.it] INFO: Extracting data for car ID: 1979819
2026-03-25 16:37:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9eade3b8-62c8-57d2-a3c4-86d2de57eb8f with identifier: 1979819
2026-03-25 16:37:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9eade3b8-62c8-57d2-a3c4-86d2de57eb8f with scrape type 2
2026-03-25 16:37:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9eade3b8-62c8-57d2-a3c4-86d2de57eb8f with scrape type 2
2026-03-25 16:37:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 9eade3b8-62c8-57d2-a3c4-86d2de57eb8f, identifier: 1979819
2026-03-25 16:37:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 9eade3b8-62c8-57d2-a3c4-86d2de57eb8f with identifier: 1979819
2026-03-25 16:37:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 9eade3b8-62c8-57d2-a3c4-86d2de57eb8f with identifier: 1979819
2026-03-25 16:37:12 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 9eade3b8-62c8-57d2-a3c4-86d2de57eb8f with identifier: 1979819 to the API
2026-03-25 16:37:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:37:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:37:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Deep Black perla',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-26T09:30:00Z',
'fuel_type': 'diesel',
'id': '9eade3b8-62c8-57d2-a3c4-86d2de57eb8f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40968',
'listing': 'auction',
'location': None,
'make': 'VOLKSWAGEN',
'model': 'VOLKSWAGEN TIGUAN 2.0 TDI SCR 110KW Business BMT DSG Sport utility '
'vehicle 5-door (Euro 6.2)',
'odometer': 495609,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-06-27',
'seats_number': 5,
'seller_name': None,
'title': 'VOLKSWAGEN VOLKSWAGEN TIGUAN 2.0 TDI SCR 110KW Business BMT DSG '
'Sport utility vehicle 5-door (Euro 6.2) -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2019}
2026-03-25 16:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979819%27 HTTP/1.1" 200 None
2026-03-25 16:37:12 [ayvens.it] INFO: Saving data for 1979819: {'auction_closing_time': 1774517400.0, 'created_time': 1774370186.30372, 'last_price_update_time': 1774456632.539512}
2026-03-25 16:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1979819') HTTP/1.1" 204 0
2026-03-25 16:37:12 [ayvens.it] INFO: Found listing with ID: 1979820
2026-03-25 16:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979820%27 HTTP/1.1" 200 None
2026-03-25 16:37:12 [ayvens.it] INFO: Scrape type for 1979820: 2
2026-03-25 16:37:12 [ayvens.it] INFO: Extracting data for car ID: 1979820
2026-03-25 16:37:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1e54a68f-7ac7-5c90-9d01-0f875505c13a with identifier: 1979820
2026-03-25 16:37:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1e54a68f-7ac7-5c90-9d01-0f875505c13a with scrape type 2
2026-03-25 16:37:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1e54a68f-7ac7-5c90-9d01-0f875505c13a with scrape type 2
2026-03-25 16:37:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 1e54a68f-7ac7-5c90-9d01-0f875505c13a, identifier: 1979820
2026-03-25 16:37:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 1e54a68f-7ac7-5c90-9d01-0f875505c13a with identifier: 1979820
2026-03-25 16:37:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 1e54a68f-7ac7-5c90-9d01-0f875505c13a with identifier: 1979820
2026-03-25 16:37:12 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 1e54a68f-7ac7-5c90-9d01-0f875505c13a with identifier: 1979820 to the API
2026-03-25 16:37:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:37:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:37:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'BIANCO GELATO PASTELLO',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-26T09:30:00Z',
'fuel_type': 'petrol_lpg',
'id': '1e54a68f-7ac7-5c90-9d01-0f875505c13a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40968',
'listing': 'auction',
'location': None,
'make': 'FIAT',
'model': 'FIAT PANDA CONSIP14 1.2 69 CV EASYPOWER E6D-TEMP EASY FP',
'odometer': 37313,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-07-08',
'seats_number': 5,
'seller_name': None,
'title': 'FIAT FIAT PANDA CONSIP14 1.2 69 CV EASYPOWER E6D-TEMP EASY FP -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2020}
2026-03-25 16:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979820%27 HTTP/1.1" 200 None
2026-03-25 16:37:12 [ayvens.it] INFO: Saving data for 1979820: {'auction_closing_time': 1774517400.0, 'created_time': 1774370187.86108, 'last_price_update_time': 1774456632.876456}
2026-03-25 16:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1979820') HTTP/1.1" 204 0
2026-03-25 16:37:12 [ayvens.it] INFO: Found listing with ID: 1979821
2026-03-25 16:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979821%27 HTTP/1.1" 200 None
2026-03-25 16:37:12 [ayvens.it] INFO: Scrape type for 1979821: 2
2026-03-25 16:37:12 [ayvens.it] INFO: Extracting data for car ID: 1979821
2026-03-25 16:37:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9e7edf7e-d701-5b8b-bd24-6a92d4b70bc8 with identifier: 1979821
2026-03-25 16:37:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9e7edf7e-d701-5b8b-bd24-6a92d4b70bc8 with scrape type 2
2026-03-25 16:37:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9e7edf7e-d701-5b8b-bd24-6a92d4b70bc8 with scrape type 2
2026-03-25 16:37:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 9e7edf7e-d701-5b8b-bd24-6a92d4b70bc8, identifier: 1979821
2026-03-25 16:37:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 9e7edf7e-d701-5b8b-bd24-6a92d4b70bc8 with identifier: 1979821
2026-03-25 16:37:12 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:37:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 9e7edf7e-d701-5b8b-bd24-6a92d4b70bc8 with identifier: 1979821
2026-03-25 16:37:13 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 9e7edf7e-d701-5b8b-bd24-6a92d4b70bc8 with identifier: 1979821 to the API
2026-03-25 16:37:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:37:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:37:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Blazer Blue pastello',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.1L',
'expiration_date': '2026-03-26T09:30:00Z',
'fuel_type': 'petrol_lpg',
'id': '9e7edf7e-d701-5b8b-bd24-6a92d4b70bc8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40968',
'listing': 'auction',
'location': None,
'make': 'FORD',
'model': 'FORD FIESTA 1.1 75CV GPL S&S Titanium Hatchback 5-door (Euro 6.2)',
'odometer': 78164,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-06-23',
'seats_number': 5,
'seller_name': None,
'title': 'FORD FORD FIESTA 1.1 75CV GPL S&S Titanium Hatchback 5-door (Euro '
'6.2) -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2020}
2026-03-25 16:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979821%27 HTTP/1.1" 200 None
2026-03-25 16:37:13 [ayvens.it] INFO: Saving data for 1979821: {'auction_closing_time': 1774517400.0, 'created_time': 1774370189.406756, 'last_price_update_time': 1774456633.262814}
2026-03-25 16:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1979821') HTTP/1.1" 204 0
2026-03-25 16:37:13 [ayvens.it] INFO: Found listing with ID: 1979822
2026-03-25 16:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979822%27 HTTP/1.1" 200 None
2026-03-25 16:37:13 [ayvens.it] INFO: Scrape type for 1979822: 2
2026-03-25 16:37:13 [ayvens.it] INFO: Extracting data for car ID: 1979822
2026-03-25 16:37:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cf4ad2b8-f0c0-586e-93ab-2c728e067522 with identifier: 1979822
2026-03-25 16:37:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cf4ad2b8-f0c0-586e-93ab-2c728e067522 with scrape type 2
2026-03-25 16:37:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cf4ad2b8-f0c0-586e-93ab-2c728e067522 with scrape type 2
2026-03-25 16:37:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: cf4ad2b8-f0c0-586e-93ab-2c728e067522, identifier: 1979822
2026-03-25 16:37:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: cf4ad2b8-f0c0-586e-93ab-2c728e067522 with identifier: 1979822
2026-03-25 16:37:13 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:37:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: cf4ad2b8-f0c0-586e-93ab-2c728e067522 with identifier: 1979822
2026-03-25 16:37:13 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: cf4ad2b8-f0c0-586e-93ab-2c728e067522 with identifier: 1979822 to the API
2026-03-25 16:37:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:37:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:37:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'MINERAL GREY METALLIZZATO',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-26T09:30:00Z',
'fuel_type': 'hybrid',
'id': 'cf4ad2b8-f0c0-586e-93ab-2c728e067522',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40968',
'listing': 'auction',
'location': None,
'make': 'BMW',
'model': 'BMW X1 (PC) XDRIVE 25E BUSINESS ADVANTAGE AUTOMATICO F FP',
'odometer': 30414,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-12-04',
'seats_number': 5,
'seller_name': None,
'title': 'BMW BMW X1 (PC) XDRIVE 25E BUSINESS ADVANTAGE AUTOMATICO F FP -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2020}
2026-03-25 16:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979822%27 HTTP/1.1" 200 None
2026-03-25 16:37:13 [ayvens.it] INFO: Saving data for 1979822: {'auction_closing_time': 1774517400.0, 'created_time': 1774370191.521024, 'last_price_update_time': 1774456633.626579}
2026-03-25 16:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1979822') HTTP/1.1" 204 0
2026-03-25 16:37:13 [ayvens.it] INFO: Found listing with ID: 1979823
2026-03-25 16:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979823%27 HTTP/1.1" 200 None
2026-03-25 16:37:13 [ayvens.it] INFO: Scrape type for 1979823: 2
2026-03-25 16:37:13 [ayvens.it] INFO: Extracting data for car ID: 1979823
2026-03-25 16:37:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fd27d294-4af3-5f43-a707-5e79250d75ed with identifier: 1979823
2026-03-25 16:37:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fd27d294-4af3-5f43-a707-5e79250d75ed with scrape type 2
2026-03-25 16:37:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fd27d294-4af3-5f43-a707-5e79250d75ed with scrape type 2
2026-03-25 16:37:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: fd27d294-4af3-5f43-a707-5e79250d75ed, identifier: 1979823
2026-03-25 16:37:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: fd27d294-4af3-5f43-a707-5e79250d75ed with identifier: 1979823
2026-03-25 16:37:13 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:37:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: fd27d294-4af3-5f43-a707-5e79250d75ed with identifier: 1979823
2026-03-25 16:37:13 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: fd27d294-4af3-5f43-a707-5e79250d75ed with identifier: 1979823 to the API
2026-03-25 16:37:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:37:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:37:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'OCEAN GREEN METALLIZZATO',
'currency': 'EUR',
'doors_number': 3,
'engine': '',
'expiration_date': '2026-03-26T09:30:00Z',
'fuel_type': 'electric',
'id': 'fd27d294-4af3-5f43-a707-5e79250d75ed',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40968',
'listing': 'auction',
'location': None,
'make': 'FIAT',
'model': 'FIAT 500 CABRIO ELETTRICA LA PRIMA FP',
'odometer': 17998,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-02-15',
'seats_number': 5,
'seller_name': None,
'title': 'FIAT FIAT 500 CABRIO ELETTRICA LA PRIMA FP -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2021}
2026-03-25 16:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979823%27 HTTP/1.1" 200 None
2026-03-25 16:37:13 [ayvens.it] INFO: Saving data for 1979823: {'auction_closing_time': 1774517400.0, 'created_time': 1774370193.744449, 'last_price_update_time': 1774456633.979366}
2026-03-25 16:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1979823') HTTP/1.1" 204 0
2026-03-25 16:37:13 [ayvens.it] INFO: Found listing with ID: 1979824
2026-03-25 16:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979824%27 HTTP/1.1" 200 None
2026-03-25 16:37:14 [ayvens.it] INFO: Scrape type for 1979824: 2
2026-03-25 16:37:14 [ayvens.it] INFO: Extracting data for car ID: 1979824
2026-03-25 16:37:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e5603b10-eb45-5713-87d7-ed439ccc683b with identifier: 1979824
2026-03-25 16:37:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e5603b10-eb45-5713-87d7-ed439ccc683b with scrape type 2
2026-03-25 16:37:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e5603b10-eb45-5713-87d7-ed439ccc683b with scrape type 2
2026-03-25 16:37:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: e5603b10-eb45-5713-87d7-ed439ccc683b, identifier: 1979824
2026-03-25 16:37:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: e5603b10-eb45-5713-87d7-ed439ccc683b with identifier: 1979824
2026-03-25 16:37:14 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:37:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: e5603b10-eb45-5713-87d7-ed439ccc683b with identifier: 1979824
2026-03-25 16:37:14 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: e5603b10-eb45-5713-87d7-ed439ccc683b with identifier: 1979824 to the API
2026-03-25 16:37:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:37:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:37:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'WHITE JADE',
'currency': 'EUR',
'doors_number': 3,
'engine': '1.5L',
'expiration_date': '2026-03-26T09:30:00Z',
'fuel_type': 'diesel',
'id': 'e5603b10-eb45-5713-87d7-ed439ccc683b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40968',
'listing': 'auction',
'location': None,
'make': 'OPEL',
'model': 'OPEL COMBO 1.5 DIESEL 100CV L1 650 KG MT5 FP',
'odometer': 109714,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-03-25',
'seats_number': 5,
'seller_name': None,
'title': 'OPEL OPEL COMBO 1.5 DIESEL 100CV L1 650 KG MT5 FP -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2021}
2026-03-25 16:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979824%27 HTTP/1.1" 200 None
2026-03-25 16:37:14 [ayvens.it] INFO: Saving data for 1979824: {'auction_closing_time': 1774517400.0, 'created_time': 1774370195.845437, 'last_price_update_time': 1774456634.383104}
2026-03-25 16:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1979824') HTTP/1.1" 204 0
2026-03-25 16:37:14 [ayvens.it] INFO: Found listing with ID: 1979825
2026-03-25 16:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979825%27 HTTP/1.1" 200 None
2026-03-25 16:37:14 [ayvens.it] INFO: Scrape type for 1979825: 2
2026-03-25 16:37:14 [ayvens.it] INFO: Extracting data for car ID: 1979825
2026-03-25 16:37:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2506a2d0-be33-5c25-ab10-9884a22a4829 with identifier: 1979825
2026-03-25 16:37:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2506a2d0-be33-5c25-ab10-9884a22a4829 with scrape type 2
2026-03-25 16:37:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2506a2d0-be33-5c25-ab10-9884a22a4829 with scrape type 2
2026-03-25 16:37:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 2506a2d0-be33-5c25-ab10-9884a22a4829, identifier: 1979825
2026-03-25 16:37:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 2506a2d0-be33-5c25-ab10-9884a22a4829 with identifier: 1979825
2026-03-25 16:37:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 2506a2d0-be33-5c25-ab10-9884a22a4829 with identifier: 1979825
2026-03-25 16:37:14 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 2506a2d0-be33-5c25-ab10-9884a22a4829 with identifier: 1979825 to the API
2026-03-25 16:37:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:37:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:37:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'GRIGIO PLATINUM MET',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-26T09:30:00Z',
'fuel_type': 'diesel',
'id': '2506a2d0-be33-5c25-ab10-9884a22a4829',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40968',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': 'PEUGEOT 3008 (PC) BLUEHDI 130 EAT8 S&S ALLURE PACK FP',
'odometer': 89975,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-01-28',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT PEUGEOT 3008 (PC) BLUEHDI 130 EAT8 S&S ALLURE PACK FP -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-25 16:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979825%27 HTTP/1.1" 200 None
2026-03-25 16:37:14 [ayvens.it] INFO: Saving data for 1979825: {'auction_closing_time': 1774517400.0, 'created_time': 1774370199.189615, 'last_price_update_time': 1774456634.726141}
2026-03-25 16:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1979825') HTTP/1.1" 204 0
2026-03-25 16:37:14 [ayvens.it] INFO: Found listing with ID: 1979826
2026-03-25 16:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979826%27 HTTP/1.1" 200 None
2026-03-25 16:37:14 [ayvens.it] INFO: Scrape type for 1979826: 2
2026-03-25 16:37:14 [ayvens.it] INFO: Extracting data for car ID: 1979826
2026-03-25 16:37:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c579849f-f4af-555b-857f-95cc32e7c3c5 with identifier: 1979826
2026-03-25 16:37:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c579849f-f4af-555b-857f-95cc32e7c3c5 with scrape type 2
2026-03-25 16:37:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c579849f-f4af-555b-857f-95cc32e7c3c5 with scrape type 2
2026-03-25 16:37:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: c579849f-f4af-555b-857f-95cc32e7c3c5, identifier: 1979826
2026-03-25 16:37:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: c579849f-f4af-555b-857f-95cc32e7c3c5 with identifier: 1979826
2026-03-25 16:37:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: c579849f-f4af-555b-857f-95cc32e7c3c5 with identifier: 1979826
2026-03-25 16:37:14 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: c579849f-f4af-555b-857f-95cc32e7c3c5 with identifier: 1979826 to the API
2026-03-25 16:37:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:37:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:37:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'ALPINE WHITE PASTELLO',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-26T09:30:00Z',
'fuel_type': 'diesel',
'id': 'c579849f-f4af-555b-857f-95cc32e7c3c5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40968',
'listing': 'auction',
'location': None,
'make': 'BMW',
'model': 'BMW SERIES 5 SW 518D M SPORT TOURING',
'odometer': 69607,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-09-06',
'seats_number': 5,
'seller_name': None,
'title': 'BMW BMW SERIES 5 SW 518D M SPORT TOURING -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-25 16:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979826%27 HTTP/1.1" 200 None
2026-03-25 16:37:15 [ayvens.it] INFO: Saving data for 1979826: {'auction_closing_time': 1774517400.0, 'created_time': 1774370200.765848, 'last_price_update_time': 1774456635.111447}
2026-03-25 16:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1979826') HTTP/1.1" 204 0
2026-03-25 16:37:15 [ayvens.it] INFO: Found listing with ID: 1979827
2026-03-25 16:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979827%27 HTTP/1.1" 200 None
2026-03-25 16:37:15 [ayvens.it] INFO: Scrape type for 1979827: 2
2026-03-25 16:37:15 [ayvens.it] INFO: Extracting data for car ID: 1979827
2026-03-25 16:37:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6d46b548-6d8c-583a-be4d-cf19ab960f38 with identifier: 1979827
2026-03-25 16:37:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6d46b548-6d8c-583a-be4d-cf19ab960f38 with scrape type 2
2026-03-25 16:37:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6d46b548-6d8c-583a-be4d-cf19ab960f38 with scrape type 2
2026-03-25 16:37:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 6d46b548-6d8c-583a-be4d-cf19ab960f38, identifier: 1979827
2026-03-25 16:37:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 6d46b548-6d8c-583a-be4d-cf19ab960f38 with identifier: 1979827
2026-03-25 16:37:15 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:37:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 6d46b548-6d8c-583a-be4d-cf19ab960f38 with identifier: 1979827
2026-03-25 16:37:15 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 6d46b548-6d8c-583a-be4d-cf19ab960f38 with identifier: 1979827 to the API
2026-03-25 16:37:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:37:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:37:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'BLU LAVA METALLIZZATO',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-26T09:30:00Z',
'fuel_type': 'diesel',
'id': '6d46b548-6d8c-583a-be4d-cf19ab960f38',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40968',
'listing': 'auction',
'location': None,
'make': 'SKODA',
'model': 'SKODA KODIAQ 2.0 TDI EVO SCR EXECUTIVE DSG 5P FP',
'odometer': 209726,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-10-26',
'seats_number': 5,
'seller_name': None,
'title': 'SKODA SKODA KODIAQ 2.0 TDI EVO SCR EXECUTIVE DSG 5P FP -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-25 16:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979827%27 HTTP/1.1" 200 None
2026-03-25 16:37:15 [ayvens.it] INFO: Saving data for 1979827: {'auction_closing_time': 1774517400.0, 'created_time': 1774370202.793127, 'last_price_update_time': 1774456635.488137}
2026-03-25 16:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1979827') HTTP/1.1" 204 0
2026-03-25 16:37:15 [ayvens.it] INFO: Found listing with ID: 1979828
2026-03-25 16:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979828%27 HTTP/1.1" 200 None
2026-03-25 16:37:15 [ayvens.it] INFO: Scrape type for 1979828: 2
2026-03-25 16:37:15 [ayvens.it] INFO: Extracting data for car ID: 1979828
2026-03-25 16:37:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ac2a8852-f60f-59c9-bdce-e7e99dada96f with identifier: 1979828
2026-03-25 16:37:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ac2a8852-f60f-59c9-bdce-e7e99dada96f with scrape type 2
2026-03-25 16:37:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ac2a8852-f60f-59c9-bdce-e7e99dada96f with scrape type 2
2026-03-25 16:37:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: ac2a8852-f60f-59c9-bdce-e7e99dada96f, identifier: 1979828
2026-03-25 16:37:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: ac2a8852-f60f-59c9-bdce-e7e99dada96f with identifier: 1979828
2026-03-25 16:37:15 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:37:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: ac2a8852-f60f-59c9-bdce-e7e99dada96f with identifier: 1979828
2026-03-25 16:37:15 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: ac2a8852-f60f-59c9-bdce-e7e99dada96f with identifier: 1979828 to the API
2026-03-25 16:37:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:37:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:37:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'BIANCO PERLATO',
'currency': 'EUR',
'doors_number': 5,
'engine': '',
'expiration_date': '2026-03-26T09:30:00Z',
'fuel_type': 'electric',
'id': 'ac2a8852-f60f-59c9-bdce-e7e99dada96f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40968',
'listing': 'auction',
'location': None,
'make': 'TESLA',
'model': 'TESLA MODEL 3 50 kWh RWD Sedan 4-door',
'odometer': 44103,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-06-06',
'seats_number': 5,
'seller_name': None,
'title': 'TESLA TESLA MODEL 3 50 kWh RWD Sedan 4-door -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-25 16:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979828%27 HTTP/1.1" 200 None
2026-03-25 16:37:16 [ayvens.it] INFO: Saving data for 1979828: {'auction_closing_time': 1774517400.0, 'created_time': 1774370205.069635, 'last_price_update_time': 1774456636.064352}
2026-03-25 16:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1979828') HTTP/1.1" 204 0
2026-03-25 16:37:16 [ayvens.it] INFO: Found listing with ID: 1979829
2026-03-25 16:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979829%27 HTTP/1.1" 200 None
2026-03-25 16:37:16 [ayvens.it] INFO: Scrape type for 1979829: 2
2026-03-25 16:37:16 [ayvens.it] INFO: Extracting data for car ID: 1979829
2026-03-25 16:37:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2e34b690-889a-57a1-876f-e935801ce1b2 with identifier: 1979829
2026-03-25 16:37:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2e34b690-889a-57a1-876f-e935801ce1b2 with scrape type 2
2026-03-25 16:37:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2e34b690-889a-57a1-876f-e935801ce1b2 with scrape type 2
2026-03-25 16:37:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 2e34b690-889a-57a1-876f-e935801ce1b2, identifier: 1979829
2026-03-25 16:37:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 2e34b690-889a-57a1-876f-e935801ce1b2 with identifier: 1979829
2026-03-25 16:37:16 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:37:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 2e34b690-889a-57a1-876f-e935801ce1b2 with identifier: 1979829
2026-03-25 16:37:16 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 2e34b690-889a-57a1-876f-e935801ce1b2 with identifier: 1979829 to the API
2026-03-25 16:37:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:37:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:37:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Dark Metallic Grey metallizzat',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-26T09:30:00Z',
'fuel_type': 'petrol',
'id': '2e34b690-889a-57a1-876f-e935801ce1b2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40968',
'listing': 'auction',
'location': None,
'make': 'NISSAN',
'model': 'NISSAN JUKE 1.0 DIG-T 114 N-Connecta Dct Cross over 5-door (Euro '
'6D)',
'odometer': 38140,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-06-20',
'seats_number': 5,
'seller_name': None,
'title': 'NISSAN NISSAN JUKE 1.0 DIG-T 114 N-Connecta Dct Cross over 5-door '
'(Euro 6D) -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-25 16:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979829%27 HTTP/1.1" 200 None
2026-03-25 16:37:16 [ayvens.it] INFO: Saving data for 1979829: {'auction_closing_time': 1774517400.0, 'created_time': 1774370207.537608, 'last_price_update_time': 1774456636.839724}
2026-03-25 16:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1979829') HTTP/1.1" 204 0
2026-03-25 16:37:16 [ayvens.it] INFO: Found listing with ID: 1979830
2026-03-25 16:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979830%27 HTTP/1.1" 200 None
2026-03-25 16:37:16 [ayvens.it] INFO: Scrape type for 1979830: 2
2026-03-25 16:37:16 [ayvens.it] INFO: Extracting data for car ID: 1979830
2026-03-25 16:37:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 62fdd4ff-9dc0-5400-9b7c-fee20d548d20 with identifier: 1979830
2026-03-25 16:37:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 62fdd4ff-9dc0-5400-9b7c-fee20d548d20 with scrape type 2
2026-03-25 16:37:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 62fdd4ff-9dc0-5400-9b7c-fee20d548d20 with scrape type 2
2026-03-25 16:37:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 62fdd4ff-9dc0-5400-9b7c-fee20d548d20, identifier: 1979830
2026-03-25 16:37:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 62fdd4ff-9dc0-5400-9b7c-fee20d548d20 with identifier: 1979830
2026-03-25 16:37:16 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:37:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 62fdd4ff-9dc0-5400-9b7c-fee20d548d20 with identifier: 1979830
2026-03-25 16:37:17 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 62fdd4ff-9dc0-5400-9b7c-fee20d548d20 with identifier: 1979830 to the API
2026-03-25 16:37:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:37:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:37:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Nero Perla',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-26T09:30:00Z',
'fuel_type': 'diesel',
'id': '62fdd4ff-9dc0-5400-9b7c-fee20d548d20',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40968',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': 'PEUGEOT 2008 BlueHDi 130 EAT8 Allure S/S aut. Cross over 5-door '
'(Euro 6D)',
'odometer': 47758,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-01-11',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT PEUGEOT 2008 BlueHDi 130 EAT8 Allure S/S aut. Cross over '
'5-door (Euro 6D) -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2023}
2026-03-25 16:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979830%27 HTTP/1.1" 200 None
2026-03-25 16:37:17 [ayvens.it] INFO: Saving data for 1979830: {'auction_closing_time': 1774517400.0, 'created_time': 1774370209.064756, 'last_price_update_time': 1774456637.524893}
2026-03-25 16:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1979830') HTTP/1.1" 204 0
2026-03-25 16:37:17 [ayvens.it] INFO: Found listing with ID: 1979831
2026-03-25 16:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979831%27 HTTP/1.1" 200 None
2026-03-25 16:37:17 [ayvens.it] INFO: Scrape type for 1979831: 2
2026-03-25 16:37:17 [ayvens.it] INFO: Extracting data for car ID: 1979831
2026-03-25 16:37:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e5a4245a-8726-53dc-b2bf-185b74e0ce4d with identifier: 1979831
2026-03-25 16:37:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e5a4245a-8726-53dc-b2bf-185b74e0ce4d with scrape type 2
2026-03-25 16:37:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e5a4245a-8726-53dc-b2bf-185b74e0ce4d with scrape type 2
2026-03-25 16:37:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: e5a4245a-8726-53dc-b2bf-185b74e0ce4d, identifier: 1979831
2026-03-25 16:37:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: e5a4245a-8726-53dc-b2bf-185b74e0ce4d with identifier: 1979831
2026-03-25 16:37:17 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:37:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: e5a4245a-8726-53dc-b2bf-185b74e0ce4d with identifier: 1979831
2026-03-25 16:37:17 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: e5a4245a-8726-53dc-b2bf-185b74e0ce4d with identifier: 1979831 to the API
2026-03-25 16:37:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:37:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:37:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'White Jade brilliant',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-26T09:30:00Z',
'fuel_type': 'diesel',
'id': 'e5a4245a-8726-53dc-b2bf-185b74e0ce4d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40968',
'listing': 'auction',
'location': None,
'make': 'OPEL',
'model': 'OPEL GRANDLAND 1.5 130cv GS Line AT8 Sport utility vehicle 5-door '
'(Euro 6D)',
'odometer': 150216,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-04-17',
'seats_number': 5,
'seller_name': None,
'title': 'OPEL OPEL GRANDLAND 1.5 130cv GS Line AT8 Sport utility vehicle '
'5-door (Euro 6D) -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2023}
2026-03-25 16:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979831%27 HTTP/1.1" 200 None
2026-03-25 16:37:17 [ayvens.it] INFO: Saving data for 1979831: {'auction_closing_time': 1774517400.0, 'created_time': 1774370210.93653, 'last_price_update_time': 1774456637.883419}
2026-03-25 16:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1979831') HTTP/1.1" 204 0
2026-03-25 16:37:17 [ayvens.it] INFO: Found listing with ID: 1979832
2026-03-25 16:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979832%27 HTTP/1.1" 200 None
2026-03-25 16:37:17 [ayvens.it] INFO: Scrape type for 1979832: 2
2026-03-25 16:37:17 [ayvens.it] INFO: Extracting data for car ID: 1979832
2026-03-25 16:37:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 00ed787f-da16-599c-8604-0139b22e911f with identifier: 1979832
2026-03-25 16:37:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 00ed787f-da16-599c-8604-0139b22e911f with scrape type 2
2026-03-25 16:37:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 00ed787f-da16-599c-8604-0139b22e911f with scrape type 2
2026-03-25 16:37:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 00ed787f-da16-599c-8604-0139b22e911f, identifier: 1979832
2026-03-25 16:37:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 00ed787f-da16-599c-8604-0139b22e911f with identifier: 1979832
2026-03-25 16:37:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 00ed787f-da16-599c-8604-0139b22e911f with identifier: 1979832
2026-03-25 16:37:18 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 00ed787f-da16-599c-8604-0139b22e911f with identifier: 1979832 to the API
2026-03-25 16:37:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:37:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:37:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Solar Silver metallizzato',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-26T09:30:00Z',
'fuel_type': 'diesel',
'id': '00ed787f-da16-599c-8604-0139b22e911f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40968',
'listing': 'auction',
'location': None,
'make': 'FORD',
'model': 'FORD KUGA 1.5 EcoBlue 120CV 2WD Titanium Bus. Auto Sport utility '
'vehicle 5-door (Euro 6.2)',
'odometer': 155330,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-02-10',
'seats_number': 5,
'seller_name': None,
'title': 'FORD FORD KUGA 1.5 EcoBlue 120CV 2WD Titanium Bus. Auto Sport '
'utility vehicle 5-door (Euro 6.2) -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-25 16:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979832%27 HTTP/1.1" 200 None
2026-03-25 16:37:18 [ayvens.it] INFO: Saving data for 1979832: {'auction_closing_time': 1774517400.0, 'created_time': 1774370213.196853, 'last_price_update_time': 1774456638.291643}
2026-03-25 16:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1979832') HTTP/1.1" 204 0
2026-03-25 16:37:18 [ayvens.it] INFO: Found listing with ID: 1979833
2026-03-25 16:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979833%27 HTTP/1.1" 200 None
2026-03-25 16:37:18 [ayvens.it] INFO: Scrape type for 1979833: 2
2026-03-25 16:37:18 [ayvens.it] INFO: Extracting data for car ID: 1979833
2026-03-25 16:37:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 20f386ed-2d2a-5c9e-aece-b5d6b8a4b850 with identifier: 1979833
2026-03-25 16:37:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 20f386ed-2d2a-5c9e-aece-b5d6b8a4b850 with scrape type 2
2026-03-25 16:37:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 20f386ed-2d2a-5c9e-aece-b5d6b8a4b850 with scrape type 2
2026-03-25 16:37:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 20f386ed-2d2a-5c9e-aece-b5d6b8a4b850, identifier: 1979833
2026-03-25 16:37:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 20f386ed-2d2a-5c9e-aece-b5d6b8a4b850 with identifier: 1979833
2026-03-25 16:37:18 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:37:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 20f386ed-2d2a-5c9e-aece-b5d6b8a4b850 with identifier: 1979833
2026-03-25 16:37:18 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 20f386ed-2d2a-5c9e-aece-b5d6b8a4b850 with identifier: 1979833 to the API
2026-03-25 16:37:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:37:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:37:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'DARK METAL GREY',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-26T09:30:00Z',
'fuel_type': 'hybrid',
'id': '20f386ed-2d2a-5c9e-aece-b5d6b8a4b850',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40968',
'listing': 'auction',
'location': None,
'make': 'NISSAN',
'model': 'NISSAN QASHQAI (PC) 1.5 HEV E-POWER BUSINESS AUTO FP',
'odometer': 97572,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-09-29',
'seats_number': 5,
'seller_name': None,
'title': 'NISSAN NISSAN QASHQAI (PC) 1.5 HEV E-POWER BUSINESS AUTO FP -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2023}
2026-03-25 16:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979833%27 HTTP/1.1" 200 None
2026-03-25 16:37:18 [ayvens.it] INFO: Saving data for 1979833: {'auction_closing_time': 1774517400.0, 'created_time': 1774370214.834821, 'last_price_update_time': 1774456638.647382}
2026-03-25 16:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1979833') HTTP/1.1" 204 0
2026-03-25 16:37:18 [ayvens.it] INFO: Found listing with ID: 1979834
2026-03-25 16:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979834%27 HTTP/1.1" 200 None
2026-03-25 16:37:18 [ayvens.it] INFO: Scrape type for 1979834: 2
2026-03-25 16:37:18 [ayvens.it] INFO: Extracting data for car ID: 1979834
2026-03-25 16:37:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: afe2f8ca-8ddf-5679-ad3a-f23a1f3a7dce with identifier: 1979834
2026-03-25 16:37:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item afe2f8ca-8ddf-5679-ad3a-f23a1f3a7dce with scrape type 2
2026-03-25 16:37:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item afe2f8ca-8ddf-5679-ad3a-f23a1f3a7dce with scrape type 2
2026-03-25 16:37:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: afe2f8ca-8ddf-5679-ad3a-f23a1f3a7dce, identifier: 1979834
2026-03-25 16:37:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: afe2f8ca-8ddf-5679-ad3a-f23a1f3a7dce with identifier: 1979834
2026-03-25 16:37:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: afe2f8ca-8ddf-5679-ad3a-f23a1f3a7dce with identifier: 1979834
2026-03-25 16:37:18 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: afe2f8ca-8ddf-5679-ad3a-f23a1f3a7dce with identifier: 1979834 to the API
2026-03-25 16:37:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:37:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:37:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'FROZEN WHITE',
'currency': 'EUR',
'doors_number': 4,
'engine': '1.5L',
'expiration_date': '2026-03-26T09:30:00Z',
'fuel_type': 'diesel',
'id': 'afe2f8ca-8ddf-5679-ad3a-f23a1f3a7dce',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40968',
'listing': 'auction',
'location': None,
'make': 'FORD',
'model': 'FORD TRANSIT COURIER 1.5 TDCI 75 CV TREND FP (PC)',
'odometer': 62259,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-04-17',
'seats_number': 5,
'seller_name': None,
'title': 'FORD FORD TRANSIT COURIER 1.5 TDCI 75 CV TREND FP (PC) -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2023}
2026-03-25 16:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979834%27 HTTP/1.1" 200 None
2026-03-25 16:37:19 [ayvens.it] INFO: Saving data for 1979834: {'auction_closing_time': 1774517400.0, 'created_time': 1774370218.253182, 'last_price_update_time': 1774456639.090525}
2026-03-25 16:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1979834') HTTP/1.1" 204 0
2026-03-25 16:37:19 [ayvens.it] INFO: Found listing with ID: 1979835
2026-03-25 16:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979835%27 HTTP/1.1" 200 None
2026-03-25 16:37:19 [ayvens.it] INFO: Scrape type for 1979835: 2
2026-03-25 16:37:19 [ayvens.it] INFO: Extracting data for car ID: 1979835
2026-03-25 16:37:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bac57458-548a-5621-8373-05658b9fa3f4 with identifier: 1979835
2026-03-25 16:37:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bac57458-548a-5621-8373-05658b9fa3f4 with scrape type 2
2026-03-25 16:37:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bac57458-548a-5621-8373-05658b9fa3f4 with scrape type 2
2026-03-25 16:37:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: bac57458-548a-5621-8373-05658b9fa3f4, identifier: 1979835
2026-03-25 16:37:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: bac57458-548a-5621-8373-05658b9fa3f4 with identifier: 1979835
2026-03-25 16:37:19 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:37:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: bac57458-548a-5621-8373-05658b9fa3f4 with identifier: 1979835
2026-03-25 16:37:19 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: bac57458-548a-5621-8373-05658b9fa3f4 with identifier: 1979835 to the API
2026-03-25 16:37:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:37:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:37:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Mineral White metallizzato',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-26T09:30:00Z',
'fuel_type': 'diesel',
'id': 'bac57458-548a-5621-8373-05658b9fa3f4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40968',
'listing': 'auction',
'location': None,
'make': 'BMW',
'model': 'BMW SERIE 3 318d 48V Touring auto SW 5-door',
'odometer': 83675,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-06-06',
'seats_number': 5,
'seller_name': None,
'title': 'BMW BMW SERIE 3 318d 48V Touring auto SW 5-door -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2023}
2026-03-25 16:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979835%27 HTTP/1.1" 200 None
2026-03-25 16:37:19 [ayvens.it] INFO: Saving data for 1979835: {'auction_closing_time': 1774517400.0, 'created_time': 1774370220.576282, 'last_price_update_time': 1774456639.556314}
2026-03-25 16:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1979835') HTTP/1.1" 204 0
2026-03-25 16:37:19 [ayvens.it] INFO: Found listing with ID: 1979836
2026-03-25 16:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979836%27 HTTP/1.1" 200 None
2026-03-25 16:37:19 [ayvens.it] INFO: Scrape type for 1979836: 2
2026-03-25 16:37:19 [ayvens.it] INFO: Extracting data for car ID: 1979836
2026-03-25 16:37:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c7505620-491a-5a66-b953-246c3b1e0080 with identifier: 1979836
2026-03-25 16:37:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c7505620-491a-5a66-b953-246c3b1e0080 with scrape type 2
2026-03-25 16:37:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c7505620-491a-5a66-b953-246c3b1e0080 with scrape type 2
2026-03-25 16:37:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: c7505620-491a-5a66-b953-246c3b1e0080, identifier: 1979836
2026-03-25 16:37:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: c7505620-491a-5a66-b953-246c3b1e0080 with identifier: 1979836
2026-03-25 16:37:19 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:37:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: c7505620-491a-5a66-b953-246c3b1e0080 with identifier: 1979836
2026-03-25 16:37:19 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: c7505620-491a-5a66-b953-246c3b1e0080 with identifier: 1979836 to the API
2026-03-25 16:37:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:37:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:37:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'METALLIC COPPER METALLIZZATO',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-26T09:30:00Z',
'fuel_type': 'diesel',
'id': 'c7505620-491a-5a66-b953-246c3b1e0080',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40968',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': 'PEUGEOT 3008 BlueHDI 130 S&S Business Sport utility vehicle 5-door',
'odometer': 100845,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-10-09',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT PEUGEOT 3008 BlueHDI 130 S&S Business Sport utility vehicle '
'5-door -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2018}
2026-03-25 16:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979836%27 HTTP/1.1" 200 None
2026-03-25 16:37:19 [ayvens.it] INFO: Saving data for 1979836: {'auction_closing_time': 1774517400.0, 'created_time': 1774370223.080889, 'last_price_update_time': 1774456639.93723}
2026-03-25 16:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1979836') HTTP/1.1" 204 0
2026-03-25 16:37:19 [ayvens.it] INFO: Found listing with ID: 1979837
2026-03-25 16:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979837%27 HTTP/1.1" 200 None
2026-03-25 16:37:19 [ayvens.it] INFO: Scrape type for 1979837: 2
2026-03-25 16:37:19 [ayvens.it] INFO: Extracting data for car ID: 1979837
2026-03-25 16:37:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5f639fa3-1414-52c5-89bf-983abcc06436 with identifier: 1979837
2026-03-25 16:37:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5f639fa3-1414-52c5-89bf-983abcc06436 with scrape type 2
2026-03-25 16:37:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5f639fa3-1414-52c5-89bf-983abcc06436 with scrape type 2
2026-03-25 16:37:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 5f639fa3-1414-52c5-89bf-983abcc06436, identifier: 1979837
2026-03-25 16:37:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 5f639fa3-1414-52c5-89bf-983abcc06436 with identifier: 1979837
2026-03-25 16:37:20 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:37:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 5f639fa3-1414-52c5-89bf-983abcc06436 with identifier: 1979837
2026-03-25 16:37:20 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 5f639fa3-1414-52c5-89bf-983abcc06436 with identifier: 1979837 to the API
2026-03-25 16:37:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:37:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:37:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'NERO MYTHOS METALLIZZATO',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-26T09:30:00Z',
'fuel_type': 'diesel',
'id': '5f639fa3-1414-52c5-89bf-983abcc06436',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40968',
'listing': 'auction',
'location': None,
'make': 'AUDI',
'model': 'AUDI A3 30 TDI S tronic Business S.Back Hatchback 5-door (Euro 6D)',
'odometer': 85821,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-10-11',
'seats_number': 5,
'seller_name': None,
'title': 'AUDI AUDI A3 30 TDI S tronic Business S.Back Hatchback 5-door (Euro '
'6D) -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2021}
2026-03-25 16:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979837%27 HTTP/1.1" 200 None
2026-03-25 16:37:20 [ayvens.it] INFO: Saving data for 1979837: {'auction_closing_time': 1774517400.0, 'created_time': 1774370223.977108, 'last_price_update_time': 1774456640.340883}
2026-03-25 16:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1979837') HTTP/1.1" 204 0
2026-03-25 16:37:20 [ayvens.it] INFO: Found listing with ID: 1979838
2026-03-25 16:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979838%27 HTTP/1.1" 200 None
2026-03-25 16:37:20 [ayvens.it] INFO: Scrape type for 1979838: 2
2026-03-25 16:37:20 [ayvens.it] INFO: Extracting data for car ID: 1979838
2026-03-25 16:37:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9fc28dec-02e7-553f-ba95-a352fbce1dbe with identifier: 1979838
2026-03-25 16:37:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9fc28dec-02e7-553f-ba95-a352fbce1dbe with scrape type 2
2026-03-25 16:37:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9fc28dec-02e7-553f-ba95-a352fbce1dbe with scrape type 2
2026-03-25 16:37:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 9fc28dec-02e7-553f-ba95-a352fbce1dbe, identifier: 1979838
2026-03-25 16:37:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 9fc28dec-02e7-553f-ba95-a352fbce1dbe with identifier: 1979838
2026-03-25 16:37:20 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:37:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 9fc28dec-02e7-553f-ba95-a352fbce1dbe with identifier: 1979838
2026-03-25 16:37:20 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 9fc28dec-02e7-553f-ba95-a352fbce1dbe with identifier: 1979838 to the API
2026-03-25 16:37:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:37:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:37:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'LUCID RED METALLIZZATO PREMIUM',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.5L',
'expiration_date': '2026-03-26T09:30:00Z',
'fuel_type': 'hybrid',
'id': '9fc28dec-02e7-553f-ba95-a352fbce1dbe',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40968',
'listing': 'auction',
'location': None,
'make': 'FORD',
'model': 'FORD KUGA 2.5 BENZINA FHEV 190CV AWD ST-LINE AUT FP',
'odometer': 106898,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-08-01',
'seats_number': 5,
'seller_name': None,
'title': 'FORD FORD KUGA 2.5 BENZINA FHEV 190CV AWD ST-LINE AUT FP -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-25 16:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979838%27 HTTP/1.1" 200 None
2026-03-25 16:37:20 [ayvens.it] INFO: Saving data for 1979838: {'auction_closing_time': 1774517400.0, 'created_time': 1774370226.013025, 'last_price_update_time': 1774456640.71192}
2026-03-25 16:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1979838') HTTP/1.1" 204 0
2026-03-25 16:37:20 [ayvens.it] INFO: Found listing with ID: 1979839
2026-03-25 16:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979839%27 HTTP/1.1" 200 None
2026-03-25 16:37:20 [ayvens.it] INFO: Scrape type for 1979839: 2
2026-03-25 16:37:20 [ayvens.it] INFO: Extracting data for car ID: 1979839
2026-03-25 16:37:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a073b5ee-ad65-50e5-84e8-61c6c50c5431 with identifier: 1979839
2026-03-25 16:37:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a073b5ee-ad65-50e5-84e8-61c6c50c5431 with scrape type 2
2026-03-25 16:37:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a073b5ee-ad65-50e5-84e8-61c6c50c5431 with scrape type 2
2026-03-25 16:37:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: a073b5ee-ad65-50e5-84e8-61c6c50c5431, identifier: 1979839
2026-03-25 16:37:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: a073b5ee-ad65-50e5-84e8-61c6c50c5431 with identifier: 1979839
2026-03-25 16:37:20 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:37:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: a073b5ee-ad65-50e5-84e8-61c6c50c5431 with identifier: 1979839
2026-03-25 16:37:21 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: a073b5ee-ad65-50e5-84e8-61c6c50c5431 with identifier: 1979839 to the API
2026-03-25 16:37:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:37:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:37:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'JET BLACK MICALIZZATO',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.8L',
'expiration_date': '2026-03-26T09:30:00Z',
'fuel_type': 'diesel',
'id': 'a073b5ee-ad65-50e5-84e8-61c6c50c5431',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40968',
'listing': 'auction',
'location': None,
'make': 'MAZDA',
'model': 'MAZDA CX-3 1.8L Skyactiv-D 115hp 2WD 6MT Executive Sport utility '
'vehicle 5-door (Euro 6.2)',
'odometer': 183683,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-03-29',
'seats_number': 5,
'seller_name': None,
'title': 'MAZDA MAZDA CX-3 1.8L Skyactiv-D 115hp 2WD 6MT Executive Sport '
'utility vehicle 5-door (Euro 6.2) -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2019}
2026-03-25 16:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979839%27 HTTP/1.1" 200 None
2026-03-25 16:37:21 [ayvens.it] INFO: Saving data for 1979839: {'auction_closing_time': 1774517400.0, 'created_time': 1774370227.693474, 'last_price_update_time': 1774456641.427803}
2026-03-25 16:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1979839') HTTP/1.1" 204 0
2026-03-25 16:37:21 [ayvens.it] INFO: Found listing with ID: 1979840
2026-03-25 16:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979840%27 HTTP/1.1" 200 None
2026-03-25 16:37:21 [ayvens.it] INFO: Scrape type for 1979840: 2
2026-03-25 16:37:21 [ayvens.it] INFO: Extracting data for car ID: 1979840
2026-03-25 16:37:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3b6b2f59-6f82-556e-849e-e076e063b327 with identifier: 1979840
2026-03-25 16:37:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3b6b2f59-6f82-556e-849e-e076e063b327 with scrape type 2
2026-03-25 16:37:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3b6b2f59-6f82-556e-849e-e076e063b327 with scrape type 2
2026-03-25 16:37:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 3b6b2f59-6f82-556e-849e-e076e063b327, identifier: 1979840
2026-03-25 16:37:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 3b6b2f59-6f82-556e-849e-e076e063b327 with identifier: 1979840
2026-03-25 16:37:21 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:37:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 3b6b2f59-6f82-556e-849e-e076e063b327 with identifier: 1979840
2026-03-25 16:37:21 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 3b6b2f59-6f82-556e-849e-e076e063b327 with identifier: 1979840 to the API
2026-03-25 16:37:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:37:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:37:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'NERO PASTELLO',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-26T09:30:00Z',
'fuel_type': 'diesel',
'id': '3b6b2f59-6f82-556e-849e-e076e063b327',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40968',
'listing': 'auction',
'location': None,
'make': 'BMW',
'model': 'BMW SERIE 2 ACTIVE TOURER 220d xDrive Business autom. Mini mpv '
'5-door (Euro 6D)',
'odometer': 59150,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-09-16',
'seats_number': 5,
'seller_name': None,
'title': 'BMW BMW SERIE 2 ACTIVE TOURER 220d xDrive Business autom. Mini mpv '
'5-door (Euro 6D) -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2020}
2026-03-25 16:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979840%27 HTTP/1.1" 200 None
2026-03-25 16:37:21 [ayvens.it] INFO: Saving data for 1979840: {'auction_closing_time': 1774517400.0, 'created_time': 1774370229.577189, 'last_price_update_time': 1774456641.792021}
2026-03-25 16:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1979840') HTTP/1.1" 204 0
2026-03-25 16:37:21 [ayvens.it] INFO: Found listing with ID: 1979841
2026-03-25 16:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979841%27 HTTP/1.1" 200 None
2026-03-25 16:37:21 [ayvens.it] INFO: Scrape type for 1979841: 2
2026-03-25 16:37:21 [ayvens.it] INFO: Extracting data for car ID: 1979841
2026-03-25 16:37:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1f52974e-a363-5348-a3e8-2c54427851f1 with identifier: 1979841
2026-03-25 16:37:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1f52974e-a363-5348-a3e8-2c54427851f1 with scrape type 2
2026-03-25 16:37:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1f52974e-a363-5348-a3e8-2c54427851f1 with scrape type 2
2026-03-25 16:37:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 1f52974e-a363-5348-a3e8-2c54427851f1, identifier: 1979841
2026-03-25 16:37:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 1f52974e-a363-5348-a3e8-2c54427851f1 with identifier: 1979841
2026-03-25 16:37:21 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:37:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 1f52974e-a363-5348-a3e8-2c54427851f1 with identifier: 1979841
2026-03-25 16:37:21 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 1f52974e-a363-5348-a3e8-2c54427851f1 with identifier: 1979841 to the API
2026-03-25 16:37:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:37:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:37:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'BLU RACE METALLIZZATO',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-26T09:30:00Z',
'fuel_type': 'diesel',
'id': '1f52974e-a363-5348-a3e8-2c54427851f1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40968',
'listing': 'auction',
'location': None,
'make': 'SKODA',
'model': 'SKODA OCTAVIA SW 2.0 TDI EVO 110KW EXECUTIVE DSG FP',
'odometer': 158520,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-08-29',
'seats_number': 5,
'seller_name': None,
'title': 'SKODA SKODA OCTAVIA SW 2.0 TDI EVO 110KW EXECUTIVE DSG FP -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-25 16:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979841%27 HTTP/1.1" 200 None
2026-03-25 16:37:22 [ayvens.it] INFO: Saving data for 1979841: {'auction_closing_time': 1774517400.0, 'created_time': 1774370230.7477, 'last_price_update_time': 1774456642.220225}
2026-03-25 16:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1979841') HTTP/1.1" 204 0
2026-03-25 16:37:22 [ayvens.it] INFO: Found listing with ID: 1979842
2026-03-25 16:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979842%27 HTTP/1.1" 200 None
2026-03-25 16:37:22 [ayvens.it] INFO: Scrape type for 1979842: 2
2026-03-25 16:37:22 [ayvens.it] INFO: Extracting data for car ID: 1979842
2026-03-25 16:37:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f9df3354-477b-5b37-b917-b593ebf7b156 with identifier: 1979842
2026-03-25 16:37:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f9df3354-477b-5b37-b917-b593ebf7b156 with scrape type 2
2026-03-25 16:37:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f9df3354-477b-5b37-b917-b593ebf7b156 with scrape type 2
2026-03-25 16:37:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: f9df3354-477b-5b37-b917-b593ebf7b156, identifier: 1979842
2026-03-25 16:37:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: f9df3354-477b-5b37-b917-b593ebf7b156 with identifier: 1979842
2026-03-25 16:37:22 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:37:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: f9df3354-477b-5b37-b917-b593ebf7b156 with identifier: 1979842
2026-03-25 16:37:22 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: f9df3354-477b-5b37-b917-b593ebf7b156 with identifier: 1979842 to the API
2026-03-25 16:37:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:37:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:37:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'BIANCO GHIACCIO OPACO SPECIALE',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-26T09:30:00Z',
'fuel_type': 'diesel',
'id': 'f9df3354-477b-5b37-b917-b593ebf7b156',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40968',
'listing': 'auction',
'location': None,
'make': 'RENAULT',
'model': 'RENAULT CLIO 1.5 dCi 75cv Life Hatchback 5-door (Euro 6.2)',
'odometer': 109974,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-07-04',
'seats_number': 5,
'seller_name': None,
'title': 'RENAULT RENAULT CLIO 1.5 dCi 75cv Life Hatchback 5-door (Euro 6.2) '
'-',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2019}
2026-03-25 16:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979842%27 HTTP/1.1" 200 None
2026-03-25 16:37:22 [ayvens.it] INFO: Saving data for 1979842: {'auction_closing_time': 1774517400.0, 'created_time': 1774370237.891033, 'last_price_update_time': 1774456642.6692}
2026-03-25 16:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1979842') HTTP/1.1" 204 0
2026-03-25 16:37:22 [ayvens.it] INFO: Found listing with ID: 1979843
2026-03-25 16:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979843%27 HTTP/1.1" 200 None
2026-03-25 16:37:22 [ayvens.it] INFO: Scrape type for 1979843: 2
2026-03-25 16:37:22 [ayvens.it] INFO: Extracting data for car ID: 1979843
2026-03-25 16:37:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4856d4e4-7333-5ccc-a22d-46c34820dc77 with identifier: 1979843
2026-03-25 16:37:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4856d4e4-7333-5ccc-a22d-46c34820dc77 with scrape type 2
2026-03-25 16:37:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4856d4e4-7333-5ccc-a22d-46c34820dc77 with scrape type 2
2026-03-25 16:37:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 4856d4e4-7333-5ccc-a22d-46c34820dc77, identifier: 1979843
2026-03-25 16:37:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 4856d4e4-7333-5ccc-a22d-46c34820dc77 with identifier: 1979843
2026-03-25 16:37:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 4856d4e4-7333-5ccc-a22d-46c34820dc77 with identifier: 1979843
2026-03-25 16:37:22 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 4856d4e4-7333-5ccc-a22d-46c34820dc77 with identifier: 1979843 to the API
2026-03-25 16:37:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:37:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:37:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'PURE WHITE PASTELLO',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-26T09:30:00Z',
'fuel_type': 'diesel',
'id': '4856d4e4-7333-5ccc-a22d-46c34820dc77',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40968',
'listing': 'auction',
'location': None,
'make': 'VOLKSWAGEN',
'model': 'VOLKSWAGEN TOURAN 2.0 TDI SCR EXECUTIVE DSG FP',
'odometer': 120366,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-10-06',
'seats_number': 5,
'seller_name': None,
'title': 'VOLKSWAGEN VOLKSWAGEN TOURAN 2.0 TDI SCR EXECUTIVE DSG FP -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2020}
2026-03-25 16:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979843%27 HTTP/1.1" 200 None
2026-03-25 16:37:23 [ayvens.it] INFO: Saving data for 1979843: {'auction_closing_time': 1774517400.0, 'created_time': 1774370239.127304, 'last_price_update_time': 1774456643.055343}
2026-03-25 16:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1979843') HTTP/1.1" 204 0
2026-03-25 16:37:23 [ayvens.it] INFO: Found listing with ID: 1979844
2026-03-25 16:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979844%27 HTTP/1.1" 200 None
2026-03-25 16:37:23 [ayvens.it] INFO: Scrape type for 1979844: 2
2026-03-25 16:37:23 [ayvens.it] INFO: Extracting data for car ID: 1979844
2026-03-25 16:37:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1c5bf222-d796-531d-a631-7e03553e16e9 with identifier: 1979844
2026-03-25 16:37:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1c5bf222-d796-531d-a631-7e03553e16e9 with scrape type 2
2026-03-25 16:37:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1c5bf222-d796-531d-a631-7e03553e16e9 with scrape type 2
2026-03-25 16:37:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 1c5bf222-d796-531d-a631-7e03553e16e9, identifier: 1979844
2026-03-25 16:37:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 1c5bf222-d796-531d-a631-7e03553e16e9 with identifier: 1979844
2026-03-25 16:37:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 1c5bf222-d796-531d-a631-7e03553e16e9 with identifier: 1979844
2026-03-25 16:37:23 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 1c5bf222-d796-531d-a631-7e03553e16e9 with identifier: 1979844 to the API
2026-03-25 16:37:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:37:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:37:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Dark Metal Grey metallic',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-26T09:30:00Z',
'fuel_type': 'diesel',
'id': '1c5bf222-d796-531d-a631-7e03553e16e9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40968',
'listing': 'auction',
'location': None,
'make': 'NISSAN',
'model': 'NISSAN QASHQAI 1.6 dCi 130 2WD Business Cross over 5-door (Euro 6)',
'odometer': 192929,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-06-18',
'seats_number': 5,
'seller_name': None,
'title': 'NISSAN NISSAN QASHQAI 1.6 dCi 130 2WD Business Cross over 5-door '
'(Euro 6) -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2018}
2026-03-25 16:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979844%27 HTTP/1.1" 200 None
2026-03-25 16:37:23 [ayvens.it] INFO: Saving data for 1979844: {'auction_closing_time': 1774517400.0, 'created_time': 1774370240.535627, 'last_price_update_time': 1774456643.410983}
2026-03-25 16:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1979844') HTTP/1.1" 204 0
2026-03-25 16:37:23 [ayvens.it] INFO: Found listing with ID: 1979845
2026-03-25 16:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979845%27 HTTP/1.1" 200 None
2026-03-25 16:37:23 [ayvens.it] INFO: Scrape type for 1979845: 2
2026-03-25 16:37:23 [ayvens.it] INFO: Extracting data for car ID: 1979845
2026-03-25 16:37:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 82a6b710-0a11-5122-8b5c-e9e75cb3a60e with identifier: 1979845
2026-03-25 16:37:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 82a6b710-0a11-5122-8b5c-e9e75cb3a60e with scrape type 2
2026-03-25 16:37:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 82a6b710-0a11-5122-8b5c-e9e75cb3a60e with scrape type 2
2026-03-25 16:37:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 82a6b710-0a11-5122-8b5c-e9e75cb3a60e, identifier: 1979845
2026-03-25 16:37:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 82a6b710-0a11-5122-8b5c-e9e75cb3a60e with identifier: 1979845
2026-03-25 16:37:23 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 16:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 16:37:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 82a6b710-0a11-5122-8b5c-e9e75cb3a60e with identifier: 1979845
2026-03-25 16:37:23 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 82a6b710-0a11-5122-8b5c-e9e75cb3a60e with identifier: 1979845 to the API
2026-03-25 16:37:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 16:37:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 16:37:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Bianco solido',
'currency': 'EUR',
'doors_number': 5,
'engine': '',
'expiration_date': '2026-03-26T09:30:00Z',
'fuel_type': 'electric',
'id': '82a6b710-0a11-5122-8b5c-e9e75cb3a60e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40968',
'listing': 'auction',
'location': None,
'make': 'NISSAN',
'model': 'NISSAN LEAF Business 40KWh Hatchback 5-door',
'odometer': 121095,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-09-17',
'seats_number': 5,
'seller_name': None,
'title': 'NISSAN NISSAN LEAF Business 40KWh Hatchback 5-door -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2019}
2026-03-25 16:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979845%27 HTTP/1.1" 200 None
2026-03-25 16:37:23 [ayvens.it] INFO: Saving data for 1979845: {'auction_closing_time': 1774517400.0, 'created_time': 1774370241.972564, 'last_price_update_time': 1774456643.788228}
2026-03-25 16:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1979845') HTTP/1.1" 204 0
2026-03-25 16:37:23 [ayvens.it] INFO: Found listing with ID: 1979846
2026-03-25 16:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979846%27 HTTP/1.1" 200 None
2026-03-25 16:37:23 [ayvens.it] INFO: Scrape type for 1979846: 0
2026-03-25 16:37:23 [ayvens.it] INFO: Found listing with ID: 1979847
2026-03-25 16:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979847%27 HTTP/1.1" 200 None
2026-03-25 16:37:23 [ayvens.it] INFO: Scrape type for 1979847: 0
2026-03-25 16:37:23 [ayvens.it] INFO: Found listing with ID: 1979848
2026-03-25 16:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979848%27 HTTP/1.1" 200 None
2026-03-25 16:37:23 [ayvens.it] INFO: Scrape type for 1979848: 0
2026-03-25 16:37:23 [ayvens.it] INFO: Found listing with ID: 1979849
2026-03-25 16:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979849%27 HTTP/1.1" 200 None
2026-03-25 16:37:23 [ayvens.it] INFO: Scrape type for 1979849: 0
2026-03-25 16:37:23 [ayvens.it] INFO: Found listing with ID: 1979850
2026-03-25 16:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979850%27 HTTP/1.1" 200 None
2026-03-25 16:37:23 [ayvens.it] INFO: Scrape type for 1979850: 0
2026-03-25 16:37:23 [ayvens.it] INFO: Found listing with ID: 1979851
2026-03-25 16:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979851%27 HTTP/1.1" 200 None
2026-03-25 16:37:23 [ayvens.it] INFO: Scrape type for 1979851: 0
2026-03-25 16:37:23 [ayvens.it] INFO: Found listing with ID: 1979852
2026-03-25 16:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979852%27 HTTP/1.1" 200 None
2026-03-25 16:37:23 [ayvens.it] INFO: Scrape type for 1979852: 0
2026-03-25 16:37:23 [ayvens.it] INFO: Found listing with ID: 1979853
2026-03-25 16:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979853%27 HTTP/1.1" 200 None
2026-03-25 16:37:23 [ayvens.it] INFO: Scrape type for 1979853: 0
2026-03-25 16:37:23 [ayvens.it] INFO: Found listing with ID: 1979854
2026-03-25 16:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979854%27 HTTP/1.1" 200 None
2026-03-25 16:37:23 [ayvens.it] INFO: Scrape type for 1979854: 0
2026-03-25 16:37:23 [ayvens.it] INFO: Found listing with ID: 1979855
2026-03-25 16:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979855%27 HTTP/1.1" 200 None
2026-03-25 16:37:23 [ayvens.it] INFO: Scrape type for 1979855: 0
2026-03-25 16:37:23 [ayvens.it] INFO: Found listing with ID: 1979856
2026-03-25 16:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979856%27 HTTP/1.1" 200 None
2026-03-25 16:37:23 [ayvens.it] INFO: Scrape type for 1979856: 0
2026-03-25 16:37:23 [ayvens.it] INFO: Found listing with ID: 1979857
2026-03-25 16:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979857%27 HTTP/1.1" 200 None
2026-03-25 16:37:23 [ayvens.it] INFO: Scrape type for 1979857: 0
2026-03-25 16:37:23 [ayvens.it] INFO: Found listing with ID: 1979858
2026-03-25 16:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979858%27 HTTP/1.1" 200 None
2026-03-25 16:37:24 [ayvens.it] INFO: Scrape type for 1979858: 0
2026-03-25 16:37:24 [ayvens.it] INFO: Found listing with ID: 1979859
2026-03-25 16:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979859%27 HTTP/1.1" 200 None
2026-03-25 16:37:24 [ayvens.it] INFO: Scrape type for 1979859: 0
2026-03-25 16:37:24 [ayvens.it] INFO: Found listing with ID: 1979860
2026-03-25 16:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979860%27 HTTP/1.1" 200 None
2026-03-25 16:37:24 [ayvens.it] INFO: Scrape type for 1979860: 0
2026-03-25 16:37:24 [ayvens.it] INFO: Found listing with ID: 1979861
2026-03-25 16:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979861%27 HTTP/1.1" 200 None
2026-03-25 16:37:24 [ayvens.it] INFO: Scrape type for 1979861: 0
2026-03-25 16:37:24 [ayvens.it] INFO: Found listing with ID: 1979862
2026-03-25 16:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979862%27 HTTP/1.1" 200 None
2026-03-25 16:37:24 [ayvens.it] INFO: Scrape type for 1979862: 0
2026-03-25 16:37:24 [ayvens.it] INFO: Found listing with ID: 1979863
2026-03-25 16:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979863%27 HTTP/1.1" 200 None
2026-03-25 16:37:24 [ayvens.it] INFO: Scrape type for 1979863: 0
2026-03-25 16:37:24 [ayvens.it] INFO: Fetching listings with token: 3b2cc62fd26c4e29a762db3de181266b and skip: 400
2026-03-25 16:37:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-25 16:37:26 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.aldcarmarket.com/graphql/saleevents> (referer: https://carmarket.ayvens.com/) ['zyte-api']
2026-03-25 16:37:26 [ayvens.it] INFO: Found listing with ID: 1979864
2026-03-25 16:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979864%27 HTTP/1.1" 200 None
2026-03-25 16:37:26 [ayvens.it] INFO: Scrape type for 1979864: 0
2026-03-25 16:37:26 [ayvens.it] INFO: Found listing with ID: 1979865
2026-03-25 16:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979865%27 HTTP/1.1" 200 None
2026-03-25 16:37:26 [ayvens.it] INFO: Scrape type for 1979865: 0
2026-03-25 16:37:26 [ayvens.it] INFO: Found listing with ID: 1979866
2026-03-25 16:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979866%27 HTTP/1.1" 200 None
2026-03-25 16:37:26 [ayvens.it] INFO: Scrape type for 1979866: 0
2026-03-25 16:37:26 [ayvens.it] INFO: Found listing with ID: 1979867
2026-03-25 16:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979867%27 HTTP/1.1" 200 None
2026-03-25 16:37:26 [ayvens.it] INFO: Scrape type for 1979867: 0
2026-03-25 16:37:26 [ayvens.it] INFO: Found listing with ID: 1979868
2026-03-25 16:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979868%27 HTTP/1.1" 200 None
2026-03-25 16:37:26 [ayvens.it] INFO: Scrape type for 1979868: 0
2026-03-25 16:37:26 [ayvens.it] INFO: Found listing with ID: 1979869
2026-03-25 16:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979869%27 HTTP/1.1" 200 None
2026-03-25 16:37:26 [ayvens.it] INFO: Scrape type for 1979869: 0
2026-03-25 16:37:26 [ayvens.it] INFO: Found listing with ID: 1979870
2026-03-25 16:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979870%27 HTTP/1.1" 200 None
2026-03-25 16:37:26 [ayvens.it] INFO: Scrape type for 1979870: 0
2026-03-25 16:37:26 [ayvens.it] INFO: Found listing with ID: 1979871
2026-03-25 16:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979871%27 HTTP/1.1" 200 None
2026-03-25 16:37:26 [ayvens.it] INFO: Scrape type for 1979871: 0
2026-03-25 16:37:26 [ayvens.it] INFO: Found listing with ID: 1979872
2026-03-25 16:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979872%27 HTTP/1.1" 200 None
2026-03-25 16:37:26 [ayvens.it] INFO: Scrape type for 1979872: 0
2026-03-25 16:37:26 [ayvens.it] INFO: Found listing with ID: 1979873
2026-03-25 16:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979873%27 HTTP/1.1" 200 None
2026-03-25 16:37:26 [ayvens.it] INFO: Scrape type for 1979873: 0
2026-03-25 16:37:26 [ayvens.it] INFO: Found listing with ID: 1979874
2026-03-25 16:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979874%27 HTTP/1.1" 200 None
2026-03-25 16:37:26 [ayvens.it] INFO: Scrape type for 1979874: 0
2026-03-25 16:37:26 [ayvens.it] INFO: Found listing with ID: 1979875
2026-03-25 16:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979875%27 HTTP/1.1" 200 None
2026-03-25 16:37:26 [ayvens.it] INFO: Scrape type for 1979875: 0
2026-03-25 16:37:26 [ayvens.it] INFO: Found listing with ID: 1979876
2026-03-25 16:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979876%27 HTTP/1.1" 200 None
2026-03-25 16:37:26 [ayvens.it] INFO: Scrape type for 1979876: 0
2026-03-25 16:37:26 [ayvens.it] INFO: Found listing with ID: 1979877
2026-03-25 16:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979877%27 HTTP/1.1" 200 None
2026-03-25 16:37:26 [ayvens.it] INFO: Scrape type for 1979877: 0
2026-03-25 16:37:26 [ayvens.it] INFO: Found listing with ID: 1979878
2026-03-25 16:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979878%27 HTTP/1.1" 200 None
2026-03-25 16:37:26 [ayvens.it] INFO: Scrape type for 1979878: 0
2026-03-25 16:37:26 [ayvens.it] INFO: Found listing with ID: 1979879
2026-03-25 16:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979879%27 HTTP/1.1" 200 None
2026-03-25 16:37:26 [ayvens.it] INFO: Scrape type for 1979879: 0
2026-03-25 16:37:26 [ayvens.it] INFO: Found listing with ID: 1979880
2026-03-25 16:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979880%27 HTTP/1.1" 200 None
2026-03-25 16:37:26 [ayvens.it] INFO: Scrape type for 1979880: 0
2026-03-25 16:37:26 [ayvens.it] INFO: Found listing with ID: 1979881
2026-03-25 16:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979881%27 HTTP/1.1" 200 None
2026-03-25 16:37:26 [ayvens.it] INFO: Scrape type for 1979881: 0
2026-03-25 16:37:26 [ayvens.it] INFO: Found listing with ID: 1979882
2026-03-25 16:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979882%27 HTTP/1.1" 200 None
2026-03-25 16:37:26 [ayvens.it] INFO: Scrape type for 1979882: 0
2026-03-25 16:37:26 [ayvens.it] INFO: Found listing with ID: 1979883
2026-03-25 16:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979883%27 HTTP/1.1" 200 None
2026-03-25 16:37:26 [ayvens.it] INFO: Scrape type for 1979883: 0
2026-03-25 16:37:26 [ayvens.it] INFO: Found listing with ID: 1979884
2026-03-25 16:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979884%27 HTTP/1.1" 200 None
2026-03-25 16:37:26 [ayvens.it] INFO: Scrape type for 1979884: 0
2026-03-25 16:37:26 [ayvens.it] INFO: Found listing with ID: 1979885
2026-03-25 16:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979885%27 HTTP/1.1" 200 None
2026-03-25 16:37:26 [ayvens.it] INFO: Scrape type for 1979885: 0
2026-03-25 16:37:26 [ayvens.it] INFO: Found listing with ID: 1979886
2026-03-25 16:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979886%27 HTTP/1.1" 200 None
2026-03-25 16:37:26 [ayvens.it] INFO: Scrape type for 1979886: 0
2026-03-25 16:37:26 [ayvens.it] INFO: Found listing with ID: 1979887
2026-03-25 16:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979887%27 HTTP/1.1" 200 None
2026-03-25 16:37:26 [ayvens.it] INFO: Scrape type for 1979887: 0
2026-03-25 16:37:26 [ayvens.it] INFO: Found listing with ID: 1979888
2026-03-25 16:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979888%27 HTTP/1.1" 200 None
2026-03-25 16:37:26 [ayvens.it] INFO: Scrape type for 1979888: 0
2026-03-25 16:37:26 [ayvens.it] INFO: Found listing with ID: 1979889
2026-03-25 16:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979889%27 HTTP/1.1" 200 None
2026-03-25 16:37:26 [ayvens.it] INFO: Scrape type for 1979889: 0
2026-03-25 16:37:26 [ayvens.it] INFO: Found listing with ID: 1979890
2026-03-25 16:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979890%27 HTTP/1.1" 200 None
2026-03-25 16:37:26 [ayvens.it] INFO: Scrape type for 1979890: 0
2026-03-25 16:37:26 [ayvens.it] INFO: Found listing with ID: 1979891
2026-03-25 16:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979891%27 HTTP/1.1" 200 None
2026-03-25 16:37:26 [ayvens.it] INFO: Scrape type for 1979891: 0
2026-03-25 16:37:26 [ayvens.it] INFO: Found listing with ID: 1979892
2026-03-25 16:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979892%27 HTTP/1.1" 200 None
2026-03-25 16:37:26 [ayvens.it] INFO: Scrape type for 1979892: 0
2026-03-25 16:37:26 [ayvens.it] INFO: Found listing with ID: 1979893
2026-03-25 16:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979893%27 HTTP/1.1" 200 None
2026-03-25 16:37:26 [ayvens.it] INFO: Scrape type for 1979893: 0
2026-03-25 16:37:26 [ayvens.it] INFO: Found listing with ID: 1979894
2026-03-25 16:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979894%27 HTTP/1.1" 200 None
2026-03-25 16:37:26 [ayvens.it] INFO: Scrape type for 1979894: 0
2026-03-25 16:37:26 [ayvens.it] INFO: Found listing with ID: 1979895
2026-03-25 16:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979895%27 HTTP/1.1" 200 None
2026-03-25 16:37:26 [ayvens.it] INFO: Scrape type for 1979895: 0
2026-03-25 16:37:26 [ayvens.it] INFO: Found listing with ID: 1979896
2026-03-25 16:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979896%27 HTTP/1.1" 200 None
2026-03-25 16:37:26 [ayvens.it] INFO: Scrape type for 1979896: 0
2026-03-25 16:37:26 [ayvens.it] INFO: Found listing with ID: 1979897
2026-03-25 16:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979897%27 HTTP/1.1" 200 None
2026-03-25 16:37:26 [ayvens.it] INFO: Scrape type for 1979897: 0
2026-03-25 16:37:26 [ayvens.it] INFO: Found listing with ID: 1979898
2026-03-25 16:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979898%27 HTTP/1.1" 200 None
2026-03-25 16:37:26 [ayvens.it] INFO: Scrape type for 1979898: 0
2026-03-25 16:37:26 [ayvens.it] INFO: Found listing with ID: 1979899
2026-03-25 16:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979899%27 HTTP/1.1" 200 None
2026-03-25 16:37:26 [ayvens.it] INFO: Scrape type for 1979899: 0
2026-03-25 16:37:26 [ayvens.it] INFO: Found listing with ID: 1979900
2026-03-25 16:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979900%27 HTTP/1.1" 200 None
2026-03-25 16:37:27 [ayvens.it] INFO: Scrape type for 1979900: 0
2026-03-25 16:37:27 [ayvens.it] INFO: Found listing with ID: 1979901
2026-03-25 16:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979901%27 HTTP/1.1" 200 None
2026-03-25 16:37:27 [ayvens.it] INFO: Scrape type for 1979901: 0
2026-03-25 16:37:27 [ayvens.it] INFO: Found listing with ID: 1979902
2026-03-25 16:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979902%27 HTTP/1.1" 200 None
2026-03-25 16:37:27 [ayvens.it] INFO: Scrape type for 1979902: 0
2026-03-25 16:37:27 [ayvens.it] INFO: Found listing with ID: 1979903
2026-03-25 16:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979903%27 HTTP/1.1" 200 None
2026-03-25 16:37:27 [ayvens.it] INFO: Scrape type for 1979903: 0
2026-03-25 16:37:27 [ayvens.it] INFO: Found listing with ID: 1979904
2026-03-25 16:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979904%27 HTTP/1.1" 200 None
2026-03-25 16:37:27 [ayvens.it] INFO: Scrape type for 1979904: 0
2026-03-25 16:37:27 [ayvens.it] INFO: Found listing with ID: 1979905
2026-03-25 16:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979905%27 HTTP/1.1" 200 None
2026-03-25 16:37:27 [ayvens.it] INFO: Scrape type for 1979905: 0
2026-03-25 16:37:27 [ayvens.it] INFO: Found listing with ID: 1979906
2026-03-25 16:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979906%27 HTTP/1.1" 200 None
2026-03-25 16:37:27 [ayvens.it] INFO: Scrape type for 1979906: 0
2026-03-25 16:37:27 [ayvens.it] INFO: Found listing with ID: 1979907
2026-03-25 16:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979907%27 HTTP/1.1" 200 None
2026-03-25 16:37:27 [ayvens.it] INFO: Scrape type for 1979907: 0
2026-03-25 16:37:27 [ayvens.it] INFO: Found listing with ID: 1979908
2026-03-25 16:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979908%27 HTTP/1.1" 200 None
2026-03-25 16:37:27 [ayvens.it] INFO: Scrape type for 1979908: 0
2026-03-25 16:37:27 [ayvens.it] INFO: Found listing with ID: 1979909
2026-03-25 16:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979909%27 HTTP/1.1" 200 None
2026-03-25 16:37:27 [ayvens.it] INFO: Scrape type for 1979909: 0
2026-03-25 16:37:27 [ayvens.it] INFO: Found listing with ID: 1979910
2026-03-25 16:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979910%27 HTTP/1.1" 200 None
2026-03-25 16:37:27 [ayvens.it] INFO: Scrape type for 1979910: 0
2026-03-25 16:37:27 [ayvens.it] INFO: Found listing with ID: 1979911
2026-03-25 16:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271979911%27 HTTP/1.1" 200 None
2026-03-25 16:37:27 [ayvens.it] INFO: Scrape type for 1979911: 0
2026-03-25 16:37:27 [ayvens.it] INFO: Fetching listings with token: 3b2cc62fd26c4e29a762db3de181266b and skip: 500
2026-03-25 16:37:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-25 16:37:28 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.aldcarmarket.com/graphql/saleevents> (referer: https://carmarket.ayvens.com/) ['zyte-api']
2026-03-25 16:37:28 [scrapy.core.engine] INFO: Closing spider (finished)
2026-03-25 16:37:28 [ayvens.it] INFO: ayvens.it Crawl ended with reason finished, scrape types: {<ScrapeType.NEW: 1>: 0, <ScrapeType.NEW_DUPLICATE_ID: 4>: 0, <ScrapeType.PRICE_UPDATE: 2>: 7, <ScrapeType.AUCTION_UPDATE: 3>: 0, <ScrapeType.SKIPPED: 0>: 66, <ScrapeType.BATCH_SKIPPED: 5>: 0}
2026-03-25 16:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20last_price_update_time%20lt%201774024648 HTTP/1.1" 200 None
2026-03-25 16:37:29 [scrapy.extensions.feedexport] INFO: Stored jsonlines feed (380 items) in: file:///var/lib/scrapyd/items/sourcing_v2/ayvens.it/task_39_2026-03-25T16_30_00.jl
2026-03-25 16:37:29 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/request_bytes': 832400,
'downloader/request_count': 1787,
'downloader/request_method_count/GET': 1781,
'downloader/request_method_count/POST': 6,
'downloader/response_bytes': 1074022570,
'downloader/response_count': 1787,
'downloader/response_status_count/200': 1777,
'downloader/response_status_count/404': 10,
'elapsed_time_seconds': 443.899433,
'feedexport/success_count/FileFeedStorage': 1,
'finish_reason': 'finished',
'finish_time': datetime.datetime(2026, 3, 25, 16, 37, 29, 27706, tzinfo=datetime.timezone.utc),
'item_scraped_count': 380,
'log_count/DEBUG': 16748,
'log_count/INFO': 17412,
'memusage/max': 194228224,
'memusage/startup': 147832832,
'photo_download_count': 1770,
'playwright/context_count': 1,
'playwright/context_count/max_concurrent': 1,
'playwright/context_count/persistent/False': 1,
'playwright/context_count/remote/False': 1,
'playwright/page_count': 1,
'playwright/page_count/max_concurrent': 1,
'playwright/request_count': 144,
'playwright/request_count/aborted': 15,
'playwright/request_count/method/GET': 140,
'playwright/request_count/method/POST': 4,
'playwright/request_count/navigation': 2,
'playwright/request_count/resource_type/document': 2,
'playwright/request_count/resource_type/fetch': 6,
'playwright/request_count/resource_type/font': 16,
'playwright/request_count/resource_type/image': 31,
'playwright/request_count/resource_type/script': 83,
'playwright/request_count/resource_type/stylesheet': 1,
'playwright/request_count/resource_type/xhr': 5,
'playwright/response_count': 126,
'playwright/response_count/method/GET': 123,
'playwright/response_count/method/POST': 3,
'playwright/response_count/resource_type/document': 2,
'playwright/response_count/resource_type/fetch': 6,
'playwright/response_count/resource_type/font': 16,
'playwright/response_count/resource_type/image': 16,
'playwright/response_count/resource_type/script': 81,
'playwright/response_count/resource_type/stylesheet': 1,
'playwright/response_count/resource_type/xhr': 4,
'request_depth_max': 6,
'response_received_count': 17,
'scheduler/dequeued': 1787,
'scheduler/dequeued/memory': 1787,
'scheduler/enqueued': 1787,
'scheduler/enqueued/memory': 1787,
'scrape_type/new': 178,
'scrape_type/price_update': 202,
'scrape_type/skipped': 68,
'scrapy-zyte-api/429': 0,
'scrapy-zyte-api/attempts': 6,
'scrapy-zyte-api/error_ratio': 0.0,
'scrapy-zyte-api/errors': 0,
'scrapy-zyte-api/fatal_errors': 0,
'scrapy-zyte-api/mean_connection_seconds': 3.953117990323032,
'scrapy-zyte-api/mean_response_seconds': 4.002124838996679,
'scrapy-zyte-api/processed': 6,
'scrapy-zyte-api/request_args/customHttpRequestHeaders': 6,
'scrapy-zyte-api/request_args/experimental.responseCookies': 6,
'scrapy-zyte-api/request_args/httpRequestBody': 6,
'scrapy-zyte-api/request_args/httpRequestMethod': 6,
'scrapy-zyte-api/request_args/httpResponseBody': 6,
'scrapy-zyte-api/request_args/httpResponseHeaders': 6,
'scrapy-zyte-api/request_args/url': 6,
'scrapy-zyte-api/status_codes/200': 6,
'scrapy-zyte-api/success': 6,
'scrapy-zyte-api/success_ratio': 1.0,
'scrapy-zyte-api/throttle_ratio': 0.0,
'start_time': datetime.datetime(2026, 3, 25, 16, 30, 5, 128273, tzinfo=datetime.timezone.utc)}
2026-03-25 16:37:29 [scrapy.core.engine] INFO: Spider closed (finished)