2026-03-28 19:00:06 [scrapy.utils.log] INFO: Scrapy 2.11.2 started (bot: SourcingV2)
2026-03-28 19:00:06 [scrapy.utils.log] INFO: Versions: lxml 5.2.2.0, libxml2 2.12.6, cssselect 1.2.0, parsel 1.9.1, w3lib 2.1.2, Twisted 24.3.0, Python 3.11.2 (main, Mar 13 2023, 12:18:29) [GCC 12.2.0], pyOpenSSL 24.1.0 (OpenSSL 3.2.1 30 Jan 2024), cryptography 42.0.7, Platform Linux-5.15.0-1098-azure-x86_64-with-glibc2.36
2026-03-28 19:00:06 [auto1.nl] INFO: Batch mode enabled: batch 1/2
2026-03-28 19:00:06 [auto1.nl] INFO: Starting spider auto1.nl
2026-03-28 19:00:06 [scrapy.addons] INFO: Enabled addons:
[]
2026-03-28 19:00:06 [asyncio] DEBUG: Using selector: EpollSelector
2026-03-28 19:00:06 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2026-03-28 19:00:06 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2026-03-28 19:00:06 [scrapy.extensions.telnet] INFO: Telnet Password: 4a6fab30f0af84e4
2026-03-28 19:00:06 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
 'scrapy.extensions.telnet.TelnetConsole',
 'scrapy.extensions.memusage.MemoryUsage',
 'scrapy.extensions.feedexport.FeedExporter',
 'scrapy.extensions.logstats.LogStats',
 'scrapy.extensions.closespider.CloseSpider']
2026-03-28 19:00:06 [scrapy.crawler] INFO: Overridden settings:
{'BOT_NAME': 'SourcingV2',
 'CLOSESPIDER_TIMEOUT': 7200,
 'DOWNLOAD_MAXSIZE': 52428800,
 'DOWNLOAD_WARNSIZE': 10485760,
 'FEED_EXPORT_ENCODING': 'utf-8',
 'LOG_FILE': '/var/log/scrapyd/logs/sourcing_v2/auto1.nl/task_27_2026-03-28T19_00_00.log',
 'LOG_FORMATTER': 'crawlers.log_formatter.SourcingLogFormatter',
 'MEMUSAGE_LIMIT_MB': 2048,
 'MEMUSAGE_WARNING_MB': 1536,
 'NEWSPIDER_MODULE': 'spiders',
 'REQUEST_FINGERPRINTER_CLASS': 'scrapy_zyte_api.ScrapyZyteAPIRequestFingerprinter',
 'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7',
 'SPIDER_MODULES': ['spiders', 'auth_check'],
 'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor',
 'USER_AGENT': ''}
2026-03-28 19:00:06 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-28 19:00:06 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-28 19:00:06 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
 'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
 'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
 'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
 'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPIDownloaderMiddleware',
 'scrapy.downloadermiddlewares.retry.RetryMiddleware',
 'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
 'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
 'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
 'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
 'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
 'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-03-28 19:00:06 [crawlers.middlewares.id_gen_middleware] INFO: Setting up IdGenerationMiddleware
2026-03-28 19:00:06 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPISpiderMiddleware',
 'crawlers.middlewares.monitoring_spider_middleware.MonitoringSpiderMiddleware',
 'scrapy.spidermiddlewares.referer.RefererMiddleware',
 'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
 'scrapy.spidermiddlewares.depth.DepthMiddleware',
 'crawlers.middlewares.photo_download_middleware.PhotoDownloadMiddleware',
 'crawlers.middlewares.report_download_middleware.ReportDownloadMiddleware',
 'crawlers.middlewares.id_gen_middleware.IdGenMiddleware']
2026-03-28 19:00:06 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_CLIENT_ID, AZURE_TENANT_ID
2026-03-28 19:00:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-28 19:00:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2115
2026-03-28 19:00:06 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2026-03-28 19:00:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxsourcingstorageprod.table.core.windows.net:443
2026-03-28 19:00:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:06 [crawlers.pipelines.translation_pipeline] INFO: Loading translations for language: auto
2026-03-28 19:00:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /Translations()?$filter=PartitionKey%20eq%20%27auto%27%20and%20RowKey%20eq%20%27auto%27 HTTP/1.1" 200 None
2026-03-28 19:00:06 [crawlers.pipelines.item_rules_pipeline] INFO: Setting up ItemRules Pipeline
2026-03-28 19:00:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_location_for_country.json
2026-03-28 19:00:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_cars_from_auction_title.json
2026-03-28 19:00:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_country.json
2026-03-28 19:00:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_fr.json
2026-03-28 19:00:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_photos.json
2026-03-28 19:00:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_from_info.json
2026-03-28 19:00:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_not_allowed.json
2026-03-28 19:00:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: not_operable_from_info.json
2026-03-28 19:00:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_models_not_allowed.json
2026-03-28 19:00:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_title.json
2026-03-28 19:00:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: imported_cars.json
2026-03-28 19:00:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_currency.json
2026-03-28 19:00:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_mileage.json
2026-03-28 19:00:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_auction_title.json
2026-03-28 19:00:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_country_of_origin.json
2026-03-28 19:00:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_pt.json
2026-03-28 19:00:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: electric_cars.json
2026-03-28 19:00:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_color.json
2026-03-28 19:00:06 [crawlers.pipelines.post_to_api] INFO: Setting up PostToApi Pipeline pointing to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-03-28 19:00:06 [scrapy.middleware] INFO: Enabled item pipelines:
['crawlers.pipelines.translation_pipeline.TranslationPipeline',
 'crawlers.pipelines.item_rules_pipeline.ItemRulesPipeline',
 'crawlers.pipelines.post_to_api.PostToApiPipeline']
2026-03-28 19:00:06 [scrapy.core.engine] INFO: Spider opened
2026-03-28 19:00:06 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-03-28 19:00:06 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-03-28 19:00:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 143MiB
2026-03-28 19:00:06 [scrapy-playwright] INFO: Starting download handler
2026-03-28 19:00:06 [scrapy-playwright] INFO: Starting download handler
2026-03-28 19:00:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:00:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/home> (referer: None) ['zyte-api']
2026-03-28 19:00:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:00:14 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/en/merchant/signin/ajax> (referer: https://www.auto1.com/en/home) ['zyte-api']
2026-03-28 19:00:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:00:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/user-token/obtain-token> (referer: https://www.auto1.com/en/merchant/signin/ajax) ['zyte-api']
2026-03-28 19:00:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:00:16 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/en/app/user-token/obtain-token) ['zyte-api']
2026-03-28 19:00:16 [auto1.nl] INFO: Channel: 24h | Page: 0 | totalHits: 647 | hits on page: 40
2026-03-28 19:00:16 [auto1.nl] INFO: Found listing with ID: KX21734
2026-03-28 19:00:16 [auto1.nl] INFO: Found listing with ID: EP75091
2026-03-28 19:00:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EP75091%27 HTTP/1.1" 200 None
2026-03-28 19:00:16 [auto1.nl] INFO: Scrape type for EP75091: 1
2026-03-28 19:00:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:00:16 [auto1.nl] INFO: Found listing with ID: HR57884
2026-03-28 19:00:16 [auto1.nl] INFO: Found listing with ID: PT29526
2026-03-28 19:00:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PT29526%27 HTTP/1.1" 200 None
2026-03-28 19:00:16 [auto1.nl] INFO: Scrape type for PT29526: 1
2026-03-28 19:00:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:00:16 [auto1.nl] INFO: Found listing with ID: LT58475
2026-03-28 19:00:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LT58475%27 HTTP/1.1" 200 None
2026-03-28 19:00:16 [auto1.nl] INFO: Scrape type for LT58475: 1
2026-03-28 19:00:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:00:16 [auto1.nl] INFO: Found listing with ID: DJ99279
2026-03-28 19:00:16 [auto1.nl] INFO: Found listing with ID: LZ20154
2026-03-28 19:00:16 [auto1.nl] INFO: Found listing with ID: ZU81802
2026-03-28 19:00:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZU81802%27 HTTP/1.1" 200 None
2026-03-28 19:00:16 [auto1.nl] INFO: Scrape type for ZU81802: 1
2026-03-28 19:00:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:00:16 [auto1.nl] INFO: Found listing with ID: GW21106
2026-03-28 19:00:16 [auto1.nl] INFO: Found listing with ID: VV89778
2026-03-28 19:00:16 [auto1.nl] INFO: Found listing with ID: HT85176
2026-03-28 19:00:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HT85176%27 HTTP/1.1" 200 None
2026-03-28 19:00:16 [auto1.nl] INFO: Scrape type for HT85176: 2
2026-03-28 19:00:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0e8f5641-8913-59fc-a07d-53b1cce8ef56 with identifier: HT85176
2026-03-28 19:00:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0e8f5641-8913-59fc-a07d-53b1cce8ef56 with scrape type 2
2026-03-28 19:00:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0e8f5641-8913-59fc-a07d-53b1cce8ef56 with scrape type 2
2026-03-28 19:00:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 0e8f5641-8913-59fc-a07d-53b1cce8ef56, identifier: HT85176
2026-03-28 19:00:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 0e8f5641-8913-59fc-a07d-53b1cce8ef56 with identifier: HT85176
2026-03-28 19:00:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 19:00:16 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=black HTTP/1.1" 200 None
2026-03-28 19:00:16 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 19:00:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 19:00:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 19:00:17 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=diesel HTTP/1.1" 200 None
2026-03-28 19:00:17 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 19:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 19:00:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 0e8f5641-8913-59fc-a07d-53b1cce8ef56 with identifier: HT85176
2026-03-28 19:00:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 0e8f5641-8913-59fc-a07d-53b1cce8ef56 with identifier: HT85176 to the API
2026-03-28 19:00:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 19:00:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 19:00:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:20:13Z',
 'fuel_type': 'diesel',
 'id': '0e8f5641-8913-59fc-a07d-53b1cce8ef56',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HT85176',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Caddy',
 'odometer': 212515,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-09-17',
 'seller_name': None,
 'title': 'Volkswagen Caddy 2.0 SDI Kasten',
 'transmission': 'manual',
 'trim': 'Kasten',
 'year': 2008}
2026-03-28 19:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HT85176%27 HTTP/1.1" 200 None
2026-03-28 19:00:17 [auto1.nl] INFO: Saving data for HT85176: {'auction_closing_time': 1774884013.0, 'created_time': 1774526497.839594, 'last_price_update_time': 1774724417.544792}
2026-03-28 19:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='HT85176') HTTP/1.1" 204 0
2026-03-28 19:00:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:00:17 [auto1.nl] INFO: Found listing with ID: AR18023
2026-03-28 19:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AR18023%27 HTTP/1.1" 200 None
2026-03-28 19:00:17 [auto1.nl] INFO: Scrape type for AR18023: 1
2026-03-28 19:00:17 [auto1.nl] INFO: Found listing with ID: VV23298
2026-03-28 19:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VV23298%27 HTTP/1.1" 200 None
2026-03-28 19:00:17 [auto1.nl] INFO: Scrape type for VV23298: 2
2026-03-28 19:00:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7cb7b06f-3e71-578a-b5c2-3f3e01508065 with identifier: VV23298
2026-03-28 19:00:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7cb7b06f-3e71-578a-b5c2-3f3e01508065 with scrape type 2
2026-03-28 19:00:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7cb7b06f-3e71-578a-b5c2-3f3e01508065 with scrape type 2
2026-03-28 19:00:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 7cb7b06f-3e71-578a-b5c2-3f3e01508065, identifier: VV23298
2026-03-28 19:00:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:00:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 7cb7b06f-3e71-578a-b5c2-3f3e01508065 with identifier: VV23298
2026-03-28 19:00:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 19:00:17 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=petrol HTTP/1.1" 200 None
2026-03-28 19:00:17 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 19:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 19:00:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 7cb7b06f-3e71-578a-b5c2-3f3e01508065 with identifier: VV23298
2026-03-28 19:00:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 7cb7b06f-3e71-578a-b5c2-3f3e01508065 with identifier: VV23298 to the API
2026-03-28 19:00:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 19:00:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 19:00:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:13:16Z',
 'fuel_type': 'petrol',
 'id': '7cb7b06f-3e71-578a-b5c2-3f3e01508065',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VV23298',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 110320,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-11-03',
 'seller_name': None,
 'title': 'Nissan Qashqai 1.2 N-Connecta',
 'transmission': 'automatic',
 'trim': 'N-Connecta',
 'year': 2016}
2026-03-28 19:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VV23298%27 HTTP/1.1" 200 None
2026-03-28 19:00:18 [auto1.nl] INFO: Saving data for VV23298: {'auction_closing_time': 1774883596.0, 'created_time': 1773428627.268047, 'last_price_update_time': 1774724418.256801}
2026-03-28 19:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='VV23298') HTTP/1.1" 204 0
2026-03-28 19:00:18 [auto1.nl] INFO: Found listing with ID: XZ29701
2026-03-28 19:00:18 [auto1.nl] INFO: Found listing with ID: UM83404
2026-03-28 19:00:18 [auto1.nl] INFO: Found listing with ID: TA68954
2026-03-28 19:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TA68954%27 HTTP/1.1" 200 None
2026-03-28 19:00:18 [auto1.nl] INFO: Scrape type for TA68954: 1
2026-03-28 19:00:18 [auto1.nl] INFO: Found listing with ID: MC92565
2026-03-28 19:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MC92565%27 HTTP/1.1" 200 None
2026-03-28 19:00:18 [auto1.nl] INFO: Scrape type for MC92565: 1
2026-03-28 19:00:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:00:18 [auto1.nl] INFO: Found listing with ID: JB49049
2026-03-28 19:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JB49049%27 HTTP/1.1" 200 None
2026-03-28 19:00:18 [auto1.nl] INFO: Scrape type for JB49049: 0
2026-03-28 19:00:18 [auto1.nl] INFO: Found listing with ID: ML03692
2026-03-28 19:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ML03692%27 HTTP/1.1" 200 None
2026-03-28 19:00:18 [auto1.nl] INFO: Scrape type for ML03692: 0
2026-03-28 19:00:18 [auto1.nl] INFO: Found listing with ID: GN29290
2026-03-28 19:00:18 [auto1.nl] INFO: Found listing with ID: KV65945
2026-03-28 19:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KV65945%27 HTTP/1.1" 200 None
2026-03-28 19:00:18 [auto1.nl] INFO: Scrape type for KV65945: 0
2026-03-28 19:00:18 [auto1.nl] INFO: Found listing with ID: AR80776
2026-03-28 19:00:18 [auto1.nl] INFO: Found listing with ID: EB25456
2026-03-28 19:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EB25456%27 HTTP/1.1" 200 None
2026-03-28 19:00:18 [auto1.nl] INFO: Scrape type for EB25456: 2
2026-03-28 19:00:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fa005e43-9bf0-537a-9aa4-5b8163c55914 with identifier: EB25456
2026-03-28 19:00:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fa005e43-9bf0-537a-9aa4-5b8163c55914 with scrape type 2
2026-03-28 19:00:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fa005e43-9bf0-537a-9aa4-5b8163c55914 with scrape type 2
2026-03-28 19:00:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: fa005e43-9bf0-537a-9aa4-5b8163c55914, identifier: EB25456
2026-03-28 19:00:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: fa005e43-9bf0-537a-9aa4-5b8163c55914 with identifier: EB25456
2026-03-28 19:00:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 19:00:18 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=hybrid HTTP/1.1" 200 None
2026-03-28 19:00:18 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 19:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 19:00:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: fa005e43-9bf0-537a-9aa4-5b8163c55914 with identifier: EB25456
2026-03-28 19:00:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: fa005e43-9bf0-537a-9aa4-5b8163c55914 with identifier: EB25456 to the API
2026-03-28 19:00:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 19:00:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 19:00:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-30T15:32:48Z',
 'fuel_type': 'hybrid',
 'id': 'fa005e43-9bf0-537a-9aa4-5b8163c55914',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EB25456',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 178503,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-10',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 1.4 eHybrid R-Line',
 'transmission': 'automatic',
 'trim': 'R-Line',
 'year': 2022}
2026-03-28 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EB25456%27 HTTP/1.1" 200 None
2026-03-28 19:00:19 [auto1.nl] INFO: Saving data for EB25456: {'auction_closing_time': 1774884768.0, 'created_time': 1774526446.091097, 'last_price_update_time': 1774724419.798371}
2026-03-28 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='EB25456') HTTP/1.1" 204 0
2026-03-28 19:00:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:00:19 [auto1.nl] INFO: Found listing with ID: ZR90330
2026-03-28 19:00:19 [auto1.nl] INFO: Found listing with ID: NV18219
2026-03-28 19:00:19 [auto1.nl] INFO: Found listing with ID: SA79399
2026-03-28 19:00:19 [auto1.nl] INFO: Found listing with ID: MR73967
2026-03-28 19:00:19 [auto1.nl] INFO: Found listing with ID: EY20513
2026-03-28 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EY20513%27 HTTP/1.1" 200 None
2026-03-28 19:00:19 [auto1.nl] INFO: Scrape type for EY20513: 0
2026-03-28 19:00:19 [auto1.nl] INFO: Found listing with ID: FZ85660
2026-03-28 19:00:19 [auto1.nl] INFO: Found listing with ID: LX89920
2026-03-28 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LX89920%27 HTTP/1.1" 200 None
2026-03-28 19:00:19 [auto1.nl] INFO: Scrape type for LX89920: 0
2026-03-28 19:00:19 [auto1.nl] INFO: Found listing with ID: BN23461
2026-03-28 19:00:19 [auto1.nl] INFO: Found listing with ID: VD03329
2026-03-28 19:00:19 [auto1.nl] INFO: Found listing with ID: JG46150
2026-03-28 19:00:19 [auto1.nl] INFO: Found listing with ID: MM65316
2026-03-28 19:00:19 [auto1.nl] INFO: Found listing with ID: TE70578
2026-03-28 19:00:19 [auto1.nl] INFO: Found listing with ID: HB74565
2026-03-28 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HB74565%27 HTTP/1.1" 200 None
2026-03-28 19:00:19 [auto1.nl] INFO: Scrape type for HB74565: 0
2026-03-28 19:00:19 [auto1.nl] INFO: Found listing with ID: FR61201
2026-03-28 19:00:19 [auto1.nl] INFO: Found listing with ID: WN75862
2026-03-28 19:00:19 [auto1.nl] INFO: Found listing with ID: UB57166
2026-03-28 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UB57166%27 HTTP/1.1" 200 None
2026-03-28 19:00:19 [auto1.nl] INFO: Scrape type for UB57166: 0
2026-03-28 19:00:19 [auto1.nl] INFO: Found listing with ID: RL60639
2026-03-28 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RL60639%27 HTTP/1.1" 200 None
2026-03-28 19:00:20 [auto1.nl] INFO: Scrape type for RL60639: 0
2026-03-28 19:00:20 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 19:00:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PT29526/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 19:00:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EP75091/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 19:00:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LT58475/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 19:00:20 [auto1.nl] INFO: Channel: 24h | Page: 1 | totalHits: 647 | hits on page: 40
2026-03-28 19:00:20 [auto1.nl] INFO: Found listing with ID: KX21734
2026-03-28 19:00:20 [auto1.nl] INFO: Found listing with ID: EP75091
2026-03-28 19:00:20 [scrapy.dupefilters] DEBUG: Filtered duplicate request: <GET https://www.auto1.com/v1/car-details-view/EP75091/cdb8adcc-312b-4040-b112-4a289f3f9b07> - no more duplicates will be shown (see DUPEFILTER_DEBUG to show all duplicates)
2026-03-28 19:00:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:00:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:00:20 [auto1.nl] INFO: Found listing with ID: HR57884
2026-03-28 19:00:20 [auto1.nl] INFO: Found listing with ID: PT29526
2026-03-28 19:00:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:00:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:00:20 [auto1.nl] INFO: Found listing with ID: LT58475
2026-03-28 19:00:20 [auto1.nl] INFO: Found listing with ID: DJ99279
2026-03-28 19:00:20 [auto1.nl] INFO: Found listing with ID: LZ20154
2026-03-28 19:00:20 [auto1.nl] INFO: Found listing with ID: ZU81802
2026-03-28 19:00:20 [auto1.nl] INFO: Found listing with ID: GW21106
2026-03-28 19:00:20 [auto1.nl] INFO: Found listing with ID: VV89778
2026-03-28 19:00:20 [auto1.nl] INFO: Found listing with ID: HT85176
2026-03-28 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HT85176%27 HTTP/1.1" 200 None
2026-03-28 19:00:20 [auto1.nl] INFO: Scrape type for HT85176: 0
2026-03-28 19:00:20 [auto1.nl] INFO: Found listing with ID: AR18023
2026-03-28 19:00:20 [auto1.nl] INFO: Found listing with ID: VV23298
2026-03-28 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VV23298%27 HTTP/1.1" 200 None
2026-03-28 19:00:20 [auto1.nl] INFO: Scrape type for VV23298: 0
2026-03-28 19:00:20 [auto1.nl] INFO: Found listing with ID: XZ29701
2026-03-28 19:00:20 [auto1.nl] INFO: Found listing with ID: UM83404
2026-03-28 19:00:20 [auto1.nl] INFO: Found listing with ID: TA68954
2026-03-28 19:00:20 [auto1.nl] INFO: Found listing with ID: MC92565
2026-03-28 19:00:20 [auto1.nl] INFO: Found listing with ID: JB49049
2026-03-28 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JB49049%27 HTTP/1.1" 200 None
2026-03-28 19:00:20 [auto1.nl] INFO: Scrape type for JB49049: 0
2026-03-28 19:00:20 [auto1.nl] INFO: Found listing with ID: ML03692
2026-03-28 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ML03692%27 HTTP/1.1" 200 None
2026-03-28 19:00:20 [auto1.nl] INFO: Scrape type for ML03692: 0
2026-03-28 19:00:20 [auto1.nl] INFO: Found listing with ID: GN29290
2026-03-28 19:00:20 [auto1.nl] INFO: Found listing with ID: KV65945
2026-03-28 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KV65945%27 HTTP/1.1" 200 None
2026-03-28 19:00:20 [auto1.nl] INFO: Scrape type for KV65945: 0
2026-03-28 19:00:20 [auto1.nl] INFO: Found listing with ID: AR80776
2026-03-28 19:00:20 [auto1.nl] INFO: Found listing with ID: EB25456
2026-03-28 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EB25456%27 HTTP/1.1" 200 None
2026-03-28 19:00:20 [auto1.nl] INFO: Scrape type for EB25456: 0
2026-03-28 19:00:20 [auto1.nl] INFO: Found listing with ID: ZR90330
2026-03-28 19:00:20 [auto1.nl] INFO: Found listing with ID: NV18219
2026-03-28 19:00:20 [auto1.nl] INFO: Found listing with ID: SA79399
2026-03-28 19:00:20 [auto1.nl] INFO: Found listing with ID: MR73967
2026-03-28 19:00:20 [auto1.nl] INFO: Found listing with ID: EY20513
2026-03-28 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EY20513%27 HTTP/1.1" 200 None
2026-03-28 19:00:20 [auto1.nl] INFO: Scrape type for EY20513: 0
2026-03-28 19:00:20 [auto1.nl] INFO: Found listing with ID: FZ85660
2026-03-28 19:00:20 [auto1.nl] INFO: Found listing with ID: LX89920
2026-03-28 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LX89920%27 HTTP/1.1" 200 None
2026-03-28 19:00:20 [auto1.nl] INFO: Scrape type for LX89920: 0
2026-03-28 19:00:20 [auto1.nl] INFO: Found listing with ID: BN23461
2026-03-28 19:00:20 [auto1.nl] INFO: Found listing with ID: VD03329
2026-03-28 19:00:20 [auto1.nl] INFO: Found listing with ID: JG46150
2026-03-28 19:00:20 [auto1.nl] INFO: Found listing with ID: MM65316
2026-03-28 19:00:20 [auto1.nl] INFO: Found listing with ID: TE70578
2026-03-28 19:00:20 [auto1.nl] INFO: Found listing with ID: HB74565
2026-03-28 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HB74565%27 HTTP/1.1" 200 None
2026-03-28 19:00:20 [auto1.nl] INFO: Scrape type for HB74565: 0
2026-03-28 19:00:20 [auto1.nl] INFO: Found listing with ID: FR61201
2026-03-28 19:00:20 [auto1.nl] INFO: Found listing with ID: WN75862
2026-03-28 19:00:20 [auto1.nl] INFO: Found listing with ID: UB57166
2026-03-28 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UB57166%27 HTTP/1.1" 200 None
2026-03-28 19:00:20 [auto1.nl] INFO: Scrape type for UB57166: 0
2026-03-28 19:00:20 [auto1.nl] INFO: Found listing with ID: RL60639
2026-03-28 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RL60639%27 HTTP/1.1" 200 None
2026-03-28 19:00:20 [auto1.nl] INFO: Scrape type for RL60639: 0
2026-03-28 19:00:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZU81802/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 19:00:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TA68954/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 19:00:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:00:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MC92565/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 19:00:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:00:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AR18023/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 19:00:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:00:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:00:21 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 19:00:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LT58475> (referer: https://www.auto1.com/v1/car-details-view/LT58475/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 19:00:21 [auto1.nl] INFO: Channel: 24h | Page: 2 | totalHits: 647 | hits on page: 40
2026-03-28 19:00:21 [auto1.nl] INFO: Found listing with ID: SV00912
2026-03-28 19:00:21 [auto1.nl] INFO: Found listing with ID: AX06352
2026-03-28 19:00:21 [auto1.nl] INFO: Found listing with ID: JN77730
2026-03-28 19:00:21 [auto1.nl] INFO: Found listing with ID: YT76844
2026-03-28 19:00:21 [auto1.nl] INFO: Found listing with ID: VU12203
2026-03-28 19:00:21 [auto1.nl] INFO: Found listing with ID: XD02824
2026-03-28 19:00:21 [auto1.nl] INFO: Found listing with ID: AA80905
2026-03-28 19:00:21 [auto1.nl] INFO: Found listing with ID: TB82163
2026-03-28 19:00:21 [auto1.nl] INFO: Found listing with ID: SY92282
2026-03-28 19:00:21 [auto1.nl] INFO: Found listing with ID: FB46775
2026-03-28 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FB46775%27 HTTP/1.1" 200 None
2026-03-28 19:00:21 [auto1.nl] INFO: Scrape type for FB46775: 0
2026-03-28 19:00:21 [auto1.nl] INFO: Found listing with ID: HY50584
2026-03-28 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HY50584%27 HTTP/1.1" 200 None
2026-03-28 19:00:21 [auto1.nl] INFO: Scrape type for HY50584: 0
2026-03-28 19:00:21 [auto1.nl] INFO: Found listing with ID: HK41309
2026-03-28 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HK41309%27 HTTP/1.1" 200 None
2026-03-28 19:00:21 [auto1.nl] INFO: Scrape type for HK41309: 0
2026-03-28 19:00:21 [auto1.nl] INFO: Found listing with ID: AX28541
2026-03-28 19:00:21 [auto1.nl] INFO: Found listing with ID: KZ09082
2026-03-28 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KZ09082%27 HTTP/1.1" 200 None
2026-03-28 19:00:21 [auto1.nl] INFO: Scrape type for KZ09082: 0
2026-03-28 19:00:21 [auto1.nl] INFO: Found listing with ID: MP54654
2026-03-28 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MP54654%27 HTTP/1.1" 200 None
2026-03-28 19:00:21 [auto1.nl] INFO: Scrape type for MP54654: 0
2026-03-28 19:00:21 [auto1.nl] INFO: Found listing with ID: DD48612
2026-03-28 19:00:21 [auto1.nl] INFO: Found listing with ID: VF61988
2026-03-28 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VF61988%27 HTTP/1.1" 200 None
2026-03-28 19:00:21 [auto1.nl] INFO: Scrape type for VF61988: 0
2026-03-28 19:00:21 [auto1.nl] INFO: Found listing with ID: MM08239
2026-03-28 19:00:21 [auto1.nl] INFO: Found listing with ID: DM34469
2026-03-28 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DM34469%27 HTTP/1.1" 200 None
2026-03-28 19:00:21 [auto1.nl] INFO: Scrape type for DM34469: 2
2026-03-28 19:00:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a887a3e2-7f81-592f-8b9a-e3e1da2cbdd3 with identifier: DM34469
2026-03-28 19:00:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a887a3e2-7f81-592f-8b9a-e3e1da2cbdd3 with scrape type 2
2026-03-28 19:00:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a887a3e2-7f81-592f-8b9a-e3e1da2cbdd3 with scrape type 2
2026-03-28 19:00:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: a887a3e2-7f81-592f-8b9a-e3e1da2cbdd3, identifier: DM34469
2026-03-28 19:00:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: a887a3e2-7f81-592f-8b9a-e3e1da2cbdd3 with identifier: DM34469
2026-03-28 19:00:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 19:00:21 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=brown HTTP/1.1" 200 None
2026-03-28 19:00:21 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 19:00:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: a887a3e2-7f81-592f-8b9a-e3e1da2cbdd3 with identifier: DM34469
2026-03-28 19:00:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: a887a3e2-7f81-592f-8b9a-e3e1da2cbdd3 with identifier: DM34469 to the API
2026-03-28 19:00:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 19:00:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 19:00:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-30T15:13:34Z',
 'fuel_type': 'petrol',
 'id': 'a887a3e2-7f81-592f-8b9a-e3e1da2cbdd3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DM34469',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'Clubman',
 'odometer': 153029,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-12-02',
 'seller_name': None,
 'title': 'MINI Clubman One',
 'transmission': 'manual',
 'trim': '',
 'year': 2009}
2026-03-28 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DM34469%27 HTTP/1.1" 200 None
2026-03-28 19:00:22 [auto1.nl] INFO: Saving data for DM34469: {'auction_closing_time': 1774883614.0, 'created_time': 1774526485.470252, 'last_price_update_time': 1774724422.711928}
2026-03-28 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='DM34469') HTTP/1.1" 204 0
2026-03-28 19:00:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:00:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e4c28d85-2f83-5beb-a179-ecca40c5152b with identifier: LT58475
2026-03-28 19:00:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e4c28d85-2f83-5beb-a179-ecca40c5152b with scrape type 1
2026-03-28 19:00:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item e4c28d85-2f83-5beb-a179-ecca40c5152b
2026-03-28 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F58%252F5858de9d501ca156075375c70d91b9e0%252Fpa%252FLT58475_b4276e7450c40c33d3ff86050ffccc84.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:00:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/58/5858de9d501ca156075375c70d91b9e0/pa/LT58475_b4276e7450c40c33d3ff86050ffccc84.jpg already downloaded
2026-03-28 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F58%252F5858de9d501ca156075375c70d91b9e0%252Fpa%252FLT58475_12ab9b5b311723cce8489571bc69aec4.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:00:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/58/5858de9d501ca156075375c70d91b9e0/pa/LT58475_12ab9b5b311723cce8489571bc69aec4.jpg already downloaded
2026-03-28 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F58%252F5858de9d501ca156075375c70d91b9e0%252Fpa%252FLT58475_27f2319ec309e11ee41abdb164c4af3a.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:00:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/58/5858de9d501ca156075375c70d91b9e0/pa/LT58475_27f2319ec309e11ee41abdb164c4af3a.jpg already downloaded
2026-03-28 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F58%252F5858de9d501ca156075375c70d91b9e0%252Fpa%252FLT58475_4da41ab6a87e2e794a2433fc4d9419a1.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:00:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/58/5858de9d501ca156075375c70d91b9e0/pa/LT58475_4da41ab6a87e2e794a2433fc4d9419a1.jpg already downloaded
2026-03-28 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F58%252F5858de9d501ca156075375c70d91b9e0%252Fpa%252FLT58475_3a957e561a986f677020cf542602f725.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:00:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/58/5858de9d501ca156075375c70d91b9e0/pa/LT58475_3a957e561a986f677020cf542602f725.jpg already downloaded
2026-03-28 19:00:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: e4c28d85-2f83-5beb-a179-ecca40c5152b, identifier: LT58475
2026-03-28 19:00:23 [auto1.nl] INFO: Found listing with ID: DE05380
2026-03-28 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DE05380%27 HTTP/1.1" 200 None
2026-03-28 19:00:23 [auto1.nl] INFO: Scrape type for DE05380: 0
2026-03-28 19:00:23 [auto1.nl] INFO: Found listing with ID: FL02627
2026-03-28 19:00:23 [auto1.nl] INFO: Found listing with ID: NR59954
2026-03-28 19:00:23 [auto1.nl] INFO: Found listing with ID: LC20908
2026-03-28 19:00:23 [auto1.nl] INFO: Found listing with ID: GR72952
2026-03-28 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GR72952%27 HTTP/1.1" 200 None
2026-03-28 19:00:23 [auto1.nl] INFO: Scrape type for GR72952: 0
2026-03-28 19:00:23 [auto1.nl] INFO: Found listing with ID: VJ06664
2026-03-28 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VJ06664%27 HTTP/1.1" 200 None
2026-03-28 19:00:23 [auto1.nl] INFO: Scrape type for VJ06664: 0
2026-03-28 19:00:23 [auto1.nl] INFO: Found listing with ID: ET47420
2026-03-28 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ET47420%27 HTTP/1.1" 200 None
2026-03-28 19:00:23 [auto1.nl] INFO: Scrape type for ET47420: 1
2026-03-28 19:00:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: e4c28d85-2f83-5beb-a179-ecca40c5152b with identifier: LT58475
2026-03-28 19:00:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: e4c28d85-2f83-5beb-a179-ecca40c5152b with identifier: LT58475
2026-03-28 19:00:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: e4c28d85-2f83-5beb-a179-ecca40c5152b with identifier: LT58475 to the API
2026-03-28 19:00:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 19:00:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 19:00:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/LT58475>
{'auction_title': '',
 'c_o_2_emission_value': 197,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 3',
 'engine': '2.2L',
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:33:24Z',
 'fuel_type': 'diesel',
 'id': 'e4c28d85-2f83-5beb-a179-ecca40c5152b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '68NXBN',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LT58475',
 'listing': 'auction',
 'location': 'NL, Venlo',
 'make': 'Saab',
 'model': '9-5',
 'odometer': 566783,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 5,
 'photo_urls': ['https://img-pa.auto1.com/img58/58/5858de9d501ca156075375c70d91b9e0/pa/LT58475_b4276e7450c40c33d3ff86050ffccc84.jpg',
                'https://img-pa.auto1.com/img58/58/5858de9d501ca156075375c70d91b9e0/pa/LT58475_12ab9b5b311723cce8489571bc69aec4.jpg',
                'https://img-pa.auto1.com/img58/58/5858de9d501ca156075375c70d91b9e0/pa/LT58475_27f2319ec309e11ee41abdb164c4af3a.jpg',
                'https://img-pa.auto1.com/img58/58/5858de9d501ca156075375c70d91b9e0/pa/LT58475_4da41ab6a87e2e794a2433fc4d9419a1.jpg',
                'https://img-pa.auto1.com/img58/58/5858de9d501ca156075375c70d91b9e0/pa/LT58475_3a957e561a986f677020cf542602f725.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4c28d85-2f83-5beb-a179-ecca40c5152b/e4c28d85-2f83-5beb-a179-ecca40c5152b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70666,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img58/58/5858de9d501ca156075375c70d91b9e0/pa/LT58475_b4276e7450c40c33d3ff86050ffccc84.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4c28d85-2f83-5beb-a179-ecca40c5152b/e4c28d85-2f83-5beb-a179-ecca40c5152b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71145,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img58/58/5858de9d501ca156075375c70d91b9e0/pa/LT58475_12ab9b5b311723cce8489571bc69aec4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4c28d85-2f83-5beb-a179-ecca40c5152b/e4c28d85-2f83-5beb-a179-ecca40c5152b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84274,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img58/58/5858de9d501ca156075375c70d91b9e0/pa/LT58475_27f2319ec309e11ee41abdb164c4af3a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4c28d85-2f83-5beb-a179-ecca40c5152b/e4c28d85-2f83-5beb-a179-ecca40c5152b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77845,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img58/58/5858de9d501ca156075375c70d91b9e0/pa/LT58475_4da41ab6a87e2e794a2433fc4d9419a1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4c28d85-2f83-5beb-a179-ecca40c5152b/e4c28d85-2f83-5beb-a179-ecca40c5152b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60922,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img58/58/5858de9d501ca156075375c70d91b9e0/pa/LT58475_3a957e561a986f677020cf542602f725.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2004-03-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Saab 9-5 2.2 TiD ARC',
 'transmission': 'automatic',
 'trim': 'ARC',
 'year': 2004}
2026-03-28 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LT58475%27 HTTP/1.1" 200 None
2026-03-28 19:00:23 [auto1.nl] INFO: Saving data for LT58475: {'created_time': 1774724423.641637, 'last_price_update_time': 1774724423.641655, 'auction_closing_time': 1774884804.0}
2026-03-28 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='LT58475') HTTP/1.1" 204 0
2026-03-28 19:00:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PT29526> (referer: https://www.auto1.com/v1/car-details-view/PT29526/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 19:00:23 [auto1.nl] INFO: Found listing with ID: KB59261
2026-03-28 19:00:23 [auto1.nl] INFO: Found listing with ID: GS47094
2026-03-28 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GS47094%27 HTTP/1.1" 200 None
2026-03-28 19:00:23 [auto1.nl] INFO: Scrape type for GS47094: 0
2026-03-28 19:00:23 [auto1.nl] INFO: Found listing with ID: NX76865
2026-03-28 19:00:23 [auto1.nl] INFO: Found listing with ID: MD55137
2026-03-28 19:00:23 [auto1.nl] INFO: Found listing with ID: KT95598
2026-03-28 19:00:23 [auto1.nl] INFO: Found listing with ID: JK36770
2026-03-28 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JK36770%27 HTTP/1.1" 200 None
2026-03-28 19:00:23 [auto1.nl] INFO: Scrape type for JK36770: 0
2026-03-28 19:00:23 [auto1.nl] INFO: Found listing with ID: ZR40703
2026-03-28 19:00:23 [auto1.nl] INFO: Found listing with ID: FP10265
2026-03-28 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FP10265%27 HTTP/1.1" 200 None
2026-03-28 19:00:23 [auto1.nl] INFO: Scrape type for FP10265: 0
2026-03-28 19:00:23 [auto1.nl] INFO: Found listing with ID: SY10793
2026-03-28 19:00:23 [auto1.nl] INFO: Found listing with ID: FY76730
2026-03-28 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FY76730%27 HTTP/1.1" 200 None
2026-03-28 19:00:23 [auto1.nl] INFO: Scrape type for FY76730: 0
2026-03-28 19:00:23 [auto1.nl] INFO: Found listing with ID: LA17019
2026-03-28 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LA17019%27 HTTP/1.1" 200 None
2026-03-28 19:00:23 [auto1.nl] INFO: Scrape type for LA17019: 0
2026-03-28 19:00:23 [auto1.nl] INFO: Found listing with ID: NZ11721
2026-03-28 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NZ11721%27 HTTP/1.1" 200 None
2026-03-28 19:00:23 [auto1.nl] INFO: Scrape type for NZ11721: 0
2026-03-28 19:00:23 [auto1.nl] INFO: Found listing with ID: LZ16255
2026-03-28 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LZ16255%27 HTTP/1.1" 200 None
2026-03-28 19:00:23 [auto1.nl] INFO: Scrape type for LZ16255: 0
2026-03-28 19:00:23 [auto1.nl] INFO: Found listing with ID: MZ48021
2026-03-28 19:00:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZU81802> (referer: https://www.auto1.com/v1/car-details-view/ZU81802/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 19:00:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TA68954> (referer: https://www.auto1.com/v1/car-details-view/TA68954/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 19:00:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MC92565> (referer: https://www.auto1.com/v1/car-details-view/MC92565/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 19:00:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:00:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d170a6a4-9bab-5705-ae24-a0f2b41431a6 with identifier: PT29526
2026-03-28 19:00:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d170a6a4-9bab-5705-ae24-a0f2b41431a6 with scrape type 1
2026-03-28 19:00:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d170a6a4-9bab-5705-ae24-a0f2b41431a6
2026-03-28 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F2a%252F952abbc3638d9d50ed5f6884ed3c1b1a%252Fpa%252FPT29526_53c30cbd14e6e12bf197de3217edc69b.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:00:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/2a/952abbc3638d9d50ed5f6884ed3c1b1a/pa/PT29526_53c30cbd14e6e12bf197de3217edc69b.jpg already downloaded
2026-03-28 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F2a%252F952abbc3638d9d50ed5f6884ed3c1b1a%252Fpa%252FPT29526_4651785e987069261e42c3e0007e95fd.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:00:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/2a/952abbc3638d9d50ed5f6884ed3c1b1a/pa/PT29526_4651785e987069261e42c3e0007e95fd.jpg already downloaded
2026-03-28 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F2a%252F952abbc3638d9d50ed5f6884ed3c1b1a%252Fpa%252FPT29526_0881fe4c8d50e7dd5b9c0c725a0ec5a9.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:00:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/2a/952abbc3638d9d50ed5f6884ed3c1b1a/pa/PT29526_0881fe4c8d50e7dd5b9c0c725a0ec5a9.jpg already downloaded
2026-03-28 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F2a%252F952abbc3638d9d50ed5f6884ed3c1b1a%252Fpa%252FPT29526_a20033859695c336bdc72a5d0a06ade1.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:00:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/2a/952abbc3638d9d50ed5f6884ed3c1b1a/pa/PT29526_a20033859695c336bdc72a5d0a06ade1.jpg already downloaded
2026-03-28 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F2a%252F952abbc3638d9d50ed5f6884ed3c1b1a%252Fpa%252FPT29526_f625b2d525865d264191acff71cdba9c.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:00:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/2a/952abbc3638d9d50ed5f6884ed3c1b1a/pa/PT29526_f625b2d525865d264191acff71cdba9c.jpg already downloaded
2026-03-28 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F2a%252F952abbc3638d9d50ed5f6884ed3c1b1a%252Fpa%252FPT29526_2178f2e7cb4691cc5b5a13cdfe7e896f.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:00:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/2a/952abbc3638d9d50ed5f6884ed3c1b1a/pa/PT29526_2178f2e7cb4691cc5b5a13cdfe7e896f.jpg already downloaded
2026-03-28 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F2a%252F952abbc3638d9d50ed5f6884ed3c1b1a%252Fpa%252FPT29526_cdd3b6e91b70a159750a993b5822523e.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:00:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/2a/952abbc3638d9d50ed5f6884ed3c1b1a/pa/PT29526_cdd3b6e91b70a159750a993b5822523e.jpg already downloaded
2026-03-28 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F2a%252F952abbc3638d9d50ed5f6884ed3c1b1a%252Fpa%252FPT29526_69c02d54a93bca41e5826f2c8f2b625a.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:00:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/2a/952abbc3638d9d50ed5f6884ed3c1b1a/pa/PT29526_69c02d54a93bca41e5826f2c8f2b625a.jpg already downloaded
2026-03-28 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F2a%252F952abbc3638d9d50ed5f6884ed3c1b1a%252Fpa%252FPT29526_47ce0eac126743cdd9800208874fda23.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:00:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/2a/952abbc3638d9d50ed5f6884ed3c1b1a/pa/PT29526_47ce0eac126743cdd9800208874fda23.jpg already downloaded
2026-03-28 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F2a%252F952abbc3638d9d50ed5f6884ed3c1b1a%252Fpa%252FPT29526_38a6549c2090a9898f6d516ec84363a6.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:00:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/2a/952abbc3638d9d50ed5f6884ed3c1b1a/pa/PT29526_38a6549c2090a9898f6d516ec84363a6.jpg already downloaded
2026-03-28 19:00:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: d170a6a4-9bab-5705-ae24-a0f2b41431a6, identifier: PT29526
2026-03-28 19:00:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: d170a6a4-9bab-5705-ae24-a0f2b41431a6 with identifier: PT29526
2026-03-28 19:00:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 19:00:24 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=green HTTP/1.1" 200 None
2026-03-28 19:00:24 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 19:00:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: d170a6a4-9bab-5705-ae24-a0f2b41431a6 with identifier: PT29526
2026-03-28 19:00:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: d170a6a4-9bab-5705-ae24-a0f2b41431a6 with identifier: PT29526 to the API
2026-03-28 19:00:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 19:00:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 19:00:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/PT29526>
{'auction_title': '',
 'c_o_2_emission_value': 136,
 'category': None,
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 165,
 'expiration_date': '2026-03-30T15:49:30Z',
 'fuel_type': 'petrol',
 'id': 'd170a6a4-9bab-5705-ae24-a0f2b41431a6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'RX982R',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PT29526',
 'listing': 'auction',
 'location': 'NL, Oosterhout',
 'make': 'Opel',
 'model': 'Insignia Sports Tourer',
 'odometer': 115178,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img95/2a/952abbc3638d9d50ed5f6884ed3c1b1a/pa/PT29526_53c30cbd14e6e12bf197de3217edc69b.jpg',
                'https://img-pa.auto1.com/img95/2a/952abbc3638d9d50ed5f6884ed3c1b1a/pa/PT29526_4651785e987069261e42c3e0007e95fd.jpg',
                'https://img-pa.auto1.com/img95/2a/952abbc3638d9d50ed5f6884ed3c1b1a/pa/PT29526_0881fe4c8d50e7dd5b9c0c725a0ec5a9.jpg',
                'https://img-pa.auto1.com/img95/2a/952abbc3638d9d50ed5f6884ed3c1b1a/pa/PT29526_a20033859695c336bdc72a5d0a06ade1.jpg',
                'https://img-pa.auto1.com/img95/2a/952abbc3638d9d50ed5f6884ed3c1b1a/pa/PT29526_f625b2d525865d264191acff71cdba9c.jpg',
                'https://img-pa.auto1.com/img95/2a/952abbc3638d9d50ed5f6884ed3c1b1a/pa/PT29526_2178f2e7cb4691cc5b5a13cdfe7e896f.jpg',
                'https://img-pa.auto1.com/img95/2a/952abbc3638d9d50ed5f6884ed3c1b1a/pa/PT29526_cdd3b6e91b70a159750a993b5822523e.jpg',
                'https://img-pa.auto1.com/img95/2a/952abbc3638d9d50ed5f6884ed3c1b1a/pa/PT29526_69c02d54a93bca41e5826f2c8f2b625a.jpg',
                'https://img-pa.auto1.com/img95/2a/952abbc3638d9d50ed5f6884ed3c1b1a/pa/PT29526_47ce0eac126743cdd9800208874fda23.jpg',
                'https://img-pa.auto1.com/img95/2a/952abbc3638d9d50ed5f6884ed3c1b1a/pa/PT29526_38a6549c2090a9898f6d516ec84363a6.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d170a6a4-9bab-5705-ae24-a0f2b41431a6/d170a6a4-9bab-5705-ae24-a0f2b41431a6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 110324,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img95/2a/952abbc3638d9d50ed5f6884ed3c1b1a/pa/PT29526_53c30cbd14e6e12bf197de3217edc69b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d170a6a4-9bab-5705-ae24-a0f2b41431a6/d170a6a4-9bab-5705-ae24-a0f2b41431a6_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2633812,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img95/2a/952abbc3638d9d50ed5f6884ed3c1b1a/pa/PT29526_4651785e987069261e42c3e0007e95fd.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d170a6a4-9bab-5705-ae24-a0f2b41431a6/d170a6a4-9bab-5705-ae24-a0f2b41431a6_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2731288,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img95/2a/952abbc3638d9d50ed5f6884ed3c1b1a/pa/PT29526_0881fe4c8d50e7dd5b9c0c725a0ec5a9.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d170a6a4-9bab-5705-ae24-a0f2b41431a6/d170a6a4-9bab-5705-ae24-a0f2b41431a6_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2313229,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img95/2a/952abbc3638d9d50ed5f6884ed3c1b1a/pa/PT29526_a20033859695c336bdc72a5d0a06ade1.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d170a6a4-9bab-5705-ae24-a0f2b41431a6/d170a6a4-9bab-5705-ae24-a0f2b41431a6_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2555393,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img95/2a/952abbc3638d9d50ed5f6884ed3c1b1a/pa/PT29526_f625b2d525865d264191acff71cdba9c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d170a6a4-9bab-5705-ae24-a0f2b41431a6/d170a6a4-9bab-5705-ae24-a0f2b41431a6_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2605312,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img95/2a/952abbc3638d9d50ed5f6884ed3c1b1a/pa/PT29526_2178f2e7cb4691cc5b5a13cdfe7e896f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d170a6a4-9bab-5705-ae24-a0f2b41431a6/d170a6a4-9bab-5705-ae24-a0f2b41431a6_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69583,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img95/2a/952abbc3638d9d50ed5f6884ed3c1b1a/pa/PT29526_cdd3b6e91b70a159750a993b5822523e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d170a6a4-9bab-5705-ae24-a0f2b41431a6/d170a6a4-9bab-5705-ae24-a0f2b41431a6_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2637765,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img95/2a/952abbc3638d9d50ed5f6884ed3c1b1a/pa/PT29526_69c02d54a93bca41e5826f2c8f2b625a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d170a6a4-9bab-5705-ae24-a0f2b41431a6/d170a6a4-9bab-5705-ae24-a0f2b41431a6_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2430721,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img95/2a/952abbc3638d9d50ed5f6884ed3c1b1a/pa/PT29526_47ce0eac126743cdd9800208874fda23.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d170a6a4-9bab-5705-ae24-a0f2b41431a6/d170a6a4-9bab-5705-ae24-a0f2b41431a6_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2267239,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img95/2a/952abbc3638d9d50ed5f6884ed3c1b1a/pa/PT29526_38a6549c2090a9898f6d516ec84363a6.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-02-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Insignia Sports Tourer 1.5 SIDI Turbo INNOVATION',
 'transmission': 'manual',
 'trim': 'INNOVATION',
 'year': 2018}
2026-03-28 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PT29526%27 HTTP/1.1" 200 None
2026-03-28 19:00:25 [auto1.nl] INFO: Saving data for PT29526: {'created_time': 1774724425.802126, 'last_price_update_time': 1774724425.802137, 'auction_closing_time': 1774885770.0}
2026-03-28 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='PT29526') HTTP/1.1" 204 0
2026-03-28 19:00:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AR18023> (referer: https://www.auto1.com/v1/car-details-view/AR18023/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 19:00:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 32de9075-0881-591d-93e4-1169e36d2b66 with identifier: ZU81802
2026-03-28 19:00:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 32de9075-0881-591d-93e4-1169e36d2b66 with scrape type 1
2026-03-28 19:00:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 32de9075-0881-591d-93e4-1169e36d2b66
2026-03-28 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252F52%252Fbc52c70395219a283dbeaf39410a711f%252Fpa%252FZU81802_8fd194177cc7659c776025fbc95e4e11.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:00:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/52/bc52c70395219a283dbeaf39410a711f/pa/ZU81802_8fd194177cc7659c776025fbc95e4e11.jpg already downloaded
2026-03-28 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252F52%252Fbc52c70395219a283dbeaf39410a711f%252Fpa%252FZU81802_46bc095fd0790b5c687092678eafdbc5.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:00:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/52/bc52c70395219a283dbeaf39410a711f/pa/ZU81802_46bc095fd0790b5c687092678eafdbc5.jpg already downloaded
2026-03-28 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252F52%252Fbc52c70395219a283dbeaf39410a711f%252Fpa%252FZU81802_0572272da4fe3d4210cd2469a8af9ec2.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:00:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/52/bc52c70395219a283dbeaf39410a711f/pa/ZU81802_0572272da4fe3d4210cd2469a8af9ec2.jpg already downloaded
2026-03-28 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252F52%252Fbc52c70395219a283dbeaf39410a711f%252Fpa%252FZU81802_e991bdc47fe845e846bcb0a29486c710.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:00:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/52/bc52c70395219a283dbeaf39410a711f/pa/ZU81802_e991bdc47fe845e846bcb0a29486c710.jpg already downloaded
2026-03-28 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252F52%252Fbc52c70395219a283dbeaf39410a711f%252Fpa%252FZU81802_ff166a5d8d750cc0f2cf2c7d64e83c16.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:00:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/52/bc52c70395219a283dbeaf39410a711f/pa/ZU81802_ff166a5d8d750cc0f2cf2c7d64e83c16.jpg already downloaded
2026-03-28 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252F52%252Fbc52c70395219a283dbeaf39410a711f%252Fpa%252FZU81802_01440e418c67c80f7fa88e2568beb959.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:00:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/52/bc52c70395219a283dbeaf39410a711f/pa/ZU81802_01440e418c67c80f7fa88e2568beb959.jpg already downloaded
2026-03-28 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252F52%252Fbc52c70395219a283dbeaf39410a711f%252Fpa%252FZU81802_b5b4bf36e2e563fa28424c83d04181a0.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:00:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/52/bc52c70395219a283dbeaf39410a711f/pa/ZU81802_b5b4bf36e2e563fa28424c83d04181a0.jpg already downloaded
2026-03-28 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252F52%252Fbc52c70395219a283dbeaf39410a711f%252Fpa%252FZU81802_6dfd4918e31322e36d1c4c6a4215cedf.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:00:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/52/bc52c70395219a283dbeaf39410a711f/pa/ZU81802_6dfd4918e31322e36d1c4c6a4215cedf.jpg already downloaded
2026-03-28 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252F52%252Fbc52c70395219a283dbeaf39410a711f%252Fpa%252FZU81802_59086378b63289583fb3a0086e85f23f.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:00:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/52/bc52c70395219a283dbeaf39410a711f/pa/ZU81802_59086378b63289583fb3a0086e85f23f.jpg already downloaded
2026-03-28 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252F52%252Fbc52c70395219a283dbeaf39410a711f%252Fpa%252FZU81802_5f9275b84f38e09b62877d660adc5477.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:00:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/52/bc52c70395219a283dbeaf39410a711f/pa/ZU81802_5f9275b84f38e09b62877d660adc5477.jpg already downloaded
2026-03-28 19:00:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 32de9075-0881-591d-93e4-1169e36d2b66, identifier: ZU81802
2026-03-28 19:00:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0e3d831a-7ba3-50d8-b396-9761e3075c13 with identifier: TA68954
2026-03-28 19:00:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0e3d831a-7ba3-50d8-b396-9761e3075c13 with scrape type 1
2026-03-28 19:00:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0e3d831a-7ba3-50d8-b396-9761e3075c13
2026-03-28 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252Fff%252F42ffa7b9305406a420347874b2c8ac42%252Fpa%252FTA68954_a5e5862bcf55749c26e4465f9e8cad27.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:00:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/ff/42ffa7b9305406a420347874b2c8ac42/pa/TA68954_a5e5862bcf55749c26e4465f9e8cad27.jpg already downloaded
2026-03-28 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252Fff%252F42ffa7b9305406a420347874b2c8ac42%252Fpa%252FTA68954_fc09ed71fcfffd4403fd2ab24d5d3a93.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:00:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/ff/42ffa7b9305406a420347874b2c8ac42/pa/TA68954_fc09ed71fcfffd4403fd2ab24d5d3a93.jpg already downloaded
2026-03-28 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252Fff%252F42ffa7b9305406a420347874b2c8ac42%252Fpa%252FTA68954_1d8291ec62fc3dc4887f181aa48d5585.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:00:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/ff/42ffa7b9305406a420347874b2c8ac42/pa/TA68954_1d8291ec62fc3dc4887f181aa48d5585.jpg already downloaded
2026-03-28 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252Fff%252F42ffa7b9305406a420347874b2c8ac42%252Fpa%252FTA68954_4971de2d8ba64c3c4bc44367a6311482.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:00:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/ff/42ffa7b9305406a420347874b2c8ac42/pa/TA68954_4971de2d8ba64c3c4bc44367a6311482.jpg already downloaded
2026-03-28 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252Fff%252F42ffa7b9305406a420347874b2c8ac42%252Fpa%252FTA68954_7b561615be4952b878768c9c8e5ef241.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:00:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/ff/42ffa7b9305406a420347874b2c8ac42/pa/TA68954_7b561615be4952b878768c9c8e5ef241.jpg already downloaded
2026-03-28 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252Fff%252F42ffa7b9305406a420347874b2c8ac42%252Fpa%252FTA68954_63eed54dd007d2e136972d3fc6adb379.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:00:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/ff/42ffa7b9305406a420347874b2c8ac42/pa/TA68954_63eed54dd007d2e136972d3fc6adb379.jpg already downloaded
2026-03-28 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252Fff%252F42ffa7b9305406a420347874b2c8ac42%252Fpa%252FTA68954_2a854529b55161bc339a468b341470db.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:00:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/ff/42ffa7b9305406a420347874b2c8ac42/pa/TA68954_2a854529b55161bc339a468b341470db.jpg already downloaded
2026-03-28 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252Fff%252F42ffa7b9305406a420347874b2c8ac42%252Fpa%252FTA68954_d23216c580c4c242d654729f6d20e4a2.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:00:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/ff/42ffa7b9305406a420347874b2c8ac42/pa/TA68954_d23216c580c4c242d654729f6d20e4a2.jpg already downloaded
2026-03-28 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252Fff%252F42ffa7b9305406a420347874b2c8ac42%252Fpa%252FTA68954_2f4174e25daaea32a458fd4d21cfc02d.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:00:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/ff/42ffa7b9305406a420347874b2c8ac42/pa/TA68954_2f4174e25daaea32a458fd4d21cfc02d.jpg already downloaded
2026-03-28 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252Fff%252F42ffa7b9305406a420347874b2c8ac42%252Fpa%252FTA68954_dfa828d4784cddbb9a5c170426795bff.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:00:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/ff/42ffa7b9305406a420347874b2c8ac42/pa/TA68954_dfa828d4784cddbb9a5c170426795bff.jpg already downloaded
2026-03-28 19:00:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 0e3d831a-7ba3-50d8-b396-9761e3075c13, identifier: TA68954
2026-03-28 19:00:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3b663251-2061-5ae3-8887-c9b9d3ac403b with identifier: MC92565
2026-03-28 19:00:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3b663251-2061-5ae3-8887-c9b9d3ac403b with scrape type 1
2026-03-28 19:00:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3b663251-2061-5ae3-8887-c9b9d3ac403b
2026-03-28 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252F2c%252F902cf57d5dd96447dd75b2cfb8d935af%252Fpa%252FMC92565_561cbff269c462206622c3e36afdf50e.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:00:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/2c/902cf57d5dd96447dd75b2cfb8d935af/pa/MC92565_561cbff269c462206622c3e36afdf50e.jpg not downloaded yet
2026-03-28 19:00:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 32de9075-0881-591d-93e4-1169e36d2b66 with identifier: ZU81802
2026-03-28 19:00:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 19:00:26 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gray HTTP/1.1" 200 None
2026-03-28 19:00:26 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 19:00:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 32de9075-0881-591d-93e4-1169e36d2b66 with identifier: ZU81802
2026-03-28 19:00:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 32de9075-0881-591d-93e4-1169e36d2b66 with identifier: ZU81802 to the API
2026-03-28 19:00:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 19:00:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 19:00:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ZU81802>
{'auction_title': '',
 'c_o_2_emission_value': 218,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'emission_standard': 'EURO 4',
 'engine': '2.5L',
 'engine_horse_power': 218,
 'expiration_date': '2026-03-30T15:13:17Z',
 'fuel_type': 'petrol',
 'id': '32de9075-0881-591d-93e4-1169e36d2b66',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'L300BV',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZU81802',
 'listing': 'auction',
 'location': 'NL, Oosterhout',
 'make': 'BMW',
 'model': '3er',
 'odometer': 255002,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imgbc/52/bc52c70395219a283dbeaf39410a711f/pa/ZU81802_8fd194177cc7659c776025fbc95e4e11.jpg',
                'https://img-pa.auto1.com/imgbc/52/bc52c70395219a283dbeaf39410a711f/pa/ZU81802_46bc095fd0790b5c687092678eafdbc5.jpg',
                'https://img-pa.auto1.com/imgbc/52/bc52c70395219a283dbeaf39410a711f/pa/ZU81802_0572272da4fe3d4210cd2469a8af9ec2.jpg',
                'https://img-pa.auto1.com/imgbc/52/bc52c70395219a283dbeaf39410a711f/pa/ZU81802_e991bdc47fe845e846bcb0a29486c710.jpg',
                'https://img-pa.auto1.com/imgbc/52/bc52c70395219a283dbeaf39410a711f/pa/ZU81802_ff166a5d8d750cc0f2cf2c7d64e83c16.jpg',
                'https://img-pa.auto1.com/imgbc/52/bc52c70395219a283dbeaf39410a711f/pa/ZU81802_01440e418c67c80f7fa88e2568beb959.jpg',
                'https://img-pa.auto1.com/imgbc/52/bc52c70395219a283dbeaf39410a711f/pa/ZU81802_b5b4bf36e2e563fa28424c83d04181a0.jpg',
                'https://img-pa.auto1.com/imgbc/52/bc52c70395219a283dbeaf39410a711f/pa/ZU81802_6dfd4918e31322e36d1c4c6a4215cedf.jpg',
                'https://img-pa.auto1.com/imgbc/52/bc52c70395219a283dbeaf39410a711f/pa/ZU81802_59086378b63289583fb3a0086e85f23f.jpg',
                'https://img-pa.auto1.com/imgbc/52/bc52c70395219a283dbeaf39410a711f/pa/ZU81802_5f9275b84f38e09b62877d660adc5477.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32de9075-0881-591d-93e4-1169e36d2b66/32de9075-0881-591d-93e4-1169e36d2b66_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87749,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/52/bc52c70395219a283dbeaf39410a711f/pa/ZU81802_8fd194177cc7659c776025fbc95e4e11.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32de9075-0881-591d-93e4-1169e36d2b66/32de9075-0881-591d-93e4-1169e36d2b66_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83278,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/52/bc52c70395219a283dbeaf39410a711f/pa/ZU81802_46bc095fd0790b5c687092678eafdbc5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32de9075-0881-591d-93e4-1169e36d2b66/32de9075-0881-591d-93e4-1169e36d2b66_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69777,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/52/bc52c70395219a283dbeaf39410a711f/pa/ZU81802_0572272da4fe3d4210cd2469a8af9ec2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32de9075-0881-591d-93e4-1169e36d2b66/32de9075-0881-591d-93e4-1169e36d2b66_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73570,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/52/bc52c70395219a283dbeaf39410a711f/pa/ZU81802_e991bdc47fe845e846bcb0a29486c710.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32de9075-0881-591d-93e4-1169e36d2b66/32de9075-0881-591d-93e4-1169e36d2b66_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72139,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/52/bc52c70395219a283dbeaf39410a711f/pa/ZU81802_ff166a5d8d750cc0f2cf2c7d64e83c16.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32de9075-0881-591d-93e4-1169e36d2b66/32de9075-0881-591d-93e4-1169e36d2b66_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75493,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/52/bc52c70395219a283dbeaf39410a711f/pa/ZU81802_01440e418c67c80f7fa88e2568beb959.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32de9075-0881-591d-93e4-1169e36d2b66/32de9075-0881-591d-93e4-1169e36d2b66_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63693,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/52/bc52c70395219a283dbeaf39410a711f/pa/ZU81802_b5b4bf36e2e563fa28424c83d04181a0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32de9075-0881-591d-93e4-1169e36d2b66/32de9075-0881-591d-93e4-1169e36d2b66_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88097,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/52/bc52c70395219a283dbeaf39410a711f/pa/ZU81802_6dfd4918e31322e36d1c4c6a4215cedf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32de9075-0881-591d-93e4-1169e36d2b66/32de9075-0881-591d-93e4-1169e36d2b66_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84251,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/52/bc52c70395219a283dbeaf39410a711f/pa/ZU81802_59086378b63289583fb3a0086e85f23f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32de9075-0881-591d-93e4-1169e36d2b66/32de9075-0881-591d-93e4-1169e36d2b66_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68343,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/52/bc52c70395219a283dbeaf39410a711f/pa/ZU81802_5f9275b84f38e09b62877d660adc5477.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2006-11-13',
 'seats_number': 4,
 'seller_name': None,
 'title': 'BMW 3er 325i',
 'transmission': 'automatic',
 'trim': '',
 'year': 2006}
2026-03-28 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZU81802%27 HTTP/1.1" 200 None
2026-03-28 19:00:28 [auto1.nl] INFO: Saving data for ZU81802: {'created_time': 1774724428.343342, 'last_price_update_time': 1774724428.343357, 'auction_closing_time': 1774883597.0}
2026-03-28 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='ZU81802') HTTP/1.1" 204 0
2026-03-28 19:00:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 0e3d831a-7ba3-50d8-b396-9761e3075c13 with identifier: TA68954
2026-03-28 19:00:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 0e3d831a-7ba3-50d8-b396-9761e3075c13 with identifier: TA68954
2026-03-28 19:00:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 0e3d831a-7ba3-50d8-b396-9761e3075c13 with identifier: TA68954 to the API
2026-03-28 19:00:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 19:00:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 19:00:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/TA68954>
{'auction_title': '',
 'c_o_2_emission_value': 149,
 'category': None,
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:44:24Z',
 'fuel_type': 'petrol',
 'id': '0e3d831a-7ba3-50d8-b396-9761e3075c13',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '3KLP52',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TA68954',
 'listing': 'auction',
 'location': 'NL, Oosterhout',
 'make': 'Kia',
 'model': 'Sportage',
 'odometer': 215183,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img42/ff/42ffa7b9305406a420347874b2c8ac42/pa/TA68954_a5e5862bcf55749c26e4465f9e8cad27.jpg',
                'https://img-pa.auto1.com/img42/ff/42ffa7b9305406a420347874b2c8ac42/pa/TA68954_fc09ed71fcfffd4403fd2ab24d5d3a93.jpg',
                'https://img-pa.auto1.com/img42/ff/42ffa7b9305406a420347874b2c8ac42/pa/TA68954_1d8291ec62fc3dc4887f181aa48d5585.jpg',
                'https://img-pa.auto1.com/img42/ff/42ffa7b9305406a420347874b2c8ac42/pa/TA68954_4971de2d8ba64c3c4bc44367a6311482.jpg',
                'https://img-pa.auto1.com/img42/ff/42ffa7b9305406a420347874b2c8ac42/pa/TA68954_7b561615be4952b878768c9c8e5ef241.jpg',
                'https://img-pa.auto1.com/img42/ff/42ffa7b9305406a420347874b2c8ac42/pa/TA68954_63eed54dd007d2e136972d3fc6adb379.jpg',
                'https://img-pa.auto1.com/img42/ff/42ffa7b9305406a420347874b2c8ac42/pa/TA68954_2a854529b55161bc339a468b341470db.jpg',
                'https://img-pa.auto1.com/img42/ff/42ffa7b9305406a420347874b2c8ac42/pa/TA68954_d23216c580c4c242d654729f6d20e4a2.jpg',
                'https://img-pa.auto1.com/img42/ff/42ffa7b9305406a420347874b2c8ac42/pa/TA68954_2f4174e25daaea32a458fd4d21cfc02d.jpg',
                'https://img-pa.auto1.com/img42/ff/42ffa7b9305406a420347874b2c8ac42/pa/TA68954_dfa828d4784cddbb9a5c170426795bff.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e3d831a-7ba3-50d8-b396-9761e3075c13/0e3d831a-7ba3-50d8-b396-9761e3075c13_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2406644,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img42/ff/42ffa7b9305406a420347874b2c8ac42/pa/TA68954_a5e5862bcf55749c26e4465f9e8cad27.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e3d831a-7ba3-50d8-b396-9761e3075c13/0e3d831a-7ba3-50d8-b396-9761e3075c13_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2468385,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img42/ff/42ffa7b9305406a420347874b2c8ac42/pa/TA68954_fc09ed71fcfffd4403fd2ab24d5d3a93.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e3d831a-7ba3-50d8-b396-9761e3075c13/0e3d831a-7ba3-50d8-b396-9761e3075c13_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69863,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img42/ff/42ffa7b9305406a420347874b2c8ac42/pa/TA68954_1d8291ec62fc3dc4887f181aa48d5585.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e3d831a-7ba3-50d8-b396-9761e3075c13/0e3d831a-7ba3-50d8-b396-9761e3075c13_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2471162,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img42/ff/42ffa7b9305406a420347874b2c8ac42/pa/TA68954_4971de2d8ba64c3c4bc44367a6311482.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e3d831a-7ba3-50d8-b396-9761e3075c13/0e3d831a-7ba3-50d8-b396-9761e3075c13_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2299559,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img42/ff/42ffa7b9305406a420347874b2c8ac42/pa/TA68954_7b561615be4952b878768c9c8e5ef241.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e3d831a-7ba3-50d8-b396-9761e3075c13/0e3d831a-7ba3-50d8-b396-9761e3075c13_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2426535,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img42/ff/42ffa7b9305406a420347874b2c8ac42/pa/TA68954_63eed54dd007d2e136972d3fc6adb379.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e3d831a-7ba3-50d8-b396-9761e3075c13/0e3d831a-7ba3-50d8-b396-9761e3075c13_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2463484,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img42/ff/42ffa7b9305406a420347874b2c8ac42/pa/TA68954_2a854529b55161bc339a468b341470db.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e3d831a-7ba3-50d8-b396-9761e3075c13/0e3d831a-7ba3-50d8-b396-9761e3075c13_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51355,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img42/ff/42ffa7b9305406a420347874b2c8ac42/pa/TA68954_d23216c580c4c242d654729f6d20e4a2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e3d831a-7ba3-50d8-b396-9761e3075c13/0e3d831a-7ba3-50d8-b396-9761e3075c13_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2517001,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img42/ff/42ffa7b9305406a420347874b2c8ac42/pa/TA68954_2f4174e25daaea32a458fd4d21cfc02d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e3d831a-7ba3-50d8-b396-9761e3075c13/0e3d831a-7ba3-50d8-b396-9761e3075c13_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56833,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img42/ff/42ffa7b9305406a420347874b2c8ac42/pa/TA68954_dfa828d4784cddbb9a5c170426795bff.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-01-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Kia Sportage 1.6 GDI Spirit 2WD',
 'transmission': 'manual',
 'trim': 'Spirit 2WD',
 'year': 2014}
2026-03-28 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TA68954%27 HTTP/1.1" 200 None
2026-03-28 19:00:28 [auto1.nl] INFO: Saving data for TA68954: {'created_time': 1774724428.860796, 'last_price_update_time': 1774724428.860809, 'auction_closing_time': 1774885464.0}
2026-03-28 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='TA68954') HTTP/1.1" 204 0
2026-03-28 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252F2c%252F902cf57d5dd96447dd75b2cfb8d935af%252Fpa%252FMC92565_f9c52d2f5b04e3fcb4c53545afcff3d4.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/2c/902cf57d5dd96447dd75b2cfb8d935af/pa/MC92565_f9c52d2f5b04e3fcb4c53545afcff3d4.jpg not downloaded yet
2026-03-28 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252F2c%252F902cf57d5dd96447dd75b2cfb8d935af%252Fpa%252FMC92565_fb27762e9f2cdc2f2a498fa0aa1f0a77.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/2c/902cf57d5dd96447dd75b2cfb8d935af/pa/MC92565_fb27762e9f2cdc2f2a498fa0aa1f0a77.jpg not downloaded yet
2026-03-28 19:00:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8d6fdcfe-df6f-54fd-856d-5bd0bf94e8a2 with identifier: AR18023
2026-03-28 19:00:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8d6fdcfe-df6f-54fd-856d-5bd0bf94e8a2 with scrape type 1
2026-03-28 19:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8d6fdcfe-df6f-54fd-856d-5bd0bf94e8a2
2026-03-28 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252Fb0%252F45b0810dcbfe1865a2eda7452627ba3d%252Fpa%252FAR18023_8819e543f1afb243ff651ff7398d4a7b.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/b0/45b0810dcbfe1865a2eda7452627ba3d/pa/AR18023_8819e543f1afb243ff651ff7398d4a7b.jpg already downloaded
2026-03-28 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252Fb0%252F45b0810dcbfe1865a2eda7452627ba3d%252Fpa%252FAR18023_08e666dcafba1715e56915beda683c99.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/b0/45b0810dcbfe1865a2eda7452627ba3d/pa/AR18023_08e666dcafba1715e56915beda683c99.jpg already downloaded
2026-03-28 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252Fb0%252F45b0810dcbfe1865a2eda7452627ba3d%252Fpa%252FAR18023_3d4b3873d36e8078e7ddc5b8c2f2e532.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/b0/45b0810dcbfe1865a2eda7452627ba3d/pa/AR18023_3d4b3873d36e8078e7ddc5b8c2f2e532.jpg already downloaded
2026-03-28 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252Fb0%252F45b0810dcbfe1865a2eda7452627ba3d%252Fpa%252FAR18023_eb4cf1e0393995077bc05712002b6e8a.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:00:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/b0/45b0810dcbfe1865a2eda7452627ba3d/pa/AR18023_eb4cf1e0393995077bc05712002b6e8a.jpg already downloaded
2026-03-28 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252Fb0%252F45b0810dcbfe1865a2eda7452627ba3d%252Fpa%252FAR18023_88832676b87d714d53dae94b57418231.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:00:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/b0/45b0810dcbfe1865a2eda7452627ba3d/pa/AR18023_88832676b87d714d53dae94b57418231.jpg already downloaded
2026-03-28 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252Fb0%252F45b0810dcbfe1865a2eda7452627ba3d%252Fpa%252FAR18023_74ca5da8a465e2d3e2ff475557f0f324.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:00:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/b0/45b0810dcbfe1865a2eda7452627ba3d/pa/AR18023_74ca5da8a465e2d3e2ff475557f0f324.jpg already downloaded
2026-03-28 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252Fb0%252F45b0810dcbfe1865a2eda7452627ba3d%252Fpa%252FAR18023_e340a2a2c6b159989e96e81864e3a2d1.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:00:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/b0/45b0810dcbfe1865a2eda7452627ba3d/pa/AR18023_e340a2a2c6b159989e96e81864e3a2d1.jpg already downloaded
2026-03-28 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252Fb0%252F45b0810dcbfe1865a2eda7452627ba3d%252Fpa%252FAR18023_c68f2a6ecc688ea30fdebd945751aac6.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:00:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/b0/45b0810dcbfe1865a2eda7452627ba3d/pa/AR18023_c68f2a6ecc688ea30fdebd945751aac6.jpg already downloaded
2026-03-28 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252Fb0%252F45b0810dcbfe1865a2eda7452627ba3d%252Fpa%252FAR18023_dcc190bdf8c71f1f46ad60a44fde7335.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:00:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/b0/45b0810dcbfe1865a2eda7452627ba3d/pa/AR18023_dcc190bdf8c71f1f46ad60a44fde7335.jpg already downloaded
2026-03-28 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252Fb0%252F45b0810dcbfe1865a2eda7452627ba3d%252Fpa%252FAR18023_054ab1d8ae9c64468a82b84b05993921.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:00:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/b0/45b0810dcbfe1865a2eda7452627ba3d/pa/AR18023_054ab1d8ae9c64468a82b84b05993921.jpg already downloaded
2026-03-28 19:00:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 8d6fdcfe-df6f-54fd-856d-5bd0bf94e8a2, identifier: AR18023
2026-03-28 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252F2c%252F902cf57d5dd96447dd75b2cfb8d935af%252Fpa%252FMC92565_a6619ccd5ca8a22a8d35fc8d9c1ee811.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:00:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/2c/902cf57d5dd96447dd75b2cfb8d935af/pa/MC92565_a6619ccd5ca8a22a8d35fc8d9c1ee811.jpg not downloaded yet
2026-03-28 19:00:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 8d6fdcfe-df6f-54fd-856d-5bd0bf94e8a2 with identifier: AR18023
2026-03-28 19:00:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 8d6fdcfe-df6f-54fd-856d-5bd0bf94e8a2 with identifier: AR18023
2026-03-28 19:00:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 8d6fdcfe-df6f-54fd-856d-5bd0bf94e8a2 with identifier: AR18023 to the API
2026-03-28 19:00:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 19:00:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 19:00:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/AR18023>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '3.0L',
 'engine_horse_power': 374,
 'expiration_date': '2026-03-30T15:52:55Z',
 'fuel_type': 'hybrid',
 'id': '8d6fdcfe-df6f-54fd-856d-5bd0bf94e8a2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'SG975H',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AR18023',
 'listing': 'auction',
 'location': 'NL, Oosterhout',
 'make': 'Audi',
 'model': 'Q7',
 'odometer': 127969,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img45/b0/45b0810dcbfe1865a2eda7452627ba3d/pa/AR18023_8819e543f1afb243ff651ff7398d4a7b.jpg',
                'https://img-pa.auto1.com/img45/b0/45b0810dcbfe1865a2eda7452627ba3d/pa/AR18023_08e666dcafba1715e56915beda683c99.jpg',
                'https://img-pa.auto1.com/img45/b0/45b0810dcbfe1865a2eda7452627ba3d/pa/AR18023_3d4b3873d36e8078e7ddc5b8c2f2e532.jpg',
                'https://img-pa.auto1.com/img45/b0/45b0810dcbfe1865a2eda7452627ba3d/pa/AR18023_eb4cf1e0393995077bc05712002b6e8a.jpg',
                'https://img-pa.auto1.com/img45/b0/45b0810dcbfe1865a2eda7452627ba3d/pa/AR18023_88832676b87d714d53dae94b57418231.jpg',
                'https://img-pa.auto1.com/img45/b0/45b0810dcbfe1865a2eda7452627ba3d/pa/AR18023_74ca5da8a465e2d3e2ff475557f0f324.jpg',
                'https://img-pa.auto1.com/img45/b0/45b0810dcbfe1865a2eda7452627ba3d/pa/AR18023_e340a2a2c6b159989e96e81864e3a2d1.jpg',
                'https://img-pa.auto1.com/img45/b0/45b0810dcbfe1865a2eda7452627ba3d/pa/AR18023_c68f2a6ecc688ea30fdebd945751aac6.jpg',
                'https://img-pa.auto1.com/img45/b0/45b0810dcbfe1865a2eda7452627ba3d/pa/AR18023_dcc190bdf8c71f1f46ad60a44fde7335.jpg',
                'https://img-pa.auto1.com/img45/b0/45b0810dcbfe1865a2eda7452627ba3d/pa/AR18023_054ab1d8ae9c64468a82b84b05993921.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d6fdcfe-df6f-54fd-856d-5bd0bf94e8a2/8d6fdcfe-df6f-54fd-856d-5bd0bf94e8a2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76264,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img45/b0/45b0810dcbfe1865a2eda7452627ba3d/pa/AR18023_8819e543f1afb243ff651ff7398d4a7b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d6fdcfe-df6f-54fd-856d-5bd0bf94e8a2/8d6fdcfe-df6f-54fd-856d-5bd0bf94e8a2_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2205692,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img45/b0/45b0810dcbfe1865a2eda7452627ba3d/pa/AR18023_08e666dcafba1715e56915beda683c99.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d6fdcfe-df6f-54fd-856d-5bd0bf94e8a2/8d6fdcfe-df6f-54fd-856d-5bd0bf94e8a2_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2123666,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img45/b0/45b0810dcbfe1865a2eda7452627ba3d/pa/AR18023_3d4b3873d36e8078e7ddc5b8c2f2e532.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d6fdcfe-df6f-54fd-856d-5bd0bf94e8a2/8d6fdcfe-df6f-54fd-856d-5bd0bf94e8a2_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2156307,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img45/b0/45b0810dcbfe1865a2eda7452627ba3d/pa/AR18023_eb4cf1e0393995077bc05712002b6e8a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d6fdcfe-df6f-54fd-856d-5bd0bf94e8a2/8d6fdcfe-df6f-54fd-856d-5bd0bf94e8a2_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2159462,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img45/b0/45b0810dcbfe1865a2eda7452627ba3d/pa/AR18023_88832676b87d714d53dae94b57418231.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d6fdcfe-df6f-54fd-856d-5bd0bf94e8a2/8d6fdcfe-df6f-54fd-856d-5bd0bf94e8a2_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2242195,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img45/b0/45b0810dcbfe1865a2eda7452627ba3d/pa/AR18023_74ca5da8a465e2d3e2ff475557f0f324.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d6fdcfe-df6f-54fd-856d-5bd0bf94e8a2/8d6fdcfe-df6f-54fd-856d-5bd0bf94e8a2_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58152,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img45/b0/45b0810dcbfe1865a2eda7452627ba3d/pa/AR18023_e340a2a2c6b159989e96e81864e3a2d1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d6fdcfe-df6f-54fd-856d-5bd0bf94e8a2/8d6fdcfe-df6f-54fd-856d-5bd0bf94e8a2_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69812,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img45/b0/45b0810dcbfe1865a2eda7452627ba3d/pa/AR18023_c68f2a6ecc688ea30fdebd945751aac6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d6fdcfe-df6f-54fd-856d-5bd0bf94e8a2/8d6fdcfe-df6f-54fd-856d-5bd0bf94e8a2_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73684,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img45/b0/45b0810dcbfe1865a2eda7452627ba3d/pa/AR18023_dcc190bdf8c71f1f46ad60a44fde7335.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d6fdcfe-df6f-54fd-856d-5bd0bf94e8a2/8d6fdcfe-df6f-54fd-856d-5bd0bf94e8a2_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63135,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img45/b0/45b0810dcbfe1865a2eda7452627ba3d/pa/AR18023_054ab1d8ae9c64468a82b84b05993921.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-02-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi Q7 3.0 TDI e-tron quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2017}
2026-03-28 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AR18023%27 HTTP/1.1" 200 None
2026-03-28 19:00:29 [auto1.nl] INFO: Saving data for AR18023: {'created_time': 1774724429.704676, 'last_price_update_time': 1774724429.704687, 'auction_closing_time': 1774885975.0}
2026-03-28 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='AR18023') HTTP/1.1" 204 0
2026-03-28 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252F2c%252F902cf57d5dd96447dd75b2cfb8d935af%252Fpa%252FMC92565_bdc4701ee40b542a8c3e7daf8946de4c.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:00:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/2c/902cf57d5dd96447dd75b2cfb8d935af/pa/MC92565_bdc4701ee40b542a8c3e7daf8946de4c.jpg not downloaded yet
2026-03-28 19:00:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ET47420/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 19:00:29 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252F2c%252F902cf57d5dd96447dd75b2cfb8d935af%252Fpa%252FMC92565_2aeff4f097e5234f55943a1b4edc6d13.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:00:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/2c/902cf57d5dd96447dd75b2cfb8d935af/pa/MC92565_2aeff4f097e5234f55943a1b4edc6d13.jpg not downloaded yet
2026-03-28 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252F2c%252F902cf57d5dd96447dd75b2cfb8d935af%252Fpa%252FMC92565_52fa99e224f21777ccd603166c7a9a82.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:00:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/2c/902cf57d5dd96447dd75b2cfb8d935af/pa/MC92565_52fa99e224f21777ccd603166c7a9a82.jpg not downloaded yet
2026-03-28 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252F2c%252F902cf57d5dd96447dd75b2cfb8d935af%252Fpa%252FMC92565_8262200d09a25c52b0103e5824762abf.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:00:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/2c/902cf57d5dd96447dd75b2cfb8d935af/pa/MC92565_8262200d09a25c52b0103e5824762abf.jpg not downloaded yet
2026-03-28 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252F2c%252F902cf57d5dd96447dd75b2cfb8d935af%252Fpa%252FMC92565_c70aa3f9a88942530ca0a38731dcdcf8.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:00:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/2c/902cf57d5dd96447dd75b2cfb8d935af/pa/MC92565_c70aa3f9a88942530ca0a38731dcdcf8.jpg not downloaded yet
2026-03-28 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252F2c%252F902cf57d5dd96447dd75b2cfb8d935af%252Fpa%252FMC92565_c2db1dfa98cb83221b3cc55e176e8111.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:00:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/2c/902cf57d5dd96447dd75b2cfb8d935af/pa/MC92565_c2db1dfa98cb83221b3cc55e176e8111.jpg not downloaded yet
2026-03-28 19:00:29 [auto1.nl] INFO: Channel: 24h | Page: 3 | totalHits: 647 | hits on page: 40
2026-03-28 19:00:29 [auto1.nl] INFO: Found listing with ID: TF89424
2026-03-28 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TF89424%27 HTTP/1.1" 200 None
2026-03-28 19:00:29 [auto1.nl] INFO: Scrape type for TF89424: 2
2026-03-28 19:00:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c46568cf-5996-58d7-b399-896c2a31ade2 with identifier: TF89424
2026-03-28 19:00:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c46568cf-5996-58d7-b399-896c2a31ade2 with scrape type 2
2026-03-28 19:00:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c46568cf-5996-58d7-b399-896c2a31ade2 with scrape type 2
2026-03-28 19:00:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: c46568cf-5996-58d7-b399-896c2a31ade2, identifier: TF89424
2026-03-28 19:00:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: c46568cf-5996-58d7-b399-896c2a31ade2 with identifier: TF89424
2026-03-28 19:00:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: c46568cf-5996-58d7-b399-896c2a31ade2 with identifier: TF89424
2026-03-28 19:00:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: c46568cf-5996-58d7-b399-896c2a31ade2 with identifier: TF89424 to the API
2026-03-28 19:00:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 19:00:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 19:00:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 145,
 'expiration_date': '2026-03-30T15:23:08Z',
 'fuel_type': 'petrol',
 'id': 'c46568cf-5996-58d7-b399-896c2a31ade2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TF89424',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A5 Sportback',
 'odometer': 147131,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-02-29',
 'seller_name': None,
 'title': 'Audi A5 Sportback 1.8 TFSI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2016}
2026-03-28 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TF89424%27 HTTP/1.1" 200 None
2026-03-28 19:00:31 [auto1.nl] INFO: Saving data for TF89424: {'auction_closing_time': 1774884188.0, 'created_time': 1773405907.997885, 'last_price_update_time': 1774724431.45727}
2026-03-28 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='TF89424') HTTP/1.1" 204 0
2026-03-28 19:00:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:00:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:00:31 [auto1.nl] INFO: Found listing with ID: PY50820
2026-03-28 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PY50820%27 HTTP/1.1" 200 None
2026-03-28 19:00:31 [auto1.nl] INFO: Scrape type for PY50820: 0
2026-03-28 19:00:31 [auto1.nl] INFO: Found listing with ID: DS36560
2026-03-28 19:00:31 [auto1.nl] INFO: Found listing with ID: RN50601
2026-03-28 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RN50601%27 HTTP/1.1" 200 None
2026-03-28 19:00:31 [auto1.nl] INFO: Scrape type for RN50601: 0
2026-03-28 19:00:31 [auto1.nl] INFO: Found listing with ID: YN14337
2026-03-28 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YN14337%27 HTTP/1.1" 200 None
2026-03-28 19:00:31 [auto1.nl] INFO: Scrape type for YN14337: 0
2026-03-28 19:00:31 [auto1.nl] INFO: Found listing with ID: LN13615
2026-03-28 19:00:31 [auto1.nl] INFO: Found listing with ID: UD40907
2026-03-28 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UD40907%27 HTTP/1.1" 200 None
2026-03-28 19:00:31 [auto1.nl] INFO: Scrape type for UD40907: 0
2026-03-28 19:00:31 [auto1.nl] INFO: Found listing with ID: MB44193
2026-03-28 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MB44193%27 HTTP/1.1" 200 None
2026-03-28 19:00:31 [auto1.nl] INFO: Scrape type for MB44193: 0
2026-03-28 19:00:31 [auto1.nl] INFO: Found listing with ID: LG57021
2026-03-28 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LG57021%27 HTTP/1.1" 200 None
2026-03-28 19:00:31 [auto1.nl] INFO: Scrape type for LG57021: 0
2026-03-28 19:00:31 [auto1.nl] INFO: Found listing with ID: NZ51488
2026-03-28 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NZ51488%27 HTTP/1.1" 200 None
2026-03-28 19:00:31 [auto1.nl] INFO: Scrape type for NZ51488: 0
2026-03-28 19:00:31 [auto1.nl] INFO: Found listing with ID: EK85406
2026-03-28 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EK85406%27 HTTP/1.1" 200 None
2026-03-28 19:00:31 [auto1.nl] INFO: Scrape type for EK85406: 0
2026-03-28 19:00:31 [auto1.nl] INFO: Found listing with ID: RC74760
2026-03-28 19:00:31 [auto1.nl] INFO: Found listing with ID: BW31181
2026-03-28 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BW31181%27 HTTP/1.1" 200 None
2026-03-28 19:00:31 [auto1.nl] INFO: Scrape type for BW31181: 0
2026-03-28 19:00:31 [auto1.nl] INFO: Found listing with ID: VM45476
2026-03-28 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VM45476%27 HTTP/1.1" 200 None
2026-03-28 19:00:31 [auto1.nl] INFO: Scrape type for VM45476: 2
2026-03-28 19:00:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5834ca94-a5e7-5a67-9ecb-5c757b878c10 with identifier: VM45476
2026-03-28 19:00:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5834ca94-a5e7-5a67-9ecb-5c757b878c10 with scrape type 2
2026-03-28 19:00:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5834ca94-a5e7-5a67-9ecb-5c757b878c10 with scrape type 2
2026-03-28 19:00:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 5834ca94-a5e7-5a67-9ecb-5c757b878c10, identifier: VM45476
2026-03-28 19:00:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 5834ca94-a5e7-5a67-9ecb-5c757b878c10 with identifier: VM45476
2026-03-28 19:00:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 19:00:31 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=blue HTTP/1.1" 200 None
2026-03-28 19:00:31 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 19:00:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 5834ca94-a5e7-5a67-9ecb-5c757b878c10 with identifier: VM45476
2026-03-28 19:00:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 5834ca94-a5e7-5a67-9ecb-5c757b878c10 with identifier: VM45476 to the API
2026-03-28 19:00:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 19:00:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 19:00:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 309,
 'expiration_date': '2026-03-30T15:42:22Z',
 'fuel_type': 'hybrid',
 'id': '5834ca94-a5e7-5a67-9ecb-5c757b878c10',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VM45476',
 'listing': 'auction',
 'make': 'Land Rover',
 'model': 'Discovery Sport',
 'odometer': 80148,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-22',
 'seller_name': None,
 'title': 'Land Rover Discovery Sport P300e Hybrid R-Dynamic SE AWD',
 'transmission': 'automatic',
 'trim': 'R-Dynamic SE AWD',
 'year': 2021}
2026-03-28 19:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VM45476%27 HTTP/1.1" 200 None
2026-03-28 19:00:32 [auto1.nl] INFO: Saving data for VM45476: {'auction_closing_time': 1774885342.0, 'created_time': 1774292523.0696, 'last_price_update_time': 1774724432.787901}
2026-03-28 19:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='VM45476') HTTP/1.1" 204 0
2026-03-28 19:00:32 [auto1.nl] INFO: Found listing with ID: KA53212
2026-03-28 19:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KA53212%27 HTTP/1.1" 200 None
2026-03-28 19:00:32 [auto1.nl] INFO: Scrape type for KA53212: 0
2026-03-28 19:00:32 [auto1.nl] INFO: Found listing with ID: VL07732
2026-03-28 19:00:32 [auto1.nl] INFO: Found listing with ID: RX80263
2026-03-28 19:00:32 [auto1.nl] INFO: Found listing with ID: GL59810
2026-03-28 19:00:32 [auto1.nl] INFO: Found listing with ID: DG66253
2026-03-28 19:00:32 [auto1.nl] INFO: Found listing with ID: CF65603
2026-03-28 19:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CF65603%27 HTTP/1.1" 200 None
2026-03-28 19:00:32 [auto1.nl] INFO: Scrape type for CF65603: 0
2026-03-28 19:00:32 [auto1.nl] INFO: Found listing with ID: GD99184
2026-03-28 19:00:32 [auto1.nl] INFO: Found listing with ID: FD12318
2026-03-28 19:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FD12318%27 HTTP/1.1" 200 None
2026-03-28 19:00:32 [auto1.nl] INFO: Scrape type for FD12318: 0
2026-03-28 19:00:32 [auto1.nl] INFO: Found listing with ID: RT28324
2026-03-28 19:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RT28324%27 HTTP/1.1" 200 None
2026-03-28 19:00:32 [auto1.nl] INFO: Scrape type for RT28324: 2
2026-03-28 19:00:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 30da8169-e641-50bf-af5a-57af04ba4990 with identifier: RT28324
2026-03-28 19:00:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 30da8169-e641-50bf-af5a-57af04ba4990 with scrape type 2
2026-03-28 19:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 30da8169-e641-50bf-af5a-57af04ba4990 with scrape type 2
2026-03-28 19:00:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 30da8169-e641-50bf-af5a-57af04ba4990, identifier: RT28324
2026-03-28 19:00:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 30da8169-e641-50bf-af5a-57af04ba4990 with identifier: RT28324
2026-03-28 19:00:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 30da8169-e641-50bf-af5a-57af04ba4990 with identifier: RT28324
2026-03-28 19:00:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 30da8169-e641-50bf-af5a-57af04ba4990 with identifier: RT28324 to the API
2026-03-28 19:00:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 19:00:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 19:00:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:33:39Z',
 'fuel_type': 'petrol',
 'id': '30da8169-e641-50bf-af5a-57af04ba4990',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RT28324',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 50150,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-06-05',
 'seller_name': None,
 'title': 'BMW X1 sDrive 18i',
 'transmission': 'manual',
 'trim': '',
 'year': 2012}
2026-03-28 19:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RT28324%27 HTTP/1.1" 200 None
2026-03-28 19:00:33 [auto1.nl] INFO: Saving data for RT28324: {'auction_closing_time': 1774884819.0, 'created_time': 1774526506.285307, 'last_price_update_time': 1774724433.408641}
2026-03-28 19:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='RT28324') HTTP/1.1" 204 0
2026-03-28 19:00:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img90/2c/902cf57d5dd96447dd75b2cfb8d935af/pa/MC92565_561cbff269c462206622c3e36afdf50e.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:00:33 [auto1.nl] INFO: Found listing with ID: ZP12059
2026-03-28 19:00:33 [auto1.nl] INFO: Found listing with ID: ML63258
2026-03-28 19:00:33 [auto1.nl] INFO: Found listing with ID: RA23366
2026-03-28 19:00:33 [auto1.nl] INFO: Found listing with ID: NX47084
2026-03-28 19:00:33 [auto1.nl] INFO: Found listing with ID: JR89598
2026-03-28 19:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JR89598%27 HTTP/1.1" 200 None
2026-03-28 19:00:33 [auto1.nl] INFO: Scrape type for JR89598: 0
2026-03-28 19:00:33 [auto1.nl] INFO: Found listing with ID: EY85081
2026-03-28 19:00:33 [auto1.nl] INFO: Found listing with ID: MW16655
2026-03-28 19:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MW16655%27 HTTP/1.1" 200 None
2026-03-28 19:00:33 [auto1.nl] INFO: Scrape type for MW16655: 2
2026-03-28 19:00:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a035ded3-6a3d-5870-8819-bb065735b37f with identifier: MW16655
2026-03-28 19:00:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a035ded3-6a3d-5870-8819-bb065735b37f with scrape type 2
2026-03-28 19:00:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a035ded3-6a3d-5870-8819-bb065735b37f with scrape type 2
2026-03-28 19:00:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: a035ded3-6a3d-5870-8819-bb065735b37f, identifier: MW16655
2026-03-28 19:00:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: a035ded3-6a3d-5870-8819-bb065735b37f with identifier: MW16655
2026-03-28 19:00:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 19:00:33 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=white HTTP/1.1" 200 None
2026-03-28 19:00:33 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 19:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 19:00:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: a035ded3-6a3d-5870-8819-bb065735b37f with identifier: MW16655
2026-03-28 19:00:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: a035ded3-6a3d-5870-8819-bb065735b37f with identifier: MW16655 to the API
2026-03-28 19:00:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 19:00:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 19:00:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:24:51Z',
 'fuel_type': 'petrol',
 'id': 'a035ded3-6a3d-5870-8819-bb065735b37f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MW16655',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500',
 'odometer': 55843,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-05-17',
 'seller_name': None,
 'title': 'Fiat 500 1.2 Lounge',
 'transmission': 'automatic',
 'trim': 'Lounge',
 'year': 2010}
2026-03-28 19:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MW16655%27 HTTP/1.1" 200 None
2026-03-28 19:00:33 [auto1.nl] INFO: Saving data for MW16655: {'auction_closing_time': 1774884291.0, 'created_time': 1774526487.240626, 'last_price_update_time': 1774724433.972757}
2026-03-28 19:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='MW16655') HTTP/1.1" 204 0
2026-03-28 19:00:34 [auto1.nl] INFO: Found listing with ID: XY67301
2026-03-28 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XY67301%27 HTTP/1.1" 200 None
2026-03-28 19:00:34 [auto1.nl] INFO: Scrape type for XY67301: 0
2026-03-28 19:00:34 [auto1.nl] INFO: Found listing with ID: ET49040
2026-03-28 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ET49040%27 HTTP/1.1" 200 None
2026-03-28 19:00:34 [auto1.nl] INFO: Scrape type for ET49040: 0
2026-03-28 19:00:34 [auto1.nl] INFO: Found listing with ID: AC84495
2026-03-28 19:00:34 [auto1.nl] INFO: Found listing with ID: WV54622
2026-03-28 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WV54622%27 HTTP/1.1" 200 None
2026-03-28 19:00:34 [auto1.nl] INFO: Scrape type for WV54622: 0
2026-03-28 19:00:34 [auto1.nl] INFO: Found listing with ID: TN92622
2026-03-28 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TN92622%27 HTTP/1.1" 200 None
2026-03-28 19:00:34 [auto1.nl] INFO: Scrape type for TN92622: 0
2026-03-28 19:00:34 [auto1.nl] INFO: Found listing with ID: FK48987
2026-03-28 19:00:34 [auto1.nl] INFO: Found listing with ID: MD18353
2026-03-28 19:00:34 [auto1.nl] INFO: Found listing with ID: PM71197
2026-03-28 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PM71197%27 HTTP/1.1" 200 None
2026-03-28 19:00:34 [auto1.nl] INFO: Scrape type for PM71197: 0
2026-03-28 19:00:34 [auto1.nl] INFO: Found listing with ID: FP18275
2026-03-28 19:00:34 [auto1.nl] INFO: Found listing with ID: BV58634
2026-03-28 19:00:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img90/2c/902cf57d5dd96447dd75b2cfb8d935af/pa/MC92565_2aeff4f097e5234f55943a1b4edc6d13.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:00:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img90/2c/902cf57d5dd96447dd75b2cfb8d935af/pa/MC92565_8262200d09a25c52b0103e5824762abf.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:00:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-03-28 19:00:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-03-28 19:00:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:00:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bd72dad90>
2026-03-28 19:00:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:00:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-28 19:00:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2113
2026-03-28 19:00:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-03-28 19:00:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:00:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:00:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b663251-2061-5ae3-8887-c9b9d3ac403b/3b663251-2061-5ae3-8887-c9b9d3ac403b_image_0.jpg HTTP/1.1" 201 0
2026-03-28 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252F2c%252F902cf57d5dd96447dd75b2cfb8d935af%252Fpa%252FMC92565_561cbff269c462206622c3e36afdf50e.jpg') HTTP/1.1" 204 0
2026-03-28 19:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/2c/902cf57d5dd96447dd75b2cfb8d935af/pa/MC92565_561cbff269c462206622c3e36afdf50e.jpg saved to cache
2026-03-28 19:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3b663251-2061-5ae3-8887-c9b9d3ac403b
2026-03-28 19:00:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img90/2c/902cf57d5dd96447dd75b2cfb8d935af/pa/MC92565_c70aa3f9a88942530ca0a38731dcdcf8.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:00:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:00:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bd7213f10>
2026-03-28 19:00:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:00:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:00:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:00:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b663251-2061-5ae3-8887-c9b9d3ac403b/3b663251-2061-5ae3-8887-c9b9d3ac403b_image_5.jpg HTTP/1.1" 201 0
2026-03-28 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252F2c%252F902cf57d5dd96447dd75b2cfb8d935af%252Fpa%252FMC92565_2aeff4f097e5234f55943a1b4edc6d13.jpg') HTTP/1.1" 204 0
2026-03-28 19:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/2c/902cf57d5dd96447dd75b2cfb8d935af/pa/MC92565_2aeff4f097e5234f55943a1b4edc6d13.jpg saved to cache
2026-03-28 19:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3b663251-2061-5ae3-8887-c9b9d3ac403b
2026-03-28 19:00:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:00:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bdd3b7b50>
2026-03-28 19:00:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:00:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:00:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:00:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b663251-2061-5ae3-8887-c9b9d3ac403b/3b663251-2061-5ae3-8887-c9b9d3ac403b_image_7.jpg HTTP/1.1" 201 0
2026-03-28 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252F2c%252F902cf57d5dd96447dd75b2cfb8d935af%252Fpa%252FMC92565_8262200d09a25c52b0103e5824762abf.jpg') HTTP/1.1" 204 0
2026-03-28 19:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/2c/902cf57d5dd96447dd75b2cfb8d935af/pa/MC92565_8262200d09a25c52b0103e5824762abf.jpg saved to cache
2026-03-28 19:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3b663251-2061-5ae3-8887-c9b9d3ac403b
2026-03-28 19:00:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:00:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bd728bc10>
2026-03-28 19:00:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:00:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:00:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:00:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b663251-2061-5ae3-8887-c9b9d3ac403b/3b663251-2061-5ae3-8887-c9b9d3ac403b_image_8.jpg HTTP/1.1" 201 0
2026-03-28 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252F2c%252F902cf57d5dd96447dd75b2cfb8d935af%252Fpa%252FMC92565_c70aa3f9a88942530ca0a38731dcdcf8.jpg') HTTP/1.1" 204 0
2026-03-28 19:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/2c/902cf57d5dd96447dd75b2cfb8d935af/pa/MC92565_c70aa3f9a88942530ca0a38731dcdcf8.jpg saved to cache
2026-03-28 19:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3b663251-2061-5ae3-8887-c9b9d3ac403b
2026-03-28 19:00:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img90/2c/902cf57d5dd96447dd75b2cfb8d935af/pa/MC92565_fb27762e9f2cdc2f2a498fa0aa1f0a77.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:00:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img90/2c/902cf57d5dd96447dd75b2cfb8d935af/pa/MC92565_bdc4701ee40b542a8c3e7daf8946de4c.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:00:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img90/2c/902cf57d5dd96447dd75b2cfb8d935af/pa/MC92565_a6619ccd5ca8a22a8d35fc8d9c1ee811.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:00:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img90/2c/902cf57d5dd96447dd75b2cfb8d935af/pa/MC92565_f9c52d2f5b04e3fcb4c53545afcff3d4.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:00:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img90/2c/902cf57d5dd96447dd75b2cfb8d935af/pa/MC92565_52fa99e224f21777ccd603166c7a9a82.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:00:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img90/2c/902cf57d5dd96447dd75b2cfb8d935af/pa/MC92565_c2db1dfa98cb83221b3cc55e176e8111.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:00:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 19:00:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:00:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bd72c46d0>
2026-03-28 19:00:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:00:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:00:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:00:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b663251-2061-5ae3-8887-c9b9d3ac403b/3b663251-2061-5ae3-8887-c9b9d3ac403b_image_2.jpg HTTP/1.1" 201 0
2026-03-28 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252F2c%252F902cf57d5dd96447dd75b2cfb8d935af%252Fpa%252FMC92565_fb27762e9f2cdc2f2a498fa0aa1f0a77.jpg') HTTP/1.1" 204 0
2026-03-28 19:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/2c/902cf57d5dd96447dd75b2cfb8d935af/pa/MC92565_fb27762e9f2cdc2f2a498fa0aa1f0a77.jpg saved to cache
2026-03-28 19:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3b663251-2061-5ae3-8887-c9b9d3ac403b
2026-03-28 19:00:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 19:00:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:00:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bd72805d0>
2026-03-28 19:00:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:00:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:00:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:00:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b663251-2061-5ae3-8887-c9b9d3ac403b/3b663251-2061-5ae3-8887-c9b9d3ac403b_image_4.jpg HTTP/1.1" 201 0
2026-03-28 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252F2c%252F902cf57d5dd96447dd75b2cfb8d935af%252Fpa%252FMC92565_bdc4701ee40b542a8c3e7daf8946de4c.jpg') HTTP/1.1" 204 0
2026-03-28 19:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/2c/902cf57d5dd96447dd75b2cfb8d935af/pa/MC92565_bdc4701ee40b542a8c3e7daf8946de4c.jpg saved to cache
2026-03-28 19:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3b663251-2061-5ae3-8887-c9b9d3ac403b
2026-03-28 19:00:35 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 19:00:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 19:00:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:00:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bd72d1790>
2026-03-28 19:00:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:00:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:00:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:00:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b663251-2061-5ae3-8887-c9b9d3ac403b/3b663251-2061-5ae3-8887-c9b9d3ac403b_image_3.jpg HTTP/1.1" 201 0
2026-03-28 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252F2c%252F902cf57d5dd96447dd75b2cfb8d935af%252Fpa%252FMC92565_a6619ccd5ca8a22a8d35fc8d9c1ee811.jpg') HTTP/1.1" 204 0
2026-03-28 19:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/2c/902cf57d5dd96447dd75b2cfb8d935af/pa/MC92565_a6619ccd5ca8a22a8d35fc8d9c1ee811.jpg saved to cache
2026-03-28 19:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3b663251-2061-5ae3-8887-c9b9d3ac403b
2026-03-28 19:00:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 19:00:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:00:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bd72417d0>
2026-03-28 19:00:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:00:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:00:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:00:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b663251-2061-5ae3-8887-c9b9d3ac403b/3b663251-2061-5ae3-8887-c9b9d3ac403b_image_1.jpg HTTP/1.1" 201 0
2026-03-28 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252F2c%252F902cf57d5dd96447dd75b2cfb8d935af%252Fpa%252FMC92565_f9c52d2f5b04e3fcb4c53545afcff3d4.jpg') HTTP/1.1" 204 0
2026-03-28 19:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/2c/902cf57d5dd96447dd75b2cfb8d935af/pa/MC92565_f9c52d2f5b04e3fcb4c53545afcff3d4.jpg saved to cache
2026-03-28 19:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3b663251-2061-5ae3-8887-c9b9d3ac403b
2026-03-28 19:00:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 19:00:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:00:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bdd205190>
2026-03-28 19:00:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:00:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:00:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:00:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b663251-2061-5ae3-8887-c9b9d3ac403b/3b663251-2061-5ae3-8887-c9b9d3ac403b_image_6.jpg HTTP/1.1" 201 0
2026-03-28 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252F2c%252F902cf57d5dd96447dd75b2cfb8d935af%252Fpa%252FMC92565_52fa99e224f21777ccd603166c7a9a82.jpg') HTTP/1.1" 204 0
2026-03-28 19:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/2c/902cf57d5dd96447dd75b2cfb8d935af/pa/MC92565_52fa99e224f21777ccd603166c7a9a82.jpg saved to cache
2026-03-28 19:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3b663251-2061-5ae3-8887-c9b9d3ac403b
2026-03-28 19:00:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:00:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bdd20c6d0>
2026-03-28 19:00:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:00:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:00:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:00:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b663251-2061-5ae3-8887-c9b9d3ac403b/3b663251-2061-5ae3-8887-c9b9d3ac403b_image_9.jpg HTTP/1.1" 201 0
2026-03-28 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252F2c%252F902cf57d5dd96447dd75b2cfb8d935af%252Fpa%252FMC92565_c2db1dfa98cb83221b3cc55e176e8111.jpg') HTTP/1.1" 204 0
2026-03-28 19:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/2c/902cf57d5dd96447dd75b2cfb8d935af/pa/MC92565_c2db1dfa98cb83221b3cc55e176e8111.jpg saved to cache
2026-03-28 19:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3b663251-2061-5ae3-8887-c9b9d3ac403b
2026-03-28 19:00:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3b663251-2061-5ae3-8887-c9b9d3ac403b, skipping ID generation
2026-03-28 19:00:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3b663251-2061-5ae3-8887-c9b9d3ac403b with scrape type 1
2026-03-28 19:00:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3b663251-2061-5ae3-8887-c9b9d3ac403b sending to next pipeline
2026-03-28 19:00:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 3b663251-2061-5ae3-8887-c9b9d3ac403b, identifier: MC92565
2026-03-28 19:00:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 3b663251-2061-5ae3-8887-c9b9d3ac403b with identifier: MC92565
2026-03-28 19:00:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 3b663251-2061-5ae3-8887-c9b9d3ac403b with identifier: MC92565
2026-03-28 19:00:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 3b663251-2061-5ae3-8887-c9b9d3ac403b with identifier: MC92565 to the API
2026-03-28 19:00:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 19:00:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 19:00:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img90/2c/902cf57d5dd96447dd75b2cfb8d935af/pa/MC92565_c2db1dfa98cb83221b3cc55e176e8111.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 149,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 4',
 'engine': '3.0L',
 'engine_horse_power': 205,
 'expiration_date': '2026-03-30T15:22:39Z',
 'fuel_type': 'diesel',
 'id': '3b663251-2061-5ae3-8887-c9b9d3ac403b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'ZD813B',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MC92565',
 'listing': 'auction',
 'location': 'NL, Eindhoven',
 'make': 'Mercedes-Benz',
 'model': 'Viano',
 'odometer': 260330,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b663251-2061-5ae3-8887-c9b9d3ac403b/3b663251-2061-5ae3-8887-c9b9d3ac403b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84876,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img90/2c/902cf57d5dd96447dd75b2cfb8d935af/pa/MC92565_561cbff269c462206622c3e36afdf50e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b663251-2061-5ae3-8887-c9b9d3ac403b/3b663251-2061-5ae3-8887-c9b9d3ac403b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2409237,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img90/2c/902cf57d5dd96447dd75b2cfb8d935af/pa/MC92565_f9c52d2f5b04e3fcb4c53545afcff3d4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b663251-2061-5ae3-8887-c9b9d3ac403b/3b663251-2061-5ae3-8887-c9b9d3ac403b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2109973,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img90/2c/902cf57d5dd96447dd75b2cfb8d935af/pa/MC92565_fb27762e9f2cdc2f2a498fa0aa1f0a77.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b663251-2061-5ae3-8887-c9b9d3ac403b/3b663251-2061-5ae3-8887-c9b9d3ac403b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2338510,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img90/2c/902cf57d5dd96447dd75b2cfb8d935af/pa/MC92565_a6619ccd5ca8a22a8d35fc8d9c1ee811.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b663251-2061-5ae3-8887-c9b9d3ac403b/3b663251-2061-5ae3-8887-c9b9d3ac403b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2174303,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img90/2c/902cf57d5dd96447dd75b2cfb8d935af/pa/MC92565_bdc4701ee40b542a8c3e7daf8946de4c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b663251-2061-5ae3-8887-c9b9d3ac403b/3b663251-2061-5ae3-8887-c9b9d3ac403b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73852,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img90/2c/902cf57d5dd96447dd75b2cfb8d935af/pa/MC92565_2aeff4f097e5234f55943a1b4edc6d13.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b663251-2061-5ae3-8887-c9b9d3ac403b/3b663251-2061-5ae3-8887-c9b9d3ac403b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2302261,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img90/2c/902cf57d5dd96447dd75b2cfb8d935af/pa/MC92565_52fa99e224f21777ccd603166c7a9a82.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b663251-2061-5ae3-8887-c9b9d3ac403b/3b663251-2061-5ae3-8887-c9b9d3ac403b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81260,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img90/2c/902cf57d5dd96447dd75b2cfb8d935af/pa/MC92565_8262200d09a25c52b0103e5824762abf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b663251-2061-5ae3-8887-c9b9d3ac403b/3b663251-2061-5ae3-8887-c9b9d3ac403b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77822,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img90/2c/902cf57d5dd96447dd75b2cfb8d935af/pa/MC92565_c70aa3f9a88942530ca0a38731dcdcf8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b663251-2061-5ae3-8887-c9b9d3ac403b/3b663251-2061-5ae3-8887-c9b9d3ac403b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66741,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img90/2c/902cf57d5dd96447dd75b2cfb8d935af/pa/MC92565_c2db1dfa98cb83221b3cc55e176e8111.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2007-01-24',
 'seats_number': 6,
 'seller_name': None,
 'title': 'Mercedes-Benz Viano 3.0 CDI kompakt Trend',
 'transmission': 'automatic',
 'trim': 'kompakt Trend',
 'year': 2007}
2026-03-28 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MC92565%27 HTTP/1.1" 200 None
2026-03-28 19:00:36 [auto1.nl] INFO: Saving data for MC92565: {'created_time': 1774724436.09668, 'last_price_update_time': 1774724436.096691, 'auction_closing_time': 1774884159.0}
2026-03-28 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='MC92565') HTTP/1.1" 204 0
2026-03-28 19:00:36 [auto1.nl] INFO: Channel: 24h | Page: 4 | totalHits: 647 | hits on page: 40
2026-03-28 19:00:36 [auto1.nl] INFO: Found listing with ID: SE99372
2026-03-28 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SE99372%27 HTTP/1.1" 200 None
2026-03-28 19:00:36 [auto1.nl] INFO: Scrape type for SE99372: 1
2026-03-28 19:00:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:00:36 [auto1.nl] INFO: Found listing with ID: JM47469
2026-03-28 19:00:36 [auto1.nl] INFO: Found listing with ID: FL63517
2026-03-28 19:00:36 [auto1.nl] INFO: Found listing with ID: BZ34461
2026-03-28 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BZ34461%27 HTTP/1.1" 200 None
2026-03-28 19:00:36 [auto1.nl] INFO: Scrape type for BZ34461: 0
2026-03-28 19:00:36 [auto1.nl] INFO: Found listing with ID: BM96536
2026-03-28 19:00:36 [auto1.nl] INFO: Found listing with ID: MY95801
2026-03-28 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MY95801%27 HTTP/1.1" 200 None
2026-03-28 19:00:36 [auto1.nl] INFO: Scrape type for MY95801: 2
2026-03-28 19:00:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fdf7c4a4-d51c-5b5d-91c1-a0a2dba73acd with identifier: MY95801
2026-03-28 19:00:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fdf7c4a4-d51c-5b5d-91c1-a0a2dba73acd with scrape type 2
2026-03-28 19:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fdf7c4a4-d51c-5b5d-91c1-a0a2dba73acd with scrape type 2
2026-03-28 19:00:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: fdf7c4a4-d51c-5b5d-91c1-a0a2dba73acd, identifier: MY95801
2026-03-28 19:00:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: fdf7c4a4-d51c-5b5d-91c1-a0a2dba73acd with identifier: MY95801
2026-03-28 19:00:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: fdf7c4a4-d51c-5b5d-91c1-a0a2dba73acd with identifier: MY95801
2026-03-28 19:00:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: fdf7c4a4-d51c-5b5d-91c1-a0a2dba73acd with identifier: MY95801 to the API
2026-03-28 19:00:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 19:00:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 19:00:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:59:01Z',
 'fuel_type': 'petrol',
 'id': 'fdf7c4a4-d51c-5b5d-91c1-a0a2dba73acd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MY95801',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 85105,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-03-29',
 'seller_name': None,
 'title': 'BMW 5er 520i M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2018}
2026-03-28 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MY95801%27 HTTP/1.1" 200 None
2026-03-28 19:00:36 [auto1.nl] INFO: Saving data for MY95801: {'auction_closing_time': 1774886341.0, 'created_time': 1774526473.15677, 'last_price_update_time': 1774724436.635768}
2026-03-28 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='MY95801') HTTP/1.1" 204 0
2026-03-28 19:00:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:00:36 [auto1.nl] INFO: Found listing with ID: WP95967
2026-03-28 19:00:36 [auto1.nl] INFO: Found listing with ID: XV01386
2026-03-28 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XV01386%27 HTTP/1.1" 200 None
2026-03-28 19:00:36 [auto1.nl] INFO: Scrape type for XV01386: 0
2026-03-28 19:00:36 [auto1.nl] INFO: Found listing with ID: MD48743
2026-03-28 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MD48743%27 HTTP/1.1" 200 None
2026-03-28 19:00:36 [auto1.nl] INFO: Scrape type for MD48743: 0
2026-03-28 19:00:36 [auto1.nl] INFO: Found listing with ID: ZL63379
2026-03-28 19:00:36 [auto1.nl] INFO: Found listing with ID: MW60386
2026-03-28 19:00:36 [auto1.nl] INFO: Found listing with ID: DY48945
2026-03-28 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DY48945%27 HTTP/1.1" 200 None
2026-03-28 19:00:36 [auto1.nl] INFO: Scrape type for DY48945: 0
2026-03-28 19:00:36 [auto1.nl] INFO: Found listing with ID: CM00428
2026-03-28 19:00:36 [auto1.nl] INFO: Found listing with ID: GW56825
2026-03-28 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GW56825%27 HTTP/1.1" 200 None
2026-03-28 19:00:36 [auto1.nl] INFO: Scrape type for GW56825: 0
2026-03-28 19:00:36 [auto1.nl] INFO: Found listing with ID: WD65994
2026-03-28 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WD65994%27 HTTP/1.1" 200 None
2026-03-28 19:00:36 [auto1.nl] INFO: Scrape type for WD65994: 0
2026-03-28 19:00:36 [auto1.nl] INFO: Found listing with ID: LD78562
2026-03-28 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LD78562%27 HTTP/1.1" 200 None
2026-03-28 19:00:36 [auto1.nl] INFO: Scrape type for LD78562: 2
2026-03-28 19:00:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5727513d-93cb-5a28-a9c2-3deb89ee0476 with identifier: LD78562
2026-03-28 19:00:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5727513d-93cb-5a28-a9c2-3deb89ee0476 with scrape type 2
2026-03-28 19:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5727513d-93cb-5a28-a9c2-3deb89ee0476 with scrape type 2
2026-03-28 19:00:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 5727513d-93cb-5a28-a9c2-3deb89ee0476, identifier: LD78562
2026-03-28 19:00:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 5727513d-93cb-5a28-a9c2-3deb89ee0476 with identifier: LD78562
2026-03-28 19:00:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 5727513d-93cb-5a28-a9c2-3deb89ee0476 with identifier: LD78562
2026-03-28 19:00:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 5727513d-93cb-5a28-a9c2-3deb89ee0476 with identifier: LD78562 to the API
2026-03-28 19:00:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 19:00:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 19:00:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-30T15:05:37Z',
 'fuel_type': 'petrol',
 'id': '5727513d-93cb-5a28-a9c2-3deb89ee0476',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LD78562',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 295518,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-02-27',
 'seller_name': None,
 'title': 'Seat Leon 1.6 Reference',
 'transmission': 'manual',
 'trim': 'Reference',
 'year': 2006}
2026-03-28 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LD78562%27 HTTP/1.1" 200 None
2026-03-28 19:00:37 [auto1.nl] INFO: Saving data for LD78562: {'auction_closing_time': 1774883137.0, 'created_time': 1774001973.259294, 'last_price_update_time': 1774724437.305473}
2026-03-28 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='LD78562') HTTP/1.1" 204 0
2026-03-28 19:00:37 [auto1.nl] INFO: Found listing with ID: LK58980
2026-03-28 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LK58980%27 HTTP/1.1" 200 None
2026-03-28 19:00:37 [auto1.nl] INFO: Scrape type for LK58980: 0
2026-03-28 19:00:37 [auto1.nl] INFO: Found listing with ID: FJ00169
2026-03-28 19:00:37 [auto1.nl] INFO: Found listing with ID: NL71418
2026-03-28 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NL71418%27 HTTP/1.1" 200 None
2026-03-28 19:00:37 [auto1.nl] INFO: Scrape type for NL71418: 0
2026-03-28 19:00:37 [auto1.nl] INFO: Found listing with ID: GP63449
2026-03-28 19:00:37 [auto1.nl] INFO: Found listing with ID: BZ75535
2026-03-28 19:00:37 [auto1.nl] INFO: Found listing with ID: FD60713
2026-03-28 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FD60713%27 HTTP/1.1" 200 None
2026-03-28 19:00:37 [auto1.nl] INFO: Scrape type for FD60713: 0
2026-03-28 19:00:37 [auto1.nl] INFO: Found listing with ID: GD83498
2026-03-28 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GD83498%27 HTTP/1.1" 200 None
2026-03-28 19:00:37 [auto1.nl] INFO: Scrape type for GD83498: 0
2026-03-28 19:00:37 [auto1.nl] INFO: Found listing with ID: CM82546
2026-03-28 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CM82546%27 HTTP/1.1" 200 None
2026-03-28 19:00:37 [auto1.nl] INFO: Scrape type for CM82546: 0
2026-03-28 19:00:37 [auto1.nl] INFO: Found listing with ID: DH15529
2026-03-28 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DH15529%27 HTTP/1.1" 200 None
2026-03-28 19:00:37 [auto1.nl] INFO: Scrape type for DH15529: 0
2026-03-28 19:00:37 [auto1.nl] INFO: Found listing with ID: YW81523
2026-03-28 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YW81523%27 HTTP/1.1" 200 None
2026-03-28 19:00:37 [auto1.nl] INFO: Scrape type for YW81523: 2
2026-03-28 19:00:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 382aef13-4829-597e-9f28-b53e227c1782 with identifier: YW81523
2026-03-28 19:00:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 382aef13-4829-597e-9f28-b53e227c1782 with scrape type 2
2026-03-28 19:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 382aef13-4829-597e-9f28-b53e227c1782 with scrape type 2
2026-03-28 19:00:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 382aef13-4829-597e-9f28-b53e227c1782, identifier: YW81523
2026-03-28 19:00:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 382aef13-4829-597e-9f28-b53e227c1782 with identifier: YW81523
2026-03-28 19:00:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 382aef13-4829-597e-9f28-b53e227c1782 with identifier: YW81523
2026-03-28 19:00:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 382aef13-4829-597e-9f28-b53e227c1782 with identifier: YW81523 to the API
2026-03-28 19:00:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 19:00:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 19:00:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:38:43Z',
 'fuel_type': 'petrol',
 'id': '382aef13-4829-597e-9f28-b53e227c1782',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YW81523',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'CLA-Klasse',
 'odometer': 193516,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-06-24',
 'seller_name': None,
 'title': 'Mercedes-Benz CLA-Klasse CLA 180 AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2018}
2026-03-28 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YW81523%27 HTTP/1.1" 200 None
2026-03-28 19:00:37 [auto1.nl] INFO: Saving data for YW81523: {'auction_closing_time': 1774885123.0, 'created_time': 1774526430.613596, 'last_price_update_time': 1774724437.912929}
2026-03-28 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='YW81523') HTTP/1.1" 204 0
2026-03-28 19:00:38 [auto1.nl] INFO: Found listing with ID: KK56723
2026-03-28 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KK56723%27 HTTP/1.1" 200 None
2026-03-28 19:00:38 [auto1.nl] INFO: Scrape type for KK56723: 2
2026-03-28 19:00:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2e6af16e-6a59-5bee-bde9-300e33c2eab8 with identifier: KK56723
2026-03-28 19:00:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2e6af16e-6a59-5bee-bde9-300e33c2eab8 with scrape type 2
2026-03-28 19:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2e6af16e-6a59-5bee-bde9-300e33c2eab8 with scrape type 2
2026-03-28 19:00:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 2e6af16e-6a59-5bee-bde9-300e33c2eab8, identifier: KK56723
2026-03-28 19:00:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 2e6af16e-6a59-5bee-bde9-300e33c2eab8 with identifier: KK56723
2026-03-28 19:00:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 2e6af16e-6a59-5bee-bde9-300e33c2eab8 with identifier: KK56723
2026-03-28 19:00:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 2e6af16e-6a59-5bee-bde9-300e33c2eab8 with identifier: KK56723 to the API
2026-03-28 19:00:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 19:00:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 19:00:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:02:18Z',
 'fuel_type': 'hybrid',
 'id': '2e6af16e-6a59-5bee-bde9-300e33c2eab8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KK56723',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'C-HR',
 'odometer': 154829,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-01-19',
 'seller_name': None,
 'title': 'Toyota C-HR 1.8 Hybrid Active',
 'transmission': 'automatic',
 'trim': 'Active',
 'year': 2017}
2026-03-28 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KK56723%27 HTTP/1.1" 200 None
2026-03-28 19:00:38 [auto1.nl] INFO: Saving data for KK56723: {'auction_closing_time': 1774882938.0, 'created_time': 1774526479.770742, 'last_price_update_time': 1774724438.452119}
2026-03-28 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='KK56723') HTTP/1.1" 204 0
2026-03-28 19:00:38 [auto1.nl] INFO: Found listing with ID: PE89486
2026-03-28 19:00:38 [auto1.nl] INFO: Found listing with ID: CR31925
2026-03-28 19:00:38 [auto1.nl] INFO: Found listing with ID: UR99157
2026-03-28 19:00:38 [auto1.nl] INFO: Found listing with ID: UJ24113
2026-03-28 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UJ24113%27 HTTP/1.1" 200 None
2026-03-28 19:00:38 [auto1.nl] INFO: Scrape type for UJ24113: 0
2026-03-28 19:00:38 [auto1.nl] INFO: Found listing with ID: ZX00670
2026-03-28 19:00:38 [auto1.nl] INFO: Found listing with ID: ZC66376
2026-03-28 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZC66376%27 HTTP/1.1" 200 None
2026-03-28 19:00:38 [auto1.nl] INFO: Scrape type for ZC66376: 0
2026-03-28 19:00:38 [auto1.nl] INFO: Found listing with ID: CW75343
2026-03-28 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CW75343%27 HTTP/1.1" 200 None
2026-03-28 19:00:38 [auto1.nl] INFO: Scrape type for CW75343: 0
2026-03-28 19:00:38 [auto1.nl] INFO: Found listing with ID: DF87411
2026-03-28 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DF87411%27 HTTP/1.1" 200 None
2026-03-28 19:00:38 [auto1.nl] INFO: Scrape type for DF87411: 2
2026-03-28 19:00:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4a460bdb-cac6-5457-88e8-45d0702eab76 with identifier: DF87411
2026-03-28 19:00:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4a460bdb-cac6-5457-88e8-45d0702eab76 with scrape type 2
2026-03-28 19:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4a460bdb-cac6-5457-88e8-45d0702eab76 with scrape type 2
2026-03-28 19:00:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 4a460bdb-cac6-5457-88e8-45d0702eab76, identifier: DF87411
2026-03-28 19:00:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 4a460bdb-cac6-5457-88e8-45d0702eab76 with identifier: DF87411
2026-03-28 19:00:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 4a460bdb-cac6-5457-88e8-45d0702eab76 with identifier: DF87411
2026-03-28 19:00:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 4a460bdb-cac6-5457-88e8-45d0702eab76 with identifier: DF87411 to the API
2026-03-28 19:00:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 19:00:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 19:00:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:14:21Z',
 'fuel_type': 'petrol',
 'id': '4a460bdb-cac6-5457-88e8-45d0702eab76',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DF87411',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 130172,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-12-10',
 'seller_name': None,
 'title': 'Ford Focus 1.0 EcoBoost Business',
 'transmission': 'manual',
 'trim': 'Business',
 'year': 2017}
2026-03-28 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DF87411%27 HTTP/1.1" 200 None
2026-03-28 19:00:38 [auto1.nl] INFO: Saving data for DF87411: {'auction_closing_time': 1774883661.0, 'created_time': 1774526474.990101, 'last_price_update_time': 1774724438.962881}
2026-03-28 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='DF87411') HTTP/1.1" 204 0
2026-03-28 19:00:38 [auto1.nl] INFO: Found listing with ID: NP69601
2026-03-28 19:00:38 [auto1.nl] INFO: Found listing with ID: SR40415
2026-03-28 19:00:38 [auto1.nl] INFO: Found listing with ID: HX69861
2026-03-28 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HX69861%27 HTTP/1.1" 200 None
2026-03-28 19:00:39 [auto1.nl] INFO: Scrape type for HX69861: 2
2026-03-28 19:00:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 759c289a-6f1a-5c6d-a4c3-9cdd63597780 with identifier: HX69861
2026-03-28 19:00:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 759c289a-6f1a-5c6d-a4c3-9cdd63597780 with scrape type 2
2026-03-28 19:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 759c289a-6f1a-5c6d-a4c3-9cdd63597780 with scrape type 2
2026-03-28 19:00:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 759c289a-6f1a-5c6d-a4c3-9cdd63597780, identifier: HX69861
2026-03-28 19:00:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 759c289a-6f1a-5c6d-a4c3-9cdd63597780 with identifier: HX69861
2026-03-28 19:00:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 759c289a-6f1a-5c6d-a4c3-9cdd63597780 with identifier: HX69861
2026-03-28 19:00:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 759c289a-6f1a-5c6d-a4c3-9cdd63597780 with identifier: HX69861 to the API
2026-03-28 19:00:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 19:00:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 19:00:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:52:24Z',
 'fuel_type': 'diesel',
 'id': '759c289a-6f1a-5c6d-a4c3-9cdd63597780',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HX69861',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'V-Klasse',
 'odometer': 386924,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-11-29',
 'seller_name': None,
 'title': 'Mercedes-Benz V-Klasse V 250 d lang 4Matic BlueTEC Avantgarde',
 'transmission': 'automatic',
 'trim': 'lang 4Matic BlueTEC Avantgarde',
 'year': 2015}
2026-03-28 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HX69861%27 HTTP/1.1" 200 None
2026-03-28 19:00:39 [auto1.nl] INFO: Saving data for HX69861: {'auction_closing_time': 1774885944.0, 'created_time': 1774002003.933543, 'last_price_update_time': 1774724439.443055}
2026-03-28 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='HX69861') HTTP/1.1" 204 0
2026-03-28 19:00:39 [auto1.nl] INFO: Found listing with ID: SD33545
2026-03-28 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SD33545%27 HTTP/1.1" 200 None
2026-03-28 19:00:39 [auto1.nl] INFO: Scrape type for SD33545: 0
2026-03-28 19:00:39 [auto1.nl] INFO: Found listing with ID: NR15886
2026-03-28 19:00:40 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 19:00:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SE99372/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 19:00:40 [auto1.nl] INFO: Channel: 24h | Page: 5 | totalHits: 647 | hits on page: 40
2026-03-28 19:00:40 [auto1.nl] INFO: Found listing with ID: JZ14599
2026-03-28 19:00:40 [auto1.nl] INFO: Found listing with ID: VA79192
2026-03-28 19:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VA79192%27 HTTP/1.1" 200 None
2026-03-28 19:00:40 [auto1.nl] INFO: Scrape type for VA79192: 2
2026-03-28 19:00:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 95553b68-c4db-5f63-a7c4-4af85e2cc2c1 with identifier: VA79192
2026-03-28 19:00:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 95553b68-c4db-5f63-a7c4-4af85e2cc2c1 with scrape type 2
2026-03-28 19:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 95553b68-c4db-5f63-a7c4-4af85e2cc2c1 with scrape type 2
2026-03-28 19:00:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 95553b68-c4db-5f63-a7c4-4af85e2cc2c1, identifier: VA79192
2026-03-28 19:00:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 95553b68-c4db-5f63-a7c4-4af85e2cc2c1 with identifier: VA79192
2026-03-28 19:00:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 95553b68-c4db-5f63-a7c4-4af85e2cc2c1 with identifier: VA79192
2026-03-28 19:00:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 95553b68-c4db-5f63-a7c4-4af85e2cc2c1 with identifier: VA79192 to the API
2026-03-28 19:00:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 19:00:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 19:00:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:33:39Z',
 'fuel_type': 'petrol',
 'id': '95553b68-c4db-5f63-a7c4-4af85e2cc2c1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VA79192',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Duster',
 'odometer': 59094,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-10-15',
 'seller_name': None,
 'title': 'Dacia Duster 1.2 TCe Prestige 4x2',
 'transmission': 'manual',
 'trim': 'Prestige 4x2',
 'year': 2014}
2026-03-28 19:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VA79192%27 HTTP/1.1" 200 None
2026-03-28 19:00:40 [auto1.nl] INFO: Saving data for VA79192: {'auction_closing_time': 1774884819.0, 'created_time': 1774526494.338331, 'last_price_update_time': 1774724440.97528}
2026-03-28 19:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='VA79192') HTTP/1.1" 204 0
2026-03-28 19:00:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:00:40 [auto1.nl] INFO: Found listing with ID: FL22944
2026-03-28 19:00:40 [auto1.nl] INFO: Found listing with ID: ME98271
2026-03-28 19:00:40 [auto1.nl] INFO: Found listing with ID: DK58919
2026-03-28 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DK58919%27 HTTP/1.1" 200 None
2026-03-28 19:00:41 [auto1.nl] INFO: Scrape type for DK58919: 0
2026-03-28 19:00:41 [auto1.nl] INFO: Found listing with ID: CK43593
2026-03-28 19:00:41 [auto1.nl] INFO: Found listing with ID: JC35078
2026-03-28 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JC35078%27 HTTP/1.1" 200 None
2026-03-28 19:00:41 [auto1.nl] INFO: Scrape type for JC35078: 0
2026-03-28 19:00:41 [auto1.nl] INFO: Found listing with ID: CL96583
2026-03-28 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CL96583%27 HTTP/1.1" 200 None
2026-03-28 19:00:41 [auto1.nl] INFO: Scrape type for CL96583: 0
2026-03-28 19:00:41 [auto1.nl] INFO: Found listing with ID: WH69219
2026-03-28 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WH69219%27 HTTP/1.1" 200 None
2026-03-28 19:00:41 [auto1.nl] INFO: Scrape type for WH69219: 0
2026-03-28 19:00:41 [auto1.nl] INFO: Found listing with ID: JS19868
2026-03-28 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JS19868%27 HTTP/1.1" 200 None
2026-03-28 19:00:41 [auto1.nl] INFO: Scrape type for JS19868: 0
2026-03-28 19:00:41 [auto1.nl] INFO: Found listing with ID: SV78620
2026-03-28 19:00:41 [auto1.nl] INFO: Found listing with ID: FU31497
2026-03-28 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FU31497%27 HTTP/1.1" 200 None
2026-03-28 19:00:41 [auto1.nl] INFO: Scrape type for FU31497: 0
2026-03-28 19:00:41 [auto1.nl] INFO: Found listing with ID: NV42843
2026-03-28 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NV42843%27 HTTP/1.1" 200 None
2026-03-28 19:00:41 [auto1.nl] INFO: Scrape type for NV42843: 0
2026-03-28 19:00:41 [auto1.nl] INFO: Found listing with ID: MF68511
2026-03-28 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MF68511%27 HTTP/1.1" 200 None
2026-03-28 19:00:41 [auto1.nl] INFO: Scrape type for MF68511: 0
2026-03-28 19:00:41 [auto1.nl] INFO: Found listing with ID: VA70092
2026-03-28 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VA70092%27 HTTP/1.1" 200 None
2026-03-28 19:00:41 [auto1.nl] INFO: Scrape type for VA70092: 0
2026-03-28 19:00:41 [auto1.nl] INFO: Found listing with ID: HZ82321
2026-03-28 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HZ82321%27 HTTP/1.1" 200 None
2026-03-28 19:00:41 [auto1.nl] INFO: Scrape type for HZ82321: 0
2026-03-28 19:00:41 [auto1.nl] INFO: Found listing with ID: YZ85937
2026-03-28 19:00:41 [auto1.nl] INFO: Found listing with ID: MZ50492
2026-03-28 19:00:41 [auto1.nl] INFO: Found listing with ID: ZX63291
2026-03-28 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZX63291%27 HTTP/1.1" 200 None
2026-03-28 19:00:41 [auto1.nl] INFO: Scrape type for ZX63291: 0
2026-03-28 19:00:41 [auto1.nl] INFO: Found listing with ID: UY18740
2026-03-28 19:00:41 [auto1.nl] INFO: Found listing with ID: FB74313
2026-03-28 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FB74313%27 HTTP/1.1" 200 None
2026-03-28 19:00:41 [auto1.nl] INFO: Scrape type for FB74313: 0
2026-03-28 19:00:41 [auto1.nl] INFO: Found listing with ID: UJ05110
2026-03-28 19:00:41 [auto1.nl] INFO: Found listing with ID: MJ47722
2026-03-28 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MJ47722%27 HTTP/1.1" 200 None
2026-03-28 19:00:41 [auto1.nl] INFO: Scrape type for MJ47722: 2
2026-03-28 19:00:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 08dc3162-687d-561c-8a0f-a64e30ae2351 with identifier: MJ47722
2026-03-28 19:00:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 08dc3162-687d-561c-8a0f-a64e30ae2351 with scrape type 2
2026-03-28 19:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 08dc3162-687d-561c-8a0f-a64e30ae2351 with scrape type 2
2026-03-28 19:00:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 08dc3162-687d-561c-8a0f-a64e30ae2351, identifier: MJ47722
2026-03-28 19:00:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 08dc3162-687d-561c-8a0f-a64e30ae2351 with identifier: MJ47722
2026-03-28 19:00:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 08dc3162-687d-561c-8a0f-a64e30ae2351 with identifier: MJ47722
2026-03-28 19:00:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 08dc3162-687d-561c-8a0f-a64e30ae2351 with identifier: MJ47722 to the API
2026-03-28 19:00:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 19:00:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 19:00:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 192,
 'expiration_date': '2026-03-30T15:39:24Z',
 'fuel_type': 'petrol',
 'id': '08dc3162-687d-561c-8a0f-a64e30ae2351',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MJ47722',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 262393,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-02-08',
 'seller_name': None,
 'title': 'BMW 5er 525i',
 'transmission': 'automatic',
 'trim': '',
 'year': 2005}
2026-03-28 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MJ47722%27 HTTP/1.1" 200 None
2026-03-28 19:00:41 [auto1.nl] INFO: Saving data for MJ47722: {'auction_closing_time': 1774885164.0, 'created_time': 1774526463.278356, 'last_price_update_time': 1774724441.637993}
2026-03-28 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='MJ47722') HTTP/1.1" 204 0
2026-03-28 19:00:41 [auto1.nl] INFO: Found listing with ID: XG57923
2026-03-28 19:00:41 [auto1.nl] INFO: Found listing with ID: RP15329
2026-03-28 19:00:41 [auto1.nl] INFO: Found listing with ID: VM41876
2026-03-28 19:00:41 [auto1.nl] INFO: Found listing with ID: FH34143
2026-03-28 19:00:41 [auto1.nl] INFO: Found listing with ID: FW39949
2026-03-28 19:00:41 [auto1.nl] INFO: Found listing with ID: ZP69271
2026-03-28 19:00:41 [auto1.nl] INFO: Found listing with ID: LL90951
2026-03-28 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LL90951%27 HTTP/1.1" 200 None
2026-03-28 19:00:41 [auto1.nl] INFO: Scrape type for LL90951: 0
2026-03-28 19:00:41 [auto1.nl] INFO: Found listing with ID: BY94157
2026-03-28 19:00:41 [auto1.nl] INFO: Found listing with ID: VD56637
2026-03-28 19:00:41 [auto1.nl] INFO: Found listing with ID: JK88621
2026-03-28 19:00:41 [auto1.nl] INFO: Found listing with ID: WX34396
2026-03-28 19:00:41 [auto1.nl] INFO: Found listing with ID: JT64166
2026-03-28 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JT64166%27 HTTP/1.1" 200 None
2026-03-28 19:00:41 [auto1.nl] INFO: Scrape type for JT64166: 2
2026-03-28 19:00:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 82c88a9e-c5b7-5075-867a-5a21665e2328 with identifier: JT64166
2026-03-28 19:00:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 82c88a9e-c5b7-5075-867a-5a21665e2328 with scrape type 2
2026-03-28 19:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 82c88a9e-c5b7-5075-867a-5a21665e2328 with scrape type 2
2026-03-28 19:00:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 82c88a9e-c5b7-5075-867a-5a21665e2328, identifier: JT64166
2026-03-28 19:00:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 82c88a9e-c5b7-5075-867a-5a21665e2328 with identifier: JT64166
2026-03-28 19:00:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 82c88a9e-c5b7-5075-867a-5a21665e2328 with identifier: JT64166
2026-03-28 19:00:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 82c88a9e-c5b7-5075-867a-5a21665e2328 with identifier: JT64166 to the API
2026-03-28 19:00:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 19:00:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 19:00:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:24:11Z',
 'fuel_type': 'petrol',
 'id': '82c88a9e-c5b7-5075-867a-5a21665e2328',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JT64166',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 209817,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-12-29',
 'seller_name': None,
 'title': 'Renault Clio 0.9 Energy Expression',
 'transmission': 'manual',
 'trim': 'Expression',
 'year': 2015}
2026-03-28 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JT64166%27 HTTP/1.1" 200 None
2026-03-28 19:00:42 [auto1.nl] INFO: Saving data for JT64166: {'auction_closing_time': 1774884251.0, 'created_time': 1774526484.730215, 'last_price_update_time': 1774724442.226689}
2026-03-28 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='JT64166') HTTP/1.1" 204 0
2026-03-28 19:00:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:00:42 [auto1.nl] INFO: Found listing with ID: XD61678
2026-03-28 19:00:42 [auto1.nl] INFO: Found listing with ID: YK98733
2026-03-28 19:00:42 [auto1.nl] INFO: Found listing with ID: YP25238
2026-03-28 19:00:42 [auto1.nl] INFO: Found listing with ID: XA85497
2026-03-28 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XA85497%27 HTTP/1.1" 200 None
2026-03-28 19:00:42 [auto1.nl] INFO: Scrape type for XA85497: 0
2026-03-28 19:00:42 [auto1.nl] INFO: Found listing with ID: WC04014
2026-03-28 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WC04014%27 HTTP/1.1" 200 None
2026-03-28 19:00:42 [auto1.nl] INFO: Scrape type for WC04014: 0
2026-03-28 19:00:43 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 19:00:43 [auto1.nl] INFO: Channel: 24h | Page: 6 | totalHits: 647 | hits on page: 40
2026-03-28 19:00:43 [auto1.nl] INFO: Found listing with ID: HD17412
2026-03-28 19:00:43 [auto1.nl] INFO: Found listing with ID: MX82019
2026-03-28 19:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MX82019%27 HTTP/1.1" 200 None
2026-03-28 19:00:43 [auto1.nl] INFO: Scrape type for MX82019: 0
2026-03-28 19:00:43 [auto1.nl] INFO: Found listing with ID: ES69537
2026-03-28 19:00:43 [auto1.nl] INFO: Found listing with ID: ZD81791
2026-03-28 19:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZD81791%27 HTTP/1.1" 200 None
2026-03-28 19:00:43 [auto1.nl] INFO: Scrape type for ZD81791: 0
2026-03-28 19:00:43 [auto1.nl] INFO: Found listing with ID: WS29354
2026-03-28 19:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WS29354%27 HTTP/1.1" 200 None
2026-03-28 19:00:43 [auto1.nl] INFO: Scrape type for WS29354: 0
2026-03-28 19:00:43 [auto1.nl] INFO: Found listing with ID: CR08212
2026-03-28 19:00:43 [auto1.nl] INFO: Found listing with ID: GN05115
2026-03-28 19:00:43 [auto1.nl] INFO: Found listing with ID: NK23750
2026-03-28 19:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NK23750%27 HTTP/1.1" 200 None
2026-03-28 19:00:43 [auto1.nl] INFO: Scrape type for NK23750: 0
2026-03-28 19:00:43 [auto1.nl] INFO: Found listing with ID: LT61011
2026-03-28 19:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LT61011%27 HTTP/1.1" 200 None
2026-03-28 19:00:43 [auto1.nl] INFO: Scrape type for LT61011: 0
2026-03-28 19:00:43 [auto1.nl] INFO: Found listing with ID: CT54062
2026-03-28 19:00:43 [auto1.nl] INFO: Found listing with ID: PZ45874
2026-03-28 19:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PZ45874%27 HTTP/1.1" 200 None
2026-03-28 19:00:43 [auto1.nl] INFO: Scrape type for PZ45874: 0
2026-03-28 19:00:43 [auto1.nl] INFO: Found listing with ID: RY75066
2026-03-28 19:00:43 [auto1.nl] INFO: Found listing with ID: VJ86590
2026-03-28 19:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VJ86590%27 HTTP/1.1" 200 None
2026-03-28 19:00:43 [auto1.nl] INFO: Scrape type for VJ86590: 0
2026-03-28 19:00:43 [auto1.nl] INFO: Found listing with ID: EK38089
2026-03-28 19:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EK38089%27 HTTP/1.1" 200 None
2026-03-28 19:00:43 [auto1.nl] INFO: Scrape type for EK38089: 0
2026-03-28 19:00:43 [auto1.nl] INFO: Found listing with ID: CJ41969
2026-03-28 19:00:43 [auto1.nl] INFO: Found listing with ID: BD37870
2026-03-28 19:00:43 [auto1.nl] INFO: Found listing with ID: FR87941
2026-03-28 19:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FR87941%27 HTTP/1.1" 200 None
2026-03-28 19:00:43 [auto1.nl] INFO: Scrape type for FR87941: 2
2026-03-28 19:00:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 69ba76af-1f75-54e6-8b5f-c1ad96e9b9a3 with identifier: FR87941
2026-03-28 19:00:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 69ba76af-1f75-54e6-8b5f-c1ad96e9b9a3 with scrape type 2
2026-03-28 19:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 69ba76af-1f75-54e6-8b5f-c1ad96e9b9a3 with scrape type 2
2026-03-28 19:00:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 69ba76af-1f75-54e6-8b5f-c1ad96e9b9a3, identifier: FR87941
2026-03-28 19:00:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 69ba76af-1f75-54e6-8b5f-c1ad96e9b9a3 with identifier: FR87941
2026-03-28 19:00:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 19:00:43 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=red HTTP/1.1" 200 None
2026-03-28 19:00:43 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 19:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 19:00:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 69ba76af-1f75-54e6-8b5f-c1ad96e9b9a3 with identifier: FR87941
2026-03-28 19:00:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 69ba76af-1f75-54e6-8b5f-c1ad96e9b9a3 with identifier: FR87941 to the API
2026-03-28 19:00:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 19:00:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 19:00:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:18:50Z',
 'fuel_type': 'petrol',
 'id': '69ba76af-1f75-54e6-8b5f-c1ad96e9b9a3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FR87941',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Panda',
 'odometer': 117577,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-07-30',
 'seller_name': None,
 'title': 'Fiat Panda 1.2 Classic',
 'transmission': 'manual',
 'trim': 'Classic',
 'year': 2012}
2026-03-28 19:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FR87941%27 HTTP/1.1" 200 None
2026-03-28 19:00:43 [auto1.nl] INFO: Saving data for FR87941: {'auction_closing_time': 1774883930.0, 'created_time': 1774526508.124505, 'last_price_update_time': 1774724443.85304}
2026-03-28 19:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='FR87941') HTTP/1.1" 204 0
2026-03-28 19:00:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:00:43 [auto1.nl] INFO: Found listing with ID: WK29789
2026-03-28 19:00:43 [auto1.nl] INFO: Found listing with ID: KV87922
2026-03-28 19:00:43 [auto1.nl] INFO: Found listing with ID: EL29526
2026-03-28 19:00:43 [auto1.nl] INFO: Found listing with ID: CP17463
2026-03-28 19:00:43 [auto1.nl] INFO: Found listing with ID: SX81397
2026-03-28 19:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SX81397%27 HTTP/1.1" 200 None
2026-03-28 19:00:43 [auto1.nl] INFO: Scrape type for SX81397: 2
2026-03-28 19:00:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0b1aff7c-92ee-5b89-a34a-fcb0810c6657 with identifier: SX81397
2026-03-28 19:00:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0b1aff7c-92ee-5b89-a34a-fcb0810c6657 with scrape type 2
2026-03-28 19:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0b1aff7c-92ee-5b89-a34a-fcb0810c6657 with scrape type 2
2026-03-28 19:00:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 0b1aff7c-92ee-5b89-a34a-fcb0810c6657, identifier: SX81397
2026-03-28 19:00:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 0b1aff7c-92ee-5b89-a34a-fcb0810c6657 with identifier: SX81397
2026-03-28 19:00:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 0b1aff7c-92ee-5b89-a34a-fcb0810c6657 with identifier: SX81397
2026-03-28 19:00:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 0b1aff7c-92ee-5b89-a34a-fcb0810c6657 with identifier: SX81397 to the API
2026-03-28 19:00:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 19:00:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 19:00:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-30T15:46:32Z',
 'fuel_type': 'diesel',
 'id': '0b1aff7c-92ee-5b89-a34a-fcb0810c6657',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SX81397',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T6 Transporter',
 'odometer': 195017,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-07',
 'seller_name': None,
 'title': 'Volkswagen T6 Transporter 2.0 TDI Kasten Hochdach lang 4Motion',
 'transmission': 'automatic',
 'trim': 'Kasten Hochdach lang 4Motion',
 'year': 2017}
2026-03-28 19:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SX81397%27 HTTP/1.1" 200 None
2026-03-28 19:00:44 [auto1.nl] INFO: Saving data for SX81397: {'auction_closing_time': 1774885592.0, 'created_time': 1773232031.892876, 'last_price_update_time': 1774724444.375708}
2026-03-28 19:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='SX81397') HTTP/1.1" 204 0
2026-03-28 19:00:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SE99372> (referer: https://www.auto1.com/v1/car-details-view/SE99372/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 19:00:44 [auto1.nl] INFO: Found listing with ID: UV82075
2026-03-28 19:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UV82075%27 HTTP/1.1" 200 None
2026-03-28 19:00:44 [auto1.nl] INFO: Scrape type for UV82075: 0
2026-03-28 19:00:44 [auto1.nl] INFO: Found listing with ID: WW80908
2026-03-28 19:00:44 [auto1.nl] INFO: Found listing with ID: SM80467
2026-03-28 19:00:44 [auto1.nl] INFO: Found listing with ID: EH64896
2026-03-28 19:00:44 [auto1.nl] INFO: Found listing with ID: DB11708
2026-03-28 19:00:44 [auto1.nl] INFO: Found listing with ID: TU10821
2026-03-28 19:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TU10821%27 HTTP/1.1" 200 None
2026-03-28 19:00:44 [auto1.nl] INFO: Scrape type for TU10821: 0
2026-03-28 19:00:44 [auto1.nl] INFO: Found listing with ID: ZD26534
2026-03-28 19:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZD26534%27 HTTP/1.1" 200 None
2026-03-28 19:00:44 [auto1.nl] INFO: Scrape type for ZD26534: 0
2026-03-28 19:00:44 [auto1.nl] INFO: Found listing with ID: PX51139
2026-03-28 19:00:44 [auto1.nl] INFO: Found listing with ID: TY61758
2026-03-28 19:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TY61758%27 HTTP/1.1" 200 None
2026-03-28 19:00:44 [auto1.nl] INFO: Scrape type for TY61758: 0
2026-03-28 19:00:44 [auto1.nl] INFO: Found listing with ID: DU88284
2026-03-28 19:00:44 [auto1.nl] INFO: Found listing with ID: AZ42388
2026-03-28 19:00:44 [auto1.nl] INFO: Found listing with ID: PG46787
2026-03-28 19:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PG46787%27 HTTP/1.1" 200 None
2026-03-28 19:00:44 [auto1.nl] INFO: Scrape type for PG46787: 2
2026-03-28 19:00:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f665fc60-c58f-5fd6-96ed-ce77a307ed1f with identifier: PG46787
2026-03-28 19:00:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f665fc60-c58f-5fd6-96ed-ce77a307ed1f with scrape type 2
2026-03-28 19:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f665fc60-c58f-5fd6-96ed-ce77a307ed1f with scrape type 2
2026-03-28 19:00:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: f665fc60-c58f-5fd6-96ed-ce77a307ed1f, identifier: PG46787
2026-03-28 19:00:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: f665fc60-c58f-5fd6-96ed-ce77a307ed1f with identifier: PG46787
2026-03-28 19:00:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: f665fc60-c58f-5fd6-96ed-ce77a307ed1f with identifier: PG46787
2026-03-28 19:00:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: f665fc60-c58f-5fd6-96ed-ce77a307ed1f with identifier: PG46787 to the API
2026-03-28 19:00:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 19:00:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 19:00:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-30T15:56:51Z',
 'fuel_type': 'petrol',
 'id': 'f665fc60-c58f-5fd6-96ed-ce77a307ed1f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PG46787',
 'listing': 'auction',
 'make': 'Mitsubishi',
 'model': 'Colt',
 'odometer': 51364,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-12-15',
 'seller_name': None,
 'title': 'Mitsubishi Colt 1.3 Intense',
 'transmission': 'automatic',
 'trim': 'Intense',
 'year': 2011}
2026-03-28 19:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PG46787%27 HTTP/1.1" 200 None
2026-03-28 19:00:44 [auto1.nl] INFO: Saving data for PG46787: {'auction_closing_time': 1774886211.0, 'created_time': 1774612931.822116, 'last_price_update_time': 1774724444.975521}
2026-03-28 19:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='PG46787') HTTP/1.1" 204 0
2026-03-28 19:00:45 [auto1.nl] INFO: Found listing with ID: TW55830
2026-03-28 19:00:45 [auto1.nl] INFO: Found listing with ID: HB03885
2026-03-28 19:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HB03885%27 HTTP/1.1" 200 None
2026-03-28 19:00:45 [auto1.nl] INFO: Scrape type for HB03885: 0
2026-03-28 19:00:45 [auto1.nl] INFO: Found listing with ID: CG77801
2026-03-28 19:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CG77801%27 HTTP/1.1" 200 None
2026-03-28 19:00:45 [auto1.nl] INFO: Scrape type for CG77801: 0
2026-03-28 19:00:45 [auto1.nl] INFO: Found listing with ID: BU16200
2026-03-28 19:00:45 [auto1.nl] INFO: Found listing with ID: PA43644
2026-03-28 19:00:45 [auto1.nl] INFO: Found listing with ID: HC58225
2026-03-28 19:00:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f93ef787-8d36-5225-b349-a44182ad45ef with identifier: SE99372
2026-03-28 19:00:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f93ef787-8d36-5225-b349-a44182ad45ef with scrape type 1
2026-03-28 19:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f93ef787-8d36-5225-b349-a44182ad45ef
2026-03-28 19:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F65%252Fbd65f5dff01f89bf0d70ded3d89f501e%252Fpa%252FSE99372_bc575e63f58e9edaa218939b4fbdbb3e.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/65/bd65f5dff01f89bf0d70ded3d89f501e/pa/SE99372_bc575e63f58e9edaa218939b4fbdbb3e.jpg not downloaded yet
2026-03-28 19:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F65%252Fbd65f5dff01f89bf0d70ded3d89f501e%252Fpa%252FSE99372_51147ccac654dd6ed7cc9bdde90cabc7.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/65/bd65f5dff01f89bf0d70ded3d89f501e/pa/SE99372_51147ccac654dd6ed7cc9bdde90cabc7.jpg not downloaded yet
2026-03-28 19:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F65%252Fbd65f5dff01f89bf0d70ded3d89f501e%252Fpa%252FSE99372_6dd48be18222c765499ed0cf6294edb7.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/65/bd65f5dff01f89bf0d70ded3d89f501e/pa/SE99372_6dd48be18222c765499ed0cf6294edb7.jpg not downloaded yet
2026-03-28 19:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F65%252Fbd65f5dff01f89bf0d70ded3d89f501e%252Fpa%252FSE99372_84f12b55eceab3b4ab44a20901e85bbf.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/65/bd65f5dff01f89bf0d70ded3d89f501e/pa/SE99372_84f12b55eceab3b4ab44a20901e85bbf.jpg not downloaded yet
2026-03-28 19:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F65%252Fbd65f5dff01f89bf0d70ded3d89f501e%252Fpa%252FSE99372_9ef45c44ca74ff11cbee4e216fc61a39.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/65/bd65f5dff01f89bf0d70ded3d89f501e/pa/SE99372_9ef45c44ca74ff11cbee4e216fc61a39.jpg not downloaded yet
2026-03-28 19:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F65%252Fbd65f5dff01f89bf0d70ded3d89f501e%252Fpa%252FSE99372_f6427ca64bd25bc648770575b8789e9f.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/65/bd65f5dff01f89bf0d70ded3d89f501e/pa/SE99372_f6427ca64bd25bc648770575b8789e9f.jpg not downloaded yet
2026-03-28 19:00:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbd/65/bd65f5dff01f89bf0d70ded3d89f501e/pa/SE99372_bc575e63f58e9edaa218939b4fbdbb3e.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F65%252Fbd65f5dff01f89bf0d70ded3d89f501e%252Fpa%252FSE99372_2d9e3b4f5dabe095870ca091a9504893.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/65/bd65f5dff01f89bf0d70ded3d89f501e/pa/SE99372_2d9e3b4f5dabe095870ca091a9504893.jpg not downloaded yet
2026-03-28 19:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F65%252Fbd65f5dff01f89bf0d70ded3d89f501e%252Fpa%252FSE99372_8fb6623f66f1c3d77691dffc9442bfe7.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/65/bd65f5dff01f89bf0d70ded3d89f501e/pa/SE99372_8fb6623f66f1c3d77691dffc9442bfe7.jpg not downloaded yet
2026-03-28 19:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F65%252Fbd65f5dff01f89bf0d70ded3d89f501e%252Fpa%252FSE99372_bb57edef4cbf38dbd0054b891d291d50.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/65/bd65f5dff01f89bf0d70ded3d89f501e/pa/SE99372_bb57edef4cbf38dbd0054b891d291d50.jpg not downloaded yet
2026-03-28 19:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F65%252Fbd65f5dff01f89bf0d70ded3d89f501e%252Fpa%252FSE99372_9f14c95941d81a80c044dce7cd763bf7.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/65/bd65f5dff01f89bf0d70ded3d89f501e/pa/SE99372_9f14c95941d81a80c044dce7cd763bf7.jpg not downloaded yet
2026-03-28 19:00:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:00:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bd71dc350>
2026-03-28 19:00:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:00:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:00:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:00:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f93ef787-8d36-5225-b349-a44182ad45ef/f93ef787-8d36-5225-b349-a44182ad45ef_image_0.jpg HTTP/1.1" 201 0
2026-03-28 19:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F65%252Fbd65f5dff01f89bf0d70ded3d89f501e%252Fpa%252FSE99372_bc575e63f58e9edaa218939b4fbdbb3e.jpg') HTTP/1.1" 204 0
2026-03-28 19:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/65/bd65f5dff01f89bf0d70ded3d89f501e/pa/SE99372_bc575e63f58e9edaa218939b4fbdbb3e.jpg saved to cache
2026-03-28 19:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f93ef787-8d36-5225-b349-a44182ad45ef
2026-03-28 19:00:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbd/65/bd65f5dff01f89bf0d70ded3d89f501e/pa/SE99372_51147ccac654dd6ed7cc9bdde90cabc7.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:00:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbd/65/bd65f5dff01f89bf0d70ded3d89f501e/pa/SE99372_84f12b55eceab3b4ab44a20901e85bbf.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:00:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbd/65/bd65f5dff01f89bf0d70ded3d89f501e/pa/SE99372_6dd48be18222c765499ed0cf6294edb7.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:00:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:00:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bd71b5f50>
2026-03-28 19:00:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:00:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:00:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:00:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f93ef787-8d36-5225-b349-a44182ad45ef/f93ef787-8d36-5225-b349-a44182ad45ef_image_1.jpg HTTP/1.1" 201 0
2026-03-28 19:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F65%252Fbd65f5dff01f89bf0d70ded3d89f501e%252Fpa%252FSE99372_51147ccac654dd6ed7cc9bdde90cabc7.jpg') HTTP/1.1" 204 0
2026-03-28 19:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/65/bd65f5dff01f89bf0d70ded3d89f501e/pa/SE99372_51147ccac654dd6ed7cc9bdde90cabc7.jpg saved to cache
2026-03-28 19:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f93ef787-8d36-5225-b349-a44182ad45ef
2026-03-28 19:00:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbd/65/bd65f5dff01f89bf0d70ded3d89f501e/pa/SE99372_8fb6623f66f1c3d77691dffc9442bfe7.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:00:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbd/65/bd65f5dff01f89bf0d70ded3d89f501e/pa/SE99372_bb57edef4cbf38dbd0054b891d291d50.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:00:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 19:00:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:00:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bd71d1ed0>
2026-03-28 19:00:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:00:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:00:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:00:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f93ef787-8d36-5225-b349-a44182ad45ef/f93ef787-8d36-5225-b349-a44182ad45ef_image_3.jpg HTTP/1.1" 201 0
2026-03-28 19:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F65%252Fbd65f5dff01f89bf0d70ded3d89f501e%252Fpa%252FSE99372_84f12b55eceab3b4ab44a20901e85bbf.jpg') HTTP/1.1" 204 0
2026-03-28 19:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/65/bd65f5dff01f89bf0d70ded3d89f501e/pa/SE99372_84f12b55eceab3b4ab44a20901e85bbf.jpg saved to cache
2026-03-28 19:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f93ef787-8d36-5225-b349-a44182ad45ef
2026-03-28 19:00:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbd/65/bd65f5dff01f89bf0d70ded3d89f501e/pa/SE99372_9f14c95941d81a80c044dce7cd763bf7.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:00:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbd/65/bd65f5dff01f89bf0d70ded3d89f501e/pa/SE99372_9ef45c44ca74ff11cbee4e216fc61a39.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:00:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 19:00:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:00:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bd71b6990>
2026-03-28 19:00:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:00:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:00:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:00:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f93ef787-8d36-5225-b349-a44182ad45ef/f93ef787-8d36-5225-b349-a44182ad45ef_image_2.jpg HTTP/1.1" 201 0
2026-03-28 19:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F65%252Fbd65f5dff01f89bf0d70ded3d89f501e%252Fpa%252FSE99372_6dd48be18222c765499ed0cf6294edb7.jpg') HTTP/1.1" 204 0
2026-03-28 19:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/65/bd65f5dff01f89bf0d70ded3d89f501e/pa/SE99372_6dd48be18222c765499ed0cf6294edb7.jpg saved to cache
2026-03-28 19:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f93ef787-8d36-5225-b349-a44182ad45ef
2026-03-28 19:00:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:00:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bdd5b8950>
2026-03-28 19:00:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:00:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:00:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:00:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f93ef787-8d36-5225-b349-a44182ad45ef/f93ef787-8d36-5225-b349-a44182ad45ef_image_7.jpg HTTP/1.1" 201 0
2026-03-28 19:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F65%252Fbd65f5dff01f89bf0d70ded3d89f501e%252Fpa%252FSE99372_8fb6623f66f1c3d77691dffc9442bfe7.jpg') HTTP/1.1" 204 0
2026-03-28 19:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/65/bd65f5dff01f89bf0d70ded3d89f501e/pa/SE99372_8fb6623f66f1c3d77691dffc9442bfe7.jpg saved to cache
2026-03-28 19:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f93ef787-8d36-5225-b349-a44182ad45ef
2026-03-28 19:00:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:00:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bd72f03d0>
2026-03-28 19:00:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:00:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:00:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:00:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f93ef787-8d36-5225-b349-a44182ad45ef/f93ef787-8d36-5225-b349-a44182ad45ef_image_8.jpg HTTP/1.1" 201 0
2026-03-28 19:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F65%252Fbd65f5dff01f89bf0d70ded3d89f501e%252Fpa%252FSE99372_bb57edef4cbf38dbd0054b891d291d50.jpg') HTTP/1.1" 204 0
2026-03-28 19:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/65/bd65f5dff01f89bf0d70ded3d89f501e/pa/SE99372_bb57edef4cbf38dbd0054b891d291d50.jpg saved to cache
2026-03-28 19:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f93ef787-8d36-5225-b349-a44182ad45ef
2026-03-28 19:00:45 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 19:00:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:00:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bdd4ef190>
2026-03-28 19:00:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:00:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:00:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:00:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f93ef787-8d36-5225-b349-a44182ad45ef/f93ef787-8d36-5225-b349-a44182ad45ef_image_9.jpg HTTP/1.1" 201 0
2026-03-28 19:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F65%252Fbd65f5dff01f89bf0d70ded3d89f501e%252Fpa%252FSE99372_9f14c95941d81a80c044dce7cd763bf7.jpg') HTTP/1.1" 204 0
2026-03-28 19:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/65/bd65f5dff01f89bf0d70ded3d89f501e/pa/SE99372_9f14c95941d81a80c044dce7cd763bf7.jpg saved to cache
2026-03-28 19:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f93ef787-8d36-5225-b349-a44182ad45ef
2026-03-28 19:00:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 19:00:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:00:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bd72409d0>
2026-03-28 19:00:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:00:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:00:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:00:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f93ef787-8d36-5225-b349-a44182ad45ef/f93ef787-8d36-5225-b349-a44182ad45ef_image_4.jpg HTTP/1.1" 201 0
2026-03-28 19:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F65%252Fbd65f5dff01f89bf0d70ded3d89f501e%252Fpa%252FSE99372_9ef45c44ca74ff11cbee4e216fc61a39.jpg') HTTP/1.1" 204 0
2026-03-28 19:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/65/bd65f5dff01f89bf0d70ded3d89f501e/pa/SE99372_9ef45c44ca74ff11cbee4e216fc61a39.jpg saved to cache
2026-03-28 19:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f93ef787-8d36-5225-b349-a44182ad45ef
2026-03-28 19:00:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbd/65/bd65f5dff01f89bf0d70ded3d89f501e/pa/SE99372_f6427ca64bd25bc648770575b8789e9f.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:00:46 [auto1.nl] INFO: Channel: 24h | Page: 7 | totalHits: 647 | hits on page: 40
2026-03-28 19:00:46 [auto1.nl] INFO: Found listing with ID: KB67971
2026-03-28 19:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KB67971%27 HTTP/1.1" 200 None
2026-03-28 19:00:46 [auto1.nl] INFO: Scrape type for KB67971: 0
2026-03-28 19:00:46 [auto1.nl] INFO: Found listing with ID: JX76832
2026-03-28 19:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JX76832%27 HTTP/1.1" 200 None
2026-03-28 19:00:46 [auto1.nl] INFO: Scrape type for JX76832: 0
2026-03-28 19:00:46 [auto1.nl] INFO: Found listing with ID: CU35423
2026-03-28 19:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CU35423%27 HTTP/1.1" 200 None
2026-03-28 19:00:46 [auto1.nl] INFO: Scrape type for CU35423: 0
2026-03-28 19:00:46 [auto1.nl] INFO: Found listing with ID: XW28642
2026-03-28 19:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XW28642%27 HTTP/1.1" 200 None
2026-03-28 19:00:46 [auto1.nl] INFO: Scrape type for XW28642: 1
2026-03-28 19:00:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbd/65/bd65f5dff01f89bf0d70ded3d89f501e/pa/SE99372_2d9e3b4f5dabe095870ca091a9504893.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:00:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:00:46 [auto1.nl] INFO: Found listing with ID: SY53039
2026-03-28 19:00:46 [auto1.nl] INFO: Found listing with ID: DN96174
2026-03-28 19:00:46 [auto1.nl] INFO: Found listing with ID: BD28084
2026-03-28 19:00:46 [auto1.nl] INFO: Found listing with ID: SE84312
2026-03-28 19:00:46 [auto1.nl] INFO: Found listing with ID: RF39867
2026-03-28 19:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RF39867%27 HTTP/1.1" 200 None
2026-03-28 19:00:46 [auto1.nl] INFO: Scrape type for RF39867: 0
2026-03-28 19:00:46 [auto1.nl] INFO: Found listing with ID: DZ87358
2026-03-28 19:00:46 [auto1.nl] INFO: Found listing with ID: LE78061
2026-03-28 19:00:46 [auto1.nl] INFO: Found listing with ID: RC74228
2026-03-28 19:00:46 [auto1.nl] INFO: Found listing with ID: MD57319
2026-03-28 19:00:46 [auto1.nl] INFO: Found listing with ID: JG11787
2026-03-28 19:00:46 [auto1.nl] INFO: Found listing with ID: NT33284
2026-03-28 19:00:46 [auto1.nl] INFO: Found listing with ID: MU53685
2026-03-28 19:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MU53685%27 HTTP/1.1" 200 None
2026-03-28 19:00:46 [auto1.nl] INFO: Scrape type for MU53685: 2
2026-03-28 19:00:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6216bfca-7290-5e92-9d40-7f8f23485812 with identifier: MU53685
2026-03-28 19:00:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6216bfca-7290-5e92-9d40-7f8f23485812 with scrape type 2
2026-03-28 19:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6216bfca-7290-5e92-9d40-7f8f23485812 with scrape type 2
2026-03-28 19:00:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 6216bfca-7290-5e92-9d40-7f8f23485812, identifier: MU53685
2026-03-28 19:00:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 6216bfca-7290-5e92-9d40-7f8f23485812 with identifier: MU53685
2026-03-28 19:00:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 6216bfca-7290-5e92-9d40-7f8f23485812 with identifier: MU53685
2026-03-28 19:00:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 6216bfca-7290-5e92-9d40-7f8f23485812 with identifier: MU53685 to the API
2026-03-28 19:00:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 19:00:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 19:00:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:28:04Z',
 'fuel_type': 'petrol',
 'id': '6216bfca-7290-5e92-9d40-7f8f23485812',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MU53685',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 246019,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-05-27',
 'seller_name': None,
 'title': 'BMW 3er 320i EfficientDynamics Edition',
 'transmission': 'automatic',
 'trim': 'EfficientDynamics Edition',
 'year': 2014}
2026-03-28 19:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MU53685%27 HTTP/1.1" 200 None
2026-03-28 19:00:46 [auto1.nl] INFO: Saving data for MU53685: {'auction_closing_time': 1774884484.0, 'created_time': 1774551631.379615, 'last_price_update_time': 1774724446.702488}
2026-03-28 19:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='MU53685') HTTP/1.1" 204 0
2026-03-28 19:00:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:00:46 [auto1.nl] INFO: Found listing with ID: EE94160
2026-03-28 19:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EE94160%27 HTTP/1.1" 200 None
2026-03-28 19:00:46 [auto1.nl] INFO: Scrape type for EE94160: 0
2026-03-28 19:00:46 [auto1.nl] INFO: Found listing with ID: FR68688
2026-03-28 19:00:46 [auto1.nl] INFO: Found listing with ID: AE06801
2026-03-28 19:00:46 [auto1.nl] INFO: Found listing with ID: WF02577
2026-03-28 19:00:46 [auto1.nl] INFO: Found listing with ID: CH10226
2026-03-28 19:00:46 [auto1.nl] INFO: Found listing with ID: WZ36257
2026-03-28 19:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WZ36257%27 HTTP/1.1" 200 None
2026-03-28 19:00:46 [auto1.nl] INFO: Scrape type for WZ36257: 0
2026-03-28 19:00:46 [auto1.nl] INFO: Found listing with ID: BM26306
2026-03-28 19:00:46 [auto1.nl] INFO: Found listing with ID: MT73533
2026-03-28 19:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MT73533%27 HTTP/1.1" 200 None
2026-03-28 19:00:46 [auto1.nl] INFO: Scrape type for MT73533: 0
2026-03-28 19:00:46 [auto1.nl] INFO: Found listing with ID: KD04773
2026-03-28 19:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KD04773%27 HTTP/1.1" 200 None
2026-03-28 19:00:46 [auto1.nl] INFO: Scrape type for KD04773: 2
2026-03-28 19:00:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8cc2d4fd-7837-5363-a9a9-59e20aecd285 with identifier: KD04773
2026-03-28 19:00:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8cc2d4fd-7837-5363-a9a9-59e20aecd285 with scrape type 2
2026-03-28 19:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8cc2d4fd-7837-5363-a9a9-59e20aecd285 with scrape type 2
2026-03-28 19:00:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 8cc2d4fd-7837-5363-a9a9-59e20aecd285, identifier: KD04773
2026-03-28 19:00:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 8cc2d4fd-7837-5363-a9a9-59e20aecd285 with identifier: KD04773
2026-03-28 19:00:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 8cc2d4fd-7837-5363-a9a9-59e20aecd285 with identifier: KD04773
2026-03-28 19:00:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 8cc2d4fd-7837-5363-a9a9-59e20aecd285 with identifier: KD04773 to the API
2026-03-28 19:00:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 19:00:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 19:00:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:22:09Z',
 'fuel_type': 'petrol',
 'id': '8cc2d4fd-7837-5363-a9a9-59e20aecd285',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KD04773',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Karl',
 'odometer': 56902,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-04-17',
 'seller_name': None,
 'title': 'Opel Karl 1.0 Cosmo Pack',
 'transmission': 'manual',
 'trim': 'Cosmo Pack',
 'year': 2016}
2026-03-28 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KD04773%27 HTTP/1.1" 200 None
2026-03-28 19:00:47 [auto1.nl] INFO: Saving data for KD04773: {'auction_closing_time': 1774884129.0, 'created_time': 1774526486.835577, 'last_price_update_time': 1774724447.349748}
2026-03-28 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='KD04773') HTTP/1.1" 204 0
2026-03-28 19:00:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 19:00:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:00:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bdc0f2fd0>
2026-03-28 19:00:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:00:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:00:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:00:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f93ef787-8d36-5225-b349-a44182ad45ef/f93ef787-8d36-5225-b349-a44182ad45ef_image_5.jpg HTTP/1.1" 201 0
2026-03-28 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F65%252Fbd65f5dff01f89bf0d70ded3d89f501e%252Fpa%252FSE99372_f6427ca64bd25bc648770575b8789e9f.jpg') HTTP/1.1" 204 0
2026-03-28 19:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/65/bd65f5dff01f89bf0d70ded3d89f501e/pa/SE99372_f6427ca64bd25bc648770575b8789e9f.jpg saved to cache
2026-03-28 19:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f93ef787-8d36-5225-b349-a44182ad45ef
2026-03-28 19:00:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 19:00:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:00:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bd737bf10>
2026-03-28 19:00:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:00:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:00:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:00:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f93ef787-8d36-5225-b349-a44182ad45ef/f93ef787-8d36-5225-b349-a44182ad45ef_image_6.jpg HTTP/1.1" 201 0
2026-03-28 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F65%252Fbd65f5dff01f89bf0d70ded3d89f501e%252Fpa%252FSE99372_2d9e3b4f5dabe095870ca091a9504893.jpg') HTTP/1.1" 204 0
2026-03-28 19:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/65/bd65f5dff01f89bf0d70ded3d89f501e/pa/SE99372_2d9e3b4f5dabe095870ca091a9504893.jpg saved to cache
2026-03-28 19:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f93ef787-8d36-5225-b349-a44182ad45ef
2026-03-28 19:00:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f93ef787-8d36-5225-b349-a44182ad45ef, skipping ID generation
2026-03-28 19:00:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f93ef787-8d36-5225-b349-a44182ad45ef with scrape type 1
2026-03-28 19:00:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f93ef787-8d36-5225-b349-a44182ad45ef sending to next pipeline
2026-03-28 19:00:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: f93ef787-8d36-5225-b349-a44182ad45ef, identifier: SE99372
2026-03-28 19:00:47 [auto1.nl] INFO: Found listing with ID: NE94931
2026-03-28 19:00:47 [auto1.nl] INFO: Found listing with ID: UF74705
2026-03-28 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UF74705%27 HTTP/1.1" 200 None
2026-03-28 19:00:47 [auto1.nl] INFO: Scrape type for UF74705: 2
2026-03-28 19:00:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0642662a-c840-5af8-97ad-31bedfba5583 with identifier: UF74705
2026-03-28 19:00:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0642662a-c840-5af8-97ad-31bedfba5583 with scrape type 2
2026-03-28 19:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0642662a-c840-5af8-97ad-31bedfba5583 with scrape type 2
2026-03-28 19:00:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 0642662a-c840-5af8-97ad-31bedfba5583, identifier: UF74705
2026-03-28 19:00:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: f93ef787-8d36-5225-b349-a44182ad45ef with identifier: SE99372
2026-03-28 19:00:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: f93ef787-8d36-5225-b349-a44182ad45ef with identifier: SE99372
2026-03-28 19:00:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: f93ef787-8d36-5225-b349-a44182ad45ef with identifier: SE99372 to the API
2026-03-28 19:00:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 19:00:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 19:00:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgbd/65/bd65f5dff01f89bf0d70ded3d89f501e/pa/SE99372_2d9e3b4f5dabe095870ca091a9504893.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 72,
 'expiration_date': '2026-03-30T15:27:05Z',
 'fuel_type': 'petrol',
 'id': 'f93ef787-8d36-5225-b349-a44182ad45ef',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'G397JT',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SE99372',
 'listing': 'auction',
 'location': 'NL, Rotterdam',
 'make': 'Peugeot',
 'model': '108',
 'odometer': 146405,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f93ef787-8d36-5225-b349-a44182ad45ef/f93ef787-8d36-5225-b349-a44182ad45ef_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75169,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbd/65/bd65f5dff01f89bf0d70ded3d89f501e/pa/SE99372_bc575e63f58e9edaa218939b4fbdbb3e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f93ef787-8d36-5225-b349-a44182ad45ef/f93ef787-8d36-5225-b349-a44182ad45ef_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67305,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbd/65/bd65f5dff01f89bf0d70ded3d89f501e/pa/SE99372_51147ccac654dd6ed7cc9bdde90cabc7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f93ef787-8d36-5225-b349-a44182ad45ef/f93ef787-8d36-5225-b349-a44182ad45ef_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2277298,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbd/65/bd65f5dff01f89bf0d70ded3d89f501e/pa/SE99372_6dd48be18222c765499ed0cf6294edb7.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f93ef787-8d36-5225-b349-a44182ad45ef/f93ef787-8d36-5225-b349-a44182ad45ef_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2628786,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbd/65/bd65f5dff01f89bf0d70ded3d89f501e/pa/SE99372_84f12b55eceab3b4ab44a20901e85bbf.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f93ef787-8d36-5225-b349-a44182ad45ef/f93ef787-8d36-5225-b349-a44182ad45ef_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2085781,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbd/65/bd65f5dff01f89bf0d70ded3d89f501e/pa/SE99372_9ef45c44ca74ff11cbee4e216fc61a39.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f93ef787-8d36-5225-b349-a44182ad45ef/f93ef787-8d36-5225-b349-a44182ad45ef_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2304140,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbd/65/bd65f5dff01f89bf0d70ded3d89f501e/pa/SE99372_f6427ca64bd25bc648770575b8789e9f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f93ef787-8d36-5225-b349-a44182ad45ef/f93ef787-8d36-5225-b349-a44182ad45ef_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2454028,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbd/65/bd65f5dff01f89bf0d70ded3d89f501e/pa/SE99372_2d9e3b4f5dabe095870ca091a9504893.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f93ef787-8d36-5225-b349-a44182ad45ef/f93ef787-8d36-5225-b349-a44182ad45ef_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59054,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbd/65/bd65f5dff01f89bf0d70ded3d89f501e/pa/SE99372_8fb6623f66f1c3d77691dffc9442bfe7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f93ef787-8d36-5225-b349-a44182ad45ef/f93ef787-8d36-5225-b349-a44182ad45ef_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71081,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbd/65/bd65f5dff01f89bf0d70ded3d89f501e/pa/SE99372_bb57edef4cbf38dbd0054b891d291d50.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f93ef787-8d36-5225-b349-a44182ad45ef/f93ef787-8d36-5225-b349-a44182ad45ef_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60488,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbd/65/bd65f5dff01f89bf0d70ded3d89f501e/pa/SE99372_9f14c95941d81a80c044dce7cd763bf7.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-09-30',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Peugeot 108 1.0 VTi Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2019}
2026-03-28 19:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SE99372%27 HTTP/1.1" 200 None
2026-03-28 19:00:48 [auto1.nl] INFO: Saving data for SE99372: {'created_time': 1774724448.131259, 'last_price_update_time': 1774724448.131273, 'auction_closing_time': 1774884425.0}
2026-03-28 19:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='SE99372') HTTP/1.1" 204 0
2026-03-28 19:00:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 0642662a-c840-5af8-97ad-31bedfba5583 with identifier: UF74705
2026-03-28 19:00:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 0642662a-c840-5af8-97ad-31bedfba5583 with identifier: UF74705
2026-03-28 19:00:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 0642662a-c840-5af8-97ad-31bedfba5583 with identifier: UF74705 to the API
2026-03-28 19:00:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 19:00:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 19:00:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:08:42Z',
 'fuel_type': 'petrol',
 'id': '0642662a-c840-5af8-97ad-31bedfba5583',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UF74705',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X3',
 'odometer': 162984,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-12-09',
 'seller_name': None,
 'title': 'BMW X3 xDrive 20i',
 'transmission': 'manual',
 'trim': '',
 'year': 2015}
2026-03-28 19:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UF74705%27 HTTP/1.1" 200 None
2026-03-28 19:00:48 [auto1.nl] INFO: Saving data for UF74705: {'auction_closing_time': 1774883322.0, 'created_time': 1773343430.616885, 'last_price_update_time': 1774724448.53411}
2026-03-28 19:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='UF74705') HTTP/1.1" 204 0
2026-03-28 19:00:48 [auto1.nl] INFO: Found listing with ID: JS13271
2026-03-28 19:00:48 [auto1.nl] INFO: Found listing with ID: WG27101
2026-03-28 19:00:48 [auto1.nl] INFO: Found listing with ID: SA72680
2026-03-28 19:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SA72680%27 HTTP/1.1" 200 None
2026-03-28 19:00:48 [auto1.nl] INFO: Scrape type for SA72680: 0
2026-03-28 19:00:48 [auto1.nl] INFO: Found listing with ID: UB80121
2026-03-28 19:00:48 [auto1.nl] INFO: Found listing with ID: MY24327
2026-03-28 19:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MY24327%27 HTTP/1.1" 200 None
2026-03-28 19:00:48 [auto1.nl] INFO: Scrape type for MY24327: 0
2026-03-28 19:00:48 [auto1.nl] INFO: Found listing with ID: WC55998
2026-03-28 19:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WC55998%27 HTTP/1.1" 200 None
2026-03-28 19:00:48 [auto1.nl] INFO: Scrape type for WC55998: 2
2026-03-28 19:00:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9f6e8c4f-3ff2-5152-8bbf-06ef202d3b4b with identifier: WC55998
2026-03-28 19:00:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9f6e8c4f-3ff2-5152-8bbf-06ef202d3b4b with scrape type 2
2026-03-28 19:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9f6e8c4f-3ff2-5152-8bbf-06ef202d3b4b with scrape type 2
2026-03-28 19:00:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 9f6e8c4f-3ff2-5152-8bbf-06ef202d3b4b, identifier: WC55998
2026-03-28 19:00:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 9f6e8c4f-3ff2-5152-8bbf-06ef202d3b4b with identifier: WC55998
2026-03-28 19:00:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 9f6e8c4f-3ff2-5152-8bbf-06ef202d3b4b with identifier: WC55998
2026-03-28 19:00:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 9f6e8c4f-3ff2-5152-8bbf-06ef202d3b4b with identifier: WC55998 to the API
2026-03-28 19:00:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 19:00:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 19:00:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 355,
 'expiration_date': '2026-03-30T15:40:12Z',
 'fuel_type': 'petrol',
 'id': '9f6e8c4f-3ff2-5152-8bbf-06ef202d3b4b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WC55998',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'SQ5',
 'odometer': 257159,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-09-10',
 'seller_name': None,
 'title': 'Audi SQ5 3.0 V6 TFSI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2018}
2026-03-28 19:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WC55998%27 HTTP/1.1" 200 None
2026-03-28 19:00:49 [auto1.nl] INFO: Saving data for WC55998: {'auction_closing_time': 1774885212.0, 'created_time': 1774526460.881914, 'last_price_update_time': 1774724449.04942}
2026-03-28 19:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='WC55998') HTTP/1.1" 204 0
2026-03-28 19:00:49 [auto1.nl] INFO: Found listing with ID: EN44222
2026-03-28 19:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EN44222%27 HTTP/1.1" 200 None
2026-03-28 19:00:49 [auto1.nl] INFO: Scrape type for EN44222: 0
2026-03-28 19:00:49 [auto1.nl] INFO: Found listing with ID: YE50957
2026-03-28 19:00:49 [auto1.nl] INFO: Found listing with ID: BC03068
2026-03-28 19:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BC03068%27 HTTP/1.1" 200 None
2026-03-28 19:00:49 [auto1.nl] INFO: Scrape type for BC03068: 0
2026-03-28 19:00:49 [auto1.nl] INFO: Found listing with ID: VT73125
2026-03-28 19:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VT73125%27 HTTP/1.1" 200 None
2026-03-28 19:00:49 [auto1.nl] INFO: Scrape type for VT73125: 2
2026-03-28 19:00:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0a125890-abcc-5834-b7b0-59af188eb17e with identifier: VT73125
2026-03-28 19:00:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0a125890-abcc-5834-b7b0-59af188eb17e with scrape type 2
2026-03-28 19:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0a125890-abcc-5834-b7b0-59af188eb17e with scrape type 2
2026-03-28 19:00:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 0a125890-abcc-5834-b7b0-59af188eb17e, identifier: VT73125
2026-03-28 19:00:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 0a125890-abcc-5834-b7b0-59af188eb17e with identifier: VT73125
2026-03-28 19:00:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 0a125890-abcc-5834-b7b0-59af188eb17e with identifier: VT73125
2026-03-28 19:00:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 0a125890-abcc-5834-b7b0-59af188eb17e with identifier: VT73125 to the API
2026-03-28 19:00:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 19:00:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 19:00:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:11:27Z',
 'fuel_type': 'petrol',
 'id': '0a125890-abcc-5834-b7b0-59af188eb17e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VT73125',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 263692,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-07-13',
 'seller_name': None,
 'title': 'Seat Leon 1.4 TSI Stylance / Style',
 'transmission': 'manual',
 'trim': 'Stylance / Style',
 'year': 2010}
2026-03-28 19:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VT73125%27 HTTP/1.1" 200 None
2026-03-28 19:00:49 [auto1.nl] INFO: Saving data for VT73125: {'auction_closing_time': 1774883487.0, 'created_time': 1774612927.420134, 'last_price_update_time': 1774724449.549082}
2026-03-28 19:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='VT73125') HTTP/1.1" 204 0
2026-03-28 19:00:49 [auto1.nl] INFO: Found listing with ID: LF56220
2026-03-28 19:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LF56220%27 HTTP/1.1" 200 None
2026-03-28 19:00:49 [auto1.nl] INFO: Scrape type for LF56220: 2
2026-03-28 19:00:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e027e053-3396-563b-b3e2-a882989d6bc4 with identifier: LF56220
2026-03-28 19:00:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e027e053-3396-563b-b3e2-a882989d6bc4 with scrape type 2
2026-03-28 19:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e027e053-3396-563b-b3e2-a882989d6bc4 with scrape type 2
2026-03-28 19:00:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: e027e053-3396-563b-b3e2-a882989d6bc4, identifier: LF56220
2026-03-28 19:00:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: e027e053-3396-563b-b3e2-a882989d6bc4 with identifier: LF56220
2026-03-28 19:00:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: e027e053-3396-563b-b3e2-a882989d6bc4 with identifier: LF56220
2026-03-28 19:00:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: e027e053-3396-563b-b3e2-a882989d6bc4 with identifier: LF56220 to the API
2026-03-28 19:00:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 19:00:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 19:00:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 218,
 'expiration_date': '2026-03-30T15:05:51Z',
 'fuel_type': 'hybrid',
 'id': 'e027e053-3396-563b-b3e2-a882989d6bc4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LF56220',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 218059,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-12-28',
 'seller_name': None,
 'title': 'Volkswagen Passat 1.4 GTE',
 'transmission': 'automatic',
 'trim': '',
 'year': 2015}
2026-03-28 19:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LF56220%27 HTTP/1.1" 200 None
2026-03-28 19:00:50 [auto1.nl] INFO: Saving data for LF56220: {'auction_closing_time': 1774883151.0, 'created_time': 1774526504.617716, 'last_price_update_time': 1774724450.006138}
2026-03-28 19:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='LF56220') HTTP/1.1" 204 0
2026-03-28 19:00:50 [auto1.nl] INFO: Found listing with ID: VU71978
2026-03-28 19:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VU71978%27 HTTP/1.1" 200 None
2026-03-28 19:00:50 [auto1.nl] INFO: Scrape type for VU71978: 0
2026-03-28 19:00:50 [auto1.nl] INFO: Found listing with ID: AY58936
2026-03-28 19:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AY58936%27 HTTP/1.1" 200 None
2026-03-28 19:00:50 [auto1.nl] INFO: Scrape type for AY58936: 0
2026-03-28 19:00:50 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 19:00:50 [auto1.nl] INFO: Channel: 24h | Page: 8 | totalHits: 647 | hits on page: 40
2026-03-28 19:00:50 [auto1.nl] INFO: Found listing with ID: VH08569
2026-03-28 19:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VH08569%27 HTTP/1.1" 200 None
2026-03-28 19:00:50 [auto1.nl] INFO: Scrape type for VH08569: 0
2026-03-28 19:00:50 [auto1.nl] INFO: Found listing with ID: YH72796
2026-03-28 19:00:50 [auto1.nl] INFO: Found listing with ID: AE74076
2026-03-28 19:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AE74076%27 HTTP/1.1" 200 None
2026-03-28 19:00:50 [auto1.nl] INFO: Scrape type for AE74076: 0
2026-03-28 19:00:50 [auto1.nl] INFO: Found listing with ID: GG02103
2026-03-28 19:00:50 [auto1.nl] INFO: Found listing with ID: NB25760
2026-03-28 19:00:50 [auto1.nl] INFO: Found listing with ID: XJ71773
2026-03-28 19:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XJ71773%27 HTTP/1.1" 200 None
2026-03-28 19:00:50 [auto1.nl] INFO: Scrape type for XJ71773: 0
2026-03-28 19:00:50 [auto1.nl] INFO: Found listing with ID: GY41852
2026-03-28 19:00:50 [auto1.nl] INFO: Found listing with ID: LF75031
2026-03-28 19:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LF75031%27 HTTP/1.1" 200 None
2026-03-28 19:00:50 [auto1.nl] INFO: Scrape type for LF75031: 2
2026-03-28 19:00:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d75e2fd9-74f2-5434-b24d-766a89eebb30 with identifier: LF75031
2026-03-28 19:00:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d75e2fd9-74f2-5434-b24d-766a89eebb30 with scrape type 2
2026-03-28 19:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d75e2fd9-74f2-5434-b24d-766a89eebb30 with scrape type 2
2026-03-28 19:00:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: d75e2fd9-74f2-5434-b24d-766a89eebb30, identifier: LF75031
2026-03-28 19:00:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: d75e2fd9-74f2-5434-b24d-766a89eebb30 with identifier: LF75031
2026-03-28 19:00:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: d75e2fd9-74f2-5434-b24d-766a89eebb30 with identifier: LF75031
2026-03-28 19:00:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: d75e2fd9-74f2-5434-b24d-766a89eebb30 with identifier: LF75031 to the API
2026-03-28 19:00:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 19:00:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 19:00:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:00:11Z',
 'fuel_type': 'petrol',
 'id': 'd75e2fd9-74f2-5434-b24d-766a89eebb30',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LF75031',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 144832,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-11-24',
 'seller_name': None,
 'title': 'BMW 3er 320i GT',
 'transmission': 'automatic',
 'trim': '',
 'year': 2017}
2026-03-28 19:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LF75031%27 HTTP/1.1" 200 None
2026-03-28 19:00:50 [auto1.nl] INFO: Saving data for LF75031: {'auction_closing_time': 1774882811.0, 'created_time': 1774638038.873056, 'last_price_update_time': 1774724450.754308}
2026-03-28 19:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='LF75031') HTTP/1.1" 204 0
2026-03-28 19:00:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:00:50 [auto1.nl] INFO: Found listing with ID: PP29341
2026-03-28 19:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PP29341%27 HTTP/1.1" 200 None
2026-03-28 19:00:50 [auto1.nl] INFO: Scrape type for PP29341: 0
2026-03-28 19:00:50 [auto1.nl] INFO: Found listing with ID: ZY76952
2026-03-28 19:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZY76952%27 HTTP/1.1" 200 None
2026-03-28 19:00:50 [auto1.nl] INFO: Scrape type for ZY76952: 0
2026-03-28 19:00:50 [auto1.nl] INFO: Found listing with ID: FC33520
2026-03-28 19:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FC33520%27 HTTP/1.1" 200 None
2026-03-28 19:00:50 [auto1.nl] INFO: Scrape type for FC33520: 2
2026-03-28 19:00:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7f2a6450-f659-5f76-bd5f-f8182c999bcc with identifier: FC33520
2026-03-28 19:00:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7f2a6450-f659-5f76-bd5f-f8182c999bcc with scrape type 2
2026-03-28 19:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7f2a6450-f659-5f76-bd5f-f8182c999bcc with scrape type 2
2026-03-28 19:00:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 7f2a6450-f659-5f76-bd5f-f8182c999bcc, identifier: FC33520
2026-03-28 19:00:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 7f2a6450-f659-5f76-bd5f-f8182c999bcc with identifier: FC33520
2026-03-28 19:00:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 7f2a6450-f659-5f76-bd5f-f8182c999bcc with identifier: FC33520
2026-03-28 19:00:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 7f2a6450-f659-5f76-bd5f-f8182c999bcc with identifier: FC33520 to the API
2026-03-28 19:00:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 19:00:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 19:00:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:35:13Z',
 'fuel_type': 'petrol',
 'id': '7f2a6450-f659-5f76-bd5f-f8182c999bcc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FC33520',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 220347,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-06-22',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 1.4 TSI Sport & Style BlueMotion Tech',
 'transmission': 'automatic',
 'trim': 'Sport & Style BlueMotion Tech',
 'year': 2015}
2026-03-28 19:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FC33520%27 HTTP/1.1" 200 None
2026-03-28 19:00:51 [auto1.nl] INFO: Saving data for FC33520: {'auction_closing_time': 1774884913.0, 'created_time': 1774526496.69668, 'last_price_update_time': 1774724451.249882}
2026-03-28 19:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='FC33520') HTTP/1.1" 204 0
2026-03-28 19:00:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XW28642/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 19:00:51 [auto1.nl] INFO: Found listing with ID: NF23683
2026-03-28 19:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NF23683%27 HTTP/1.1" 200 None
2026-03-28 19:00:51 [auto1.nl] INFO: Scrape type for NF23683: 0
2026-03-28 19:00:51 [auto1.nl] INFO: Found listing with ID: EG83115
2026-03-28 19:00:51 [auto1.nl] INFO: Found listing with ID: CR43638
2026-03-28 19:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CR43638%27 HTTP/1.1" 200 None
2026-03-28 19:00:51 [auto1.nl] INFO: Scrape type for CR43638: 0
2026-03-28 19:00:51 [auto1.nl] INFO: Found listing with ID: UC91516
2026-03-28 19:00:51 [auto1.nl] INFO: Found listing with ID: LH66044
2026-03-28 19:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LH66044%27 HTTP/1.1" 200 None
2026-03-28 19:00:51 [auto1.nl] INFO: Scrape type for LH66044: 0
2026-03-28 19:00:51 [auto1.nl] INFO: Found listing with ID: DA29812
2026-03-28 19:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DA29812%27 HTTP/1.1" 200 None
2026-03-28 19:00:51 [auto1.nl] INFO: Scrape type for DA29812: 0
2026-03-28 19:00:51 [auto1.nl] INFO: Found listing with ID: XJ87481
2026-03-28 19:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XJ87481%27 HTTP/1.1" 200 None
2026-03-28 19:00:51 [auto1.nl] INFO: Scrape type for XJ87481: 0
2026-03-28 19:00:51 [auto1.nl] INFO: Found listing with ID: EM54492
2026-03-28 19:00:51 [auto1.nl] INFO: Found listing with ID: NH69771
2026-03-28 19:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NH69771%27 HTTP/1.1" 200 None
2026-03-28 19:00:51 [auto1.nl] INFO: Scrape type for NH69771: 0
2026-03-28 19:00:51 [auto1.nl] INFO: Found listing with ID: YZ09106
2026-03-28 19:00:51 [auto1.nl] INFO: Found listing with ID: SB99593
2026-03-28 19:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SB99593%27 HTTP/1.1" 200 None
2026-03-28 19:00:51 [auto1.nl] INFO: Scrape type for SB99593: 0
2026-03-28 19:00:51 [auto1.nl] INFO: Found listing with ID: AM42063
2026-03-28 19:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AM42063%27 HTTP/1.1" 200 None
2026-03-28 19:00:51 [auto1.nl] INFO: Scrape type for AM42063: 1
2026-03-28 19:00:51 [auto1.nl] INFO: Found listing with ID: VV88142
2026-03-28 19:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VV88142%27 HTTP/1.1" 200 None
2026-03-28 19:00:51 [auto1.nl] INFO: Scrape type for VV88142: 0
2026-03-28 19:00:51 [auto1.nl] INFO: Found listing with ID: GN89359
2026-03-28 19:00:51 [auto1.nl] INFO: Found listing with ID: TC30391
2026-03-28 19:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TC30391%27 HTTP/1.1" 200 None
2026-03-28 19:00:51 [auto1.nl] INFO: Scrape type for TC30391: 0
2026-03-28 19:00:51 [auto1.nl] INFO: Found listing with ID: NS14796
2026-03-28 19:00:51 [auto1.nl] INFO: Found listing with ID: KV69786
2026-03-28 19:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KV69786%27 HTTP/1.1" 200 None
2026-03-28 19:00:51 [auto1.nl] INFO: Scrape type for KV69786: 0
2026-03-28 19:00:51 [auto1.nl] INFO: Found listing with ID: AZ90827
2026-03-28 19:00:51 [auto1.nl] INFO: Found listing with ID: VH01672
2026-03-28 19:00:51 [auto1.nl] INFO: Found listing with ID: JX11008
2026-03-28 19:00:51 [auto1.nl] INFO: Found listing with ID: EM66057
2026-03-28 19:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EM66057%27 HTTP/1.1" 200 None
2026-03-28 19:00:51 [auto1.nl] INFO: Scrape type for EM66057: 0
2026-03-28 19:00:51 [auto1.nl] INFO: Found listing with ID: AL57491
2026-03-28 19:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AL57491%27 HTTP/1.1" 200 None
2026-03-28 19:00:51 [auto1.nl] INFO: Scrape type for AL57491: 0
2026-03-28 19:00:51 [auto1.nl] INFO: Found listing with ID: MW03156
2026-03-28 19:00:51 [auto1.nl] INFO: Found listing with ID: HJ58386
2026-03-28 19:00:51 [auto1.nl] INFO: Found listing with ID: VR09113
2026-03-28 19:00:51 [auto1.nl] INFO: Found listing with ID: GX38555
2026-03-28 19:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GX38555%27 HTTP/1.1" 200 None
2026-03-28 19:00:51 [auto1.nl] INFO: Scrape type for GX38555: 0
2026-03-28 19:00:51 [auto1.nl] INFO: Found listing with ID: ML76723
2026-03-28 19:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ML76723%27 HTTP/1.1" 200 None
2026-03-28 19:00:51 [auto1.nl] INFO: Scrape type for ML76723: 0
2026-03-28 19:00:51 [auto1.nl] INFO: Found listing with ID: PD24155
2026-03-28 19:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PD24155%27 HTTP/1.1" 200 None
2026-03-28 19:00:51 [auto1.nl] INFO: Scrape type for PD24155: 0
2026-03-28 19:00:51 [auto1.nl] INFO: Found listing with ID: GK86118
2026-03-28 19:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GK86118%27 HTTP/1.1" 200 None
2026-03-28 19:00:51 [auto1.nl] INFO: Scrape type for GK86118: 0
2026-03-28 19:00:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EP75091> (referer: https://www.auto1.com/v1/car-details-view/EP75091/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 19:00:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:00:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:00:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b2708f25-630d-56aa-9cd4-7745c27257ea with identifier: EP75091
2026-03-28 19:00:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b2708f25-630d-56aa-9cd4-7745c27257ea with scrape type 1
2026-03-28 19:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 4 photos for item b2708f25-630d-56aa-9cd4-7745c27257ea
2026-03-28 19:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F54%252Fb754fca024ec49bc281c44920d506374%252Fpa%252FEP75091_570cd72313473e9d498becce67500917.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/54/b754fca024ec49bc281c44920d506374/pa/EP75091_570cd72313473e9d498becce67500917.jpg already downloaded
2026-03-28 19:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F54%252Fb754fca024ec49bc281c44920d506374%252Fpa%252FEP75091_e5ed934aad400bf7a8a78256733b5a8f.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/54/b754fca024ec49bc281c44920d506374/pa/EP75091_e5ed934aad400bf7a8a78256733b5a8f.jpg already downloaded
2026-03-28 19:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F54%252Fb754fca024ec49bc281c44920d506374%252Fpa%252FEP75091_2f2dbb824c812c4bde51023530ab1f3c.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/54/b754fca024ec49bc281c44920d506374/pa/EP75091_2f2dbb824c812c4bde51023530ab1f3c.jpg already downloaded
2026-03-28 19:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F54%252Fb754fca024ec49bc281c44920d506374%252Fpa%252FEP75091_3be620dbd174cf0cfbeca99e52f50cdd.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/54/b754fca024ec49bc281c44920d506374/pa/EP75091_3be620dbd174cf0cfbeca99e52f50cdd.jpg already downloaded
2026-03-28 19:00:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: b2708f25-630d-56aa-9cd4-7745c27257ea, identifier: EP75091
2026-03-28 19:00:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: b2708f25-630d-56aa-9cd4-7745c27257ea with identifier: EP75091
2026-03-28 19:00:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: b2708f25-630d-56aa-9cd4-7745c27257ea with identifier: EP75091
2026-03-28 19:00:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: b2708f25-630d-56aa-9cd4-7745c27257ea with identifier: EP75091 to the API
2026-03-28 19:00:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 19:00:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 19:00:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/EP75091>
{'auction_title': '',
 'c_o_2_emission_value': 116,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.2L',
 'engine_horse_power': 95,
 'expiration_date': '2026-03-30T15:41:37Z',
 'fuel_type': 'petrol',
 'id': 'b2708f25-630d-56aa-9cd4-7745c27257ea',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '15RNZ6',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EP75091',
 'listing': 'auction',
 'location': 'NL, Oosterhout',
 'make': 'Opel',
 'model': 'Agila',
 'odometer': 111768,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 4,
 'photo_urls': ['https://img-pa.auto1.com/imgb7/54/b754fca024ec49bc281c44920d506374/pa/EP75091_570cd72313473e9d498becce67500917.jpg',
                'https://img-pa.auto1.com/imgb7/54/b754fca024ec49bc281c44920d506374/pa/EP75091_e5ed934aad400bf7a8a78256733b5a8f.jpg',
                'https://img-pa.auto1.com/imgb7/54/b754fca024ec49bc281c44920d506374/pa/EP75091_2f2dbb824c812c4bde51023530ab1f3c.jpg',
                'https://img-pa.auto1.com/imgb7/54/b754fca024ec49bc281c44920d506374/pa/EP75091_3be620dbd174cf0cfbeca99e52f50cdd.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2708f25-630d-56aa-9cd4-7745c27257ea/b2708f25-630d-56aa-9cd4-7745c27257ea_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73785,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb7/54/b754fca024ec49bc281c44920d506374/pa/EP75091_570cd72313473e9d498becce67500917.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2708f25-630d-56aa-9cd4-7745c27257ea/b2708f25-630d-56aa-9cd4-7745c27257ea_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64323,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb7/54/b754fca024ec49bc281c44920d506374/pa/EP75091_e5ed934aad400bf7a8a78256733b5a8f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2708f25-630d-56aa-9cd4-7745c27257ea/b2708f25-630d-56aa-9cd4-7745c27257ea_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67613,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb7/54/b754fca024ec49bc281c44920d506374/pa/EP75091_2f2dbb824c812c4bde51023530ab1f3c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2708f25-630d-56aa-9cd4-7745c27257ea/b2708f25-630d-56aa-9cd4-7745c27257ea_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50617,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb7/54/b754fca024ec49bc281c44920d506374/pa/EP75091_3be620dbd174cf0cfbeca99e52f50cdd.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-07-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Agila 1.2 Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2011}
2026-03-28 19:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EP75091%27 HTTP/1.1" 200 None
2026-03-28 19:00:52 [auto1.nl] INFO: Saving data for EP75091: {'created_time': 1774724452.324599, 'last_price_update_time': 1774724452.324612, 'auction_closing_time': 1774885297.0}
2026-03-28 19:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='EP75091') HTTP/1.1" 204 0
2026-03-28 19:00:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XW28642> (referer: https://www.auto1.com/v1/car-details-view/XW28642/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 19:00:53 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 19:00:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AM42063/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 19:00:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a5f08860-8802-5c0a-9533-607799279a29 with identifier: XW28642
2026-03-28 19:00:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a5f08860-8802-5c0a-9533-607799279a29 with scrape type 1
2026-03-28 19:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item a5f08860-8802-5c0a-9533-607799279a29
2026-03-28 19:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F73%252Fc37354f66621aba968b226a24ae81827%252Fpa%252FXW28642_8b1b3c47e19a8ebc4fc554edead268a9.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/73/c37354f66621aba968b226a24ae81827/pa/XW28642_8b1b3c47e19a8ebc4fc554edead268a9.jpg not downloaded yet
2026-03-28 19:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F73%252Fc37354f66621aba968b226a24ae81827%252Fpa%252FXW28642_d98bfda60d03131bd0a9c50d87df3576.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/73/c37354f66621aba968b226a24ae81827/pa/XW28642_d98bfda60d03131bd0a9c50d87df3576.jpg not downloaded yet
2026-03-28 19:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F73%252Fc37354f66621aba968b226a24ae81827%252Fpa%252FXW28642_0c073624d28d41cff7c4b5f4b82291e5.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/73/c37354f66621aba968b226a24ae81827/pa/XW28642_0c073624d28d41cff7c4b5f4b82291e5.jpg not downloaded yet
2026-03-28 19:00:53 [auto1.nl] INFO: Channel: 24h | Page: 9 | totalHits: 647 | hits on page: 40
2026-03-28 19:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F73%252Fc37354f66621aba968b226a24ae81827%252Fpa%252FXW28642_6d3b24d8ed134b1d1af708c55d615b25.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/73/c37354f66621aba968b226a24ae81827/pa/XW28642_6d3b24d8ed134b1d1af708c55d615b25.jpg not downloaded yet
2026-03-28 19:00:53 [auto1.nl] INFO: Found listing with ID: FH88416
2026-03-28 19:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FH88416%27 HTTP/1.1" 200 None
2026-03-28 19:00:53 [auto1.nl] INFO: Scrape type for FH88416: 0
2026-03-28 19:00:53 [auto1.nl] INFO: Found listing with ID: KD36085
2026-03-28 19:00:53 [auto1.nl] INFO: Found listing with ID: JN86544
2026-03-28 19:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JN86544%27 HTTP/1.1" 200 None
2026-03-28 19:00:53 [auto1.nl] INFO: Scrape type for JN86544: 0
2026-03-28 19:00:53 [auto1.nl] INFO: Found listing with ID: GY00070
2026-03-28 19:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GY00070%27 HTTP/1.1" 200 None
2026-03-28 19:00:53 [auto1.nl] INFO: Scrape type for GY00070: 0
2026-03-28 19:00:53 [auto1.nl] INFO: Found listing with ID: GB93242
2026-03-28 19:00:53 [auto1.nl] INFO: Found listing with ID: YN37403
2026-03-28 19:00:53 [auto1.nl] INFO: Found listing with ID: FE21861
2026-03-28 19:00:53 [auto1.nl] INFO: Found listing with ID: HZ03058
2026-03-28 19:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HZ03058%27 HTTP/1.1" 200 None
2026-03-28 19:00:53 [auto1.nl] INFO: Scrape type for HZ03058: 0
2026-03-28 19:00:53 [auto1.nl] INFO: Found listing with ID: FA84913
2026-03-28 19:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FA84913%27 HTTP/1.1" 200 None
2026-03-28 19:00:53 [auto1.nl] INFO: Scrape type for FA84913: 0
2026-03-28 19:00:53 [auto1.nl] INFO: Found listing with ID: FK39304
2026-03-28 19:00:53 [auto1.nl] INFO: Found listing with ID: LU83430
2026-03-28 19:00:53 [auto1.nl] INFO: Found listing with ID: CC90793
2026-03-28 19:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CC90793%27 HTTP/1.1" 200 None
2026-03-28 19:00:53 [auto1.nl] INFO: Scrape type for CC90793: 0
2026-03-28 19:00:53 [auto1.nl] INFO: Found listing with ID: PY93062
2026-03-28 19:00:53 [auto1.nl] INFO: Found listing with ID: DD65196
2026-03-28 19:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DD65196%27 HTTP/1.1" 200 None
2026-03-28 19:00:53 [auto1.nl] INFO: Scrape type for DD65196: 0
2026-03-28 19:00:53 [auto1.nl] INFO: Found listing with ID: LG18300
2026-03-28 19:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LG18300%27 HTTP/1.1" 200 None
2026-03-28 19:00:53 [auto1.nl] INFO: Scrape type for LG18300: 0
2026-03-28 19:00:53 [auto1.nl] INFO: Found listing with ID: RF14080
2026-03-28 19:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RF14080%27 HTTP/1.1" 200 None
2026-03-28 19:00:53 [auto1.nl] INFO: Scrape type for RF14080: 2
2026-03-28 19:00:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f58db08d-2df7-51eb-b014-a8599e085b07 with identifier: RF14080
2026-03-28 19:00:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f58db08d-2df7-51eb-b014-a8599e085b07 with scrape type 2
2026-03-28 19:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f58db08d-2df7-51eb-b014-a8599e085b07 with scrape type 2
2026-03-28 19:00:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: f58db08d-2df7-51eb-b014-a8599e085b07, identifier: RF14080
2026-03-28 19:00:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F73%252Fc37354f66621aba968b226a24ae81827%252Fpa%252FXW28642_c50bdba76611a9712a0580e68d904939.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/73/c37354f66621aba968b226a24ae81827/pa/XW28642_c50bdba76611a9712a0580e68d904939.jpg not downloaded yet
2026-03-28 19:00:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: f58db08d-2df7-51eb-b014-a8599e085b07 with identifier: RF14080
2026-03-28 19:00:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: f58db08d-2df7-51eb-b014-a8599e085b07 with identifier: RF14080
2026-03-28 19:00:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: f58db08d-2df7-51eb-b014-a8599e085b07 with identifier: RF14080 to the API
2026-03-28 19:00:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 19:00:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 19:00:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:34:27Z',
 'fuel_type': 'petrol',
 'id': 'f58db08d-2df7-51eb-b014-a8599e085b07',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RF14080',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V50',
 'odometer': 427233,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-06-10',
 'seller_name': None,
 'title': 'Volvo V50 2.4',
 'transmission': 'automatic',
 'trim': '',
 'year': 2007}
2026-03-28 19:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RF14080%27 HTTP/1.1" 200 None
2026-03-28 19:00:53 [auto1.nl] INFO: Saving data for RF14080: {'auction_closing_time': 1774884867.0, 'created_time': 1774526469.927141, 'last_price_update_time': 1774724453.975456}
2026-03-28 19:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='RF14080') HTTP/1.1" 204 0
2026-03-28 19:00:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/73/c37354f66621aba968b226a24ae81827/pa/XW28642_8b1b3c47e19a8ebc4fc554edead268a9.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:00:54 [auto1.nl] INFO: Found listing with ID: PY55457
2026-03-28 19:00:54 [auto1.nl] INFO: Found listing with ID: AG89497
2026-03-28 19:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AG89497%27 HTTP/1.1" 200 None
2026-03-28 19:00:54 [auto1.nl] INFO: Scrape type for AG89497: 0
2026-03-28 19:00:54 [auto1.nl] INFO: Found listing with ID: CL54405
2026-03-28 19:00:54 [auto1.nl] INFO: Found listing with ID: AJ38016
2026-03-28 19:00:54 [auto1.nl] INFO: Found listing with ID: HW48392
2026-03-28 19:00:54 [auto1.nl] INFO: Found listing with ID: KP98004
2026-03-28 19:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KP98004%27 HTTP/1.1" 200 None
2026-03-28 19:00:54 [auto1.nl] INFO: Scrape type for KP98004: 2
2026-03-28 19:00:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 32785756-aa7c-5091-908d-c11fe7e13fe3 with identifier: KP98004
2026-03-28 19:00:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 32785756-aa7c-5091-908d-c11fe7e13fe3 with scrape type 2
2026-03-28 19:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 32785756-aa7c-5091-908d-c11fe7e13fe3 with scrape type 2
2026-03-28 19:00:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 32785756-aa7c-5091-908d-c11fe7e13fe3, identifier: KP98004
2026-03-28 19:00:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/73/c37354f66621aba968b226a24ae81827/pa/XW28642_d98bfda60d03131bd0a9c50d87df3576.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:00:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 32785756-aa7c-5091-908d-c11fe7e13fe3 with identifier: KP98004
2026-03-28 19:00:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 32785756-aa7c-5091-908d-c11fe7e13fe3 with identifier: KP98004
2026-03-28 19:00:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 32785756-aa7c-5091-908d-c11fe7e13fe3 with identifier: KP98004 to the API
2026-03-28 19:00:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 19:00:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 19:00:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 394,
 'expiration_date': '2026-03-30T15:05:07Z',
 'fuel_type': 'hybrid',
 'id': '32785756-aa7c-5091-908d-c11fe7e13fe3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KP98004',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X5',
 'odometer': 72861,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-04-30',
 'seller_name': None,
 'title': 'BMW X5 xDrive 45e',
 'transmission': 'automatic',
 'trim': '',
 'year': 2021}
2026-03-28 19:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KP98004%27 HTTP/1.1" 200 None
2026-03-28 19:00:54 [auto1.nl] INFO: Saving data for KP98004: {'auction_closing_time': 1774883107.0, 'created_time': 1774526471.831529, 'last_price_update_time': 1774724454.585109}
2026-03-28 19:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='KP98004') HTTP/1.1" 204 0
2026-03-28 19:00:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/73/c37354f66621aba968b226a24ae81827/pa/XW28642_0c073624d28d41cff7c4b5f4b82291e5.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:00:54 [auto1.nl] INFO: Found listing with ID: RJ32742
2026-03-28 19:00:54 [auto1.nl] INFO: Found listing with ID: PP40573
2026-03-28 19:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PP40573%27 HTTP/1.1" 200 None
2026-03-28 19:00:54 [auto1.nl] INFO: Scrape type for PP40573: 0
2026-03-28 19:00:54 [auto1.nl] INFO: Found listing with ID: MD45251
2026-03-28 19:00:54 [auto1.nl] INFO: Found listing with ID: ME73088
2026-03-28 19:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ME73088%27 HTTP/1.1" 200 None
2026-03-28 19:00:54 [auto1.nl] INFO: Scrape type for ME73088: 0
2026-03-28 19:00:54 [auto1.nl] INFO: Found listing with ID: BD38212
2026-03-28 19:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BD38212%27 HTTP/1.1" 200 None
2026-03-28 19:00:54 [auto1.nl] INFO: Scrape type for BD38212: 0
2026-03-28 19:00:54 [auto1.nl] INFO: Found listing with ID: EJ39658
2026-03-28 19:00:54 [auto1.nl] INFO: Found listing with ID: JA96094
2026-03-28 19:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JA96094%27 HTTP/1.1" 200 None
2026-03-28 19:00:54 [auto1.nl] INFO: Scrape type for JA96094: 0
2026-03-28 19:00:54 [auto1.nl] INFO: Found listing with ID: ME20407
2026-03-28 19:00:54 [auto1.nl] INFO: Found listing with ID: ZR26013
2026-03-28 19:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZR26013%27 HTTP/1.1" 200 None
2026-03-28 19:00:54 [auto1.nl] INFO: Scrape type for ZR26013: 0
2026-03-28 19:00:54 [auto1.nl] INFO: Found listing with ID: LG71332
2026-03-28 19:00:54 [auto1.nl] INFO: Found listing with ID: RM92541
2026-03-28 19:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RM92541%27 HTTP/1.1" 200 None
2026-03-28 19:00:54 [auto1.nl] INFO: Scrape type for RM92541: 0
2026-03-28 19:00:54 [auto1.nl] INFO: Found listing with ID: KF49809
2026-03-28 19:00:54 [auto1.nl] INFO: Found listing with ID: UY50656
2026-03-28 19:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UY50656%27 HTTP/1.1" 200 None
2026-03-28 19:00:54 [auto1.nl] INFO: Scrape type for UY50656: 0
2026-03-28 19:00:54 [auto1.nl] INFO: Found listing with ID: CP77095
2026-03-28 19:00:54 [auto1.nl] INFO: Found listing with ID: AM07460
2026-03-28 19:00:54 [auto1.nl] INFO: Found listing with ID: SA65575
2026-03-28 19:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SA65575%27 HTTP/1.1" 200 None
2026-03-28 19:00:54 [auto1.nl] INFO: Scrape type for SA65575: 0
2026-03-28 19:00:54 [auto1.nl] INFO: Found listing with ID: FC64695
2026-03-28 19:00:54 [auto1.nl] INFO: Found listing with ID: LS97590
2026-03-28 19:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LS97590%27 HTTP/1.1" 200 None
2026-03-28 19:00:54 [auto1.nl] INFO: Scrape type for LS97590: 2
2026-03-28 19:00:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 910f7408-963a-5ab7-a56a-45152d4c3d36 with identifier: LS97590
2026-03-28 19:00:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 910f7408-963a-5ab7-a56a-45152d4c3d36 with scrape type 2
2026-03-28 19:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 910f7408-963a-5ab7-a56a-45152d4c3d36 with scrape type 2
2026-03-28 19:00:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 910f7408-963a-5ab7-a56a-45152d4c3d36, identifier: LS97590
2026-03-28 19:00:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:00:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 910f7408-963a-5ab7-a56a-45152d4c3d36 with identifier: LS97590
2026-03-28 19:00:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 910f7408-963a-5ab7-a56a-45152d4c3d36 with identifier: LS97590
2026-03-28 19:00:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 910f7408-963a-5ab7-a56a-45152d4c3d36 with identifier: LS97590 to the API
2026-03-28 19:00:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 19:00:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 19:00:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 109,
 'expiration_date': '2026-03-30T15:26:50Z',
 'fuel_type': 'petrol',
 'id': '910f7408-963a-5ab7-a56a-45152d4c3d36',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LS97590',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 81114,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-20',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 160',
 'transmission': 'manual',
 'trim': '',
 'year': 2019}
2026-03-28 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LS97590%27 HTTP/1.1" 200 None
2026-03-28 19:00:55 [auto1.nl] INFO: Saving data for LS97590: {'auction_closing_time': 1774884410.0, 'created_time': 1774033368.996738, 'last_price_update_time': 1774724455.26651}
2026-03-28 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='LS97590') HTTP/1.1" 204 0
2026-03-28 19:00:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:00:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bd723be10>
2026-03-28 19:00:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:00:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:00:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:00:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5f08860-8802-5c0a-9533-607799279a29/a5f08860-8802-5c0a-9533-607799279a29_image_0.jpg HTTP/1.1" 201 0
2026-03-28 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F73%252Fc37354f66621aba968b226a24ae81827%252Fpa%252FXW28642_8b1b3c47e19a8ebc4fc554edead268a9.jpg') HTTP/1.1" 204 0
2026-03-28 19:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/73/c37354f66621aba968b226a24ae81827/pa/XW28642_8b1b3c47e19a8ebc4fc554edead268a9.jpg saved to cache
2026-03-28 19:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a5f08860-8802-5c0a-9533-607799279a29
2026-03-28 19:00:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:00:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bd72f2150>
2026-03-28 19:00:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:00:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:00:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:00:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5f08860-8802-5c0a-9533-607799279a29/a5f08860-8802-5c0a-9533-607799279a29_image_1.jpg HTTP/1.1" 201 0
2026-03-28 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F73%252Fc37354f66621aba968b226a24ae81827%252Fpa%252FXW28642_d98bfda60d03131bd0a9c50d87df3576.jpg') HTTP/1.1" 204 0
2026-03-28 19:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/73/c37354f66621aba968b226a24ae81827/pa/XW28642_d98bfda60d03131bd0a9c50d87df3576.jpg saved to cache
2026-03-28 19:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a5f08860-8802-5c0a-9533-607799279a29
2026-03-28 19:00:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/73/c37354f66621aba968b226a24ae81827/pa/XW28642_c50bdba76611a9712a0580e68d904939.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:00:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/73/c37354f66621aba968b226a24ae81827/pa/XW28642_6d3b24d8ed134b1d1af708c55d615b25.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:00:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:00:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bdd4f7710>
2026-03-28 19:00:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:00:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:00:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:00:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5f08860-8802-5c0a-9533-607799279a29/a5f08860-8802-5c0a-9533-607799279a29_image_2.jpg HTTP/1.1" 201 0
2026-03-28 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F73%252Fc37354f66621aba968b226a24ae81827%252Fpa%252FXW28642_0c073624d28d41cff7c4b5f4b82291e5.jpg') HTTP/1.1" 204 0
2026-03-28 19:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/73/c37354f66621aba968b226a24ae81827/pa/XW28642_0c073624d28d41cff7c4b5f4b82291e5.jpg saved to cache
2026-03-28 19:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a5f08860-8802-5c0a-9533-607799279a29
2026-03-28 19:00:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:00:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bd72dde10>
2026-03-28 19:00:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:00:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:00:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:00:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5f08860-8802-5c0a-9533-607799279a29/a5f08860-8802-5c0a-9533-607799279a29_image_4.jpg HTTP/1.1" 201 0
2026-03-28 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F73%252Fc37354f66621aba968b226a24ae81827%252Fpa%252FXW28642_c50bdba76611a9712a0580e68d904939.jpg') HTTP/1.1" 204 0
2026-03-28 19:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/73/c37354f66621aba968b226a24ae81827/pa/XW28642_c50bdba76611a9712a0580e68d904939.jpg saved to cache
2026-03-28 19:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a5f08860-8802-5c0a-9533-607799279a29
2026-03-28 19:00:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:00:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bdd205890>
2026-03-28 19:00:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:00:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:00:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:00:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5f08860-8802-5c0a-9533-607799279a29/a5f08860-8802-5c0a-9533-607799279a29_image_3.jpg HTTP/1.1" 201 0
2026-03-28 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F73%252Fc37354f66621aba968b226a24ae81827%252Fpa%252FXW28642_6d3b24d8ed134b1d1af708c55d615b25.jpg') HTTP/1.1" 204 0
2026-03-28 19:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/73/c37354f66621aba968b226a24ae81827/pa/XW28642_6d3b24d8ed134b1d1af708c55d615b25.jpg saved to cache
2026-03-28 19:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a5f08860-8802-5c0a-9533-607799279a29
2026-03-28 19:00:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a5f08860-8802-5c0a-9533-607799279a29, skipping ID generation
2026-03-28 19:00:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a5f08860-8802-5c0a-9533-607799279a29 with scrape type 1
2026-03-28 19:00:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a5f08860-8802-5c0a-9533-607799279a29 sending to next pipeline
2026-03-28 19:00:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: a5f08860-8802-5c0a-9533-607799279a29, identifier: XW28642
2026-03-28 19:00:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: a5f08860-8802-5c0a-9533-607799279a29 with identifier: XW28642
2026-03-28 19:00:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: a5f08860-8802-5c0a-9533-607799279a29 with identifier: XW28642
2026-03-28 19:00:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: a5f08860-8802-5c0a-9533-607799279a29 with identifier: XW28642 to the API
2026-03-28 19:00:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 19:00:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 19:00:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgc3/73/c37354f66621aba968b226a24ae81827/pa/XW28642_6d3b24d8ed134b1d1af708c55d615b25.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 143,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:01:02Z',
 'fuel_type': 'petrol',
 'id': 'a5f08860-8802-5c0a-9533-607799279a29',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'JB485D',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XW28642',
 'listing': 'auction',
 'location': 'NL, Amsterdam',
 'make': 'BMW',
 'model': '1er',
 'odometer': 242245,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5f08860-8802-5c0a-9533-607799279a29/a5f08860-8802-5c0a-9533-607799279a29_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88762,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/73/c37354f66621aba968b226a24ae81827/pa/XW28642_8b1b3c47e19a8ebc4fc554edead268a9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5f08860-8802-5c0a-9533-607799279a29/a5f08860-8802-5c0a-9533-607799279a29_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68910,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/73/c37354f66621aba968b226a24ae81827/pa/XW28642_d98bfda60d03131bd0a9c50d87df3576.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5f08860-8802-5c0a-9533-607799279a29/a5f08860-8802-5c0a-9533-607799279a29_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89164,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/73/c37354f66621aba968b226a24ae81827/pa/XW28642_0c073624d28d41cff7c4b5f4b82291e5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5f08860-8802-5c0a-9533-607799279a29/a5f08860-8802-5c0a-9533-607799279a29_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95729,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/73/c37354f66621aba968b226a24ae81827/pa/XW28642_6d3b24d8ed134b1d1af708c55d615b25.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5f08860-8802-5c0a-9533-607799279a29/a5f08860-8802-5c0a-9533-607799279a29_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59669,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/73/c37354f66621aba968b226a24ae81827/pa/XW28642_c50bdba76611a9712a0580e68d904939.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-03-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1er 116i',
 'transmission': 'manual',
 'trim': '',
 'year': 2011}
2026-03-28 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XW28642%27 HTTP/1.1" 200 None
2026-03-28 19:00:56 [auto1.nl] INFO: Saving data for XW28642: {'created_time': 1774724456.08019, 'last_price_update_time': 1774724456.080199, 'auction_closing_time': 1774882862.0}
2026-03-28 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='XW28642') HTTP/1.1" 204 0
2026-03-28 19:00:56 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 19:00:56 [auto1.nl] INFO: Channel: 24h | Page: 10 | totalHits: 647 | hits on page: 40
2026-03-28 19:00:56 [auto1.nl] INFO: Found listing with ID: HX62169
2026-03-28 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HX62169%27 HTTP/1.1" 200 None
2026-03-28 19:00:56 [auto1.nl] INFO: Scrape type for HX62169: 2
2026-03-28 19:00:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fc33c8e7-9d6c-57ac-b25b-14f09f86fa76 with identifier: HX62169
2026-03-28 19:00:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fc33c8e7-9d6c-57ac-b25b-14f09f86fa76 with scrape type 2
2026-03-28 19:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fc33c8e7-9d6c-57ac-b25b-14f09f86fa76 with scrape type 2
2026-03-28 19:00:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: fc33c8e7-9d6c-57ac-b25b-14f09f86fa76, identifier: HX62169
2026-03-28 19:00:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: fc33c8e7-9d6c-57ac-b25b-14f09f86fa76 with identifier: HX62169
2026-03-28 19:00:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: fc33c8e7-9d6c-57ac-b25b-14f09f86fa76 with identifier: HX62169
2026-03-28 19:00:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: fc33c8e7-9d6c-57ac-b25b-14f09f86fa76 with identifier: HX62169 to the API
2026-03-28 19:00:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 19:00:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 19:00:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:54:48Z',
 'fuel_type': 'petrol',
 'id': 'fc33c8e7-9d6c-57ac-b25b-14f09f86fa76',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HX62169',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 122332,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-01-25',
 'seller_name': None,
 'title': 'Nissan Qashqai 1.2 Tekna',
 'transmission': 'automatic',
 'trim': 'Tekna',
 'year': 2016}
2026-03-28 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HX62169%27 HTTP/1.1" 200 None
2026-03-28 19:00:56 [auto1.nl] INFO: Saving data for HX62169: {'auction_closing_time': 1774886088.0, 'created_time': 1774612924.529413, 'last_price_update_time': 1774724456.690428}
2026-03-28 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='HX62169') HTTP/1.1" 204 0
2026-03-28 19:00:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:00:56 [auto1.nl] INFO: Found listing with ID: XY26028
2026-03-28 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XY26028%27 HTTP/1.1" 200 None
2026-03-28 19:00:56 [auto1.nl] INFO: Scrape type for XY26028: 0
2026-03-28 19:00:56 [auto1.nl] INFO: Found listing with ID: FE91435
2026-03-28 19:00:56 [auto1.nl] INFO: Found listing with ID: RY51498
2026-03-28 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RY51498%27 HTTP/1.1" 200 None
2026-03-28 19:00:56 [auto1.nl] INFO: Scrape type for RY51498: 2
2026-03-28 19:00:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 01169767-6f64-578c-bae4-993e41c16c16 with identifier: RY51498
2026-03-28 19:00:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 01169767-6f64-578c-bae4-993e41c16c16 with scrape type 2
2026-03-28 19:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 01169767-6f64-578c-bae4-993e41c16c16 with scrape type 2
2026-03-28 19:00:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 01169767-6f64-578c-bae4-993e41c16c16, identifier: RY51498
2026-03-28 19:00:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 01169767-6f64-578c-bae4-993e41c16c16 with identifier: RY51498
2026-03-28 19:00:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 01169767-6f64-578c-bae4-993e41c16c16 with identifier: RY51498
2026-03-28 19:00:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 01169767-6f64-578c-bae4-993e41c16c16 with identifier: RY51498 to the API
2026-03-28 19:00:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 19:00:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 19:00:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:04:23Z',
 'fuel_type': 'petrol',
 'id': '01169767-6f64-578c-bae4-993e41c16c16',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RY51498',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 264209,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2004-01-16',
 'seller_name': None,
 'title': 'Volkswagen Touran 2.0 FSI Highline',
 'transmission': 'manual',
 'trim': 'Highline',
 'year': 2004}
2026-03-28 19:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RY51498%27 HTTP/1.1" 200 None
2026-03-28 19:00:57 [auto1.nl] INFO: Saving data for RY51498: {'auction_closing_time': 1774883063.0, 'created_time': 1774033466.589215, 'last_price_update_time': 1774724457.141268}
2026-03-28 19:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='RY51498') HTTP/1.1" 204 0
2026-03-28 19:00:57 [auto1.nl] INFO: Found listing with ID: VC22580
2026-03-28 19:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VC22580%27 HTTP/1.1" 200 None
2026-03-28 19:00:57 [auto1.nl] INFO: Scrape type for VC22580: 0
2026-03-28 19:00:57 [auto1.nl] INFO: Found listing with ID: SD85786
2026-03-28 19:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SD85786%27 HTTP/1.1" 200 None
2026-03-28 19:00:57 [auto1.nl] INFO: Scrape type for SD85786: 0
2026-03-28 19:00:57 [auto1.nl] INFO: Found listing with ID: HR88481
2026-03-28 19:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HR88481%27 HTTP/1.1" 200 None
2026-03-28 19:00:57 [auto1.nl] INFO: Scrape type for HR88481: 0
2026-03-28 19:00:57 [auto1.nl] INFO: Found listing with ID: MP21910
2026-03-28 19:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MP21910%27 HTTP/1.1" 200 None
2026-03-28 19:00:57 [auto1.nl] INFO: Scrape type for MP21910: 2
2026-03-28 19:00:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e503149d-281b-59b6-950e-a3d8945ab770 with identifier: MP21910
2026-03-28 19:00:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e503149d-281b-59b6-950e-a3d8945ab770 with scrape type 2
2026-03-28 19:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e503149d-281b-59b6-950e-a3d8945ab770 with scrape type 2
2026-03-28 19:00:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: e503149d-281b-59b6-950e-a3d8945ab770, identifier: MP21910
2026-03-28 19:00:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AM42063> (referer: https://www.auto1.com/v1/car-details-view/AM42063/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 19:00:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: e503149d-281b-59b6-950e-a3d8945ab770 with identifier: MP21910
2026-03-28 19:00:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: e503149d-281b-59b6-950e-a3d8945ab770 with identifier: MP21910
2026-03-28 19:00:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: e503149d-281b-59b6-950e-a3d8945ab770 with identifier: MP21910 to the API
2026-03-28 19:00:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 19:00:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 19:00:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:10:04Z',
 'fuel_type': 'petrol',
 'id': 'e503149d-281b-59b6-950e-a3d8945ab770',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MP21910',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 134300,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-02-19',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 180 BlueEfficiency AMG Sport',
 'transmission': 'automatic',
 'trim': 'BlueEfficiency AMG Sport',
 'year': 2018}
2026-03-28 19:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MP21910%27 HTTP/1.1" 200 None
2026-03-28 19:00:57 [auto1.nl] INFO: Saving data for MP21910: {'auction_closing_time': 1774883404.0, 'created_time': 1774526483.338157, 'last_price_update_time': 1774724457.632194}
2026-03-28 19:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='MP21910') HTTP/1.1" 204 0
2026-03-28 19:00:57 [auto1.nl] INFO: Found listing with ID: KP34214
2026-03-28 19:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KP34214%27 HTTP/1.1" 200 None
2026-03-28 19:00:57 [auto1.nl] INFO: Scrape type for KP34214: 1
2026-03-28 19:00:57 [auto1.nl] INFO: Found listing with ID: TC15988
2026-03-28 19:00:57 [auto1.nl] INFO: Found listing with ID: SL12489
2026-03-28 19:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SL12489%27 HTTP/1.1" 200 None
2026-03-28 19:00:57 [auto1.nl] INFO: Scrape type for SL12489: 0
2026-03-28 19:00:57 [auto1.nl] INFO: Found listing with ID: PB89826
2026-03-28 19:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PB89826%27 HTTP/1.1" 200 None
2026-03-28 19:00:57 [auto1.nl] INFO: Scrape type for PB89826: 2
2026-03-28 19:00:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0924e34c-8623-57d1-a916-c0a2513425a4 with identifier: PB89826
2026-03-28 19:00:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0924e34c-8623-57d1-a916-c0a2513425a4 with scrape type 2
2026-03-28 19:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0924e34c-8623-57d1-a916-c0a2513425a4 with scrape type 2
2026-03-28 19:00:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 0924e34c-8623-57d1-a916-c0a2513425a4, identifier: PB89826
2026-03-28 19:00:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 0924e34c-8623-57d1-a916-c0a2513425a4 with identifier: PB89826
2026-03-28 19:00:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 0924e34c-8623-57d1-a916-c0a2513425a4 with identifier: PB89826
2026-03-28 19:00:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 0924e34c-8623-57d1-a916-c0a2513425a4 with identifier: PB89826 to the API
2026-03-28 19:00:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 19:00:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 19:00:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 309,
 'expiration_date': '2026-03-30T15:26:53Z',
 'fuel_type': 'hybrid',
 'id': '0924e34c-8623-57d1-a916-c0a2513425a4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PB89826',
 'listing': 'auction',
 'make': 'Land Rover',
 'model': 'Evoque',
 'odometer': 82924,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-07-06',
 'seller_name': None,
 'title': 'Land Rover Evoque P300e Hybrid R-Dynamic SE',
 'transmission': 'automatic',
 'trim': 'R-Dynamic SE',
 'year': 2022}
2026-03-28 19:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PB89826%27 HTTP/1.1" 200 None
2026-03-28 19:00:58 [auto1.nl] INFO: Saving data for PB89826: {'auction_closing_time': 1774884413.0, 'created_time': 1774353790.407247, 'last_price_update_time': 1774724458.179527}
2026-03-28 19:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='PB89826') HTTP/1.1" 204 0
2026-03-28 19:00:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:00:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a44fd0f8-2bfe-5f9b-8ea6-85057d88ae6f with identifier: AM42063
2026-03-28 19:00:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a44fd0f8-2bfe-5f9b-8ea6-85057d88ae6f with scrape type 1
2026-03-28 19:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a44fd0f8-2bfe-5f9b-8ea6-85057d88ae6f
2026-03-28 19:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F0a%252F090a569ffb3c3b66628452214eb39c80%252Fpa%252FAM42063_a372d2e3e03b8714d6591936366bcd58.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/0a/090a569ffb3c3b66628452214eb39c80/pa/AM42063_a372d2e3e03b8714d6591936366bcd58.jpg already downloaded
2026-03-28 19:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F0a%252F090a569ffb3c3b66628452214eb39c80%252Fpa%252FAM42063_6351ee5c4201cd7d2d2f647ba53970a2.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/0a/090a569ffb3c3b66628452214eb39c80/pa/AM42063_6351ee5c4201cd7d2d2f647ba53970a2.jpg already downloaded
2026-03-28 19:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F0a%252F090a569ffb3c3b66628452214eb39c80%252Fpa%252FAM42063_ff3bfa2e4fde2efbda9d7e819ba3cfcb.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/0a/090a569ffb3c3b66628452214eb39c80/pa/AM42063_ff3bfa2e4fde2efbda9d7e819ba3cfcb.jpg already downloaded
2026-03-28 19:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F0a%252F090a569ffb3c3b66628452214eb39c80%252Fpa%252FAM42063_e2dfec9e33f9a3a525e0983dd67ff8f2.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/0a/090a569ffb3c3b66628452214eb39c80/pa/AM42063_e2dfec9e33f9a3a525e0983dd67ff8f2.jpg already downloaded
2026-03-28 19:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F0a%252F090a569ffb3c3b66628452214eb39c80%252Fpa%252FAM42063_df6f2a157d1d8c0bf1b395adde891dc0.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/0a/090a569ffb3c3b66628452214eb39c80/pa/AM42063_df6f2a157d1d8c0bf1b395adde891dc0.jpg already downloaded
2026-03-28 19:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F0a%252F090a569ffb3c3b66628452214eb39c80%252Fpa%252FAM42063_8456ac6d19d45857f5b9b419b05a1c17.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/0a/090a569ffb3c3b66628452214eb39c80/pa/AM42063_8456ac6d19d45857f5b9b419b05a1c17.jpg already downloaded
2026-03-28 19:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F0a%252F090a569ffb3c3b66628452214eb39c80%252Fpa%252FAM42063_90f2586ee9709be14c886fa85428b8e4.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/0a/090a569ffb3c3b66628452214eb39c80/pa/AM42063_90f2586ee9709be14c886fa85428b8e4.jpg already downloaded
2026-03-28 19:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F0a%252F090a569ffb3c3b66628452214eb39c80%252Fpa%252FAM42063_d4f0774b9e96dc25a06f7a930cd3fd97.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/0a/090a569ffb3c3b66628452214eb39c80/pa/AM42063_d4f0774b9e96dc25a06f7a930cd3fd97.jpg already downloaded
2026-03-28 19:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F0a%252F090a569ffb3c3b66628452214eb39c80%252Fpa%252FAM42063_3271ac1d145aaa473491d6ce4cfed3bb.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/0a/090a569ffb3c3b66628452214eb39c80/pa/AM42063_3271ac1d145aaa473491d6ce4cfed3bb.jpg already downloaded
2026-03-28 19:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F0a%252F090a569ffb3c3b66628452214eb39c80%252Fpa%252FAM42063_97cd8532d3bff42d77eab7623709cd90.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/0a/090a569ffb3c3b66628452214eb39c80/pa/AM42063_97cd8532d3bff42d77eab7623709cd90.jpg already downloaded
2026-03-28 19:00:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: a44fd0f8-2bfe-5f9b-8ea6-85057d88ae6f, identifier: AM42063
2026-03-28 19:00:58 [auto1.nl] INFO: Found listing with ID: WJ55319
2026-03-28 19:00:58 [auto1.nl] INFO: Found listing with ID: XV86348
2026-03-28 19:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XV86348%27 HTTP/1.1" 200 None
2026-03-28 19:00:58 [auto1.nl] INFO: Scrape type for XV86348: 0
2026-03-28 19:00:58 [auto1.nl] INFO: Found listing with ID: HK90585
2026-03-28 19:00:58 [auto1.nl] INFO: Found listing with ID: RY20438
2026-03-28 19:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RY20438%27 HTTP/1.1" 200 None
2026-03-28 19:00:58 [auto1.nl] INFO: Scrape type for RY20438: 2
2026-03-28 19:00:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fa245c6d-5eeb-53ca-8f47-b44339c58044 with identifier: RY20438
2026-03-28 19:00:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fa245c6d-5eeb-53ca-8f47-b44339c58044 with scrape type 2
2026-03-28 19:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fa245c6d-5eeb-53ca-8f47-b44339c58044 with scrape type 2
2026-03-28 19:00:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: fa245c6d-5eeb-53ca-8f47-b44339c58044, identifier: RY20438
2026-03-28 19:00:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: a44fd0f8-2bfe-5f9b-8ea6-85057d88ae6f with identifier: AM42063
2026-03-28 19:00:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: a44fd0f8-2bfe-5f9b-8ea6-85057d88ae6f with identifier: AM42063
2026-03-28 19:00:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: a44fd0f8-2bfe-5f9b-8ea6-85057d88ae6f with identifier: AM42063 to the API
2026-03-28 19:00:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 19:00:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 19:00:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/AM42063>
{'auction_title': '',
 'c_o_2_emission_value': 124,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.2L',
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:03:51Z',
 'fuel_type': 'petrol',
 'id': 'a44fd0f8-2bfe-5f9b-8ea6-85057d88ae6f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '8SKD70',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AM42063',
 'listing': 'auction',
 'location': 'NL, Oosterhout',
 'make': 'Skoda',
 'model': 'Fabia',
 'odometer': 124679,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img09/0a/090a569ffb3c3b66628452214eb39c80/pa/AM42063_a372d2e3e03b8714d6591936366bcd58.jpg',
                'https://img-pa.auto1.com/img09/0a/090a569ffb3c3b66628452214eb39c80/pa/AM42063_6351ee5c4201cd7d2d2f647ba53970a2.jpg',
                'https://img-pa.auto1.com/img09/0a/090a569ffb3c3b66628452214eb39c80/pa/AM42063_ff3bfa2e4fde2efbda9d7e819ba3cfcb.jpg',
                'https://img-pa.auto1.com/img09/0a/090a569ffb3c3b66628452214eb39c80/pa/AM42063_e2dfec9e33f9a3a525e0983dd67ff8f2.jpg',
                'https://img-pa.auto1.com/img09/0a/090a569ffb3c3b66628452214eb39c80/pa/AM42063_df6f2a157d1d8c0bf1b395adde891dc0.jpg',
                'https://img-pa.auto1.com/img09/0a/090a569ffb3c3b66628452214eb39c80/pa/AM42063_8456ac6d19d45857f5b9b419b05a1c17.jpg',
                'https://img-pa.auto1.com/img09/0a/090a569ffb3c3b66628452214eb39c80/pa/AM42063_90f2586ee9709be14c886fa85428b8e4.jpg',
                'https://img-pa.auto1.com/img09/0a/090a569ffb3c3b66628452214eb39c80/pa/AM42063_d4f0774b9e96dc25a06f7a930cd3fd97.jpg',
                'https://img-pa.auto1.com/img09/0a/090a569ffb3c3b66628452214eb39c80/pa/AM42063_3271ac1d145aaa473491d6ce4cfed3bb.jpg',
                'https://img-pa.auto1.com/img09/0a/090a569ffb3c3b66628452214eb39c80/pa/AM42063_97cd8532d3bff42d77eab7623709cd90.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a44fd0f8-2bfe-5f9b-8ea6-85057d88ae6f/a44fd0f8-2bfe-5f9b-8ea6-85057d88ae6f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65548,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img09/0a/090a569ffb3c3b66628452214eb39c80/pa/AM42063_a372d2e3e03b8714d6591936366bcd58.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a44fd0f8-2bfe-5f9b-8ea6-85057d88ae6f/a44fd0f8-2bfe-5f9b-8ea6-85057d88ae6f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2196526,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img09/0a/090a569ffb3c3b66628452214eb39c80/pa/AM42063_6351ee5c4201cd7d2d2f647ba53970a2.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a44fd0f8-2bfe-5f9b-8ea6-85057d88ae6f/a44fd0f8-2bfe-5f9b-8ea6-85057d88ae6f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2247934,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img09/0a/090a569ffb3c3b66628452214eb39c80/pa/AM42063_ff3bfa2e4fde2efbda9d7e819ba3cfcb.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a44fd0f8-2bfe-5f9b-8ea6-85057d88ae6f/a44fd0f8-2bfe-5f9b-8ea6-85057d88ae6f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2248717,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img09/0a/090a569ffb3c3b66628452214eb39c80/pa/AM42063_e2dfec9e33f9a3a525e0983dd67ff8f2.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a44fd0f8-2bfe-5f9b-8ea6-85057d88ae6f/a44fd0f8-2bfe-5f9b-8ea6-85057d88ae6f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1993637,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img09/0a/090a569ffb3c3b66628452214eb39c80/pa/AM42063_df6f2a157d1d8c0bf1b395adde891dc0.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a44fd0f8-2bfe-5f9b-8ea6-85057d88ae6f/a44fd0f8-2bfe-5f9b-8ea6-85057d88ae6f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2108171,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img09/0a/090a569ffb3c3b66628452214eb39c80/pa/AM42063_8456ac6d19d45857f5b9b419b05a1c17.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a44fd0f8-2bfe-5f9b-8ea6-85057d88ae6f/a44fd0f8-2bfe-5f9b-8ea6-85057d88ae6f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2019242,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img09/0a/090a569ffb3c3b66628452214eb39c80/pa/AM42063_90f2586ee9709be14c886fa85428b8e4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a44fd0f8-2bfe-5f9b-8ea6-85057d88ae6f/a44fd0f8-2bfe-5f9b-8ea6-85057d88ae6f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51866,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img09/0a/090a569ffb3c3b66628452214eb39c80/pa/AM42063_d4f0774b9e96dc25a06f7a930cd3fd97.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a44fd0f8-2bfe-5f9b-8ea6-85057d88ae6f/a44fd0f8-2bfe-5f9b-8ea6-85057d88ae6f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2340616,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img09/0a/090a569ffb3c3b66628452214eb39c80/pa/AM42063_3271ac1d145aaa473491d6ce4cfed3bb.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a44fd0f8-2bfe-5f9b-8ea6-85057d88ae6f/a44fd0f8-2bfe-5f9b-8ea6-85057d88ae6f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46356,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img09/0a/090a569ffb3c3b66628452214eb39c80/pa/AM42063_97cd8532d3bff42d77eab7623709cd90.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-10-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Skoda Fabia 1.2 TSI Ambition',
 'transmission': 'automatic',
 'trim': 'Ambition',
 'year': 2013}
2026-03-28 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AM42063%27 HTTP/1.1" 200 None
2026-03-28 19:00:59 [auto1.nl] INFO: Saving data for AM42063: {'created_time': 1774724459.048436, 'last_price_update_time': 1774724459.048447, 'auction_closing_time': 1774883031.0}
2026-03-28 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='AM42063') HTTP/1.1" 204 0
2026-03-28 19:00:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: fa245c6d-5eeb-53ca-8f47-b44339c58044 with identifier: RY20438
2026-03-28 19:00:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: fa245c6d-5eeb-53ca-8f47-b44339c58044 with identifier: RY20438
2026-03-28 19:00:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: fa245c6d-5eeb-53ca-8f47-b44339c58044 with identifier: RY20438 to the API
2026-03-28 19:00:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 19:00:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 19:00:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:24:26Z',
 'fuel_type': 'petrol',
 'id': 'fa245c6d-5eeb-53ca-8f47-b44339c58044',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RY20438',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 67852,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-09-28',
 'seller_name': None,
 'title': 'BMW 5er 520i',
 'transmission': 'automatic',
 'trim': '',
 'year': 2015}
2026-03-28 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RY20438%27 HTTP/1.1" 200 None
2026-03-28 19:00:59 [auto1.nl] INFO: Saving data for RY20438: {'auction_closing_time': 1774884266.0, 'created_time': 1774526441.657556, 'last_price_update_time': 1774724459.359681}
2026-03-28 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='RY20438') HTTP/1.1" 204 0
2026-03-28 19:00:59 [auto1.nl] INFO: Found listing with ID: NF42307
2026-03-28 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NF42307%27 HTTP/1.1" 200 None
2026-03-28 19:00:59 [auto1.nl] INFO: Scrape type for NF42307: 0
2026-03-28 19:00:59 [auto1.nl] INFO: Found listing with ID: JC34887
2026-03-28 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JC34887%27 HTTP/1.1" 200 None
2026-03-28 19:00:59 [auto1.nl] INFO: Scrape type for JC34887: 2
2026-03-28 19:00:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bc1d2e80-da32-5823-8172-6c9d1987bf83 with identifier: JC34887
2026-03-28 19:00:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bc1d2e80-da32-5823-8172-6c9d1987bf83 with scrape type 2
2026-03-28 19:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bc1d2e80-da32-5823-8172-6c9d1987bf83 with scrape type 2
2026-03-28 19:00:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: bc1d2e80-da32-5823-8172-6c9d1987bf83, identifier: JC34887
2026-03-28 19:00:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: bc1d2e80-da32-5823-8172-6c9d1987bf83 with identifier: JC34887
2026-03-28 19:00:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: bc1d2e80-da32-5823-8172-6c9d1987bf83 with identifier: JC34887
2026-03-28 19:00:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: bc1d2e80-da32-5823-8172-6c9d1987bf83 with identifier: JC34887 to the API
2026-03-28 19:00:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 19:00:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 19:00:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:47:46Z',
 'fuel_type': 'petrol',
 'id': 'bc1d2e80-da32-5823-8172-6c9d1987bf83',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JC34887',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Sharan',
 'odometer': 118986,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-07-25',
 'seller_name': None,
 'title': 'Volkswagen Sharan 1.4 TSI Highline BlueMotion',
 'transmission': 'manual',
 'trim': 'Highline BlueMotion',
 'year': 2016}
2026-03-28 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JC34887%27 HTTP/1.1" 200 None
2026-03-28 19:00:59 [auto1.nl] INFO: Saving data for JC34887: {'auction_closing_time': 1774885666.0, 'created_time': 1774526495.360027, 'last_price_update_time': 1774724459.835145}
2026-03-28 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='JC34887') HTTP/1.1" 204 0
2026-03-28 19:00:59 [auto1.nl] INFO: Found listing with ID: BN97277
2026-03-28 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BN97277%27 HTTP/1.1" 200 None
2026-03-28 19:00:59 [auto1.nl] INFO: Scrape type for BN97277: 0
2026-03-28 19:00:59 [auto1.nl] INFO: Found listing with ID: FD20387
2026-03-28 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FD20387%27 HTTP/1.1" 200 None
2026-03-28 19:00:59 [auto1.nl] INFO: Scrape type for FD20387: 0
2026-03-28 19:00:59 [auto1.nl] INFO: Found listing with ID: AA56023
2026-03-28 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AA56023%27 HTTP/1.1" 200 None
2026-03-28 19:00:59 [auto1.nl] INFO: Scrape type for AA56023: 2
2026-03-28 19:00:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0090e5ea-dc74-53b5-bcb9-85c7a357b069 with identifier: AA56023
2026-03-28 19:00:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0090e5ea-dc74-53b5-bcb9-85c7a357b069 with scrape type 2
2026-03-28 19:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0090e5ea-dc74-53b5-bcb9-85c7a357b069 with scrape type 2
2026-03-28 19:01:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 0090e5ea-dc74-53b5-bcb9-85c7a357b069, identifier: AA56023
2026-03-28 19:01:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 0090e5ea-dc74-53b5-bcb9-85c7a357b069 with identifier: AA56023
2026-03-28 19:01:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 0090e5ea-dc74-53b5-bcb9-85c7a357b069 with identifier: AA56023
2026-03-28 19:01:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 0090e5ea-dc74-53b5-bcb9-85c7a357b069 with identifier: AA56023 to the API
2026-03-28 19:01:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 19:01:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 19:01:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:50:35Z',
 'fuel_type': 'petrol',
 'id': '0090e5ea-dc74-53b5-bcb9-85c7a357b069',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AA56023',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C4 Picasso',
 'odometer': 137494,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-10-25',
 'seller_name': None,
 'title': 'Citroen C4 Picasso 1.2 PureTech Seduction',
 'transmission': 'manual',
 'trim': 'Seduction',
 'year': 2015}
2026-03-28 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AA56023%27 HTTP/1.1" 200 None
2026-03-28 19:01:00 [auto1.nl] INFO: Saving data for AA56023: {'auction_closing_time': 1774885835.0, 'created_time': 1774612929.080075, 'last_price_update_time': 1774724460.326854}
2026-03-28 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='AA56023') HTTP/1.1" 204 0
2026-03-28 19:01:00 [auto1.nl] INFO: Found listing with ID: FB20368
2026-03-28 19:01:00 [auto1.nl] INFO: Found listing with ID: UA44354
2026-03-28 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UA44354%27 HTTP/1.1" 200 None
2026-03-28 19:01:00 [auto1.nl] INFO: Scrape type for UA44354: 2
2026-03-28 19:01:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d6bf74ae-ea26-5e34-8fe8-484868109907 with identifier: UA44354
2026-03-28 19:01:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d6bf74ae-ea26-5e34-8fe8-484868109907 with scrape type 2
2026-03-28 19:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d6bf74ae-ea26-5e34-8fe8-484868109907 with scrape type 2
2026-03-28 19:01:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: d6bf74ae-ea26-5e34-8fe8-484868109907, identifier: UA44354
2026-03-28 19:01:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: d6bf74ae-ea26-5e34-8fe8-484868109907 with identifier: UA44354
2026-03-28 19:01:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: d6bf74ae-ea26-5e34-8fe8-484868109907 with identifier: UA44354
2026-03-28 19:01:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: d6bf74ae-ea26-5e34-8fe8-484868109907 with identifier: UA44354 to the API
2026-03-28 19:01:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 19:01:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 19:01:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 408,
 'expiration_date': '2026-03-30T15:11:23Z',
 'fuel_type': 'petrol',
 'id': 'd6bf74ae-ea26-5e34-8fe8-484868109907',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UA44354',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X6',
 'odometer': 164078,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-10-08',
 'seller_name': None,
 'title': 'BMW X6 xDrive 50i',
 'transmission': 'automatic',
 'trim': '',
 'year': 2008}
2026-03-28 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UA44354%27 HTTP/1.1" 200 None
2026-03-28 19:01:00 [auto1.nl] INFO: Saving data for UA44354: {'auction_closing_time': 1774883483.0, 'created_time': 1774526475.493805, 'last_price_update_time': 1774724460.795739}
2026-03-28 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='UA44354') HTTP/1.1" 204 0
2026-03-28 19:01:00 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 19:01:00 [auto1.nl] INFO: Found listing with ID: CT01963
2026-03-28 19:01:00 [auto1.nl] INFO: Found listing with ID: EG87315
2026-03-28 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EG87315%27 HTTP/1.1" 200 None
2026-03-28 19:01:00 [auto1.nl] INFO: Scrape type for EG87315: 0
2026-03-28 19:01:00 [auto1.nl] INFO: Found listing with ID: VB13156
2026-03-28 19:01:00 [auto1.nl] INFO: Found listing with ID: PN82428
2026-03-28 19:01:00 [auto1.nl] INFO: Found listing with ID: YR49127
2026-03-28 19:01:00 [auto1.nl] INFO: Found listing with ID: EB00697
2026-03-28 19:01:00 [auto1.nl] INFO: Found listing with ID: KV59291
2026-03-28 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KV59291%27 HTTP/1.1" 200 None
2026-03-28 19:01:00 [auto1.nl] INFO: Scrape type for KV59291: 2
2026-03-28 19:01:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 07252a0b-a4b2-5178-94a4-3e50bf65bc9e with identifier: KV59291
2026-03-28 19:01:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 07252a0b-a4b2-5178-94a4-3e50bf65bc9e with scrape type 2
2026-03-28 19:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 07252a0b-a4b2-5178-94a4-3e50bf65bc9e with scrape type 2
2026-03-28 19:01:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 07252a0b-a4b2-5178-94a4-3e50bf65bc9e, identifier: KV59291
2026-03-28 19:01:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 07252a0b-a4b2-5178-94a4-3e50bf65bc9e with identifier: KV59291
2026-03-28 19:01:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 07252a0b-a4b2-5178-94a4-3e50bf65bc9e with identifier: KV59291
2026-03-28 19:01:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 07252a0b-a4b2-5178-94a4-3e50bf65bc9e with identifier: KV59291 to the API
2026-03-28 19:01:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 19:01:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 19:01:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 230,
 'expiration_date': '2026-03-30T15:02:13Z',
 'fuel_type': 'hybrid',
 'id': '07252a0b-a4b2-5178-94a4-3e50bf65bc9e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KV59291',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V60',
 'odometer': 296665,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-09-17',
 'seller_name': None,
 'title': 'Volvo V60 2.4 D5 Hybrid Momentum AWD',
 'transmission': 'automatic',
 'trim': 'Momentum AWD',
 'year': 2015}
2026-03-28 19:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KV59291%27 HTTP/1.1" 200 None
2026-03-28 19:01:01 [auto1.nl] INFO: Saving data for KV59291: {'auction_closing_time': 1774882933.0, 'created_time': 1774638057.311481, 'last_price_update_time': 1774724461.381344}
2026-03-28 19:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='KV59291') HTTP/1.1" 204 0
2026-03-28 19:01:01 [auto1.nl] INFO: Found listing with ID: WZ30415
2026-03-28 19:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WZ30415%27 HTTP/1.1" 200 None
2026-03-28 19:01:01 [auto1.nl] INFO: Scrape type for WZ30415: 2
2026-03-28 19:01:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3d4e06d9-37dc-525f-8727-d33fe0b0eba4 with identifier: WZ30415
2026-03-28 19:01:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3d4e06d9-37dc-525f-8727-d33fe0b0eba4 with scrape type 2
2026-03-28 19:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3d4e06d9-37dc-525f-8727-d33fe0b0eba4 with scrape type 2
2026-03-28 19:01:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 3d4e06d9-37dc-525f-8727-d33fe0b0eba4, identifier: WZ30415
2026-03-28 19:01:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 3d4e06d9-37dc-525f-8727-d33fe0b0eba4 with identifier: WZ30415
2026-03-28 19:01:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 3d4e06d9-37dc-525f-8727-d33fe0b0eba4 with identifier: WZ30415
2026-03-28 19:01:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 3d4e06d9-37dc-525f-8727-d33fe0b0eba4 with identifier: WZ30415 to the API
2026-03-28 19:01:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 19:01:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 19:01:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 192,
 'expiration_date': '2026-03-30T15:41:23Z',
 'fuel_type': 'petrol',
 'id': '3d4e06d9-37dc-525f-8727-d33fe0b0eba4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WZ30415',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Zafira',
 'odometer': 295070,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2003-01-31',
 'seller_name': None,
 'title': 'Opel Zafira 2.0 Turbo OPC',
 'transmission': 'manual',
 'trim': 'OPC',
 'year': 2003}
2026-03-28 19:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WZ30415%27 HTTP/1.1" 200 None
2026-03-28 19:01:01 [auto1.nl] INFO: Saving data for WZ30415: {'auction_closing_time': 1774885283.0, 'created_time': 1774526487.712862, 'last_price_update_time': 1774724461.788127}
2026-03-28 19:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='WZ30415') HTTP/1.1" 204 0
2026-03-28 19:01:01 [auto1.nl] INFO: Channel: 24h | Page: 11 | totalHits: 647 | hits on page: 40
2026-03-28 19:01:01 [auto1.nl] INFO: Found listing with ID: RT17278
2026-03-28 19:01:01 [auto1.nl] INFO: Found listing with ID: WC97739
2026-03-28 19:01:01 [auto1.nl] INFO: Found listing with ID: BP06390
2026-03-28 19:01:01 [auto1.nl] INFO: Found listing with ID: GD14705
2026-03-28 19:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GD14705%27 HTTP/1.1" 200 None
2026-03-28 19:01:01 [auto1.nl] INFO: Scrape type for GD14705: 0
2026-03-28 19:01:01 [auto1.nl] INFO: Found listing with ID: CY67010
2026-03-28 19:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CY67010%27 HTTP/1.1" 200 None
2026-03-28 19:01:01 [auto1.nl] INFO: Scrape type for CY67010: 0
2026-03-28 19:01:01 [auto1.nl] INFO: Found listing with ID: VB96147
2026-03-28 19:01:01 [auto1.nl] INFO: Found listing with ID: LW98869
2026-03-28 19:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LW98869%27 HTTP/1.1" 200 None
2026-03-28 19:01:01 [auto1.nl] INFO: Scrape type for LW98869: 0
2026-03-28 19:01:01 [auto1.nl] INFO: Found listing with ID: TA38332
2026-03-28 19:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TA38332%27 HTTP/1.1" 200 None
2026-03-28 19:01:01 [auto1.nl] INFO: Scrape type for TA38332: 0
2026-03-28 19:01:01 [auto1.nl] INFO: Found listing with ID: DW43709
2026-03-28 19:01:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KP34214/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 19:01:01 [auto1.nl] INFO: Found listing with ID: SM08260
2026-03-28 19:01:01 [auto1.nl] INFO: Found listing with ID: PZ30163
2026-03-28 19:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PZ30163%27 HTTP/1.1" 200 None
2026-03-28 19:01:01 [auto1.nl] INFO: Scrape type for PZ30163: 2
2026-03-28 19:01:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 162ec0e3-24e0-5e3d-a3e6-76b2bf0e54c2 with identifier: PZ30163
2026-03-28 19:01:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 162ec0e3-24e0-5e3d-a3e6-76b2bf0e54c2 with scrape type 2
2026-03-28 19:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 162ec0e3-24e0-5e3d-a3e6-76b2bf0e54c2 with scrape type 2
2026-03-28 19:01:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 162ec0e3-24e0-5e3d-a3e6-76b2bf0e54c2, identifier: PZ30163
2026-03-28 19:01:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:01:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 162ec0e3-24e0-5e3d-a3e6-76b2bf0e54c2 with identifier: PZ30163
2026-03-28 19:01:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 162ec0e3-24e0-5e3d-a3e6-76b2bf0e54c2 with identifier: PZ30163
2026-03-28 19:01:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 162ec0e3-24e0-5e3d-a3e6-76b2bf0e54c2 with identifier: PZ30163 to the API
2026-03-28 19:01:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 19:01:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 19:01:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:41:15Z',
 'fuel_type': 'petrol',
 'id': '162ec0e3-24e0-5e3d-a3e6-76b2bf0e54c2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PZ30163',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'Xsara Picasso',
 'odometer': 168552,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2004-04-26',
 'seller_name': None,
 'title': 'Citroen Xsara Picasso 2.0 Exclusive',
 'transmission': 'automatic',
 'trim': 'Exclusive',
 'year': 2004}
2026-03-28 19:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PZ30163%27 HTTP/1.1" 200 None
2026-03-28 19:01:02 [auto1.nl] INFO: Saving data for PZ30163: {'auction_closing_time': 1774885275.0, 'created_time': 1774526476.553527, 'last_price_update_time': 1774724462.318915}
2026-03-28 19:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='PZ30163') HTTP/1.1" 204 0
2026-03-28 19:01:02 [auto1.nl] INFO: Found listing with ID: JP82620
2026-03-28 19:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JP82620%27 HTTP/1.1" 200 None
2026-03-28 19:01:02 [auto1.nl] INFO: Scrape type for JP82620: 0
2026-03-28 19:01:02 [auto1.nl] INFO: Found listing with ID: ZR54060
2026-03-28 19:01:02 [auto1.nl] INFO: Found listing with ID: ZA96365
2026-03-28 19:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZA96365%27 HTTP/1.1" 200 None
2026-03-28 19:01:02 [auto1.nl] INFO: Scrape type for ZA96365: 0
2026-03-28 19:01:02 [auto1.nl] INFO: Found listing with ID: TP38124
2026-03-28 19:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TP38124%27 HTTP/1.1" 200 None
2026-03-28 19:01:02 [auto1.nl] INFO: Scrape type for TP38124: 2
2026-03-28 19:01:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9700523c-b88a-5e0e-a0b2-d5b74785d7d7 with identifier: TP38124
2026-03-28 19:01:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9700523c-b88a-5e0e-a0b2-d5b74785d7d7 with scrape type 2
2026-03-28 19:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9700523c-b88a-5e0e-a0b2-d5b74785d7d7 with scrape type 2
2026-03-28 19:01:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 9700523c-b88a-5e0e-a0b2-d5b74785d7d7, identifier: TP38124
2026-03-28 19:01:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 9700523c-b88a-5e0e-a0b2-d5b74785d7d7 with identifier: TP38124
2026-03-28 19:01:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 9700523c-b88a-5e0e-a0b2-d5b74785d7d7 with identifier: TP38124
2026-03-28 19:01:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 9700523c-b88a-5e0e-a0b2-d5b74785d7d7 with identifier: TP38124 to the API
2026-03-28 19:01:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 19:01:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 19:01:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:06:54Z',
 'fuel_type': 'petrol',
 'id': '9700523c-b88a-5e0e-a0b2-d5b74785d7d7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TP38124',
 'listing': 'auction',
 'make': 'Mitsubishi',
 'model': 'Space Star',
 'odometer': 180879,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-12-15',
 'seller_name': None,
 'title': 'Mitsubishi Space Star 1.0 Basis',
 'transmission': 'manual',
 'trim': 'Basis',
 'year': 2014}
2026-03-28 19:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TP38124%27 HTTP/1.1" 200 None
2026-03-28 19:01:02 [auto1.nl] INFO: Saving data for TP38124: {'auction_closing_time': 1774883214.0, 'created_time': 1774526507.553276, 'last_price_update_time': 1774724462.870882}
2026-03-28 19:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='TP38124') HTTP/1.1" 204 0
2026-03-28 19:01:02 [auto1.nl] INFO: Found listing with ID: BH50437
2026-03-28 19:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BH50437%27 HTTP/1.1" 200 None
2026-03-28 19:01:02 [auto1.nl] INFO: Scrape type for BH50437: 0
2026-03-28 19:01:02 [auto1.nl] INFO: Found listing with ID: AB34968
2026-03-28 19:01:02 [auto1.nl] INFO: Found listing with ID: WP75740
2026-03-28 19:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WP75740%27 HTTP/1.1" 200 None
2026-03-28 19:01:02 [auto1.nl] INFO: Scrape type for WP75740: 0
2026-03-28 19:01:02 [auto1.nl] INFO: Found listing with ID: WE00434
2026-03-28 19:01:02 [auto1.nl] INFO: Found listing with ID: SZ87293
2026-03-28 19:01:02 [auto1.nl] INFO: Found listing with ID: CX26987
2026-03-28 19:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CX26987%27 HTTP/1.1" 200 None
2026-03-28 19:01:02 [auto1.nl] INFO: Scrape type for CX26987: 0
2026-03-28 19:01:02 [auto1.nl] INFO: Found listing with ID: SY05694
2026-03-28 19:01:02 [auto1.nl] INFO: Found listing with ID: HX39878
2026-03-28 19:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HX39878%27 HTTP/1.1" 200 None
2026-03-28 19:01:02 [auto1.nl] INFO: Scrape type for HX39878: 0
2026-03-28 19:01:02 [auto1.nl] INFO: Found listing with ID: GL61326
2026-03-28 19:01:02 [auto1.nl] INFO: Found listing with ID: CD92062
2026-03-28 19:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CD92062%27 HTTP/1.1" 200 None
2026-03-28 19:01:02 [auto1.nl] INFO: Scrape type for CD92062: 2
2026-03-28 19:01:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a32fc544-599c-5d4f-80c1-4427b167bb58 with identifier: CD92062
2026-03-28 19:01:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a32fc544-599c-5d4f-80c1-4427b167bb58 with scrape type 2
2026-03-28 19:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a32fc544-599c-5d4f-80c1-4427b167bb58 with scrape type 2
2026-03-28 19:01:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: a32fc544-599c-5d4f-80c1-4427b167bb58, identifier: CD92062
2026-03-28 19:01:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: a32fc544-599c-5d4f-80c1-4427b167bb58 with identifier: CD92062
2026-03-28 19:01:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: a32fc544-599c-5d4f-80c1-4427b167bb58 with identifier: CD92062
2026-03-28 19:01:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: a32fc544-599c-5d4f-80c1-4427b167bb58 with identifier: CD92062 to the API
2026-03-28 19:01:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 19:01:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 19:01:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:17:58Z',
 'fuel_type': 'petrol',
 'id': 'a32fc544-599c-5d4f-80c1-4427b167bb58',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CD92062',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'S40',
 'odometer': 194182,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2004-02-09',
 'seller_name': None,
 'title': 'Volvo S40 2.4 Momentum',
 'transmission': 'manual',
 'trim': 'Momentum',
 'year': 2004}
2026-03-28 19:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CD92062%27 HTTP/1.1" 200 None
2026-03-28 19:01:03 [auto1.nl] INFO: Saving data for CD92062: {'auction_closing_time': 1774883878.0, 'created_time': 1774526490.094607, 'last_price_update_time': 1774724463.483621}
2026-03-28 19:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='CD92062') HTTP/1.1" 204 0
2026-03-28 19:01:03 [auto1.nl] INFO: Found listing with ID: YB51800
2026-03-28 19:01:03 [auto1.nl] INFO: Found listing with ID: TP84646
2026-03-28 19:01:03 [auto1.nl] INFO: Found listing with ID: UF96545
2026-03-28 19:01:03 [auto1.nl] INFO: Found listing with ID: SG32295
2026-03-28 19:01:03 [auto1.nl] INFO: Found listing with ID: EY58020
2026-03-28 19:01:03 [auto1.nl] INFO: Found listing with ID: TJ11018
2026-03-28 19:01:03 [auto1.nl] INFO: Found listing with ID: HT40495
2026-03-28 19:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HT40495%27 HTTP/1.1" 200 None
2026-03-28 19:01:03 [auto1.nl] INFO: Scrape type for HT40495: 0
2026-03-28 19:01:03 [auto1.nl] INFO: Found listing with ID: WY03082
2026-03-28 19:01:03 [auto1.nl] INFO: Found listing with ID: JJ92825
2026-03-28 19:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JJ92825%27 HTTP/1.1" 200 None
2026-03-28 19:01:03 [auto1.nl] INFO: Scrape type for JJ92825: 0
2026-03-28 19:01:03 [auto1.nl] INFO: Found listing with ID: EU67961
2026-03-28 19:01:03 [auto1.nl] INFO: Found listing with ID: FA26024
2026-03-28 19:01:03 [auto1.nl] INFO: Found listing with ID: TU99712
2026-03-28 19:01:03 [auto1.nl] INFO: Found listing with ID: TH29476
2026-03-28 19:01:03 [auto1.nl] INFO: Found listing with ID: WR76222
2026-03-28 19:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WR76222%27 HTTP/1.1" 200 None
2026-03-28 19:01:03 [auto1.nl] INFO: Scrape type for WR76222: 0
2026-03-28 19:01:03 [auto1.nl] INFO: Found listing with ID: BX66014
2026-03-28 19:01:03 [auto1.nl] INFO: Found listing with ID: XY00413
2026-03-28 19:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XY00413%27 HTTP/1.1" 200 None
2026-03-28 19:01:03 [auto1.nl] INFO: Scrape type for XY00413: 2
2026-03-28 19:01:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 359e68c0-027b-5100-87fb-9c53256cd1c3 with identifier: XY00413
2026-03-28 19:01:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 359e68c0-027b-5100-87fb-9c53256cd1c3 with scrape type 2
2026-03-28 19:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 359e68c0-027b-5100-87fb-9c53256cd1c3 with scrape type 2
2026-03-28 19:01:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 359e68c0-027b-5100-87fb-9c53256cd1c3, identifier: XY00413
2026-03-28 19:01:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 359e68c0-027b-5100-87fb-9c53256cd1c3 with identifier: XY00413
2026-03-28 19:01:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 359e68c0-027b-5100-87fb-9c53256cd1c3 with identifier: XY00413
2026-03-28 19:01:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 359e68c0-027b-5100-87fb-9c53256cd1c3 with identifier: XY00413 to the API
2026-03-28 19:01:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 19:01:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 19:01:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:53:42Z',
 'fuel_type': 'petrol',
 'id': '359e68c0-027b-5100-87fb-9c53256cd1c3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XY00413',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Sandero',
 'odometer': 76180,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-07-18',
 'seller_name': None,
 'title': 'Dacia Sandero 1.2 Basis',
 'transmission': 'manual',
 'trim': 'Basis',
 'year': 2010}
2026-03-28 19:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XY00413%27 HTTP/1.1" 200 None
2026-03-28 19:01:04 [auto1.nl] INFO: Saving data for XY00413: {'auction_closing_time': 1774886022.0, 'created_time': 1774526468.820859, 'last_price_update_time': 1774724464.095045}
2026-03-28 19:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='XY00413') HTTP/1.1" 204 0
2026-03-28 19:01:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:01:04 [auto1.nl] INFO: Found listing with ID: BB94394
2026-03-28 19:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BB94394%27 HTTP/1.1" 200 None
2026-03-28 19:01:04 [auto1.nl] INFO: Scrape type for BB94394: 0
2026-03-28 19:01:04 [auto1.nl] INFO: Found listing with ID: LA33547
2026-03-28 19:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LA33547%27 HTTP/1.1" 200 None
2026-03-28 19:01:04 [auto1.nl] INFO: Scrape type for LA33547: 2
2026-03-28 19:01:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0056fd52-e843-5584-bf42-6c43c5b312ab with identifier: LA33547
2026-03-28 19:01:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0056fd52-e843-5584-bf42-6c43c5b312ab with scrape type 2
2026-03-28 19:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0056fd52-e843-5584-bf42-6c43c5b312ab with scrape type 2
2026-03-28 19:01:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 0056fd52-e843-5584-bf42-6c43c5b312ab, identifier: LA33547
2026-03-28 19:01:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 0056fd52-e843-5584-bf42-6c43c5b312ab with identifier: LA33547
2026-03-28 19:01:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 0056fd52-e843-5584-bf42-6c43c5b312ab with identifier: LA33547
2026-03-28 19:01:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 0056fd52-e843-5584-bf42-6c43c5b312ab with identifier: LA33547 to the API
2026-03-28 19:01:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 19:01:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 19:01:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:30:08Z',
 'fuel_type': 'petrol',
 'id': '0056fd52-e843-5584-bf42-6c43c5b312ab',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LA33547',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 252394,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-03-15',
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.4 TSI Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2012}
2026-03-28 19:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LA33547%27 HTTP/1.1" 200 None
2026-03-28 19:01:04 [auto1.nl] INFO: Saving data for LA33547: {'auction_closing_time': 1774884608.0, 'created_time': 1774551627.625031, 'last_price_update_time': 1774724464.678274}
2026-03-28 19:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='LA33547') HTTP/1.1" 204 0
2026-03-28 19:01:04 [auto1.nl] INFO: Found listing with ID: UT96124
2026-03-28 19:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UT96124%27 HTTP/1.1" 200 None
2026-03-28 19:01:04 [auto1.nl] INFO: Scrape type for UT96124: 0
2026-03-28 19:01:04 [auto1.nl] INFO: Found listing with ID: BC50110
2026-03-28 19:01:04 [auto1.nl] INFO: Found listing with ID: MX73700
2026-03-28 19:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MX73700%27 HTTP/1.1" 200 None
2026-03-28 19:01:04 [auto1.nl] INFO: Scrape type for MX73700: 2
2026-03-28 19:01:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b7e0e7a3-e6e0-5833-85c5-635e497ae8d6 with identifier: MX73700
2026-03-28 19:01:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b7e0e7a3-e6e0-5833-85c5-635e497ae8d6 with scrape type 2
2026-03-28 19:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b7e0e7a3-e6e0-5833-85c5-635e497ae8d6 with scrape type 2
2026-03-28 19:01:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: b7e0e7a3-e6e0-5833-85c5-635e497ae8d6, identifier: MX73700
2026-03-28 19:01:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: b7e0e7a3-e6e0-5833-85c5-635e497ae8d6 with identifier: MX73700
2026-03-28 19:01:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: b7e0e7a3-e6e0-5833-85c5-635e497ae8d6 with identifier: MX73700
2026-03-28 19:01:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: b7e0e7a3-e6e0-5833-85c5-635e497ae8d6 with identifier: MX73700 to the API
2026-03-28 19:01:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 19:01:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 19:01:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:16:18Z',
 'fuel_type': 'diesel',
 'id': 'b7e0e7a3-e6e0-5833-85c5-635e497ae8d6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MX73700',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Mondeo',
 'odometer': 153076,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-03-28',
 'seller_name': None,
 'title': 'Ford Mondeo 1.5 TDCi Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2018}
2026-03-28 19:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MX73700%27 HTTP/1.1" 200 None
2026-03-28 19:01:05 [auto1.nl] INFO: Saving data for MX73700: {'auction_closing_time': 1774883778.0, 'created_time': 1774033497.848266, 'last_price_update_time': 1774724465.128302}
2026-03-28 19:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='MX73700') HTTP/1.1" 204 0
2026-03-28 19:01:05 [auto1.nl] INFO: Found listing with ID: VC54517
2026-03-28 19:01:05 [auto1.nl] INFO: Found listing with ID: KW64079
2026-03-28 19:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KW64079%27 HTTP/1.1" 200 None
2026-03-28 19:01:05 [auto1.nl] INFO: Scrape type for KW64079: 2
2026-03-28 19:01:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 14e0f88a-207a-545c-98e5-0df16f7838e1 with identifier: KW64079
2026-03-28 19:01:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 14e0f88a-207a-545c-98e5-0df16f7838e1 with scrape type 2
2026-03-28 19:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 14e0f88a-207a-545c-98e5-0df16f7838e1 with scrape type 2
2026-03-28 19:01:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 14e0f88a-207a-545c-98e5-0df16f7838e1, identifier: KW64079
2026-03-28 19:01:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 14e0f88a-207a-545c-98e5-0df16f7838e1 with identifier: KW64079
2026-03-28 19:01:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 14e0f88a-207a-545c-98e5-0df16f7838e1 with identifier: KW64079
2026-03-28 19:01:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 14e0f88a-207a-545c-98e5-0df16f7838e1 with identifier: KW64079 to the API
2026-03-28 19:01:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 19:01:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 19:01:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:49:18Z',
 'fuel_type': 'petrol',
 'id': '14e0f88a-207a-545c-98e5-0df16f7838e1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KW64079',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 64181,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-04-22',
 'seller_name': None,
 'title': 'MINI Cooper',
 'transmission': 'manual',
 'trim': '',
 'year': 2020}
2026-03-28 19:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KW64079%27 HTTP/1.1" 200 None
2026-03-28 19:01:06 [auto1.nl] INFO: Saving data for KW64079: {'auction_closing_time': 1774885758.0, 'created_time': 1773837182.527827, 'last_price_update_time': 1774724466.209536}
2026-03-28 19:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='KW64079') HTTP/1.1" 204 0
2026-03-28 19:01:06 [auto1.nl] INFO: Found listing with ID: BY11680
2026-03-28 19:01:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ET47420> (referer: https://www.auto1.com/v1/car-details-view/ET47420/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 19:01:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c2d06973-cd18-582c-8c4c-98d104182ab4 with identifier: ET47420
2026-03-28 19:01:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c2d06973-cd18-582c-8c4c-98d104182ab4 with scrape type 1
2026-03-28 19:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item c2d06973-cd18-582c-8c4c-98d104182ab4
2026-03-28 19:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F67%252F22676883c48370e4e91449f65cfcbe19%252Fpa%252FET47420_b3eed58a06e240cfdef010ada25eadba.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/67/22676883c48370e4e91449f65cfcbe19/pa/ET47420_b3eed58a06e240cfdef010ada25eadba.jpg already downloaded
2026-03-28 19:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F67%252F22676883c48370e4e91449f65cfcbe19%252Fpa%252FET47420_f6c815c7f9c4a15b1b5cfaa8975fa19c.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/67/22676883c48370e4e91449f65cfcbe19/pa/ET47420_f6c815c7f9c4a15b1b5cfaa8975fa19c.jpg already downloaded
2026-03-28 19:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F67%252F22676883c48370e4e91449f65cfcbe19%252Fpa%252FET47420_fdacfe19578ecbc798ec79a93d6e872d.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/67/22676883c48370e4e91449f65cfcbe19/pa/ET47420_fdacfe19578ecbc798ec79a93d6e872d.jpg already downloaded
2026-03-28 19:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F67%252F22676883c48370e4e91449f65cfcbe19%252Fpa%252FET47420_f1a32053473973560357deecf196baaf.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/67/22676883c48370e4e91449f65cfcbe19/pa/ET47420_f1a32053473973560357deecf196baaf.jpg already downloaded
2026-03-28 19:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F67%252F22676883c48370e4e91449f65cfcbe19%252Fpa%252FET47420_24fd1027afcc99ec4f25ebfa3b2eba4f.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/67/22676883c48370e4e91449f65cfcbe19/pa/ET47420_24fd1027afcc99ec4f25ebfa3b2eba4f.jpg already downloaded
2026-03-28 19:01:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: c2d06973-cd18-582c-8c4c-98d104182ab4, identifier: ET47420
2026-03-28 19:01:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: c2d06973-cd18-582c-8c4c-98d104182ab4 with identifier: ET47420
2026-03-28 19:01:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: c2d06973-cd18-582c-8c4c-98d104182ab4 with identifier: ET47420
2026-03-28 19:01:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: c2d06973-cd18-582c-8c4c-98d104182ab4 with identifier: ET47420 to the API
2026-03-28 19:01:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 19:01:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 19:01:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ET47420>
{'auction_title': '',
 'c_o_2_emission_value': 95,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 5',
 'engine': '0.9L',
 'engine_horse_power': 85,
 'expiration_date': '2026-03-30T15:23:18Z',
 'fuel_type': 'petrol',
 'id': 'c2d06973-cd18-582c-8c4c-98d104182ab4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '80PHB7',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ET47420',
 'listing': 'auction',
 'location': 'NL, Oosterhout',
 'make': 'Fiat',
 'model': '500',
 'odometer': 141024,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 5,
 'photo_urls': ['https://img-pa.auto1.com/img22/67/22676883c48370e4e91449f65cfcbe19/pa/ET47420_b3eed58a06e240cfdef010ada25eadba.jpg',
                'https://img-pa.auto1.com/img22/67/22676883c48370e4e91449f65cfcbe19/pa/ET47420_f6c815c7f9c4a15b1b5cfaa8975fa19c.jpg',
                'https://img-pa.auto1.com/img22/67/22676883c48370e4e91449f65cfcbe19/pa/ET47420_fdacfe19578ecbc798ec79a93d6e872d.jpg',
                'https://img-pa.auto1.com/img22/67/22676883c48370e4e91449f65cfcbe19/pa/ET47420_f1a32053473973560357deecf196baaf.jpg',
                'https://img-pa.auto1.com/img22/67/22676883c48370e4e91449f65cfcbe19/pa/ET47420_24fd1027afcc99ec4f25ebfa3b2eba4f.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2d06973-cd18-582c-8c4c-98d104182ab4/c2d06973-cd18-582c-8c4c-98d104182ab4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76688,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img22/67/22676883c48370e4e91449f65cfcbe19/pa/ET47420_b3eed58a06e240cfdef010ada25eadba.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2d06973-cd18-582c-8c4c-98d104182ab4/c2d06973-cd18-582c-8c4c-98d104182ab4_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71070,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img22/67/22676883c48370e4e91449f65cfcbe19/pa/ET47420_f6c815c7f9c4a15b1b5cfaa8975fa19c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2d06973-cd18-582c-8c4c-98d104182ab4/c2d06973-cd18-582c-8c4c-98d104182ab4_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62239,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img22/67/22676883c48370e4e91449f65cfcbe19/pa/ET47420_fdacfe19578ecbc798ec79a93d6e872d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2d06973-cd18-582c-8c4c-98d104182ab4/c2d06973-cd18-582c-8c4c-98d104182ab4_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73104,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img22/67/22676883c48370e4e91449f65cfcbe19/pa/ET47420_f1a32053473973560357deecf196baaf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2d06973-cd18-582c-8c4c-98d104182ab4/c2d06973-cd18-582c-8c4c-98d104182ab4_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48202,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img22/67/22676883c48370e4e91449f65cfcbe19/pa/ET47420_24fd1027afcc99ec4f25ebfa3b2eba4f.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-01-23',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Fiat 500 0.9 Blackjack',
 'transmission': 'manual',
 'trim': 'Blackjack',
 'year': 2011}
2026-03-28 19:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ET47420%27 HTTP/1.1" 200 None
2026-03-28 19:01:06 [auto1.nl] INFO: Saving data for ET47420: {'created_time': 1774724466.837789, 'last_price_update_time': 1774724466.837799, 'auction_closing_time': 1774884198.0}
2026-03-28 19:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='ET47420') HTTP/1.1" 204 0
2026-03-28 19:01:06 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 19:01:06 [scrapy.extensions.logstats] INFO: Crawled 39 pages (at 39 pages/min), scraped 59 items (at 59 items/min)
2026-03-28 19:01:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 176MiB
2026-03-28 19:01:06 [auto1.nl] INFO: Channel: 24h | Page: 12 | totalHits: 647 | hits on page: 40
2026-03-28 19:01:06 [auto1.nl] INFO: Found listing with ID: GV91252
2026-03-28 19:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GV91252%27 HTTP/1.1" 200 None
2026-03-28 19:01:06 [auto1.nl] INFO: Scrape type for GV91252: 2
2026-03-28 19:01:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d0c9e188-5648-52f7-a1ee-c16e25eccc93 with identifier: GV91252
2026-03-28 19:01:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d0c9e188-5648-52f7-a1ee-c16e25eccc93 with scrape type 2
2026-03-28 19:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d0c9e188-5648-52f7-a1ee-c16e25eccc93 with scrape type 2
2026-03-28 19:01:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: d0c9e188-5648-52f7-a1ee-c16e25eccc93, identifier: GV91252
2026-03-28 19:01:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: d0c9e188-5648-52f7-a1ee-c16e25eccc93 with identifier: GV91252
2026-03-28 19:01:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: d0c9e188-5648-52f7-a1ee-c16e25eccc93 with identifier: GV91252
2026-03-28 19:01:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: d0c9e188-5648-52f7-a1ee-c16e25eccc93 with identifier: GV91252 to the API
2026-03-28 19:01:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 19:01:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 19:01:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:31:51Z',
 'fuel_type': 'petrol',
 'id': 'd0c9e188-5648-52f7-a1ee-c16e25eccc93',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GV91252',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '208',
 'odometer': 90047,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-04-27',
 'seller_name': None,
 'title': 'Peugeot 208 1.2 PureTech Allure',
 'transmission': 'automatic',
 'trim': 'Allure',
 'year': 2017}
2026-03-28 19:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GV91252%27 HTTP/1.1" 200 None
2026-03-28 19:01:07 [auto1.nl] INFO: Saving data for GV91252: {'auction_closing_time': 1774884711.0, 'created_time': 1774033370.121759, 'last_price_update_time': 1774724467.389253}
2026-03-28 19:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='GV91252') HTTP/1.1" 204 0
2026-03-28 19:01:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:01:07 [auto1.nl] INFO: Found listing with ID: VC21131
2026-03-28 19:01:07 [auto1.nl] INFO: Found listing with ID: ZP46172
2026-03-28 19:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZP46172%27 HTTP/1.1" 200 None
2026-03-28 19:01:07 [auto1.nl] INFO: Scrape type for ZP46172: 1
2026-03-28 19:01:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KP34214> (referer: https://www.auto1.com/v1/car-details-view/KP34214/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 19:01:07 [auto1.nl] INFO: Found listing with ID: UR81542
2026-03-28 19:01:07 [auto1.nl] INFO: Found listing with ID: VE70887
2026-03-28 19:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VE70887%27 HTTP/1.1" 200 None
2026-03-28 19:01:07 [auto1.nl] INFO: Scrape type for VE70887: 1
2026-03-28 19:01:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:01:07 [auto1.nl] INFO: Found listing with ID: BR03129
2026-03-28 19:01:07 [auto1.nl] INFO: Found listing with ID: XP28763
2026-03-28 19:01:07 [auto1.nl] INFO: Found listing with ID: TY41517
2026-03-28 19:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TY41517%27 HTTP/1.1" 200 None
2026-03-28 19:01:07 [auto1.nl] INFO: Scrape type for TY41517: 1
2026-03-28 19:01:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:01:07 [auto1.nl] INFO: Found listing with ID: HL62659
2026-03-28 19:01:07 [auto1.nl] INFO: Found listing with ID: MF69205
2026-03-28 19:01:07 [auto1.nl] INFO: Found listing with ID: WP58537
2026-03-28 19:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WP58537%27 HTTP/1.1" 200 None
2026-03-28 19:01:07 [auto1.nl] INFO: Scrape type for WP58537: 1
2026-03-28 19:01:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:01:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 42c83913-facc-5c46-95fe-7cb135f40e85 with identifier: KP34214
2026-03-28 19:01:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 42c83913-facc-5c46-95fe-7cb135f40e85 with scrape type 1
2026-03-28 19:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 42c83913-facc-5c46-95fe-7cb135f40e85
2026-03-28 19:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252F0f%252F130fa93144ff04a1e3bd30f7f0c639e7%252Fpa%252FKP34214_5d13dfb1862922564479ef83112b506c.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/0f/130fa93144ff04a1e3bd30f7f0c639e7/pa/KP34214_5d13dfb1862922564479ef83112b506c.jpg already downloaded
2026-03-28 19:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252F0f%252F130fa93144ff04a1e3bd30f7f0c639e7%252Fpa%252FKP34214_168c6970e33ebcfdc632d03d4b0013de.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/0f/130fa93144ff04a1e3bd30f7f0c639e7/pa/KP34214_168c6970e33ebcfdc632d03d4b0013de.jpg already downloaded
2026-03-28 19:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252F0f%252F130fa93144ff04a1e3bd30f7f0c639e7%252Fpa%252FKP34214_619a93729f5b364d3c02963fd728f5a5.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/0f/130fa93144ff04a1e3bd30f7f0c639e7/pa/KP34214_619a93729f5b364d3c02963fd728f5a5.jpg already downloaded
2026-03-28 19:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252F0f%252F130fa93144ff04a1e3bd30f7f0c639e7%252Fpa%252FKP34214_1b993f37c765510bea50c168b9856c8b.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/0f/130fa93144ff04a1e3bd30f7f0c639e7/pa/KP34214_1b993f37c765510bea50c168b9856c8b.jpg already downloaded
2026-03-28 19:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252F0f%252F130fa93144ff04a1e3bd30f7f0c639e7%252Fpa%252FKP34214_1ee5d89f4d90377cbe50997c776391c2.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/0f/130fa93144ff04a1e3bd30f7f0c639e7/pa/KP34214_1ee5d89f4d90377cbe50997c776391c2.jpg already downloaded
2026-03-28 19:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252F0f%252F130fa93144ff04a1e3bd30f7f0c639e7%252Fpa%252FKP34214_15260f99ef8c491875f5de151b8a1435.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/0f/130fa93144ff04a1e3bd30f7f0c639e7/pa/KP34214_15260f99ef8c491875f5de151b8a1435.jpg already downloaded
2026-03-28 19:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252F0f%252F130fa93144ff04a1e3bd30f7f0c639e7%252Fpa%252FKP34214_0027a29c6daa43ce5ee64e723609b57c.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/0f/130fa93144ff04a1e3bd30f7f0c639e7/pa/KP34214_0027a29c6daa43ce5ee64e723609b57c.jpg already downloaded
2026-03-28 19:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252F0f%252F130fa93144ff04a1e3bd30f7f0c639e7%252Fpa%252FKP34214_b0bc4756aea53afa3c09976bdc58bcbe.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/0f/130fa93144ff04a1e3bd30f7f0c639e7/pa/KP34214_b0bc4756aea53afa3c09976bdc58bcbe.jpg already downloaded
2026-03-28 19:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252F0f%252F130fa93144ff04a1e3bd30f7f0c639e7%252Fpa%252FKP34214_5c718ffeafbaa2fabfde5d1e4f1cbc47.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/0f/130fa93144ff04a1e3bd30f7f0c639e7/pa/KP34214_5c718ffeafbaa2fabfde5d1e4f1cbc47.jpg already downloaded
2026-03-28 19:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252F0f%252F130fa93144ff04a1e3bd30f7f0c639e7%252Fpa%252FKP34214_e6d3689ae86b47eb1d32c47f6be0e47a.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/0f/130fa93144ff04a1e3bd30f7f0c639e7/pa/KP34214_e6d3689ae86b47eb1d32c47f6be0e47a.jpg already downloaded
2026-03-28 19:01:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 42c83913-facc-5c46-95fe-7cb135f40e85, identifier: KP34214
2026-03-28 19:01:07 [auto1.nl] INFO: Found listing with ID: LE21715
2026-03-28 19:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LE21715%27 HTTP/1.1" 200 None
2026-03-28 19:01:07 [auto1.nl] INFO: Scrape type for LE21715: 2
2026-03-28 19:01:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b9f5fea6-0630-50af-9dc8-019eb0c6bdb8 with identifier: LE21715
2026-03-28 19:01:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b9f5fea6-0630-50af-9dc8-019eb0c6bdb8 with scrape type 2
2026-03-28 19:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b9f5fea6-0630-50af-9dc8-019eb0c6bdb8 with scrape type 2
2026-03-28 19:01:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: b9f5fea6-0630-50af-9dc8-019eb0c6bdb8, identifier: LE21715
2026-03-28 19:01:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 42c83913-facc-5c46-95fe-7cb135f40e85 with identifier: KP34214
2026-03-28 19:01:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 42c83913-facc-5c46-95fe-7cb135f40e85 with identifier: KP34214
2026-03-28 19:01:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 42c83913-facc-5c46-95fe-7cb135f40e85 with identifier: KP34214 to the API
2026-03-28 19:01:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 19:01:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 19:01:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/KP34214>
{'auction_title': '',
 'c_o_2_emission_value': 140,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:03:43Z',
 'fuel_type': 'petrol',
 'id': '42c83913-facc-5c46-95fe-7cb135f40e85',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'RG026K',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KP34214',
 'listing': 'auction',
 'location': 'NL, Staphorst',
 'make': 'MINI',
 'model': 'Countryman',
 'odometer': 224025,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img13/0f/130fa93144ff04a1e3bd30f7f0c639e7/pa/KP34214_5d13dfb1862922564479ef83112b506c.jpg',
                'https://img-pa.auto1.com/img13/0f/130fa93144ff04a1e3bd30f7f0c639e7/pa/KP34214_168c6970e33ebcfdc632d03d4b0013de.jpg',
                'https://img-pa.auto1.com/img13/0f/130fa93144ff04a1e3bd30f7f0c639e7/pa/KP34214_619a93729f5b364d3c02963fd728f5a5.jpg',
                'https://img-pa.auto1.com/img13/0f/130fa93144ff04a1e3bd30f7f0c639e7/pa/KP34214_1b993f37c765510bea50c168b9856c8b.jpg',
                'https://img-pa.auto1.com/img13/0f/130fa93144ff04a1e3bd30f7f0c639e7/pa/KP34214_1ee5d89f4d90377cbe50997c776391c2.jpg',
                'https://img-pa.auto1.com/img13/0f/130fa93144ff04a1e3bd30f7f0c639e7/pa/KP34214_15260f99ef8c491875f5de151b8a1435.jpg',
                'https://img-pa.auto1.com/img13/0f/130fa93144ff04a1e3bd30f7f0c639e7/pa/KP34214_0027a29c6daa43ce5ee64e723609b57c.jpg',
                'https://img-pa.auto1.com/img13/0f/130fa93144ff04a1e3bd30f7f0c639e7/pa/KP34214_b0bc4756aea53afa3c09976bdc58bcbe.jpg',
                'https://img-pa.auto1.com/img13/0f/130fa93144ff04a1e3bd30f7f0c639e7/pa/KP34214_5c718ffeafbaa2fabfde5d1e4f1cbc47.jpg',
                'https://img-pa.auto1.com/img13/0f/130fa93144ff04a1e3bd30f7f0c639e7/pa/KP34214_e6d3689ae86b47eb1d32c47f6be0e47a.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_42c83913-facc-5c46-95fe-7cb135f40e85/42c83913-facc-5c46-95fe-7cb135f40e85_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64918,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img13/0f/130fa93144ff04a1e3bd30f7f0c639e7/pa/KP34214_5d13dfb1862922564479ef83112b506c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_42c83913-facc-5c46-95fe-7cb135f40e85/42c83913-facc-5c46-95fe-7cb135f40e85_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2651254,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img13/0f/130fa93144ff04a1e3bd30f7f0c639e7/pa/KP34214_168c6970e33ebcfdc632d03d4b0013de.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_42c83913-facc-5c46-95fe-7cb135f40e85/42c83913-facc-5c46-95fe-7cb135f40e85_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2674933,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img13/0f/130fa93144ff04a1e3bd30f7f0c639e7/pa/KP34214_619a93729f5b364d3c02963fd728f5a5.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_42c83913-facc-5c46-95fe-7cb135f40e85/42c83913-facc-5c46-95fe-7cb135f40e85_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2854574,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img13/0f/130fa93144ff04a1e3bd30f7f0c639e7/pa/KP34214_1b993f37c765510bea50c168b9856c8b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_42c83913-facc-5c46-95fe-7cb135f40e85/42c83913-facc-5c46-95fe-7cb135f40e85_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64454,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img13/0f/130fa93144ff04a1e3bd30f7f0c639e7/pa/KP34214_1ee5d89f4d90377cbe50997c776391c2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_42c83913-facc-5c46-95fe-7cb135f40e85/42c83913-facc-5c46-95fe-7cb135f40e85_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2784512,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img13/0f/130fa93144ff04a1e3bd30f7f0c639e7/pa/KP34214_15260f99ef8c491875f5de151b8a1435.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_42c83913-facc-5c46-95fe-7cb135f40e85/42c83913-facc-5c46-95fe-7cb135f40e85_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2915637,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img13/0f/130fa93144ff04a1e3bd30f7f0c639e7/pa/KP34214_0027a29c6daa43ce5ee64e723609b57c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_42c83913-facc-5c46-95fe-7cb135f40e85/42c83913-facc-5c46-95fe-7cb135f40e85_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69542,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img13/0f/130fa93144ff04a1e3bd30f7f0c639e7/pa/KP34214_b0bc4756aea53afa3c09976bdc58bcbe.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_42c83913-facc-5c46-95fe-7cb135f40e85/42c83913-facc-5c46-95fe-7cb135f40e85_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2526252,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img13/0f/130fa93144ff04a1e3bd30f7f0c639e7/pa/KP34214_5c718ffeafbaa2fabfde5d1e4f1cbc47.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_42c83913-facc-5c46-95fe-7cb135f40e85/42c83913-facc-5c46-95fe-7cb135f40e85_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73937,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img13/0f/130fa93144ff04a1e3bd30f7f0c639e7/pa/KP34214_e6d3689ae86b47eb1d32c47f6be0e47a.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-07-25',
 'seats_number': 4,
 'seller_name': None,
 'title': 'MINI Countryman Cooper',
 'transmission': 'manual',
 'trim': '',
 'year': 2012}
2026-03-28 19:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KP34214%27 HTTP/1.1" 200 None
2026-03-28 19:01:08 [auto1.nl] INFO: Saving data for KP34214: {'created_time': 1774724468.337984, 'last_price_update_time': 1774724468.337995, 'auction_closing_time': 1774883023.0}
2026-03-28 19:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='KP34214') HTTP/1.1" 204 0
2026-03-28 19:01:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: b9f5fea6-0630-50af-9dc8-019eb0c6bdb8 with identifier: LE21715
2026-03-28 19:01:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: b9f5fea6-0630-50af-9dc8-019eb0c6bdb8 with identifier: LE21715
2026-03-28 19:01:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: b9f5fea6-0630-50af-9dc8-019eb0c6bdb8 with identifier: LE21715 to the API
2026-03-28 19:01:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 19:01:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 19:01:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 218,
 'expiration_date': '2026-03-30T15:47:19Z',
 'fuel_type': 'hybrid',
 'id': 'b9f5fea6-0630-50af-9dc8-019eb0c6bdb8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LE21715',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 223365,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-11-30',
 'seller_name': None,
 'title': 'Volkswagen Passat 1.4 GTE',
 'transmission': 'automatic',
 'trim': '',
 'year': 2015}
2026-03-28 19:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LE21715%27 HTTP/1.1" 200 None
2026-03-28 19:01:08 [auto1.nl] INFO: Saving data for LE21715: {'auction_closing_time': 1774885639.0, 'created_time': 1774353780.300876, 'last_price_update_time': 1774724468.784816}
2026-03-28 19:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='LE21715') HTTP/1.1" 204 0
2026-03-28 19:01:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:01:08 [auto1.nl] INFO: Found listing with ID: DH69810
2026-03-28 19:01:08 [auto1.nl] INFO: Found listing with ID: JH71745
2026-03-28 19:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JH71745%27 HTTP/1.1" 200 None
2026-03-28 19:01:08 [auto1.nl] INFO: Scrape type for JH71745: 1
2026-03-28 19:01:08 [auto1.nl] INFO: Found listing with ID: BL89669
2026-03-28 19:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BL89669%27 HTTP/1.1" 200 None
2026-03-28 19:01:08 [auto1.nl] INFO: Scrape type for BL89669: 2
2026-03-28 19:01:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b86ec01d-ddd3-5506-99fe-df6a570f211f with identifier: BL89669
2026-03-28 19:01:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b86ec01d-ddd3-5506-99fe-df6a570f211f with scrape type 2
2026-03-28 19:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b86ec01d-ddd3-5506-99fe-df6a570f211f with scrape type 2
2026-03-28 19:01:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: b86ec01d-ddd3-5506-99fe-df6a570f211f, identifier: BL89669
2026-03-28 19:01:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:01:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: b86ec01d-ddd3-5506-99fe-df6a570f211f with identifier: BL89669
2026-03-28 19:01:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: b86ec01d-ddd3-5506-99fe-df6a570f211f with identifier: BL89669
2026-03-28 19:01:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: b86ec01d-ddd3-5506-99fe-df6a570f211f with identifier: BL89669 to the API
2026-03-28 19:01:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 19:01:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 19:01:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 60,
 'expiration_date': '2026-03-30T15:27:55Z',
 'fuel_type': 'petrol',
 'id': 'b86ec01d-ddd3-5506-99fe-df6a570f211f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BL89669',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'up!',
 'odometer': 245384,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-04-01',
 'seller_name': None,
 'title': 'Volkswagen up! 1.0 Take up!',
 'transmission': 'manual',
 'trim': 'Take',
 'year': 2012}
2026-03-28 19:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BL89669%27 HTTP/1.1" 200 None
2026-03-28 19:01:09 [auto1.nl] INFO: Saving data for BL89669: {'auction_closing_time': 1774884475.0, 'created_time': 1774551714.699669, 'last_price_update_time': 1774724469.27408}
2026-03-28 19:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='BL89669') HTTP/1.1" 204 0
2026-03-28 19:01:09 [auto1.nl] INFO: Found listing with ID: DB68589
2026-03-28 19:01:09 [auto1.nl] INFO: Found listing with ID: HN54837
2026-03-28 19:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HN54837%27 HTTP/1.1" 200 None
2026-03-28 19:01:09 [auto1.nl] INFO: Scrape type for HN54837: 1
2026-03-28 19:01:09 [auto1.nl] INFO: Found listing with ID: WG42782
2026-03-28 19:01:09 [auto1.nl] INFO: Found listing with ID: RF41961
2026-03-28 19:01:09 [auto1.nl] INFO: Found listing with ID: BC40672
2026-03-28 19:01:09 [auto1.nl] INFO: Found listing with ID: PR08670
2026-03-28 19:01:09 [auto1.nl] INFO: Found listing with ID: XK63885
2026-03-28 19:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XK63885%27 HTTP/1.1" 200 None
2026-03-28 19:01:09 [auto1.nl] INFO: Scrape type for XK63885: 1
2026-03-28 19:01:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:01:09 [auto1.nl] INFO: Found listing with ID: BJ61509
2026-03-28 19:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BJ61509%27 HTTP/1.1" 200 None
2026-03-28 19:01:09 [auto1.nl] INFO: Scrape type for BJ61509: 1
2026-03-28 19:01:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:01:09 [auto1.nl] INFO: Found listing with ID: RH72913
2026-03-28 19:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RH72913%27 HTTP/1.1" 200 None
2026-03-28 19:01:09 [auto1.nl] INFO: Scrape type for RH72913: 1
2026-03-28 19:01:09 [auto1.nl] INFO: Found listing with ID: SR45817
2026-03-28 19:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SR45817%27 HTTP/1.1" 200 None
2026-03-28 19:01:09 [auto1.nl] INFO: Scrape type for SR45817: 1
2026-03-28 19:01:09 [auto1.nl] INFO: Found listing with ID: RZ76461
2026-03-28 19:01:09 [auto1.nl] INFO: Found listing with ID: DR36555
2026-03-28 19:01:09 [auto1.nl] INFO: Found listing with ID: BZ98625
2026-03-28 19:01:09 [auto1.nl] INFO: Found listing with ID: GM68754
2026-03-28 19:01:09 [auto1.nl] INFO: Found listing with ID: EC40520
2026-03-28 19:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EC40520%27 HTTP/1.1" 200 None
2026-03-28 19:01:09 [auto1.nl] INFO: Scrape type for EC40520: 1
2026-03-28 19:01:09 [auto1.nl] INFO: Found listing with ID: LL30088
2026-03-28 19:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LL30088%27 HTTP/1.1" 200 None
2026-03-28 19:01:09 [auto1.nl] INFO: Scrape type for LL30088: 1
2026-03-28 19:01:09 [auto1.nl] INFO: Found listing with ID: JP71821
2026-03-28 19:01:09 [auto1.nl] INFO: Found listing with ID: SN61945
2026-03-28 19:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SN61945%27 HTTP/1.1" 200 None
2026-03-28 19:01:09 [auto1.nl] INFO: Scrape type for SN61945: 1
2026-03-28 19:01:09 [auto1.nl] INFO: Found listing with ID: BG04233
2026-03-28 19:01:09 [auto1.nl] INFO: Found listing with ID: ZK31432
2026-03-28 19:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZK31432%27 HTTP/1.1" 200 None
2026-03-28 19:01:09 [auto1.nl] INFO: Scrape type for ZK31432: 1
2026-03-28 19:01:09 [auto1.nl] INFO: Found listing with ID: AT06250
2026-03-28 19:01:09 [auto1.nl] INFO: Found listing with ID: GN14496
2026-03-28 19:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GN14496%27 HTTP/1.1" 200 None
2026-03-28 19:01:09 [auto1.nl] INFO: Scrape type for GN14496: 1
2026-03-28 19:01:09 [auto1.nl] INFO: Found listing with ID: WH58354
2026-03-28 19:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WH58354%27 HTTP/1.1" 200 None
2026-03-28 19:01:09 [auto1.nl] INFO: Scrape type for WH58354: 2
2026-03-28 19:01:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9cc5b17a-759a-50de-bbee-5d90c711bc03 with identifier: WH58354
2026-03-28 19:01:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9cc5b17a-759a-50de-bbee-5d90c711bc03 with scrape type 2
2026-03-28 19:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9cc5b17a-759a-50de-bbee-5d90c711bc03 with scrape type 2
2026-03-28 19:01:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 9cc5b17a-759a-50de-bbee-5d90c711bc03, identifier: WH58354
2026-03-28 19:01:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 9cc5b17a-759a-50de-bbee-5d90c711bc03 with identifier: WH58354
2026-03-28 19:01:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 9cc5b17a-759a-50de-bbee-5d90c711bc03 with identifier: WH58354
2026-03-28 19:01:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 9cc5b17a-759a-50de-bbee-5d90c711bc03 with identifier: WH58354 to the API
2026-03-28 19:01:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 19:01:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 19:01:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 333,
 'expiration_date': '2026-03-30T15:42:56Z',
 'fuel_type': 'petrol',
 'id': '9cc5b17a-759a-50de-bbee-5d90c711bc03',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WH58354',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'CLS-Klasse',
 'odometer': 111621,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-05-26',
 'seller_name': None,
 'title': 'Mercedes-Benz CLS-Klasse CLS 400 CGI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2015}
2026-03-28 19:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WH58354%27 HTTP/1.1" 200 None
2026-03-28 19:01:10 [auto1.nl] INFO: Saving data for WH58354: {'auction_closing_time': 1774885376.0, 'created_time': 1773924618.638592, 'last_price_update_time': 1774724470.144186}
2026-03-28 19:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='WH58354') HTTP/1.1" 204 0
2026-03-28 19:01:10 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 19:01:10 [auto1.nl] INFO: Found listing with ID: VZ88435
2026-03-28 19:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VZ88435%27 HTTP/1.1" 200 None
2026-03-28 19:01:10 [auto1.nl] INFO: Scrape type for VZ88435: 1
2026-03-28 19:01:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:01:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JH71745/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 19:01:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VE70887/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 19:01:10 [auto1.nl] INFO: Found listing with ID: LM67237
2026-03-28 19:01:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:01:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:01:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZP46172/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 19:01:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TY41517/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 19:01:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WP58537/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 19:01:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:01:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:01:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:01:10 [auto1.nl] INFO: Channel: 24h | Page: 13 | totalHits: 646 | hits on page: 40
2026-03-28 19:01:10 [auto1.nl] INFO: Found listing with ID: ZN70459
2026-03-28 19:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZN70459%27 HTTP/1.1" 200 None
2026-03-28 19:01:10 [auto1.nl] INFO: Scrape type for ZN70459: 1
2026-03-28 19:01:10 [auto1.nl] INFO: Found listing with ID: JW17706
2026-03-28 19:01:10 [auto1.nl] INFO: Found listing with ID: GU81834
2026-03-28 19:01:10 [auto1.nl] INFO: Found listing with ID: BC15859
2026-03-28 19:01:10 [auto1.nl] INFO: Found listing with ID: XR27425
2026-03-28 19:01:10 [auto1.nl] INFO: Found listing with ID: ME79677
2026-03-28 19:01:10 [auto1.nl] INFO: Found listing with ID: FE67699
2026-03-28 19:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FE67699%27 HTTP/1.1" 200 None
2026-03-28 19:01:10 [auto1.nl] INFO: Scrape type for FE67699: 1
2026-03-28 19:01:10 [auto1.nl] INFO: Found listing with ID: XU82529
2026-03-28 19:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XU82529%27 HTTP/1.1" 200 None
2026-03-28 19:01:10 [auto1.nl] INFO: Scrape type for XU82529: 1
2026-03-28 19:01:10 [auto1.nl] INFO: Found listing with ID: PT04530
2026-03-28 19:01:10 [auto1.nl] INFO: Found listing with ID: VZ65695
2026-03-28 19:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VZ65695%27 HTTP/1.1" 200 None
2026-03-28 19:01:10 [auto1.nl] INFO: Scrape type for VZ65695: 1
2026-03-28 19:01:10 [auto1.nl] INFO: Found listing with ID: GU70185
2026-03-28 19:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GU70185%27 HTTP/1.1" 200 None
2026-03-28 19:01:10 [auto1.nl] INFO: Scrape type for GU70185: 1
2026-03-28 19:01:10 [auto1.nl] INFO: Found listing with ID: PS03610
2026-03-28 19:01:10 [auto1.nl] INFO: Found listing with ID: GD33520
2026-03-28 19:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GD33520%27 HTTP/1.1" 200 None
2026-03-28 19:01:10 [auto1.nl] INFO: Scrape type for GD33520: 1
2026-03-28 19:01:10 [auto1.nl] INFO: Found listing with ID: MD18286
2026-03-28 19:01:10 [auto1.nl] INFO: Found listing with ID: PS01910
2026-03-28 19:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PS01910%27 HTTP/1.1" 200 None
2026-03-28 19:01:10 [auto1.nl] INFO: Scrape type for PS01910: 1
2026-03-28 19:01:10 [auto1.nl] INFO: Found listing with ID: EB08844
2026-03-28 19:01:10 [auto1.nl] INFO: Found listing with ID: AB54003
2026-03-28 19:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AB54003%27 HTTP/1.1" 200 None
2026-03-28 19:01:10 [auto1.nl] INFO: Scrape type for AB54003: 1
2026-03-28 19:01:10 [auto1.nl] INFO: Found listing with ID: HD36341
2026-03-28 19:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HD36341%27 HTTP/1.1" 200 None
2026-03-28 19:01:10 [auto1.nl] INFO: Scrape type for HD36341: 1
2026-03-28 19:01:10 [auto1.nl] INFO: Found listing with ID: PV55742
2026-03-28 19:01:10 [auto1.nl] INFO: Found listing with ID: JA81822
2026-03-28 19:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JA81822%27 HTTP/1.1" 200 None
2026-03-28 19:01:10 [auto1.nl] INFO: Scrape type for JA81822: 1
2026-03-28 19:01:10 [auto1.nl] INFO: Found listing with ID: AM51490
2026-03-28 19:01:10 [auto1.nl] INFO: Found listing with ID: JA39510
2026-03-28 19:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JA39510%27 HTTP/1.1" 200 None
2026-03-28 19:01:10 [auto1.nl] INFO: Scrape type for JA39510: 1
2026-03-28 19:01:10 [auto1.nl] INFO: Found listing with ID: AD33035
2026-03-28 19:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AD33035%27 HTTP/1.1" 200 None
2026-03-28 19:01:10 [auto1.nl] INFO: Scrape type for AD33035: 1
2026-03-28 19:01:10 [auto1.nl] INFO: Found listing with ID: MD35327
2026-03-28 19:01:10 [auto1.nl] INFO: Found listing with ID: NJ31093
2026-03-28 19:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NJ31093%27 HTTP/1.1" 200 None
2026-03-28 19:01:10 [auto1.nl] INFO: Scrape type for NJ31093: 1
2026-03-28 19:01:10 [auto1.nl] INFO: Found listing with ID: YZ13462
2026-03-28 19:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YZ13462%27 HTTP/1.1" 200 None
2026-03-28 19:01:10 [auto1.nl] INFO: Scrape type for YZ13462: 2
2026-03-28 19:01:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 823386a8-c007-5b12-9207-3a4ec4d5060d with identifier: YZ13462
2026-03-28 19:01:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 823386a8-c007-5b12-9207-3a4ec4d5060d with scrape type 2
2026-03-28 19:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 823386a8-c007-5b12-9207-3a4ec4d5060d with scrape type 2
2026-03-28 19:01:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 823386a8-c007-5b12-9207-3a4ec4d5060d, identifier: YZ13462
2026-03-28 19:01:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 823386a8-c007-5b12-9207-3a4ec4d5060d with identifier: YZ13462
2026-03-28 19:01:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 823386a8-c007-5b12-9207-3a4ec4d5060d with identifier: YZ13462
2026-03-28 19:01:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 823386a8-c007-5b12-9207-3a4ec4d5060d with identifier: YZ13462 to the API
2026-03-28 19:01:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 19:01:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 19:01:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 279,
 'expiration_date': '2026-03-30T15:28:24Z',
 'fuel_type': 'hybrid',
 'id': '823386a8-c007-5b12-9207-3a4ec4d5060d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YZ13462',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 208100,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-08-27',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 350e T Avantgarde',
 'transmission': 'automatic',
 'trim': 'T Avantgarde',
 'year': 2017}
2026-03-28 19:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YZ13462%27 HTTP/1.1" 200 None
2026-03-28 19:01:11 [auto1.nl] INFO: Saving data for YZ13462: {'auction_closing_time': 1774884504.0, 'created_time': 1773860701.62698, 'last_price_update_time': 1774724471.095277}
2026-03-28 19:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='YZ13462') HTTP/1.1" 204 0
2026-03-28 19:01:11 [auto1.nl] INFO: Found listing with ID: LE06198
2026-03-28 19:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LE06198%27 HTTP/1.1" 200 None
2026-03-28 19:01:11 [auto1.nl] INFO: Scrape type for LE06198: 1
2026-03-28 19:01:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RH72913/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 19:01:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HN54837/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 19:01:11 [auto1.nl] INFO: Found listing with ID: TR09691
2026-03-28 19:01:11 [auto1.nl] INFO: Found listing with ID: HW32084
2026-03-28 19:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HW32084%27 HTTP/1.1" 200 None
2026-03-28 19:01:11 [auto1.nl] INFO: Scrape type for HW32084: 1
2026-03-28 19:01:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:01:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:01:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XK63885/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 19:01:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:01:11 [auto1.nl] INFO: Found listing with ID: KX19183
2026-03-28 19:01:11 [auto1.nl] INFO: Found listing with ID: EW29368
2026-03-28 19:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EW29368%27 HTTP/1.1" 200 None
2026-03-28 19:01:11 [auto1.nl] INFO: Scrape type for EW29368: 1
2026-03-28 19:01:11 [auto1.nl] INFO: Found listing with ID: UW56966
2026-03-28 19:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UW56966%27 HTTP/1.1" 200 None
2026-03-28 19:01:11 [auto1.nl] INFO: Scrape type for UW56966: 2
2026-03-28 19:01:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a598defa-a3f7-57c5-9199-3f9a63af0959 with identifier: UW56966
2026-03-28 19:01:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a598defa-a3f7-57c5-9199-3f9a63af0959 with scrape type 2
2026-03-28 19:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a598defa-a3f7-57c5-9199-3f9a63af0959 with scrape type 2
2026-03-28 19:01:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: a598defa-a3f7-57c5-9199-3f9a63af0959, identifier: UW56966
2026-03-28 19:01:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: a598defa-a3f7-57c5-9199-3f9a63af0959 with identifier: UW56966
2026-03-28 19:01:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: a598defa-a3f7-57c5-9199-3f9a63af0959 with identifier: UW56966
2026-03-28 19:01:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: a598defa-a3f7-57c5-9199-3f9a63af0959 with identifier: UW56966 to the API
2026-03-28 19:01:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 19:01:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 19:01:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 136,
 'expiration_date': '2026-03-30T15:28:23Z',
 'fuel_type': 'petrol',
 'id': 'a598defa-a3f7-57c5-9199-3f9a63af0959',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UW56966',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'B-Klasse',
 'odometer': 69650,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-12-08',
 'seller_name': None,
 'title': 'Mercedes-Benz B-Klasse B 180 AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2019}
2026-03-28 19:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UW56966%27 HTTP/1.1" 200 None
2026-03-28 19:01:11 [auto1.nl] INFO: Saving data for UW56966: {'auction_closing_time': 1774884503.0, 'created_time': 1774033498.196156, 'last_price_update_time': 1774724471.68636}
2026-03-28 19:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='UW56966') HTTP/1.1" 204 0
2026-03-28 19:01:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SR45817/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 19:01:11 [auto1.nl] INFO: Found listing with ID: JH24547
2026-03-28 19:01:11 [auto1.nl] INFO: Found listing with ID: HL97424
2026-03-28 19:01:11 [auto1.nl] INFO: Found listing with ID: YF94322
2026-03-28 19:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YF94322%27 HTTP/1.1" 200 None
2026-03-28 19:01:11 [auto1.nl] INFO: Scrape type for YF94322: 2
2026-03-28 19:01:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2841a04c-73fe-5aa2-89b8-40ddb3f00802 with identifier: YF94322
2026-03-28 19:01:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2841a04c-73fe-5aa2-89b8-40ddb3f00802 with scrape type 2
2026-03-28 19:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2841a04c-73fe-5aa2-89b8-40ddb3f00802 with scrape type 2
2026-03-28 19:01:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 2841a04c-73fe-5aa2-89b8-40ddb3f00802, identifier: YF94322
2026-03-28 19:01:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:01:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 2841a04c-73fe-5aa2-89b8-40ddb3f00802 with identifier: YF94322
2026-03-28 19:01:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 2841a04c-73fe-5aa2-89b8-40ddb3f00802 with identifier: YF94322
2026-03-28 19:01:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 2841a04c-73fe-5aa2-89b8-40ddb3f00802 with identifier: YF94322 to the API
2026-03-28 19:01:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 19:01:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 19:01:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:22:28Z',
 'fuel_type': 'petrol',
 'id': '2841a04c-73fe-5aa2-89b8-40ddb3f00802',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YF94322',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T-Roc',
 'odometer': 72692,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-12-16',
 'seller_name': None,
 'title': 'Volkswagen T-Roc 1.5 TSI ACT Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2019}
2026-03-28 19:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YF94322%27 HTTP/1.1" 200 None
2026-03-28 19:01:12 [auto1.nl] INFO: Saving data for YF94322: {'auction_closing_time': 1774884148.0, 'created_time': 1774551751.547652, 'last_price_update_time': 1774724472.154809}
2026-03-28 19:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='YF94322') HTTP/1.1" 204 0
2026-03-28 19:01:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SN61945/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 19:01:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EC40520/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 19:01:12 [auto1.nl] INFO: Found listing with ID: AB85439
2026-03-28 19:01:12 [auto1.nl] INFO: Found listing with ID: PK76759
2026-03-28 19:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PK76759%27 HTTP/1.1" 200 None
2026-03-28 19:01:12 [auto1.nl] INFO: Scrape type for PK76759: 0
2026-03-28 19:01:12 [auto1.nl] INFO: Found listing with ID: UE65811
2026-03-28 19:01:12 [auto1.nl] INFO: Found listing with ID: UY86442
2026-03-28 19:01:12 [auto1.nl] INFO: Found listing with ID: WG90560
2026-03-28 19:01:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:01:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:01:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BJ61509/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 19:01:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:01:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VZ88435/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 19:01:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:01:13 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 19:01:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:01:13 [auto1.nl] INFO: Channel: 24h | Page: 14 | totalHits: 646 | hits on page: 40
2026-03-28 19:01:13 [auto1.nl] INFO: Found listing with ID: GA63942
2026-03-28 19:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GA63942%27 HTTP/1.1" 200 None
2026-03-28 19:01:13 [auto1.nl] INFO: Scrape type for GA63942: 0
2026-03-28 19:01:13 [auto1.nl] INFO: Found listing with ID: XH80509
2026-03-28 19:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XH80509%27 HTTP/1.1" 200 None
2026-03-28 19:01:13 [auto1.nl] INFO: Scrape type for XH80509: 0
2026-03-28 19:01:13 [auto1.nl] INFO: Found listing with ID: ND88147
2026-03-28 19:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ND88147%27 HTTP/1.1" 200 None
2026-03-28 19:01:13 [auto1.nl] INFO: Scrape type for ND88147: 0
2026-03-28 19:01:13 [auto1.nl] INFO: Found listing with ID: UR39080
2026-03-28 19:01:13 [auto1.nl] INFO: Found listing with ID: WE18316
2026-03-28 19:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WE18316%27 HTTP/1.1" 200 None
2026-03-28 19:01:13 [auto1.nl] INFO: Scrape type for WE18316: 0
2026-03-28 19:01:13 [auto1.nl] INFO: Found listing with ID: SS74343
2026-03-28 19:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SS74343%27 HTTP/1.1" 200 None
2026-03-28 19:01:13 [auto1.nl] INFO: Scrape type for SS74343: 0
2026-03-28 19:01:13 [auto1.nl] INFO: Found listing with ID: YZ60467
2026-03-28 19:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YZ60467%27 HTTP/1.1" 200 None
2026-03-28 19:01:13 [auto1.nl] INFO: Scrape type for YZ60467: 0
2026-03-28 19:01:13 [auto1.nl] INFO: Found listing with ID: MZ09465
2026-03-28 19:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MZ09465%27 HTTP/1.1" 200 None
2026-03-28 19:01:13 [auto1.nl] INFO: Scrape type for MZ09465: 0
2026-03-28 19:01:13 [auto1.nl] INFO: Found listing with ID: EG04578
2026-03-28 19:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EG04578%27 HTTP/1.1" 200 None
2026-03-28 19:01:13 [auto1.nl] INFO: Scrape type for EG04578: 0
2026-03-28 19:01:13 [auto1.nl] INFO: Found listing with ID: PH88105
2026-03-28 19:01:13 [auto1.nl] INFO: Found listing with ID: UF12505
2026-03-28 19:01:13 [auto1.nl] INFO: Found listing with ID: PJ49676
2026-03-28 19:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PJ49676%27 HTTP/1.1" 200 None
2026-03-28 19:01:13 [auto1.nl] INFO: Scrape type for PJ49676: 0
2026-03-28 19:01:13 [auto1.nl] INFO: Found listing with ID: XK28167
2026-03-28 19:01:13 [auto1.nl] INFO: Found listing with ID: JC30911
2026-03-28 19:01:13 [auto1.nl] INFO: Found listing with ID: AX92237
2026-03-28 19:01:13 [auto1.nl] INFO: Found listing with ID: TL29950
2026-03-28 19:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TL29950%27 HTTP/1.1" 200 None
2026-03-28 19:01:13 [auto1.nl] INFO: Scrape type for TL29950: 2
2026-03-28 19:01:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9b60e987-fe57-5b5c-a6d8-87cfa55627ba with identifier: TL29950
2026-03-28 19:01:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9b60e987-fe57-5b5c-a6d8-87cfa55627ba with scrape type 2
2026-03-28 19:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9b60e987-fe57-5b5c-a6d8-87cfa55627ba with scrape type 2
2026-03-28 19:01:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 9b60e987-fe57-5b5c-a6d8-87cfa55627ba, identifier: TL29950
2026-03-28 19:01:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 9b60e987-fe57-5b5c-a6d8-87cfa55627ba with identifier: TL29950
2026-03-28 19:01:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 9b60e987-fe57-5b5c-a6d8-87cfa55627ba with identifier: TL29950
2026-03-28 19:01:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 9b60e987-fe57-5b5c-a6d8-87cfa55627ba with identifier: TL29950 to the API
2026-03-28 19:01:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 19:01:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 19:01:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:01:27Z',
 'fuel_type': 'diesel',
 'id': '9b60e987-fe57-5b5c-a6d8-87cfa55627ba',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TL29950',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T6 Kombi',
 'odometer': 228514,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-08-01',
 'seller_name': None,
 'title': 'Volkswagen T6 Kombi 2.0 TDI lang',
 'transmission': 'automatic',
 'trim': 'lang',
 'year': 2019}
2026-03-28 19:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TL29950%27 HTTP/1.1" 200 None
2026-03-28 19:01:13 [auto1.nl] INFO: Saving data for TL29950: {'auction_closing_time': 1774882887.0, 'created_time': 1774526497.448378, 'last_price_update_time': 1774724473.745809}
2026-03-28 19:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='TL29950') HTTP/1.1" 204 0
2026-03-28 19:01:13 [auto1.nl] INFO: Found listing with ID: UB73502
2026-03-28 19:01:13 [auto1.nl] INFO: Found listing with ID: TP02076
2026-03-28 19:01:13 [auto1.nl] INFO: Found listing with ID: GZ48867
2026-03-28 19:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GZ48867%27 HTTP/1.1" 200 None
2026-03-28 19:01:13 [auto1.nl] INFO: Scrape type for GZ48867: 0
2026-03-28 19:01:13 [auto1.nl] INFO: Found listing with ID: BV07887
2026-03-28 19:01:13 [auto1.nl] INFO: Found listing with ID: ZE09391
2026-03-28 19:01:13 [auto1.nl] INFO: Found listing with ID: ER86910
2026-03-28 19:01:13 [auto1.nl] INFO: Found listing with ID: ZB71006
2026-03-28 19:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZB71006%27 HTTP/1.1" 200 None
2026-03-28 19:01:13 [auto1.nl] INFO: Scrape type for ZB71006: 0
2026-03-28 19:01:13 [auto1.nl] INFO: Found listing with ID: DR23359
2026-03-28 19:01:13 [auto1.nl] INFO: Found listing with ID: DU11939
2026-03-28 19:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DU11939%27 HTTP/1.1" 200 None
2026-03-28 19:01:13 [auto1.nl] INFO: Scrape type for DU11939: 2
2026-03-28 19:01:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 891d58cf-ee3b-5e74-90bd-b087b7f63344 with identifier: DU11939
2026-03-28 19:01:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 891d58cf-ee3b-5e74-90bd-b087b7f63344 with scrape type 2
2026-03-28 19:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 891d58cf-ee3b-5e74-90bd-b087b7f63344 with scrape type 2
2026-03-28 19:01:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 891d58cf-ee3b-5e74-90bd-b087b7f63344, identifier: DU11939
2026-03-28 19:01:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 891d58cf-ee3b-5e74-90bd-b087b7f63344 with identifier: DU11939
2026-03-28 19:01:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 891d58cf-ee3b-5e74-90bd-b087b7f63344 with identifier: DU11939
2026-03-28 19:01:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 891d58cf-ee3b-5e74-90bd-b087b7f63344 with identifier: DU11939 to the API
2026-03-28 19:01:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 19:01:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 19:01:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:18:15Z',
 'fuel_type': 'petrol',
 'id': '891d58cf-ee3b-5e74-90bd-b087b7f63344',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DU11939',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf V',
 'odometer': 149308,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-02-20',
 'seller_name': None,
 'title': 'Volkswagen Golf V 1.4 TSI United',
 'transmission': 'automatic',
 'trim': 'United',
 'year': 2008}
2026-03-28 19:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DU11939%27 HTTP/1.1" 200 None
2026-03-28 19:01:14 [auto1.nl] INFO: Saving data for DU11939: {'auction_closing_time': 1774883895.0, 'created_time': 1774378883.943602, 'last_price_update_time': 1774724474.324266}
2026-03-28 19:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='DU11939') HTTP/1.1" 204 0
2026-03-28 19:01:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZN70459/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 19:01:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FE67699/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 19:01:14 [auto1.nl] INFO: Found listing with ID: MH16372
2026-03-28 19:01:14 [auto1.nl] INFO: Found listing with ID: ME24209
2026-03-28 19:01:14 [auto1.nl] INFO: Found listing with ID: PU27111
2026-03-28 19:01:14 [auto1.nl] INFO: Found listing with ID: KK51574
2026-03-28 19:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KK51574%27 HTTP/1.1" 200 None
2026-03-28 19:01:14 [auto1.nl] INFO: Scrape type for KK51574: 0
2026-03-28 19:01:14 [auto1.nl] INFO: Found listing with ID: AK27162
2026-03-28 19:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AK27162%27 HTTP/1.1" 200 None
2026-03-28 19:01:14 [auto1.nl] INFO: Scrape type for AK27162: 0
2026-03-28 19:01:14 [auto1.nl] INFO: Found listing with ID: KX15971
2026-03-28 19:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KX15971%27 HTTP/1.1" 200 None
2026-03-28 19:01:14 [auto1.nl] INFO: Scrape type for KX15971: 0
2026-03-28 19:01:14 [auto1.nl] INFO: Found listing with ID: MV10901
2026-03-28 19:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MV10901%27 HTTP/1.1" 200 None
2026-03-28 19:01:14 [auto1.nl] INFO: Scrape type for MV10901: 0
2026-03-28 19:01:14 [auto1.nl] INFO: Found listing with ID: EH33258
2026-03-28 19:01:14 [auto1.nl] INFO: Found listing with ID: SE67800
2026-03-28 19:01:14 [auto1.nl] INFO: Found listing with ID: TN45594
2026-03-28 19:01:14 [auto1.nl] INFO: Found listing with ID: HK48702
2026-03-28 19:01:14 [auto1.nl] INFO: Found listing with ID: PX89333
2026-03-28 19:01:14 [auto1.nl] INFO: Found listing with ID: ZT51900
2026-03-28 19:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZT51900%27 HTTP/1.1" 200 None
2026-03-28 19:01:14 [auto1.nl] INFO: Scrape type for ZT51900: 0
2026-03-28 19:01:14 [auto1.nl] INFO: Found listing with ID: GN27243
2026-03-28 19:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GN27243%27 HTTP/1.1" 200 None
2026-03-28 19:01:14 [auto1.nl] INFO: Scrape type for GN27243: 0
2026-03-28 19:01:14 [auto1.nl] INFO: Found listing with ID: NU66962
2026-03-28 19:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NU66962%27 HTTP/1.1" 200 None
2026-03-28 19:01:14 [auto1.nl] INFO: Scrape type for NU66962: 0
2026-03-28 19:01:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:01:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:01:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WP58537> (referer: https://www.auto1.com/v1/car-details-view/WP58537/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 19:01:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:01:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8dc0f4c4-b632-5ad2-b262-8bbac2c4936f with identifier: WP58537
2026-03-28 19:01:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8dc0f4c4-b632-5ad2-b262-8bbac2c4936f with scrape type 1
2026-03-28 19:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8dc0f4c4-b632-5ad2-b262-8bbac2c4936f
2026-03-28 19:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252Fd9%252F2ad9ace36dc3d9aeff7553869283cdf6%252Fpa%252FWP58537_6c8bfa3d8e8213e125bc53e405565194.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/d9/2ad9ace36dc3d9aeff7553869283cdf6/pa/WP58537_6c8bfa3d8e8213e125bc53e405565194.jpg already downloaded
2026-03-28 19:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252Fd9%252F2ad9ace36dc3d9aeff7553869283cdf6%252Fpa%252FWP58537_6e27c32fb3354a3e08d63d41571a9b66.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/d9/2ad9ace36dc3d9aeff7553869283cdf6/pa/WP58537_6e27c32fb3354a3e08d63d41571a9b66.jpg already downloaded
2026-03-28 19:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252Fd9%252F2ad9ace36dc3d9aeff7553869283cdf6%252Fpa%252FWP58537_7181c3d1b27da7d826221bbcb431402f.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/d9/2ad9ace36dc3d9aeff7553869283cdf6/pa/WP58537_7181c3d1b27da7d826221bbcb431402f.jpg already downloaded
2026-03-28 19:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252Fd9%252F2ad9ace36dc3d9aeff7553869283cdf6%252Fpa%252FWP58537_8abccccb21b01980b8839ffa69a9e654.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/d9/2ad9ace36dc3d9aeff7553869283cdf6/pa/WP58537_8abccccb21b01980b8839ffa69a9e654.jpg already downloaded
2026-03-28 19:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252Fd9%252F2ad9ace36dc3d9aeff7553869283cdf6%252Fpa%252FWP58537_d662f073ea668b226f0bf966c2a3422b.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/d9/2ad9ace36dc3d9aeff7553869283cdf6/pa/WP58537_d662f073ea668b226f0bf966c2a3422b.jpg already downloaded
2026-03-28 19:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252Fd9%252F2ad9ace36dc3d9aeff7553869283cdf6%252Fpa%252FWP58537_382ce2a1e0b49f4faeead4268f587138.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/d9/2ad9ace36dc3d9aeff7553869283cdf6/pa/WP58537_382ce2a1e0b49f4faeead4268f587138.jpg already downloaded
2026-03-28 19:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252Fd9%252F2ad9ace36dc3d9aeff7553869283cdf6%252Fpa%252FWP58537_b6149527fbea855f14c91954c9854478.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/d9/2ad9ace36dc3d9aeff7553869283cdf6/pa/WP58537_b6149527fbea855f14c91954c9854478.jpg already downloaded
2026-03-28 19:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252Fd9%252F2ad9ace36dc3d9aeff7553869283cdf6%252Fpa%252FWP58537_7d7e7c0e06f09ac35636243805350647.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/d9/2ad9ace36dc3d9aeff7553869283cdf6/pa/WP58537_7d7e7c0e06f09ac35636243805350647.jpg already downloaded
2026-03-28 19:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252Fd9%252F2ad9ace36dc3d9aeff7553869283cdf6%252Fpa%252FWP58537_84deb44c66aa417a3d5ae145f7d0f33c.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/d9/2ad9ace36dc3d9aeff7553869283cdf6/pa/WP58537_84deb44c66aa417a3d5ae145f7d0f33c.jpg already downloaded
2026-03-28 19:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252Fd9%252F2ad9ace36dc3d9aeff7553869283cdf6%252Fpa%252FWP58537_be8350474eb27734938e12c778215395.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/d9/2ad9ace36dc3d9aeff7553869283cdf6/pa/WP58537_be8350474eb27734938e12c778215395.jpg already downloaded
2026-03-28 19:01:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 8dc0f4c4-b632-5ad2-b262-8bbac2c4936f, identifier: WP58537
2026-03-28 19:01:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 8dc0f4c4-b632-5ad2-b262-8bbac2c4936f with identifier: WP58537
2026-03-28 19:01:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 8dc0f4c4-b632-5ad2-b262-8bbac2c4936f with identifier: WP58537
2026-03-28 19:01:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 8dc0f4c4-b632-5ad2-b262-8bbac2c4936f with identifier: WP58537 to the API
2026-03-28 19:01:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 19:01:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 19:01:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/WP58537>
{'auction_title': '',
 'c_o_2_emission_value': 183,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.3L',
 'engine_horse_power': 145,
 'expiration_date': '2026-03-30T15:03:56Z',
 'fuel_type': 'diesel',
 'id': '8dc0f4c4-b632-5ad2-b262-8bbac2c4936f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'license_plate': 'V677TT',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WP58537',
 'listing': 'auction',
 'location': 'NL, Oosterhout',
 'make': 'Renault',
 'model': 'Master',
 'odometer': 73615,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img2a/d9/2ad9ace36dc3d9aeff7553869283cdf6/pa/WP58537_6c8bfa3d8e8213e125bc53e405565194.jpg',
                'https://img-pa.auto1.com/img2a/d9/2ad9ace36dc3d9aeff7553869283cdf6/pa/WP58537_6e27c32fb3354a3e08d63d41571a9b66.jpg',
                'https://img-pa.auto1.com/img2a/d9/2ad9ace36dc3d9aeff7553869283cdf6/pa/WP58537_7181c3d1b27da7d826221bbcb431402f.jpg',
                'https://img-pa.auto1.com/img2a/d9/2ad9ace36dc3d9aeff7553869283cdf6/pa/WP58537_8abccccb21b01980b8839ffa69a9e654.jpg',
                'https://img-pa.auto1.com/img2a/d9/2ad9ace36dc3d9aeff7553869283cdf6/pa/WP58537_d662f073ea668b226f0bf966c2a3422b.jpg',
                'https://img-pa.auto1.com/img2a/d9/2ad9ace36dc3d9aeff7553869283cdf6/pa/WP58537_382ce2a1e0b49f4faeead4268f587138.jpg',
                'https://img-pa.auto1.com/img2a/d9/2ad9ace36dc3d9aeff7553869283cdf6/pa/WP58537_b6149527fbea855f14c91954c9854478.jpg',
                'https://img-pa.auto1.com/img2a/d9/2ad9ace36dc3d9aeff7553869283cdf6/pa/WP58537_7d7e7c0e06f09ac35636243805350647.jpg',
                'https://img-pa.auto1.com/img2a/d9/2ad9ace36dc3d9aeff7553869283cdf6/pa/WP58537_84deb44c66aa417a3d5ae145f7d0f33c.jpg',
                'https://img-pa.auto1.com/img2a/d9/2ad9ace36dc3d9aeff7553869283cdf6/pa/WP58537_be8350474eb27734938e12c778215395.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8dc0f4c4-b632-5ad2-b262-8bbac2c4936f/8dc0f4c4-b632-5ad2-b262-8bbac2c4936f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90753,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/d9/2ad9ace36dc3d9aeff7553869283cdf6/pa/WP58537_6c8bfa3d8e8213e125bc53e405565194.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8dc0f4c4-b632-5ad2-b262-8bbac2c4936f/8dc0f4c4-b632-5ad2-b262-8bbac2c4936f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88940,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/d9/2ad9ace36dc3d9aeff7553869283cdf6/pa/WP58537_6e27c32fb3354a3e08d63d41571a9b66.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8dc0f4c4-b632-5ad2-b262-8bbac2c4936f/8dc0f4c4-b632-5ad2-b262-8bbac2c4936f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82986,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/d9/2ad9ace36dc3d9aeff7553869283cdf6/pa/WP58537_7181c3d1b27da7d826221bbcb431402f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8dc0f4c4-b632-5ad2-b262-8bbac2c4936f/8dc0f4c4-b632-5ad2-b262-8bbac2c4936f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59414,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/d9/2ad9ace36dc3d9aeff7553869283cdf6/pa/WP58537_8abccccb21b01980b8839ffa69a9e654.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8dc0f4c4-b632-5ad2-b262-8bbac2c4936f/8dc0f4c4-b632-5ad2-b262-8bbac2c4936f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81587,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/d9/2ad9ace36dc3d9aeff7553869283cdf6/pa/WP58537_d662f073ea668b226f0bf966c2a3422b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8dc0f4c4-b632-5ad2-b262-8bbac2c4936f/8dc0f4c4-b632-5ad2-b262-8bbac2c4936f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74504,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/d9/2ad9ace36dc3d9aeff7553869283cdf6/pa/WP58537_382ce2a1e0b49f4faeead4268f587138.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8dc0f4c4-b632-5ad2-b262-8bbac2c4936f/8dc0f4c4-b632-5ad2-b262-8bbac2c4936f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61497,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/d9/2ad9ace36dc3d9aeff7553869283cdf6/pa/WP58537_b6149527fbea855f14c91954c9854478.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8dc0f4c4-b632-5ad2-b262-8bbac2c4936f/8dc0f4c4-b632-5ad2-b262-8bbac2c4936f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86565,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/d9/2ad9ace36dc3d9aeff7553869283cdf6/pa/WP58537_7d7e7c0e06f09ac35636243805350647.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8dc0f4c4-b632-5ad2-b262-8bbac2c4936f/8dc0f4c4-b632-5ad2-b262-8bbac2c4936f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85515,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/d9/2ad9ace36dc3d9aeff7553869283cdf6/pa/WP58537_84deb44c66aa417a3d5ae145f7d0f33c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8dc0f4c4-b632-5ad2-b262-8bbac2c4936f/8dc0f4c4-b632-5ad2-b262-8bbac2c4936f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92019,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/d9/2ad9ace36dc3d9aeff7553869283cdf6/pa/WP58537_be8350474eb27734938e12c778215395.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-12-17',
 'seats_number': 3,
 'seller_name': None,
 'title': 'Renault Master 2.3 dCi Energy L1H2 HKa 3,5t',
 'transmission': 'manual',
 'trim': 'L1H2 HKa 3,5t',
 'year': 2018}
2026-03-28 19:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WP58537%27 HTTP/1.1" 200 None
2026-03-28 19:01:15 [auto1.nl] INFO: Saving data for WP58537: {'created_time': 1774724475.149691, 'last_price_update_time': 1774724475.149702, 'auction_closing_time': 1774883036.0}
2026-03-28 19:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='WP58537') HTTP/1.1" 204 0
2026-03-28 19:01:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LE06198/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 19:01:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LL30088/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 19:01:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:01:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:01:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TY41517> (referer: https://www.auto1.com/v1/car-details-view/TY41517/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 19:01:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:01:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 78222d7a-5039-5f46-b20e-8b0f641f13ac with identifier: TY41517
2026-03-28 19:01:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 78222d7a-5039-5f46-b20e-8b0f641f13ac with scrape type 1
2026-03-28 19:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 78222d7a-5039-5f46-b20e-8b0f641f13ac
2026-03-28 19:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F3a%252F753ae6a9538d06c1c9633e98a1d92156%252Fpa%252FTY41517_65e18272662f20df32fdd04f9c82e058.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/3a/753ae6a9538d06c1c9633e98a1d92156/pa/TY41517_65e18272662f20df32fdd04f9c82e058.jpg not downloaded yet
2026-03-28 19:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F3a%252F753ae6a9538d06c1c9633e98a1d92156%252Fpa%252FTY41517_0e3f44ee69cc2568a9411fdc61357341.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/3a/753ae6a9538d06c1c9633e98a1d92156/pa/TY41517_0e3f44ee69cc2568a9411fdc61357341.jpg not downloaded yet
2026-03-28 19:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F3a%252F753ae6a9538d06c1c9633e98a1d92156%252Fpa%252FTY41517_cf8db9b059e340a85343fed167b9841d.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/3a/753ae6a9538d06c1c9633e98a1d92156/pa/TY41517_cf8db9b059e340a85343fed167b9841d.jpg not downloaded yet
2026-03-28 19:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F3a%252F753ae6a9538d06c1c9633e98a1d92156%252Fpa%252FTY41517_900e41ee8d1166a559ebec6c169a756e.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/3a/753ae6a9538d06c1c9633e98a1d92156/pa/TY41517_900e41ee8d1166a559ebec6c169a756e.jpg not downloaded yet
2026-03-28 19:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F3a%252F753ae6a9538d06c1c9633e98a1d92156%252Fpa%252FTY41517_458585b52719bd82749190b336d4fa07.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/3a/753ae6a9538d06c1c9633e98a1d92156/pa/TY41517_458585b52719bd82749190b336d4fa07.jpg not downloaded yet
2026-03-28 19:01:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EW29368/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 19:01:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:01:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AD33035/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 19:01:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:01:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img75/3a/753ae6a9538d06c1c9633e98a1d92156/pa/TY41517_900e41ee8d1166a559ebec6c169a756e.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:01:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img75/3a/753ae6a9538d06c1c9633e98a1d92156/pa/TY41517_458585b52719bd82749190b336d4fa07.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:01:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NJ31093/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 19:01:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:01:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XK63885> (referer: https://www.auto1.com/v1/car-details-view/XK63885/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 19:01:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:01:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img75/3a/753ae6a9538d06c1c9633e98a1d92156/pa/TY41517_cf8db9b059e340a85343fed167b9841d.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:01:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HN54837> (referer: https://www.auto1.com/v1/car-details-view/HN54837/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 19:01:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:01:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img75/3a/753ae6a9538d06c1c9633e98a1d92156/pa/TY41517_0e3f44ee69cc2568a9411fdc61357341.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:01:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img75/3a/753ae6a9538d06c1c9633e98a1d92156/pa/TY41517_65e18272662f20df32fdd04f9c82e058.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:01:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:01:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bd71ec7d0>
2026-03-28 19:01:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:01:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:01:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:01:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_78222d7a-5039-5f46-b20e-8b0f641f13ac/78222d7a-5039-5f46-b20e-8b0f641f13ac_image_3.jpg HTTP/1.1" 201 0
2026-03-28 19:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F3a%252F753ae6a9538d06c1c9633e98a1d92156%252Fpa%252FTY41517_900e41ee8d1166a559ebec6c169a756e.jpg') HTTP/1.1" 204 0
2026-03-28 19:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/3a/753ae6a9538d06c1c9633e98a1d92156/pa/TY41517_900e41ee8d1166a559ebec6c169a756e.jpg saved to cache
2026-03-28 19:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 78222d7a-5039-5f46-b20e-8b0f641f13ac
2026-03-28 19:01:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:01:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bd72030d0>
2026-03-28 19:01:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:01:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:01:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:01:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_78222d7a-5039-5f46-b20e-8b0f641f13ac/78222d7a-5039-5f46-b20e-8b0f641f13ac_image_4.jpg HTTP/1.1" 201 0
2026-03-28 19:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F3a%252F753ae6a9538d06c1c9633e98a1d92156%252Fpa%252FTY41517_458585b52719bd82749190b336d4fa07.jpg') HTTP/1.1" 204 0
2026-03-28 19:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/3a/753ae6a9538d06c1c9633e98a1d92156/pa/TY41517_458585b52719bd82749190b336d4fa07.jpg saved to cache
2026-03-28 19:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 78222d7a-5039-5f46-b20e-8b0f641f13ac
2026-03-28 19:01:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fa4fe243-a109-598c-934e-d9090d7d464c with identifier: XK63885
2026-03-28 19:01:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fa4fe243-a109-598c-934e-d9090d7d464c with scrape type 1
2026-03-28 19:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item fa4fe243-a109-598c-934e-d9090d7d464c
2026-03-28 19:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Fd8%252F99d8daf0854f81383878cbaa25a6afa1%252Fpa%252FXK63885_bc8c7067c6b5fed3ee632a1ded82bed6.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/d8/99d8daf0854f81383878cbaa25a6afa1/pa/XK63885_bc8c7067c6b5fed3ee632a1ded82bed6.jpg not downloaded yet
2026-03-28 19:01:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:01:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bd6390410>
2026-03-28 19:01:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:01:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:01:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:01:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_78222d7a-5039-5f46-b20e-8b0f641f13ac/78222d7a-5039-5f46-b20e-8b0f641f13ac_image_2.jpg HTTP/1.1" 201 0
2026-03-28 19:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F3a%252F753ae6a9538d06c1c9633e98a1d92156%252Fpa%252FTY41517_cf8db9b059e340a85343fed167b9841d.jpg') HTTP/1.1" 204 0
2026-03-28 19:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/3a/753ae6a9538d06c1c9633e98a1d92156/pa/TY41517_cf8db9b059e340a85343fed167b9841d.jpg saved to cache
2026-03-28 19:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 78222d7a-5039-5f46-b20e-8b0f641f13ac
2026-03-28 19:01:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4ecbafa2-810c-556f-93a0-421d7c30c287 with identifier: HN54837
2026-03-28 19:01:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4ecbafa2-810c-556f-93a0-421d7c30c287 with scrape type 1
2026-03-28 19:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4ecbafa2-810c-556f-93a0-421d7c30c287
2026-03-28 19:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252Ffb%252Ffcfb8c4123ba62d64e2d9df8efc96972%252Fpa%252FHN54837_aa0c8cb7b1905bc9134dc3ac4dc0955c.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/fb/fcfb8c4123ba62d64e2d9df8efc96972/pa/HN54837_aa0c8cb7b1905bc9134dc3ac4dc0955c.jpg not downloaded yet
2026-03-28 19:01:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:01:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bd6396e10>
2026-03-28 19:01:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:01:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:01:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:01:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_78222d7a-5039-5f46-b20e-8b0f641f13ac/78222d7a-5039-5f46-b20e-8b0f641f13ac_image_1.jpg HTTP/1.1" 201 0
2026-03-28 19:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F3a%252F753ae6a9538d06c1c9633e98a1d92156%252Fpa%252FTY41517_0e3f44ee69cc2568a9411fdc61357341.jpg') HTTP/1.1" 204 0
2026-03-28 19:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/3a/753ae6a9538d06c1c9633e98a1d92156/pa/TY41517_0e3f44ee69cc2568a9411fdc61357341.jpg saved to cache
2026-03-28 19:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 78222d7a-5039-5f46-b20e-8b0f641f13ac
2026-03-28 19:01:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:01:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bd6817dd0>
2026-03-28 19:01:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:01:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:01:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:01:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_78222d7a-5039-5f46-b20e-8b0f641f13ac/78222d7a-5039-5f46-b20e-8b0f641f13ac_image_0.jpg HTTP/1.1" 201 0
2026-03-28 19:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F3a%252F753ae6a9538d06c1c9633e98a1d92156%252Fpa%252FTY41517_65e18272662f20df32fdd04f9c82e058.jpg') HTTP/1.1" 204 0
2026-03-28 19:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/3a/753ae6a9538d06c1c9633e98a1d92156/pa/TY41517_65e18272662f20df32fdd04f9c82e058.jpg saved to cache
2026-03-28 19:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 78222d7a-5039-5f46-b20e-8b0f641f13ac
2026-03-28 19:01:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 78222d7a-5039-5f46-b20e-8b0f641f13ac, skipping ID generation
2026-03-28 19:01:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 78222d7a-5039-5f46-b20e-8b0f641f13ac with scrape type 1
2026-03-28 19:01:16 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 78222d7a-5039-5f46-b20e-8b0f641f13ac sending to next pipeline
2026-03-28 19:01:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 78222d7a-5039-5f46-b20e-8b0f641f13ac, identifier: TY41517
2026-03-28 19:01:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 78222d7a-5039-5f46-b20e-8b0f641f13ac with identifier: TY41517
2026-03-28 19:01:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 78222d7a-5039-5f46-b20e-8b0f641f13ac with identifier: TY41517
2026-03-28 19:01:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 78222d7a-5039-5f46-b20e-8b0f641f13ac with identifier: TY41517 to the API
2026-03-28 19:01:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 19:01:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 19:01:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img75/3a/753ae6a9538d06c1c9633e98a1d92156/pa/TY41517_65e18272662f20df32fdd04f9c82e058.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 149,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.4L',
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:53:49Z',
 'fuel_type': 'petrol',
 'id': '78222d7a-5039-5f46-b20e-8b0f641f13ac',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '46-KDX-3',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TY41517',
 'listing': 'auction',
 'location': 'NL, Roosendaal',
 'make': 'Volkswagen',
 'model': 'Golf V',
 'odometer': 260582,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78222d7a-5039-5f46-b20e-8b0f641f13ac/78222d7a-5039-5f46-b20e-8b0f641f13ac_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 122504,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img75/3a/753ae6a9538d06c1c9633e98a1d92156/pa/TY41517_65e18272662f20df32fdd04f9c82e058.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78222d7a-5039-5f46-b20e-8b0f641f13ac/78222d7a-5039-5f46-b20e-8b0f641f13ac_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 113711,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img75/3a/753ae6a9538d06c1c9633e98a1d92156/pa/TY41517_0e3f44ee69cc2568a9411fdc61357341.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78222d7a-5039-5f46-b20e-8b0f641f13ac/78222d7a-5039-5f46-b20e-8b0f641f13ac_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91574,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img75/3a/753ae6a9538d06c1c9633e98a1d92156/pa/TY41517_cf8db9b059e340a85343fed167b9841d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78222d7a-5039-5f46-b20e-8b0f641f13ac/78222d7a-5039-5f46-b20e-8b0f641f13ac_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68555,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img75/3a/753ae6a9538d06c1c9633e98a1d92156/pa/TY41517_900e41ee8d1166a559ebec6c169a756e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78222d7a-5039-5f46-b20e-8b0f641f13ac/78222d7a-5039-5f46-b20e-8b0f641f13ac_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 107047,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img75/3a/753ae6a9538d06c1c9633e98a1d92156/pa/TY41517_458585b52719bd82749190b336d4fa07.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2009-10-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf V 1.4 TSI Trendline',
 'transmission': 'manual',
 'trim': 'Trendline',
 'year': 2009}
2026-03-28 19:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TY41517%27 HTTP/1.1" 200 None
2026-03-28 19:01:17 [auto1.nl] INFO: Saving data for TY41517: {'created_time': 1774724477.144047, 'last_price_update_time': 1774724477.144058, 'auction_closing_time': 1774886029.0}
2026-03-28 19:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='TY41517') HTTP/1.1" 204 0
2026-03-28 19:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Fd8%252F99d8daf0854f81383878cbaa25a6afa1%252Fpa%252FXK63885_1ba14f88652ff96280cc2b08066339fe.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/d8/99d8daf0854f81383878cbaa25a6afa1/pa/XK63885_1ba14f88652ff96280cc2b08066339fe.jpg not downloaded yet
2026-03-28 19:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252Ffb%252Ffcfb8c4123ba62d64e2d9df8efc96972%252Fpa%252FHN54837_d89cf3b8e0c7f7d6d43399d9660024a7.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/fb/fcfb8c4123ba62d64e2d9df8efc96972/pa/HN54837_d89cf3b8e0c7f7d6d43399d9660024a7.jpg not downloaded yet
2026-03-28 19:01:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EC40520> (referer: https://www.auto1.com/v1/car-details-view/EC40520/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 19:01:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZK31432/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 19:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Fd8%252F99d8daf0854f81383878cbaa25a6afa1%252Fpa%252FXK63885_82d62c78c3d926b464c2c76b1fe94ff8.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/d8/99d8daf0854f81383878cbaa25a6afa1/pa/XK63885_82d62c78c3d926b464c2c76b1fe94ff8.jpg not downloaded yet
2026-03-28 19:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252Ffb%252Ffcfb8c4123ba62d64e2d9df8efc96972%252Fpa%252FHN54837_38bbb0197a2896ecb667dd0441d0e4c3.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/fb/fcfb8c4123ba62d64e2d9df8efc96972/pa/HN54837_38bbb0197a2896ecb667dd0441d0e4c3.jpg not downloaded yet
2026-03-28 19:01:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:01:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:01:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GN14496/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 19:01:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:01:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BJ61509> (referer: https://www.auto1.com/v1/car-details-view/BJ61509/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 19:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Fd8%252F99d8daf0854f81383878cbaa25a6afa1%252Fpa%252FXK63885_ee2f7c88699093c809860cb3067a10be.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/d8/99d8daf0854f81383878cbaa25a6afa1/pa/XK63885_ee2f7c88699093c809860cb3067a10be.jpg not downloaded yet
2026-03-28 19:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252Ffb%252Ffcfb8c4123ba62d64e2d9df8efc96972%252Fpa%252FHN54837_ea784cec9db2bf3333c2b5e58b90afa4.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/fb/fcfb8c4123ba62d64e2d9df8efc96972/pa/HN54837_ea784cec9db2bf3333c2b5e58b90afa4.jpg not downloaded yet
2026-03-28 19:01:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Fd8%252F99d8daf0854f81383878cbaa25a6afa1%252Fpa%252FXK63885_3ddba5f0625e68661817a3020071921a.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/d8/99d8daf0854f81383878cbaa25a6afa1/pa/XK63885_3ddba5f0625e68661817a3020071921a.jpg not downloaded yet
2026-03-28 19:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252Ffb%252Ffcfb8c4123ba62d64e2d9df8efc96972%252Fpa%252FHN54837_3287844d9874349e6f0c69a36937e9fc.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/fb/fcfb8c4123ba62d64e2d9df8efc96972/pa/HN54837_3287844d9874349e6f0c69a36937e9fc.jpg not downloaded yet
2026-03-28 19:01:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img99/d8/99d8daf0854f81383878cbaa25a6afa1/pa/XK63885_1ba14f88652ff96280cc2b08066339fe.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Fd8%252F99d8daf0854f81383878cbaa25a6afa1%252Fpa%252FXK63885_b72717698ccc1141a813ab40a3bd219f.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/d8/99d8daf0854f81383878cbaa25a6afa1/pa/XK63885_b72717698ccc1141a813ab40a3bd219f.jpg not downloaded yet
2026-03-28 19:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252Ffb%252Ffcfb8c4123ba62d64e2d9df8efc96972%252Fpa%252FHN54837_dfc183e781a9fc2c9a31d2ff7b585562.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/fb/fcfb8c4123ba62d64e2d9df8efc96972/pa/HN54837_dfc183e781a9fc2c9a31d2ff7b585562.jpg not downloaded yet
2026-03-28 19:01:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2afffbfb-f694-58b9-8f01-92e4581e3ccd with identifier: EC40520
2026-03-28 19:01:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2afffbfb-f694-58b9-8f01-92e4581e3ccd with scrape type 1
2026-03-28 19:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 2afffbfb-f694-58b9-8f01-92e4581e3ccd
2026-03-28 19:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252Fb3%252F27b342d7f90f0dc836d9d26ab964c191%252Fpa%252FEC40520_60c86f109c8d1d9323960e8b4a569952.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/b3/27b342d7f90f0dc836d9d26ab964c191/pa/EC40520_60c86f109c8d1d9323960e8b4a569952.jpg not downloaded yet
2026-03-28 19:01:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/fb/fcfb8c4123ba62d64e2d9df8efc96972/pa/HN54837_aa0c8cb7b1905bc9134dc3ac4dc0955c.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Fd8%252F99d8daf0854f81383878cbaa25a6afa1%252Fpa%252FXK63885_a0507c804131babdad8d43cf4148e310.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/d8/99d8daf0854f81383878cbaa25a6afa1/pa/XK63885_a0507c804131babdad8d43cf4148e310.jpg not downloaded yet
2026-03-28 19:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252Ffb%252Ffcfb8c4123ba62d64e2d9df8efc96972%252Fpa%252FHN54837_85865f1c374bc4f9348860420f5c01e2.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/fb/fcfb8c4123ba62d64e2d9df8efc96972/pa/HN54837_85865f1c374bc4f9348860420f5c01e2.jpg not downloaded yet
2026-03-28 19:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252Fb3%252F27b342d7f90f0dc836d9d26ab964c191%252Fpa%252FEC40520_342f51907c2b1ef4082512b1f03af7e0.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/b3/27b342d7f90f0dc836d9d26ab964c191/pa/EC40520_342f51907c2b1ef4082512b1f03af7e0.jpg not downloaded yet
2026-03-28 19:01:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2b4a82bc-7f32-57c0-b814-d577ab4e12c2 with identifier: BJ61509
2026-03-28 19:01:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2b4a82bc-7f32-57c0-b814-d577ab4e12c2 with scrape type 1
2026-03-28 19:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 4 photos for item 2b4a82bc-7f32-57c0-b814-d577ab4e12c2
2026-03-28 19:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252F78%252Fa17853b2dbdb00632b819a3b615958b5%252Fpa%252FBJ61509_7845ca86d1be34ef57192e4a8c3dfa3e.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/78/a17853b2dbdb00632b819a3b615958b5/pa/BJ61509_7845ca86d1be34ef57192e4a8c3dfa3e.jpg not downloaded yet
2026-03-28 19:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Fd8%252F99d8daf0854f81383878cbaa25a6afa1%252Fpa%252FXK63885_c93cb29f7204d25e98f255c4970eb422.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/d8/99d8daf0854f81383878cbaa25a6afa1/pa/XK63885_c93cb29f7204d25e98f255c4970eb422.jpg not downloaded yet
2026-03-28 19:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252Ffb%252Ffcfb8c4123ba62d64e2d9df8efc96972%252Fpa%252FHN54837_ea3267ac313ee7a90d75966e482c7249.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/fb/fcfb8c4123ba62d64e2d9df8efc96972/pa/HN54837_ea3267ac313ee7a90d75966e482c7249.jpg not downloaded yet
2026-03-28 19:01:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/fb/fcfb8c4123ba62d64e2d9df8efc96972/pa/HN54837_d89cf3b8e0c7f7d6d43399d9660024a7.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252Fb3%252F27b342d7f90f0dc836d9d26ab964c191%252Fpa%252FEC40520_d84055970efb3afa10b328d4b333e974.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/b3/27b342d7f90f0dc836d9d26ab964c191/pa/EC40520_d84055970efb3afa10b328d4b333e974.jpg not downloaded yet
2026-03-28 19:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252F78%252Fa17853b2dbdb00632b819a3b615958b5%252Fpa%252FBJ61509_aeaa4ef6c62ad23f233ca97fa32d5e1a.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/78/a17853b2dbdb00632b819a3b615958b5/pa/BJ61509_aeaa4ef6c62ad23f233ca97fa32d5e1a.jpg not downloaded yet
2026-03-28 19:01:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:01:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bd6804e90>
2026-03-28 19:01:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:01:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:01:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:01:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa4fe243-a109-598c-934e-d9090d7d464c/fa4fe243-a109-598c-934e-d9090d7d464c_image_1.jpg HTTP/1.1" 201 0
2026-03-28 19:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Fd8%252F99d8daf0854f81383878cbaa25a6afa1%252Fpa%252FXK63885_1ba14f88652ff96280cc2b08066339fe.jpg') HTTP/1.1" 204 0
2026-03-28 19:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/d8/99d8daf0854f81383878cbaa25a6afa1/pa/XK63885_1ba14f88652ff96280cc2b08066339fe.jpg saved to cache
2026-03-28 19:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item fa4fe243-a109-598c-934e-d9090d7d464c
2026-03-28 19:01:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:01:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bd71d8250>
2026-03-28 19:01:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:01:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:01:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:01:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ecbafa2-810c-556f-93a0-421d7c30c287/4ecbafa2-810c-556f-93a0-421d7c30c287_image_0.jpg HTTP/1.1" 201 0
2026-03-28 19:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252Ffb%252Ffcfb8c4123ba62d64e2d9df8efc96972%252Fpa%252FHN54837_aa0c8cb7b1905bc9134dc3ac4dc0955c.jpg') HTTP/1.1" 204 0
2026-03-28 19:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/fb/fcfb8c4123ba62d64e2d9df8efc96972/pa/HN54837_aa0c8cb7b1905bc9134dc3ac4dc0955c.jpg saved to cache
2026-03-28 19:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4ecbafa2-810c-556f-93a0-421d7c30c287
2026-03-28 19:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Fd8%252F99d8daf0854f81383878cbaa25a6afa1%252Fpa%252FXK63885_8571fadb4798735e63b0b0da256db3b8.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/d8/99d8daf0854f81383878cbaa25a6afa1/pa/XK63885_8571fadb4798735e63b0b0da256db3b8.jpg not downloaded yet
2026-03-28 19:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252Ffb%252Ffcfb8c4123ba62d64e2d9df8efc96972%252Fpa%252FHN54837_506e26ff2f96ce39cac6ac2867f7df69.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/fb/fcfb8c4123ba62d64e2d9df8efc96972/pa/HN54837_506e26ff2f96ce39cac6ac2867f7df69.jpg not downloaded yet
2026-03-28 19:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252Fb3%252F27b342d7f90f0dc836d9d26ab964c191%252Fpa%252FEC40520_97f15b9b42cf5a30c3fdef5174b6445a.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/b3/27b342d7f90f0dc836d9d26ab964c191/pa/EC40520_97f15b9b42cf5a30c3fdef5174b6445a.jpg not downloaded yet
2026-03-28 19:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252F78%252Fa17853b2dbdb00632b819a3b615958b5%252Fpa%252FBJ61509_a0f0c7fe5af9d040082fd5eba29b31d0.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/78/a17853b2dbdb00632b819a3b615958b5/pa/BJ61509_a0f0c7fe5af9d040082fd5eba29b31d0.jpg not downloaded yet
2026-03-28 19:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Fd8%252F99d8daf0854f81383878cbaa25a6afa1%252Fpa%252FXK63885_509643b2aae3e5426bf5688df9aa7342.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/d8/99d8daf0854f81383878cbaa25a6afa1/pa/XK63885_509643b2aae3e5426bf5688df9aa7342.jpg not downloaded yet
2026-03-28 19:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252Ffb%252Ffcfb8c4123ba62d64e2d9df8efc96972%252Fpa%252FHN54837_abe8a0757bb556dbf7b4473921b2e2d2.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/fb/fcfb8c4123ba62d64e2d9df8efc96972/pa/HN54837_abe8a0757bb556dbf7b4473921b2e2d2.jpg not downloaded yet
2026-03-28 19:01:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:01:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bd686e6d0>
2026-03-28 19:01:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:01:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:01:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:01:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ecbafa2-810c-556f-93a0-421d7c30c287/4ecbafa2-810c-556f-93a0-421d7c30c287_image_1.jpg HTTP/1.1" 201 0
2026-03-28 19:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252Ffb%252Ffcfb8c4123ba62d64e2d9df8efc96972%252Fpa%252FHN54837_d89cf3b8e0c7f7d6d43399d9660024a7.jpg') HTTP/1.1" 204 0
2026-03-28 19:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/fb/fcfb8c4123ba62d64e2d9df8efc96972/pa/HN54837_d89cf3b8e0c7f7d6d43399d9660024a7.jpg saved to cache
2026-03-28 19:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4ecbafa2-810c-556f-93a0-421d7c30c287
2026-03-28 19:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252Fb3%252F27b342d7f90f0dc836d9d26ab964c191%252Fpa%252FEC40520_64dfb08ae047bfe63dce797e9824654d.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/b3/27b342d7f90f0dc836d9d26ab964c191/pa/EC40520_64dfb08ae047bfe63dce797e9824654d.jpg not downloaded yet
2026-03-28 19:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252F78%252Fa17853b2dbdb00632b819a3b615958b5%252Fpa%252FBJ61509_b44a90168938213791c8a4eec6be532e.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/78/a17853b2dbdb00632b819a3b615958b5/pa/BJ61509_b44a90168938213791c8a4eec6be532e.jpg not downloaded yet
2026-03-28 19:01:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga1/78/a17853b2dbdb00632b819a3b615958b5/pa/BJ61509_7845ca86d1be34ef57192e4a8c3dfa3e.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:01:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VZ88435> (referer: https://www.auto1.com/v1/car-details-view/VZ88435/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 19:01:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:01:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SN61945> (referer: https://www.auto1.com/v1/car-details-view/SN61945/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 19:01:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:01:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/fb/fcfb8c4123ba62d64e2d9df8efc96972/pa/HN54837_38bbb0197a2896ecb667dd0441d0e4c3.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:01:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/fb/fcfb8c4123ba62d64e2d9df8efc96972/pa/HN54837_3287844d9874349e6f0c69a36937e9fc.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:01:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/fb/fcfb8c4123ba62d64e2d9df8efc96972/pa/HN54837_dfc183e781a9fc2c9a31d2ff7b585562.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:01:17 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 19:01:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:01:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RH72913> (referer: https://www.auto1.com/v1/car-details-view/RH72913/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 19:01:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:01:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga1/78/a17853b2dbdb00632b819a3b615958b5/pa/BJ61509_b44a90168938213791c8a4eec6be532e.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:01:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img99/d8/99d8daf0854f81383878cbaa25a6afa1/pa/XK63885_509643b2aae3e5426bf5688df9aa7342.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:01:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:01:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bd6867710>
2026-03-28 19:01:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:01:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:01:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:01:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2b4a82bc-7f32-57c0-b814-d577ab4e12c2/2b4a82bc-7f32-57c0-b814-d577ab4e12c2_image_0.jpg HTTP/1.1" 201 0
2026-03-28 19:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252F78%252Fa17853b2dbdb00632b819a3b615958b5%252Fpa%252FBJ61509_7845ca86d1be34ef57192e4a8c3dfa3e.jpg') HTTP/1.1" 204 0
2026-03-28 19:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/78/a17853b2dbdb00632b819a3b615958b5/pa/BJ61509_7845ca86d1be34ef57192e4a8c3dfa3e.jpg saved to cache
2026-03-28 19:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2b4a82bc-7f32-57c0-b814-d577ab4e12c2
2026-03-28 19:01:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f61b0cf8-f116-5867-9034-165288e35185 with identifier: VZ88435
2026-03-28 19:01:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f61b0cf8-f116-5867-9034-165288e35185 with scrape type 1
2026-03-28 19:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item f61b0cf8-f116-5867-9034-165288e35185
2026-03-28 19:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252Fe9%252F40e903696a2dbb1ddbe93abd395259bf%252Fpa%252FVZ88435_caf684ef270167640f6362db02288758.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/e9/40e903696a2dbb1ddbe93abd395259bf/pa/VZ88435_caf684ef270167640f6362db02288758.jpg not downloaded yet
2026-03-28 19:01:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/fb/fcfb8c4123ba62d64e2d9df8efc96972/pa/HN54837_abe8a0757bb556dbf7b4473921b2e2d2.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252Fe9%252F40e903696a2dbb1ddbe93abd395259bf%252Fpa%252FVZ88435_261637f28679add11df0ba1d07fd29a8.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/e9/40e903696a2dbb1ddbe93abd395259bf/pa/VZ88435_261637f28679add11df0ba1d07fd29a8.jpg not downloaded yet
2026-03-28 19:01:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img27/b3/27b342d7f90f0dc836d9d26ab964c191/pa/EC40520_64dfb08ae047bfe63dce797e9824654d.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:01:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e7e52919-9fef-5265-9a67-09711ed53cd2 with identifier: SN61945
2026-03-28 19:01:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e7e52919-9fef-5265-9a67-09711ed53cd2 with scrape type 1
2026-03-28 19:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e7e52919-9fef-5265-9a67-09711ed53cd2
2026-03-28 19:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Ff7%252F3cf759b784f0f8e17dcab15a2e8e9e5c%252Fpa%252FSN61945_49973c4ddb3d2d8999f8f87e16d69284.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/f7/3cf759b784f0f8e17dcab15a2e8e9e5c/pa/SN61945_49973c4ddb3d2d8999f8f87e16d69284.jpg not downloaded yet
2026-03-28 19:01:18 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 19:01:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:01:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bd63e1fd0>
2026-03-28 19:01:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:01:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:01:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:01:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ecbafa2-810c-556f-93a0-421d7c30c287/4ecbafa2-810c-556f-93a0-421d7c30c287_image_2.jpg HTTP/1.1" 201 0
2026-03-28 19:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252Ffb%252Ffcfb8c4123ba62d64e2d9df8efc96972%252Fpa%252FHN54837_38bbb0197a2896ecb667dd0441d0e4c3.jpg') HTTP/1.1" 204 0
2026-03-28 19:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/fb/fcfb8c4123ba62d64e2d9df8efc96972/pa/HN54837_38bbb0197a2896ecb667dd0441d0e4c3.jpg saved to cache
2026-03-28 19:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4ecbafa2-810c-556f-93a0-421d7c30c287
2026-03-28 19:01:18 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 19:01:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:01:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bd6855b10>
2026-03-28 19:01:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:01:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:01:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:01:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ecbafa2-810c-556f-93a0-421d7c30c287/4ecbafa2-810c-556f-93a0-421d7c30c287_image_4.jpg HTTP/1.1" 201 0
2026-03-28 19:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252Ffb%252Ffcfb8c4123ba62d64e2d9df8efc96972%252Fpa%252FHN54837_3287844d9874349e6f0c69a36937e9fc.jpg') HTTP/1.1" 204 0
2026-03-28 19:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/fb/fcfb8c4123ba62d64e2d9df8efc96972/pa/HN54837_3287844d9874349e6f0c69a36937e9fc.jpg saved to cache
2026-03-28 19:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4ecbafa2-810c-556f-93a0-421d7c30c287
2026-03-28 19:01:18 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 19:01:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:01:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bd68a79d0>
2026-03-28 19:01:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:01:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:01:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:01:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ecbafa2-810c-556f-93a0-421d7c30c287/4ecbafa2-810c-556f-93a0-421d7c30c287_image_5.jpg HTTP/1.1" 201 0
2026-03-28 19:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252Ffb%252Ffcfb8c4123ba62d64e2d9df8efc96972%252Fpa%252FHN54837_dfc183e781a9fc2c9a31d2ff7b585562.jpg') HTTP/1.1" 204 0
2026-03-28 19:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/fb/fcfb8c4123ba62d64e2d9df8efc96972/pa/HN54837_dfc183e781a9fc2c9a31d2ff7b585562.jpg saved to cache
2026-03-28 19:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4ecbafa2-810c-556f-93a0-421d7c30c287
2026-03-28 19:01:18 [auto1.nl] INFO: Channel: 24h | Page: 15 | totalHits: 646 | hits on page: 40
2026-03-28 19:01:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9ea900f9-9624-56bd-8cce-b2b86fa08718 with identifier: RH72913
2026-03-28 19:01:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9ea900f9-9624-56bd-8cce-b2b86fa08718 with scrape type 1
2026-03-28 19:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 9ea900f9-9624-56bd-8cce-b2b86fa08718
2026-03-28 19:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F59%252F2d59eabc368b14dd87798ca5da2af53a%252Fpa%252FRH72913_6c8d7189c3428343c13397972eaa6684.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/59/2d59eabc368b14dd87798ca5da2af53a/pa/RH72913_6c8d7189c3428343c13397972eaa6684.jpg already downloaded
2026-03-28 19:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F59%252F2d59eabc368b14dd87798ca5da2af53a%252Fpa%252FRH72913_cdcae74f8bc38244ae71f314119c87b4.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/59/2d59eabc368b14dd87798ca5da2af53a/pa/RH72913_cdcae74f8bc38244ae71f314119c87b4.jpg already downloaded
2026-03-28 19:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F59%252F2d59eabc368b14dd87798ca5da2af53a%252Fpa%252FRH72913_40792782cf59197b7fe2fbee668978ff.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/59/2d59eabc368b14dd87798ca5da2af53a/pa/RH72913_40792782cf59197b7fe2fbee668978ff.jpg already downloaded
2026-03-28 19:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F59%252F2d59eabc368b14dd87798ca5da2af53a%252Fpa%252FRH72913_5373b5cd8f0b992e392bc0e2ad659421.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/59/2d59eabc368b14dd87798ca5da2af53a/pa/RH72913_5373b5cd8f0b992e392bc0e2ad659421.jpg already downloaded
2026-03-28 19:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F59%252F2d59eabc368b14dd87798ca5da2af53a%252Fpa%252FRH72913_e9c39baeab24d94054c87247b6b7879d.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/59/2d59eabc368b14dd87798ca5da2af53a/pa/RH72913_e9c39baeab24d94054c87247b6b7879d.jpg already downloaded
2026-03-28 19:01:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 9ea900f9-9624-56bd-8cce-b2b86fa08718, identifier: RH72913
2026-03-28 19:01:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:01:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bd72c3d10>
2026-03-28 19:01:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:01:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:01:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:01:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2b4a82bc-7f32-57c0-b814-d577ab4e12c2/2b4a82bc-7f32-57c0-b814-d577ab4e12c2_image_3.jpg HTTP/1.1" 201 0
2026-03-28 19:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252F78%252Fa17853b2dbdb00632b819a3b615958b5%252Fpa%252FBJ61509_b44a90168938213791c8a4eec6be532e.jpg') HTTP/1.1" 204 0
2026-03-28 19:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/78/a17853b2dbdb00632b819a3b615958b5/pa/BJ61509_b44a90168938213791c8a4eec6be532e.jpg saved to cache
2026-03-28 19:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2b4a82bc-7f32-57c0-b814-d577ab4e12c2
2026-03-28 19:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252Fe9%252F40e903696a2dbb1ddbe93abd395259bf%252Fpa%252FVZ88435_077669b2fb0fbdb8b21d7cc138fc5bf2.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/e9/40e903696a2dbb1ddbe93abd395259bf/pa/VZ88435_077669b2fb0fbdb8b21d7cc138fc5bf2.jpg not downloaded yet
2026-03-28 19:01:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 9ea900f9-9624-56bd-8cce-b2b86fa08718 with identifier: RH72913
2026-03-28 19:01:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 9ea900f9-9624-56bd-8cce-b2b86fa08718 with identifier: RH72913
2026-03-28 19:01:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 9ea900f9-9624-56bd-8cce-b2b86fa08718 with identifier: RH72913 to the API
2026-03-28 19:01:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 19:01:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 19:01:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/RH72913>
{'auction_title': '',
 'c_o_2_emission_value': 154,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 210,
 'expiration_date': '2026-03-30T15:29:42Z',
 'fuel_type': 'petrol',
 'id': '9ea900f9-9624-56bd-8cce-b2b86fa08718',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '14PRL4',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RH72913',
 'listing': 'auction',
 'location': 'NL, Oosterhout',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 256304,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 5,
 'photo_urls': ['https://img-pa.auto1.com/img2d/59/2d59eabc368b14dd87798ca5da2af53a/pa/RH72913_6c8d7189c3428343c13397972eaa6684.jpg',
                'https://img-pa.auto1.com/img2d/59/2d59eabc368b14dd87798ca5da2af53a/pa/RH72913_cdcae74f8bc38244ae71f314119c87b4.jpg',
                'https://img-pa.auto1.com/img2d/59/2d59eabc368b14dd87798ca5da2af53a/pa/RH72913_40792782cf59197b7fe2fbee668978ff.jpg',
                'https://img-pa.auto1.com/img2d/59/2d59eabc368b14dd87798ca5da2af53a/pa/RH72913_5373b5cd8f0b992e392bc0e2ad659421.jpg',
                'https://img-pa.auto1.com/img2d/59/2d59eabc368b14dd87798ca5da2af53a/pa/RH72913_e9c39baeab24d94054c87247b6b7879d.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9ea900f9-9624-56bd-8cce-b2b86fa08718/9ea900f9-9624-56bd-8cce-b2b86fa08718_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103155,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/59/2d59eabc368b14dd87798ca5da2af53a/pa/RH72913_6c8d7189c3428343c13397972eaa6684.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9ea900f9-9624-56bd-8cce-b2b86fa08718/9ea900f9-9624-56bd-8cce-b2b86fa08718_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94752,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/59/2d59eabc368b14dd87798ca5da2af53a/pa/RH72913_cdcae74f8bc38244ae71f314119c87b4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9ea900f9-9624-56bd-8cce-b2b86fa08718/9ea900f9-9624-56bd-8cce-b2b86fa08718_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79360,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/59/2d59eabc368b14dd87798ca5da2af53a/pa/RH72913_40792782cf59197b7fe2fbee668978ff.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9ea900f9-9624-56bd-8cce-b2b86fa08718/9ea900f9-9624-56bd-8cce-b2b86fa08718_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62111,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/59/2d59eabc368b14dd87798ca5da2af53a/pa/RH72913_5373b5cd8f0b992e392bc0e2ad659421.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9ea900f9-9624-56bd-8cce-b2b86fa08718/9ea900f9-9624-56bd-8cce-b2b86fa08718_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101393,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/59/2d59eabc368b14dd87798ca5da2af53a/pa/RH72913_e9c39baeab24d94054c87247b6b7879d.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-03-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A4 2.0 TFSI Attraction',
 'transmission': 'manual',
 'trim': 'Attraction',
 'year': 2011}
2026-03-28 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RH72913%27 HTTP/1.1" 200 None
2026-03-28 19:01:19 [auto1.nl] INFO: Saving data for RH72913: {'created_time': 1774724479.189296, 'last_price_update_time': 1774724479.189307, 'auction_closing_time': 1774884582.0}
2026-03-28 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='RH72913') HTTP/1.1" 204 0
2026-03-28 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Ff7%252F3cf759b784f0f8e17dcab15a2e8e9e5c%252Fpa%252FSN61945_453da4b33ed69ec7e277b3aa484f2bba.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/f7/3cf759b784f0f8e17dcab15a2e8e9e5c/pa/SN61945_453da4b33ed69ec7e277b3aa484f2bba.jpg not downloaded yet
2026-03-28 19:01:19 [auto1.nl] INFO: Found listing with ID: VY08351
2026-03-28 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VY08351%27 HTTP/1.1" 200 None
2026-03-28 19:01:19 [auto1.nl] INFO: Scrape type for VY08351: 0
2026-03-28 19:01:19 [auto1.nl] INFO: Found listing with ID: XR71865
2026-03-28 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XR71865%27 HTTP/1.1" 200 None
2026-03-28 19:01:19 [auto1.nl] INFO: Scrape type for XR71865: 0
2026-03-28 19:01:19 [auto1.nl] INFO: Found listing with ID: JM32164
2026-03-28 19:01:19 [auto1.nl] INFO: Found listing with ID: HM06318
2026-03-28 19:01:19 [auto1.nl] INFO: Found listing with ID: KH60865
2026-03-28 19:01:19 [auto1.nl] INFO: Found listing with ID: GS42620
2026-03-28 19:01:19 [auto1.nl] INFO: Found listing with ID: YJ91466
2026-03-28 19:01:19 [auto1.nl] INFO: Found listing with ID: YA06880
2026-03-28 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YA06880%27 HTTP/1.1" 200 None
2026-03-28 19:01:19 [auto1.nl] INFO: Scrape type for YA06880: 0
2026-03-28 19:01:19 [auto1.nl] INFO: Found listing with ID: PA65227
2026-03-28 19:01:19 [auto1.nl] INFO: Found listing with ID: SE60245
2026-03-28 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SE60245%27 HTTP/1.1" 200 None
2026-03-28 19:01:19 [auto1.nl] INFO: Scrape type for SE60245: 0
2026-03-28 19:01:19 [auto1.nl] INFO: Found listing with ID: KL38892
2026-03-28 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KL38892%27 HTTP/1.1" 200 None
2026-03-28 19:01:19 [auto1.nl] INFO: Scrape type for KL38892: 0
2026-03-28 19:01:19 [auto1.nl] INFO: Found listing with ID: HG71940
2026-03-28 19:01:19 [auto1.nl] INFO: Found listing with ID: TW61693
2026-03-28 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TW61693%27 HTTP/1.1" 200 None
2026-03-28 19:01:19 [auto1.nl] INFO: Scrape type for TW61693: 0
2026-03-28 19:01:19 [auto1.nl] INFO: Found listing with ID: SE95402
2026-03-28 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SE95402%27 HTTP/1.1" 200 None
2026-03-28 19:01:19 [auto1.nl] INFO: Scrape type for SE95402: 0
2026-03-28 19:01:19 [auto1.nl] INFO: Found listing with ID: MV57262
2026-03-28 19:01:19 [auto1.nl] INFO: Found listing with ID: VS29188
2026-03-28 19:01:19 [auto1.nl] INFO: Found listing with ID: RK78214
2026-03-28 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RK78214%27 HTTP/1.1" 200 None
2026-03-28 19:01:19 [auto1.nl] INFO: Scrape type for RK78214: 0
2026-03-28 19:01:19 [auto1.nl] INFO: Found listing with ID: ZZ45478
2026-03-28 19:01:19 [auto1.nl] INFO: Found listing with ID: EW45242
2026-03-28 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EW45242%27 HTTP/1.1" 200 None
2026-03-28 19:01:19 [auto1.nl] INFO: Scrape type for EW45242: 0
2026-03-28 19:01:19 [auto1.nl] INFO: Found listing with ID: RW57039
2026-03-28 19:01:19 [auto1.nl] INFO: Found listing with ID: UA80107
2026-03-28 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UA80107%27 HTTP/1.1" 200 None
2026-03-28 19:01:19 [auto1.nl] INFO: Scrape type for UA80107: 0
2026-03-28 19:01:19 [auto1.nl] INFO: Found listing with ID: UH76205
2026-03-28 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UH76205%27 HTTP/1.1" 200 None
2026-03-28 19:01:19 [auto1.nl] INFO: Scrape type for UH76205: 0
2026-03-28 19:01:19 [auto1.nl] INFO: Found listing with ID: HM15601
2026-03-28 19:01:19 [auto1.nl] INFO: Found listing with ID: KX92525
2026-03-28 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KX92525%27 HTTP/1.1" 200 None
2026-03-28 19:01:19 [auto1.nl] INFO: Scrape type for KX92525: 0
2026-03-28 19:01:19 [auto1.nl] INFO: Found listing with ID: UU92994
2026-03-28 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UU92994%27 HTTP/1.1" 200 None
2026-03-28 19:01:19 [auto1.nl] INFO: Scrape type for UU92994: 0
2026-03-28 19:01:19 [auto1.nl] INFO: Found listing with ID: WY17438
2026-03-28 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WY17438%27 HTTP/1.1" 200 None
2026-03-28 19:01:19 [auto1.nl] INFO: Scrape type for WY17438: 0
2026-03-28 19:01:19 [auto1.nl] INFO: Found listing with ID: GP36316
2026-03-28 19:01:19 [auto1.nl] INFO: Found listing with ID: ZS54708
2026-03-28 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZS54708%27 HTTP/1.1" 200 None
2026-03-28 19:01:19 [auto1.nl] INFO: Scrape type for ZS54708: 0
2026-03-28 19:01:19 [auto1.nl] INFO: Found listing with ID: UE83954
2026-03-28 19:01:19 [auto1.nl] INFO: Found listing with ID: BB32456
2026-03-28 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BB32456%27 HTTP/1.1" 200 None
2026-03-28 19:01:19 [auto1.nl] INFO: Scrape type for BB32456: 0
2026-03-28 19:01:19 [auto1.nl] INFO: Found listing with ID: XG85677
2026-03-28 19:01:19 [auto1.nl] INFO: Found listing with ID: WW25859
2026-03-28 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WW25859%27 HTTP/1.1" 200 None
2026-03-28 19:01:19 [auto1.nl] INFO: Scrape type for WW25859: 0
2026-03-28 19:01:19 [auto1.nl] INFO: Found listing with ID: SX97177
2026-03-28 19:01:19 [auto1.nl] INFO: Found listing with ID: BP52845
2026-03-28 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BP52845%27 HTTP/1.1" 200 None
2026-03-28 19:01:19 [auto1.nl] INFO: Scrape type for BP52845: 0
2026-03-28 19:01:19 [auto1.nl] INFO: Found listing with ID: DX51815
2026-03-28 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DX51815%27 HTTP/1.1" 200 None
2026-03-28 19:01:19 [auto1.nl] INFO: Scrape type for DX51815: 0
2026-03-28 19:01:19 [auto1.nl] INFO: Found listing with ID: PF57895
2026-03-28 19:01:19 [auto1.nl] INFO: Found listing with ID: HV92208
2026-03-28 19:01:19 [auto1.nl] INFO: Found listing with ID: WY33906
2026-03-28 19:01:19 [auto1.nl] INFO: Found listing with ID: WN49119
2026-03-28 19:01:19 [auto1.nl] INFO: Found listing with ID: NJ12224
2026-03-28 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NJ12224%27 HTTP/1.1" 200 None
2026-03-28 19:01:19 [auto1.nl] INFO: Scrape type for NJ12224: 0
2026-03-28 19:01:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:01:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bd63fb6d0>
2026-03-28 19:01:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:01:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:01:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:01:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa4fe243-a109-598c-934e-d9090d7d464c/fa4fe243-a109-598c-934e-d9090d7d464c_image_9.jpg HTTP/1.1" 201 0
2026-03-28 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Fd8%252F99d8daf0854f81383878cbaa25a6afa1%252Fpa%252FXK63885_509643b2aae3e5426bf5688df9aa7342.jpg') HTTP/1.1" 204 0
2026-03-28 19:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/d8/99d8daf0854f81383878cbaa25a6afa1/pa/XK63885_509643b2aae3e5426bf5688df9aa7342.jpg saved to cache
2026-03-28 19:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item fa4fe243-a109-598c-934e-d9090d7d464c
2026-03-28 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252Fe9%252F40e903696a2dbb1ddbe93abd395259bf%252Fpa%252FVZ88435_1c31c8da8ed28f0910c6b547ae3e2be1.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/e9/40e903696a2dbb1ddbe93abd395259bf/pa/VZ88435_1c31c8da8ed28f0910c6b547ae3e2be1.jpg not downloaded yet
2026-03-28 19:01:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SR45817> (referer: https://www.auto1.com/v1/car-details-view/SR45817/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 19:01:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZN70459> (referer: https://www.auto1.com/v1/car-details-view/ZN70459/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Ff7%252F3cf759b784f0f8e17dcab15a2e8e9e5c%252Fpa%252FSN61945_eeb5b5c2a06987a0ba5d9d06b1428330.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/f7/3cf759b784f0f8e17dcab15a2e8e9e5c/pa/SN61945_eeb5b5c2a06987a0ba5d9d06b1428330.jpg not downloaded yet
2026-03-28 19:01:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:01:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AD33035> (referer: https://www.auto1.com/v1/car-details-view/AD33035/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 19:01:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:01:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bd71c2950>
2026-03-28 19:01:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:01:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:01:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:01:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ecbafa2-810c-556f-93a0-421d7c30c287/4ecbafa2-810c-556f-93a0-421d7c30c287_image_9.jpg HTTP/1.1" 201 0
2026-03-28 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252Ffb%252Ffcfb8c4123ba62d64e2d9df8efc96972%252Fpa%252FHN54837_abe8a0757bb556dbf7b4473921b2e2d2.jpg') HTTP/1.1" 204 0
2026-03-28 19:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/fb/fcfb8c4123ba62d64e2d9df8efc96972/pa/HN54837_abe8a0757bb556dbf7b4473921b2e2d2.jpg saved to cache
2026-03-28 19:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4ecbafa2-810c-556f-93a0-421d7c30c287
2026-03-28 19:01:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:01:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bd68df050>
2026-03-28 19:01:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:01:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:01:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:01:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2afffbfb-f694-58b9-8f01-92e4581e3ccd/2afffbfb-f694-58b9-8f01-92e4581e3ccd_image_4.jpg HTTP/1.1" 201 0
2026-03-28 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252Fb3%252F27b342d7f90f0dc836d9d26ab964c191%252Fpa%252FEC40520_64dfb08ae047bfe63dce797e9824654d.jpg') HTTP/1.1" 204 0
2026-03-28 19:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/b3/27b342d7f90f0dc836d9d26ab964c191/pa/EC40520_64dfb08ae047bfe63dce797e9824654d.jpg saved to cache
2026-03-28 19:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2afffbfb-f694-58b9-8f01-92e4581e3ccd
2026-03-28 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252Fe9%252F40e903696a2dbb1ddbe93abd395259bf%252Fpa%252FVZ88435_303b67bc0ff88802f4ff5f53f84d79a8.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/e9/40e903696a2dbb1ddbe93abd395259bf/pa/VZ88435_303b67bc0ff88802f4ff5f53f84d79a8.jpg not downloaded yet
2026-03-28 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Ff7%252F3cf759b784f0f8e17dcab15a2e8e9e5c%252Fpa%252FSN61945_831a9c53ee705ede1e9225ee13c70c20.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/f7/3cf759b784f0f8e17dcab15a2e8e9e5c/pa/SN61945_831a9c53ee705ede1e9225ee13c70c20.jpg not downloaded yet
2026-03-28 19:01:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 457c3195-896b-557f-a471-daa91da61c90 with identifier: SR45817
2026-03-28 19:01:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 457c3195-896b-557f-a471-daa91da61c90 with scrape type 1
2026-03-28 19:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 457c3195-896b-557f-a471-daa91da61c90
2026-03-28 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252Ffc%252Fe2fc3de8c023f4680ae5980fc45e1086%252Fpa%252FSR45817_4b79f576a917f7cbadd617ca4a8ce99a.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/fc/e2fc3de8c023f4680ae5980fc45e1086/pa/SR45817_4b79f576a917f7cbadd617ca4a8ce99a.jpg not downloaded yet
2026-03-28 19:01:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 47753836-04a1-5002-928e-0723ecea2118 with identifier: ZN70459
2026-03-28 19:01:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 47753836-04a1-5002-928e-0723ecea2118 with scrape type 1
2026-03-28 19:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 47753836-04a1-5002-928e-0723ecea2118
2026-03-28 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252F78%252Fe878909c4317c113ebf05415750ca275%252Fpa%252FZN70459_eb2cd9fde8bca7d729a3ede6fab02423.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/78/e878909c4317c113ebf05415750ca275/pa/ZN70459_eb2cd9fde8bca7d729a3ede6fab02423.jpg not downloaded yet
2026-03-28 19:01:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/e9/40e903696a2dbb1ddbe93abd395259bf/pa/VZ88435_077669b2fb0fbdb8b21d7cc138fc5bf2.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Ff7%252F3cf759b784f0f8e17dcab15a2e8e9e5c%252Fpa%252FSN61945_c9260713991c8efb71b8d802e7d3329f.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/f7/3cf759b784f0f8e17dcab15a2e8e9e5c/pa/SN61945_c9260713991c8efb71b8d802e7d3329f.jpg not downloaded yet
2026-03-28 19:01:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/e9/40e903696a2dbb1ddbe93abd395259bf/pa/VZ88435_caf684ef270167640f6362db02288758.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:01:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/e9/40e903696a2dbb1ddbe93abd395259bf/pa/VZ88435_261637f28679add11df0ba1d07fd29a8.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:01:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga1/78/a17853b2dbdb00632b819a3b615958b5/pa/BJ61509_a0f0c7fe5af9d040082fd5eba29b31d0.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252Ffc%252Fe2fc3de8c023f4680ae5980fc45e1086%252Fpa%252FSR45817_615ff6b9c87ac440dae87f8c1317d5ff.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/fc/e2fc3de8c023f4680ae5980fc45e1086/pa/SR45817_615ff6b9c87ac440dae87f8c1317d5ff.jpg not downloaded yet
2026-03-28 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252F78%252Fe878909c4317c113ebf05415750ca275%252Fpa%252FZN70459_efd3b1e45daff11e235261d0b7919d79.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/78/e878909c4317c113ebf05415750ca275/pa/ZN70459_efd3b1e45daff11e235261d0b7919d79.jpg not downloaded yet
2026-03-28 19:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Ff7%252F3cf759b784f0f8e17dcab15a2e8e9e5c%252Fpa%252FSN61945_03c4350ad8f7648900a060b8ce79738b.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/f7/3cf759b784f0f8e17dcab15a2e8e9e5c/pa/SN61945_03c4350ad8f7648900a060b8ce79738b.jpg not downloaded yet
2026-03-28 19:01:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 40f51b58-64e3-522b-b353-cfb584ce0272 with identifier: AD33035
2026-03-28 19:01:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 40f51b58-64e3-522b-b353-cfb584ce0272 with scrape type 1
2026-03-28 19:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 40f51b58-64e3-522b-b353-cfb584ce0272
2026-03-28 19:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F99%252Fd69919b27e0e123e0739ba5b8dff042d%252Fpa%252FAD33035_6ff77c4e6f1e25fe8c65b9778b878f03.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/99/d69919b27e0e123e0739ba5b8dff042d/pa/AD33035_6ff77c4e6f1e25fe8c65b9778b878f03.jpg not downloaded yet
2026-03-28 19:01:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/fb/fcfb8c4123ba62d64e2d9df8efc96972/pa/HN54837_506e26ff2f96ce39cac6ac2867f7df69.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:01:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img27/b3/27b342d7f90f0dc836d9d26ab964c191/pa/EC40520_97f15b9b42cf5a30c3fdef5174b6445a.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:01:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/f7/3cf759b784f0f8e17dcab15a2e8e9e5c/pa/SN61945_453da4b33ed69ec7e277b3aa484f2bba.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252Ffc%252Fe2fc3de8c023f4680ae5980fc45e1086%252Fpa%252FSR45817_76d7f5916f08fbc010eb4f762e8ebae3.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/fc/e2fc3de8c023f4680ae5980fc45e1086/pa/SR45817_76d7f5916f08fbc010eb4f762e8ebae3.jpg not downloaded yet
2026-03-28 19:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252F78%252Fe878909c4317c113ebf05415750ca275%252Fpa%252FZN70459_fdb8bf19dda42efdeb8ce53b8cc478ac.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/78/e878909c4317c113ebf05415750ca275/pa/ZN70459_fdb8bf19dda42efdeb8ce53b8cc478ac.jpg not downloaded yet
2026-03-28 19:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Ff7%252F3cf759b784f0f8e17dcab15a2e8e9e5c%252Fpa%252FSN61945_ea7691e270c8f9781ba323aeda52aab6.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/f7/3cf759b784f0f8e17dcab15a2e8e9e5c/pa/SN61945_ea7691e270c8f9781ba323aeda52aab6.jpg not downloaded yet
2026-03-28 19:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F99%252Fd69919b27e0e123e0739ba5b8dff042d%252Fpa%252FAD33035_a7097841ac72a026e880d59162d32f1f.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/99/d69919b27e0e123e0739ba5b8dff042d/pa/AD33035_a7097841ac72a026e880d59162d32f1f.jpg not downloaded yet
2026-03-28 19:01:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/e9/40e903696a2dbb1ddbe93abd395259bf/pa/VZ88435_1c31c8da8ed28f0910c6b547ae3e2be1.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252Ffc%252Fe2fc3de8c023f4680ae5980fc45e1086%252Fpa%252FSR45817_d7474e1fa1dde58a1075ab29b940f06c.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/fc/e2fc3de8c023f4680ae5980fc45e1086/pa/SR45817_d7474e1fa1dde58a1075ab29b940f06c.jpg not downloaded yet
2026-03-28 19:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252F78%252Fe878909c4317c113ebf05415750ca275%252Fpa%252FZN70459_f7cf27267767877c9ed5fe1380c5beca.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/78/e878909c4317c113ebf05415750ca275/pa/ZN70459_f7cf27267767877c9ed5fe1380c5beca.jpg not downloaded yet
2026-03-28 19:01:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge8/78/e878909c4317c113ebf05415750ca275/pa/ZN70459_eb2cd9fde8bca7d729a3ede6fab02423.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Ff7%252F3cf759b784f0f8e17dcab15a2e8e9e5c%252Fpa%252FSN61945_768e21acf9a6ccd047c349537256ba07.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/f7/3cf759b784f0f8e17dcab15a2e8e9e5c/pa/SN61945_768e21acf9a6ccd047c349537256ba07.jpg not downloaded yet
2026-03-28 19:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F99%252Fd69919b27e0e123e0739ba5b8dff042d%252Fpa%252FAD33035_1a3b8794c62533a65040722f29931260.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/99/d69919b27e0e123e0739ba5b8dff042d/pa/AD33035_1a3b8794c62533a65040722f29931260.jpg not downloaded yet
2026-03-28 19:01:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:01:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bd7250ed0>
2026-03-28 19:01:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:01:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:01:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:01:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f61b0cf8-f116-5867-9034-165288e35185/f61b0cf8-f116-5867-9034-165288e35185_image_2.jpg HTTP/1.1" 201 0
2026-03-28 19:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252Fe9%252F40e903696a2dbb1ddbe93abd395259bf%252Fpa%252FVZ88435_077669b2fb0fbdb8b21d7cc138fc5bf2.jpg') HTTP/1.1" 204 0
2026-03-28 19:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/e9/40e903696a2dbb1ddbe93abd395259bf/pa/VZ88435_077669b2fb0fbdb8b21d7cc138fc5bf2.jpg saved to cache
2026-03-28 19:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f61b0cf8-f116-5867-9034-165288e35185
2026-03-28 19:01:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:01:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bd6216c90>
2026-03-28 19:01:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:01:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:01:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:01:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f61b0cf8-f116-5867-9034-165288e35185/f61b0cf8-f116-5867-9034-165288e35185_image_0.jpg HTTP/1.1" 201 0
2026-03-28 19:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252Fe9%252F40e903696a2dbb1ddbe93abd395259bf%252Fpa%252FVZ88435_caf684ef270167640f6362db02288758.jpg') HTTP/1.1" 204 0
2026-03-28 19:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/e9/40e903696a2dbb1ddbe93abd395259bf/pa/VZ88435_caf684ef270167640f6362db02288758.jpg saved to cache
2026-03-28 19:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f61b0cf8-f116-5867-9034-165288e35185
2026-03-28 19:01:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:01:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bd6216210>
2026-03-28 19:01:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:01:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:01:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:01:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f61b0cf8-f116-5867-9034-165288e35185/f61b0cf8-f116-5867-9034-165288e35185_image_1.jpg HTTP/1.1" 201 0
2026-03-28 19:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252Fe9%252F40e903696a2dbb1ddbe93abd395259bf%252Fpa%252FVZ88435_261637f28679add11df0ba1d07fd29a8.jpg') HTTP/1.1" 204 0
2026-03-28 19:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/e9/40e903696a2dbb1ddbe93abd395259bf/pa/VZ88435_261637f28679add11df0ba1d07fd29a8.jpg saved to cache
2026-03-28 19:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f61b0cf8-f116-5867-9034-165288e35185
2026-03-28 19:01:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:01:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bd621a250>
2026-03-28 19:01:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:01:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:01:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:01:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2b4a82bc-7f32-57c0-b814-d577ab4e12c2/2b4a82bc-7f32-57c0-b814-d577ab4e12c2_image_2.jpg HTTP/1.1" 201 0
2026-03-28 19:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252F78%252Fa17853b2dbdb00632b819a3b615958b5%252Fpa%252FBJ61509_a0f0c7fe5af9d040082fd5eba29b31d0.jpg') HTTP/1.1" 204 0
2026-03-28 19:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/78/a17853b2dbdb00632b819a3b615958b5/pa/BJ61509_a0f0c7fe5af9d040082fd5eba29b31d0.jpg saved to cache
2026-03-28 19:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2b4a82bc-7f32-57c0-b814-d577ab4e12c2
2026-03-28 19:01:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/fc/e2fc3de8c023f4680ae5980fc45e1086/pa/SR45817_4b79f576a917f7cbadd617ca4a8ce99a.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252Ffc%252Fe2fc3de8c023f4680ae5980fc45e1086%252Fpa%252FSR45817_dc256b80addc9d55029abd1e0f77a1e4.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/fc/e2fc3de8c023f4680ae5980fc45e1086/pa/SR45817_dc256b80addc9d55029abd1e0f77a1e4.jpg not downloaded yet
2026-03-28 19:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252F78%252Fe878909c4317c113ebf05415750ca275%252Fpa%252FZN70459_9ee16af388423f0beeddcb20a33c322f.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/78/e878909c4317c113ebf05415750ca275/pa/ZN70459_9ee16af388423f0beeddcb20a33c322f.jpg not downloaded yet
2026-03-28 19:01:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge8/78/e878909c4317c113ebf05415750ca275/pa/ZN70459_efd3b1e45daff11e235261d0b7919d79.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Ff7%252F3cf759b784f0f8e17dcab15a2e8e9e5c%252Fpa%252FSN61945_624c864a683535760b6fef84a51ca569.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/f7/3cf759b784f0f8e17dcab15a2e8e9e5c/pa/SN61945_624c864a683535760b6fef84a51ca569.jpg not downloaded yet
2026-03-28 19:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F99%252Fd69919b27e0e123e0739ba5b8dff042d%252Fpa%252FAD33035_41422df232050fdc45ba1c676888ae76.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/99/d69919b27e0e123e0739ba5b8dff042d/pa/AD33035_41422df232050fdc45ba1c676888ae76.jpg not downloaded yet
2026-03-28 19:01:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:01:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bd6240250>
2026-03-28 19:01:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:01:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:01:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:01:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ecbafa2-810c-556f-93a0-421d7c30c287/4ecbafa2-810c-556f-93a0-421d7c30c287_image_8.jpg HTTP/1.1" 201 0
2026-03-28 19:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252Ffb%252Ffcfb8c4123ba62d64e2d9df8efc96972%252Fpa%252FHN54837_506e26ff2f96ce39cac6ac2867f7df69.jpg') HTTP/1.1" 204 0
2026-03-28 19:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/fb/fcfb8c4123ba62d64e2d9df8efc96972/pa/HN54837_506e26ff2f96ce39cac6ac2867f7df69.jpg saved to cache
2026-03-28 19:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4ecbafa2-810c-556f-93a0-421d7c30c287
2026-03-28 19:01:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:01:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bd68a5990>
2026-03-28 19:01:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:01:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:01:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:01:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2afffbfb-f694-58b9-8f01-92e4581e3ccd/2afffbfb-f694-58b9-8f01-92e4581e3ccd_image_3.jpg HTTP/1.1" 201 0
2026-03-28 19:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252Fb3%252F27b342d7f90f0dc836d9d26ab964c191%252Fpa%252FEC40520_97f15b9b42cf5a30c3fdef5174b6445a.jpg') HTTP/1.1" 204 0
2026-03-28 19:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/b3/27b342d7f90f0dc836d9d26ab964c191/pa/EC40520_97f15b9b42cf5a30c3fdef5174b6445a.jpg saved to cache
2026-03-28 19:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2afffbfb-f694-58b9-8f01-92e4581e3ccd
2026-03-28 19:01:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:01:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bd68ee890>
2026-03-28 19:01:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:01:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:01:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:01:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7e52919-9fef-5265-9a67-09711ed53cd2/e7e52919-9fef-5265-9a67-09711ed53cd2_image_1.jpg HTTP/1.1" 201 0
2026-03-28 19:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Ff7%252F3cf759b784f0f8e17dcab15a2e8e9e5c%252Fpa%252FSN61945_453da4b33ed69ec7e277b3aa484f2bba.jpg') HTTP/1.1" 204 0
2026-03-28 19:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/f7/3cf759b784f0f8e17dcab15a2e8e9e5c/pa/SN61945_453da4b33ed69ec7e277b3aa484f2bba.jpg saved to cache
2026-03-28 19:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e7e52919-9fef-5265-9a67-09711ed53cd2
2026-03-28 19:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252Ffc%252Fe2fc3de8c023f4680ae5980fc45e1086%252Fpa%252FSR45817_3cc8693e6dd65a21e227bdc8e860b740.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/fc/e2fc3de8c023f4680ae5980fc45e1086/pa/SR45817_3cc8693e6dd65a21e227bdc8e860b740.jpg not downloaded yet
2026-03-28 19:01:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EW29368> (referer: https://www.auto1.com/v1/car-details-view/EW29368/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 19:01:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LE06198> (referer: https://www.auto1.com/v1/car-details-view/LE06198/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 19:01:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HW32084/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 19:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Ff7%252F3cf759b784f0f8e17dcab15a2e8e9e5c%252Fpa%252FSN61945_c524d714492954938b4b71035cf2cf1c.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/f7/3cf759b784f0f8e17dcab15a2e8e9e5c/pa/SN61945_c524d714492954938b4b71035cf2cf1c.jpg not downloaded yet
2026-03-28 19:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F99%252Fd69919b27e0e123e0739ba5b8dff042d%252Fpa%252FAD33035_5e5b2aa3821ffc682f28eba3732b9037.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/99/d69919b27e0e123e0739ba5b8dff042d/pa/AD33035_5e5b2aa3821ffc682f28eba3732b9037.jpg not downloaded yet
2026-03-28 19:01:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/e9/40e903696a2dbb1ddbe93abd395259bf/pa/VZ88435_303b67bc0ff88802f4ff5f53f84d79a8.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252Ffc%252Fe2fc3de8c023f4680ae5980fc45e1086%252Fpa%252FSR45817_c57fee9b5d270f06bf609bc9d94f8984.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/fc/e2fc3de8c023f4680ae5980fc45e1086/pa/SR45817_c57fee9b5d270f06bf609bc9d94f8984.jpg not downloaded yet
2026-03-28 19:01:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LL30088> (referer: https://www.auto1.com/v1/car-details-view/LL30088/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 19:01:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:01:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bd6840350>
2026-03-28 19:01:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:01:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:01:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:01:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f61b0cf8-f116-5867-9034-165288e35185/f61b0cf8-f116-5867-9034-165288e35185_image_3.jpg HTTP/1.1" 201 0
2026-03-28 19:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252Fe9%252F40e903696a2dbb1ddbe93abd395259bf%252Fpa%252FVZ88435_1c31c8da8ed28f0910c6b547ae3e2be1.jpg') HTTP/1.1" 204 0
2026-03-28 19:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/e9/40e903696a2dbb1ddbe93abd395259bf/pa/VZ88435_1c31c8da8ed28f0910c6b547ae3e2be1.jpg saved to cache
2026-03-28 19:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f61b0cf8-f116-5867-9034-165288e35185
2026-03-28 19:01:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:01:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bd63fe410>
2026-03-28 19:01:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:01:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:01:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:01:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47753836-04a1-5002-928e-0723ecea2118/47753836-04a1-5002-928e-0723ecea2118_image_0.jpg HTTP/1.1" 201 0
2026-03-28 19:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252F78%252Fe878909c4317c113ebf05415750ca275%252Fpa%252FZN70459_eb2cd9fde8bca7d729a3ede6fab02423.jpg') HTTP/1.1" 204 0
2026-03-28 19:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/78/e878909c4317c113ebf05415750ca275/pa/ZN70459_eb2cd9fde8bca7d729a3ede6fab02423.jpg saved to cache
2026-03-28 19:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 47753836-04a1-5002-928e-0723ecea2118
2026-03-28 19:01:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:01:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bdd1f8210>
2026-03-28 19:01:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:01:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:01:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:01:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_457c3195-896b-557f-a471-daa91da61c90/457c3195-896b-557f-a471-daa91da61c90_image_0.jpg HTTP/1.1" 201 0
2026-03-28 19:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252Ffc%252Fe2fc3de8c023f4680ae5980fc45e1086%252Fpa%252FSR45817_4b79f576a917f7cbadd617ca4a8ce99a.jpg') HTTP/1.1" 204 0
2026-03-28 19:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/fc/e2fc3de8c023f4680ae5980fc45e1086/pa/SR45817_4b79f576a917f7cbadd617ca4a8ce99a.jpg saved to cache
2026-03-28 19:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 457c3195-896b-557f-a471-daa91da61c90
2026-03-28 19:01:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:01:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bd628fdd0>
2026-03-28 19:01:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:01:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:01:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:01:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47753836-04a1-5002-928e-0723ecea2118/47753836-04a1-5002-928e-0723ecea2118_image_1.jpg HTTP/1.1" 201 0
2026-03-28 19:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252F78%252Fe878909c4317c113ebf05415750ca275%252Fpa%252FZN70459_efd3b1e45daff11e235261d0b7919d79.jpg') HTTP/1.1" 204 0
2026-03-28 19:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/78/e878909c4317c113ebf05415750ca275/pa/ZN70459_efd3b1e45daff11e235261d0b7919d79.jpg saved to cache
2026-03-28 19:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 47753836-04a1-5002-928e-0723ecea2118
2026-03-28 19:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F99%252Fd69919b27e0e123e0739ba5b8dff042d%252Fpa%252FAD33035_3c148d21ad3ab5eaf55c6fa4051d17df.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/99/d69919b27e0e123e0739ba5b8dff042d/pa/AD33035_3c148d21ad3ab5eaf55c6fa4051d17df.jpg not downloaded yet
2026-03-28 19:01:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/99/d69919b27e0e123e0739ba5b8dff042d/pa/AD33035_a7097841ac72a026e880d59162d32f1f.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:01:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/f7/3cf759b784f0f8e17dcab15a2e8e9e5c/pa/SN61945_ea7691e270c8f9781ba323aeda52aab6.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252Ffc%252Fe2fc3de8c023f4680ae5980fc45e1086%252Fpa%252FSR45817_d4b5bfa61fdefc0eb4481cdf91bd20d8.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/fc/e2fc3de8c023f4680ae5980fc45e1086/pa/SR45817_d4b5bfa61fdefc0eb4481cdf91bd20d8.jpg not downloaded yet
2026-03-28 19:01:20 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 19:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F99%252Fd69919b27e0e123e0739ba5b8dff042d%252Fpa%252FAD33035_e2cbb61a97676a2ea2e4b6852aeb141b.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/99/d69919b27e0e123e0739ba5b8dff042d/pa/AD33035_e2cbb61a97676a2ea2e4b6852aeb141b.jpg not downloaded yet
2026-03-28 19:01:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 88954a77-5ac5-5492-89f5-094d7dabda53 with identifier: EW29368
2026-03-28 19:01:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 88954a77-5ac5-5492-89f5-094d7dabda53 with scrape type 1
2026-03-28 19:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 88954a77-5ac5-5492-89f5-094d7dabda53
2026-03-28 19:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F7b%252F8d7bb95a2c478917cc2c03efdf7a5550%252Fpa%252FEW29368_d891a909ff2de25be5baa55c6eab9982.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/7b/8d7bb95a2c478917cc2c03efdf7a5550/pa/EW29368_d891a909ff2de25be5baa55c6eab9982.jpg not downloaded yet
2026-03-28 19:01:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c1bedc77-12f4-5458-be21-8378521c399a with identifier: LE06198
2026-03-28 19:01:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c1bedc77-12f4-5458-be21-8378521c399a with scrape type 1
2026-03-28 19:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item c1bedc77-12f4-5458-be21-8378521c399a
2026-03-28 19:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252F30%252F7430fce1922f20b568f98dbee4fee982%252Fpa%252FLE06198_5e050a974d359d8a51ac4e7a758d44cb.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/30/7430fce1922f20b568f98dbee4fee982/pa/LE06198_5e050a974d359d8a51ac4e7a758d44cb.jpg not downloaded yet
2026-03-28 19:01:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:01:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bd6281f50>
2026-03-28 19:01:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:01:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:01:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:01:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f61b0cf8-f116-5867-9034-165288e35185/f61b0cf8-f116-5867-9034-165288e35185_image_4.jpg HTTP/1.1" 201 0
2026-03-28 19:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252Fe9%252F40e903696a2dbb1ddbe93abd395259bf%252Fpa%252FVZ88435_303b67bc0ff88802f4ff5f53f84d79a8.jpg') HTTP/1.1" 204 0
2026-03-28 19:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/e9/40e903696a2dbb1ddbe93abd395259bf/pa/VZ88435_303b67bc0ff88802f4ff5f53f84d79a8.jpg saved to cache
2026-03-28 19:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f61b0cf8-f116-5867-9034-165288e35185
2026-03-28 19:01:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f61b0cf8-f116-5867-9034-165288e35185, skipping ID generation
2026-03-28 19:01:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f61b0cf8-f116-5867-9034-165288e35185 with scrape type 1
2026-03-28 19:01:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f61b0cf8-f116-5867-9034-165288e35185 sending to next pipeline
2026-03-28 19:01:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: f61b0cf8-f116-5867-9034-165288e35185, identifier: VZ88435
2026-03-28 19:01:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6b73042b-cd7f-557a-83c4-ab3b0db13fbb with identifier: LL30088
2026-03-28 19:01:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6b73042b-cd7f-557a-83c4-ab3b0db13fbb with scrape type 1
2026-03-28 19:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 6b73042b-cd7f-557a-83c4-ab3b0db13fbb
2026-03-28 19:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252F93%252F8293cda6ebdb7e0de6737d6aa3d0fe55%252Fpa%252FLL30088_e482e63966769857b9742e77bd0ce533.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/93/8293cda6ebdb7e0de6737d6aa3d0fe55/pa/LL30088_e482e63966769857b9742e77bd0ce533.jpg not downloaded yet
2026-03-28 19:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252Ffc%252Fe2fc3de8c023f4680ae5980fc45e1086%252Fpa%252FSR45817_eb53fb1be925b05c101570645e040099.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/fc/e2fc3de8c023f4680ae5980fc45e1086/pa/SR45817_eb53fb1be925b05c101570645e040099.jpg not downloaded yet
2026-03-28 19:01:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: f61b0cf8-f116-5867-9034-165288e35185 with identifier: VZ88435
2026-03-28 19:01:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: f61b0cf8-f116-5867-9034-165288e35185 with identifier: VZ88435
2026-03-28 19:01:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: f61b0cf8-f116-5867-9034-165288e35185 with identifier: VZ88435 to the API
2026-03-28 19:01:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 19:01:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 19:01:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img40/e9/40e903696a2dbb1ddbe93abd395259bf/pa/VZ88435_303b67bc0ff88802f4ff5f53f84d79a8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 142,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.6L',
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:05:14Z',
 'fuel_type': 'petrol',
 'id': 'f61b0cf8-f116-5867-9034-165288e35185',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '07SXT9',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VZ88435',
 'listing': 'auction',
 'location': 'NL, Breukelen',
 'make': 'Hyundai',
 'model': 'i30',
 'odometer': 325294,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f61b0cf8-f116-5867-9034-165288e35185/f61b0cf8-f116-5867-9034-165288e35185_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65887,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img40/e9/40e903696a2dbb1ddbe93abd395259bf/pa/VZ88435_caf684ef270167640f6362db02288758.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f61b0cf8-f116-5867-9034-165288e35185/f61b0cf8-f116-5867-9034-165288e35185_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68732,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img40/e9/40e903696a2dbb1ddbe93abd395259bf/pa/VZ88435_261637f28679add11df0ba1d07fd29a8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f61b0cf8-f116-5867-9034-165288e35185/f61b0cf8-f116-5867-9034-165288e35185_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64746,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img40/e9/40e903696a2dbb1ddbe93abd395259bf/pa/VZ88435_077669b2fb0fbdb8b21d7cc138fc5bf2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f61b0cf8-f116-5867-9034-165288e35185/f61b0cf8-f116-5867-9034-165288e35185_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61386,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img40/e9/40e903696a2dbb1ddbe93abd395259bf/pa/VZ88435_1c31c8da8ed28f0910c6b547ae3e2be1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f61b0cf8-f116-5867-9034-165288e35185/f61b0cf8-f116-5867-9034-165288e35185_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68519,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img40/e9/40e903696a2dbb1ddbe93abd395259bf/pa/VZ88435_303b67bc0ff88802f4ff5f53f84d79a8.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-01-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Hyundai i30 1.6 Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2012}
2026-03-28 19:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VZ88435%27 HTTP/1.1" 200 None
2026-03-28 19:01:21 [auto1.nl] INFO: Saving data for VZ88435: {'created_time': 1774724481.833489, 'last_price_update_time': 1774724481.8335, 'auction_closing_time': 1774883114.0}
2026-03-28 19:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='VZ88435') HTTP/1.1" 204 0
2026-03-28 19:01:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/99/d69919b27e0e123e0739ba5b8dff042d/pa/AD33035_1a3b8794c62533a65040722f29931260.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F99%252Fd69919b27e0e123e0739ba5b8dff042d%252Fpa%252FAD33035_2aa5ac1b5db598f748a6b834fa621a50.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/99/d69919b27e0e123e0739ba5b8dff042d/pa/AD33035_2aa5ac1b5db598f748a6b834fa621a50.jpg not downloaded yet
2026-03-28 19:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F7b%252F8d7bb95a2c478917cc2c03efdf7a5550%252Fpa%252FEW29368_8812676cfc01b79f3959bfa2cd219338.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/7b/8d7bb95a2c478917cc2c03efdf7a5550/pa/EW29368_8812676cfc01b79f3959bfa2cd219338.jpg not downloaded yet
2026-03-28 19:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252F30%252F7430fce1922f20b568f98dbee4fee982%252Fpa%252FLE06198_7c35d29a48411a1f9043388881d9dafb.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/30/7430fce1922f20b568f98dbee4fee982/pa/LE06198_7c35d29a48411a1f9043388881d9dafb.jpg not downloaded yet
2026-03-28 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252F93%252F8293cda6ebdb7e0de6737d6aa3d0fe55%252Fpa%252FLL30088_753a44653ead6758ece7ee2e9f1ef200.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/93/8293cda6ebdb7e0de6737d6aa3d0fe55/pa/LL30088_753a44653ead6758ece7ee2e9f1ef200.jpg not downloaded yet
2026-03-28 19:01:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FE67699> (referer: https://www.auto1.com/v1/car-details-view/FE67699/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252Ffc%252Fe2fc3de8c023f4680ae5980fc45e1086%252Fpa%252FSR45817_f91c1bf7a360ac792fd567132045a325.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/fc/e2fc3de8c023f4680ae5980fc45e1086/pa/SR45817_f91c1bf7a360ac792fd567132045a325.jpg not downloaded yet
2026-03-28 19:01:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:01:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bdd4f0f50>
2026-03-28 19:01:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:01:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40f51b58-64e3-522b-b353-cfb584ce0272/40f51b58-64e3-522b-b353-cfb584ce0272_image_1.jpg HTTP/1.1" 201 0
2026-03-28 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F99%252Fd69919b27e0e123e0739ba5b8dff042d%252Fpa%252FAD33035_a7097841ac72a026e880d59162d32f1f.jpg') HTTP/1.1" 204 0
2026-03-28 19:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/99/d69919b27e0e123e0739ba5b8dff042d/pa/AD33035_a7097841ac72a026e880d59162d32f1f.jpg saved to cache
2026-03-28 19:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 40f51b58-64e3-522b-b353-cfb584ce0272
2026-03-28 19:01:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:01:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bd71e2e10>
2026-03-28 19:01:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:01:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7e52919-9fef-5265-9a67-09711ed53cd2/e7e52919-9fef-5265-9a67-09711ed53cd2_image_6.jpg HTTP/1.1" 201 0
2026-03-28 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Ff7%252F3cf759b784f0f8e17dcab15a2e8e9e5c%252Fpa%252FSN61945_ea7691e270c8f9781ba323aeda52aab6.jpg') HTTP/1.1" 204 0
2026-03-28 19:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/f7/3cf759b784f0f8e17dcab15a2e8e9e5c/pa/SN61945_ea7691e270c8f9781ba323aeda52aab6.jpg saved to cache
2026-03-28 19:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e7e52919-9fef-5265-9a67-09711ed53cd2
2026-03-28 19:01:22 [auto1.nl] INFO: Channel: 24h | Page: 16 | totalHits: 646 | hits on page: 40
2026-03-28 19:01:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/fc/e2fc3de8c023f4680ae5980fc45e1086/pa/SR45817_3cc8693e6dd65a21e227bdc8e860b740.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:01:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/f7/3cf759b784f0f8e17dcab15a2e8e9e5c/pa/SN61945_768e21acf9a6ccd047c349537256ba07.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F99%252Fd69919b27e0e123e0739ba5b8dff042d%252Fpa%252FAD33035_ca5d3bf45dd41f759110d1f1934d1004.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/99/d69919b27e0e123e0739ba5b8dff042d/pa/AD33035_ca5d3bf45dd41f759110d1f1934d1004.jpg not downloaded yet
2026-03-28 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F7b%252F8d7bb95a2c478917cc2c03efdf7a5550%252Fpa%252FEW29368_b76a456660a1a6d5c4dfeffab438b37b.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/7b/8d7bb95a2c478917cc2c03efdf7a5550/pa/EW29368_b76a456660a1a6d5c4dfeffab438b37b.jpg not downloaded yet
2026-03-28 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252F30%252F7430fce1922f20b568f98dbee4fee982%252Fpa%252FLE06198_11f64d4d1fdb0adceed28fd5cca09cb7.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/30/7430fce1922f20b568f98dbee4fee982/pa/LE06198_11f64d4d1fdb0adceed28fd5cca09cb7.jpg not downloaded yet
2026-03-28 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252F93%252F8293cda6ebdb7e0de6737d6aa3d0fe55%252Fpa%252FLL30088_8f08f3a29e86fd193c4cb548fe2d7a42.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/93/8293cda6ebdb7e0de6737d6aa3d0fe55/pa/LL30088_8f08f3a29e86fd193c4cb548fe2d7a42.jpg not downloaded yet
2026-03-28 19:01:22 [auto1.nl] INFO: Found listing with ID: XM87869
2026-03-28 19:01:22 [auto1.nl] INFO: Found listing with ID: DJ46393
2026-03-28 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DJ46393%27 HTTP/1.1" 200 None
2026-03-28 19:01:22 [auto1.nl] INFO: Scrape type for DJ46393: 0
2026-03-28 19:01:22 [auto1.nl] INFO: Found listing with ID: FB82909
2026-03-28 19:01:22 [auto1.nl] INFO: Found listing with ID: JF84007
2026-03-28 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JF84007%27 HTTP/1.1" 200 None
2026-03-28 19:01:22 [auto1.nl] INFO: Scrape type for JF84007: 0
2026-03-28 19:01:22 [auto1.nl] INFO: Found listing with ID: KD48941
2026-03-28 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KD48941%27 HTTP/1.1" 200 None
2026-03-28 19:01:22 [auto1.nl] INFO: Scrape type for KD48941: 0
2026-03-28 19:01:22 [auto1.nl] INFO: Found listing with ID: EU38085
2026-03-28 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EU38085%27 HTTP/1.1" 200 None
2026-03-28 19:01:22 [auto1.nl] INFO: Scrape type for EU38085: 0
2026-03-28 19:01:22 [auto1.nl] INFO: Found listing with ID: WN94746
2026-03-28 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WN94746%27 HTTP/1.1" 200 None
2026-03-28 19:01:22 [auto1.nl] INFO: Scrape type for WN94746: 0
2026-03-28 19:01:22 [auto1.nl] INFO: Found listing with ID: WU56616
2026-03-28 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WU56616%27 HTTP/1.1" 200 None
2026-03-28 19:01:22 [auto1.nl] INFO: Scrape type for WU56616: 0
2026-03-28 19:01:22 [auto1.nl] INFO: Found listing with ID: YX65431
2026-03-28 19:01:22 [auto1.nl] INFO: Found listing with ID: CT48510
2026-03-28 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CT48510%27 HTTP/1.1" 200 None
2026-03-28 19:01:22 [auto1.nl] INFO: Scrape type for CT48510: 0
2026-03-28 19:01:22 [auto1.nl] INFO: Found listing with ID: MZ74119
2026-03-28 19:01:22 [auto1.nl] INFO: Found listing with ID: RD76922
2026-03-28 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RD76922%27 HTTP/1.1" 200 None
2026-03-28 19:01:22 [auto1.nl] INFO: Scrape type for RD76922: 0
2026-03-28 19:01:22 [auto1.nl] INFO: Found listing with ID: GW58352
2026-03-28 19:01:22 [auto1.nl] INFO: Found listing with ID: JB09830
2026-03-28 19:01:22 [auto1.nl] INFO: Found listing with ID: CY78777
2026-03-28 19:01:22 [auto1.nl] INFO: Found listing with ID: WC26387
2026-03-28 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WC26387%27 HTTP/1.1" 200 None
2026-03-28 19:01:22 [auto1.nl] INFO: Scrape type for WC26387: 0
2026-03-28 19:01:22 [auto1.nl] INFO: Found listing with ID: LF00808
2026-03-28 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LF00808%27 HTTP/1.1" 200 None
2026-03-28 19:01:22 [auto1.nl] INFO: Scrape type for LF00808: 0
2026-03-28 19:01:22 [auto1.nl] INFO: Found listing with ID: DL13637
2026-03-28 19:01:22 [auto1.nl] INFO: Found listing with ID: CD19489
2026-03-28 19:01:22 [auto1.nl] INFO: Found listing with ID: RY80321
2026-03-28 19:01:22 [auto1.nl] INFO: Found listing with ID: JM92964
2026-03-28 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JM92964%27 HTTP/1.1" 200 None
2026-03-28 19:01:22 [auto1.nl] INFO: Scrape type for JM92964: 0
2026-03-28 19:01:22 [auto1.nl] INFO: Found listing with ID: KC04488
2026-03-28 19:01:22 [auto1.nl] INFO: Found listing with ID: SK13348
2026-03-28 19:01:22 [auto1.nl] INFO: Found listing with ID: JB39700
2026-03-28 19:01:22 [auto1.nl] INFO: Found listing with ID: NZ86515
2026-03-28 19:01:22 [auto1.nl] INFO: Found listing with ID: HJ37238
2026-03-28 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HJ37238%27 HTTP/1.1" 200 None
2026-03-28 19:01:22 [auto1.nl] INFO: Scrape type for HJ37238: 0
2026-03-28 19:01:22 [auto1.nl] INFO: Found listing with ID: JK34334
2026-03-28 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JK34334%27 HTTP/1.1" 200 None
2026-03-28 19:01:22 [auto1.nl] INFO: Scrape type for JK34334: 0
2026-03-28 19:01:22 [auto1.nl] INFO: Found listing with ID: YB88576
2026-03-28 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YB88576%27 HTTP/1.1" 200 None
2026-03-28 19:01:22 [auto1.nl] INFO: Scrape type for YB88576: 0
2026-03-28 19:01:22 [auto1.nl] INFO: Found listing with ID: YG37971
2026-03-28 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YG37971%27 HTTP/1.1" 200 None
2026-03-28 19:01:22 [auto1.nl] INFO: Scrape type for YG37971: 0
2026-03-28 19:01:22 [auto1.nl] INFO: Found listing with ID: UF88780
2026-03-28 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UF88780%27 HTTP/1.1" 200 None
2026-03-28 19:01:22 [auto1.nl] INFO: Scrape type for UF88780: 0
2026-03-28 19:01:22 [auto1.nl] INFO: Found listing with ID: WK03460
2026-03-28 19:01:22 [auto1.nl] INFO: Found listing with ID: FG02230
2026-03-28 19:01:22 [auto1.nl] INFO: Found listing with ID: KC88699
2026-03-28 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KC88699%27 HTTP/1.1" 200 None
2026-03-28 19:01:22 [auto1.nl] INFO: Scrape type for KC88699: 0
2026-03-28 19:01:22 [auto1.nl] INFO: Found listing with ID: NX59327
2026-03-28 19:01:22 [auto1.nl] INFO: Found listing with ID: AB36156
2026-03-28 19:01:22 [auto1.nl] INFO: Found listing with ID: WZ79997
2026-03-28 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WZ79997%27 HTTP/1.1" 200 None
2026-03-28 19:01:22 [auto1.nl] INFO: Scrape type for WZ79997: 0
2026-03-28 19:01:22 [auto1.nl] INFO: Found listing with ID: JW97628
2026-03-28 19:01:22 [auto1.nl] INFO: Found listing with ID: MP39959
2026-03-28 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MP39959%27 HTTP/1.1" 200 None
2026-03-28 19:01:22 [auto1.nl] INFO: Scrape type for MP39959: 0
2026-03-28 19:01:22 [auto1.nl] INFO: Found listing with ID: YN95467
2026-03-28 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YN95467%27 HTTP/1.1" 200 None
2026-03-28 19:01:22 [auto1.nl] INFO: Scrape type for YN95467: 0
2026-03-28 19:01:22 [auto1.nl] INFO: Found listing with ID: LR40141
2026-03-28 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F99%252Fd69919b27e0e123e0739ba5b8dff042d%252Fpa%252FAD33035_72d815cf92fc929591d51c3dd30eeb5b.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/99/d69919b27e0e123e0739ba5b8dff042d/pa/AD33035_72d815cf92fc929591d51c3dd30eeb5b.jpg not downloaded yet
2026-03-28 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F7b%252F8d7bb95a2c478917cc2c03efdf7a5550%252Fpa%252FEW29368_0e24a84fabe7daa6b42f547fbdc1d4da.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/7b/8d7bb95a2c478917cc2c03efdf7a5550/pa/EW29368_0e24a84fabe7daa6b42f547fbdc1d4da.jpg not downloaded yet
2026-03-28 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252F30%252F7430fce1922f20b568f98dbee4fee982%252Fpa%252FLE06198_118c444100459b022b55828a53dfb1eb.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/30/7430fce1922f20b568f98dbee4fee982/pa/LE06198_118c444100459b022b55828a53dfb1eb.jpg not downloaded yet
2026-03-28 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252F93%252F8293cda6ebdb7e0de6737d6aa3d0fe55%252Fpa%252FLL30088_c68f39e386fd59f3cc9916824c74a7c3.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/93/8293cda6ebdb7e0de6737d6aa3d0fe55/pa/LL30088_c68f39e386fd59f3cc9916824c74a7c3.jpg not downloaded yet
2026-03-28 19:01:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:01:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bd680f610>
2026-03-28 19:01:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:01:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40f51b58-64e3-522b-b353-cfb584ce0272/40f51b58-64e3-522b-b353-cfb584ce0272_image_2.jpg HTTP/1.1" 201 0
2026-03-28 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F99%252Fd69919b27e0e123e0739ba5b8dff042d%252Fpa%252FAD33035_1a3b8794c62533a65040722f29931260.jpg') HTTP/1.1" 204 0
2026-03-28 19:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/99/d69919b27e0e123e0739ba5b8dff042d/pa/AD33035_1a3b8794c62533a65040722f29931260.jpg saved to cache
2026-03-28 19:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 40f51b58-64e3-522b-b353-cfb584ce0272
2026-03-28 19:01:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 56e25974-08fb-59db-864b-3f609a5f4900 with identifier: FE67699
2026-03-28 19:01:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 56e25974-08fb-59db-864b-3f609a5f4900 with scrape type 1
2026-03-28 19:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 4 photos for item 56e25974-08fb-59db-864b-3f609a5f4900
2026-03-28 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252Fd8%252F7ad8636655662408bdf1e8cefbe1b56d%252Fpa%252FFE67699_4b89cd8727c5d61a57bf8829edd83f24.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/d8/7ad8636655662408bdf1e8cefbe1b56d/pa/FE67699_4b89cd8727c5d61a57bf8829edd83f24.jpg not downloaded yet
2026-03-28 19:01:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/99/d69919b27e0e123e0739ba5b8dff042d/pa/AD33035_41422df232050fdc45ba1c676888ae76.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:01:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge8/78/e878909c4317c113ebf05415750ca275/pa/ZN70459_9ee16af388423f0beeddcb20a33c322f.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:01:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/f7/3cf759b784f0f8e17dcab15a2e8e9e5c/pa/SN61945_624c864a683535760b6fef84a51ca569.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F7b%252F8d7bb95a2c478917cc2c03efdf7a5550%252Fpa%252FEW29368_cf4d42f6f5e25e1aee611e9390bb9b14.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/7b/8d7bb95a2c478917cc2c03efdf7a5550/pa/EW29368_cf4d42f6f5e25e1aee611e9390bb9b14.jpg not downloaded yet
2026-03-28 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252F30%252F7430fce1922f20b568f98dbee4fee982%252Fpa%252FLE06198_df0f2340d293b476c655f2d8d2796bdb.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/30/7430fce1922f20b568f98dbee4fee982/pa/LE06198_df0f2340d293b476c655f2d8d2796bdb.jpg not downloaded yet
2026-03-28 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252F93%252F8293cda6ebdb7e0de6737d6aa3d0fe55%252Fpa%252FLL30088_2b3557bd96eb9596b3c0419128c86d41.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/93/8293cda6ebdb7e0de6737d6aa3d0fe55/pa/LL30088_2b3557bd96eb9596b3c0419128c86d41.jpg not downloaded yet
2026-03-28 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252Fd8%252F7ad8636655662408bdf1e8cefbe1b56d%252Fpa%252FFE67699_137cc146ba9c56c92657bd6978d2ae0c.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/d8/7ad8636655662408bdf1e8cefbe1b56d/pa/FE67699_137cc146ba9c56c92657bd6978d2ae0c.jpg not downloaded yet
2026-03-28 19:01:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:01:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bd68bdf50>
2026-03-28 19:01:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:01:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_457c3195-896b-557f-a471-daa91da61c90/457c3195-896b-557f-a471-daa91da61c90_image_5.jpg HTTP/1.1" 201 0
2026-03-28 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252Ffc%252Fe2fc3de8c023f4680ae5980fc45e1086%252Fpa%252FSR45817_3cc8693e6dd65a21e227bdc8e860b740.jpg') HTTP/1.1" 204 0
2026-03-28 19:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/fc/e2fc3de8c023f4680ae5980fc45e1086/pa/SR45817_3cc8693e6dd65a21e227bdc8e860b740.jpg saved to cache
2026-03-28 19:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 457c3195-896b-557f-a471-daa91da61c90
2026-03-28 19:01:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:01:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bd68711d0>
2026-03-28 19:01:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:01:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7e52919-9fef-5265-9a67-09711ed53cd2/e7e52919-9fef-5265-9a67-09711ed53cd2_image_7.jpg HTTP/1.1" 201 0
2026-03-28 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Ff7%252F3cf759b784f0f8e17dcab15a2e8e9e5c%252Fpa%252FSN61945_768e21acf9a6ccd047c349537256ba07.jpg') HTTP/1.1" 204 0
2026-03-28 19:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/f7/3cf759b784f0f8e17dcab15a2e8e9e5c/pa/SN61945_768e21acf9a6ccd047c349537256ba07.jpg saved to cache
2026-03-28 19:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e7e52919-9fef-5265-9a67-09711ed53cd2
2026-03-28 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F7b%252F8d7bb95a2c478917cc2c03efdf7a5550%252Fpa%252FEW29368_fcec26882a2ad953b67156fdc38d7fea.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/7b/8d7bb95a2c478917cc2c03efdf7a5550/pa/EW29368_fcec26882a2ad953b67156fdc38d7fea.jpg not downloaded yet
2026-03-28 19:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252F30%252F7430fce1922f20b568f98dbee4fee982%252Fpa%252FLE06198_f17000af663c1594ba56b63757609e64.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/30/7430fce1922f20b568f98dbee4fee982/pa/LE06198_f17000af663c1594ba56b63757609e64.jpg not downloaded yet
2026-03-28 19:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252F93%252F8293cda6ebdb7e0de6737d6aa3d0fe55%252Fpa%252FLL30088_dd952388b18daf9ac51550a1b158b608.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/93/8293cda6ebdb7e0de6737d6aa3d0fe55/pa/LL30088_dd952388b18daf9ac51550a1b158b608.jpg not downloaded yet
2026-03-28 19:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252Fd8%252F7ad8636655662408bdf1e8cefbe1b56d%252Fpa%252FFE67699_eb501c97f9d57fe4baf8db98414a2d48.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/d8/7ad8636655662408bdf1e8cefbe1b56d/pa/FE67699_eb501c97f9d57fe4baf8db98414a2d48.jpg not downloaded yet
2026-03-28 19:01:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:01:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bd68805d0>
2026-03-28 19:01:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:01:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:01:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:01:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40f51b58-64e3-522b-b353-cfb584ce0272/40f51b58-64e3-522b-b353-cfb584ce0272_image_3.jpg HTTP/1.1" 201 0
2026-03-28 19:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F99%252Fd69919b27e0e123e0739ba5b8dff042d%252Fpa%252FAD33035_41422df232050fdc45ba1c676888ae76.jpg') HTTP/1.1" 204 0
2026-03-28 19:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/99/d69919b27e0e123e0739ba5b8dff042d/pa/AD33035_41422df232050fdc45ba1c676888ae76.jpg saved to cache
2026-03-28 19:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 40f51b58-64e3-522b-b353-cfb584ce0272
2026-03-28 19:01:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:01:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bdd4fb450>
2026-03-28 19:01:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:01:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:01:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:01:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47753836-04a1-5002-928e-0723ecea2118/47753836-04a1-5002-928e-0723ecea2118_image_4.jpg HTTP/1.1" 201 0
2026-03-28 19:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252F78%252Fe878909c4317c113ebf05415750ca275%252Fpa%252FZN70459_9ee16af388423f0beeddcb20a33c322f.jpg') HTTP/1.1" 204 0
2026-03-28 19:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/78/e878909c4317c113ebf05415750ca275/pa/ZN70459_9ee16af388423f0beeddcb20a33c322f.jpg saved to cache
2026-03-28 19:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 47753836-04a1-5002-928e-0723ecea2118
2026-03-28 19:01:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:01:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bd680ddd0>
2026-03-28 19:01:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:01:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:01:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:01:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7e52919-9fef-5265-9a67-09711ed53cd2/e7e52919-9fef-5265-9a67-09711ed53cd2_image_8.jpg HTTP/1.1" 201 0
2026-03-28 19:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Ff7%252F3cf759b784f0f8e17dcab15a2e8e9e5c%252Fpa%252FSN61945_624c864a683535760b6fef84a51ca569.jpg') HTTP/1.1" 204 0
2026-03-28 19:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/f7/3cf759b784f0f8e17dcab15a2e8e9e5c/pa/SN61945_624c864a683535760b6fef84a51ca569.jpg saved to cache
2026-03-28 19:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e7e52919-9fef-5265-9a67-09711ed53cd2
2026-03-28 19:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F7b%252F8d7bb95a2c478917cc2c03efdf7a5550%252Fpa%252FEW29368_458f6d0e018aeffb72915016037a09e3.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/7b/8d7bb95a2c478917cc2c03efdf7a5550/pa/EW29368_458f6d0e018aeffb72915016037a09e3.jpg not downloaded yet
2026-03-28 19:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252Fd8%252F7ad8636655662408bdf1e8cefbe1b56d%252Fpa%252FFE67699_33385392aeffa6a2f87c8dbcc5879d80.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/d8/7ad8636655662408bdf1e8cefbe1b56d/pa/FE67699_33385392aeffa6a2f87c8dbcc5879d80.jpg not downloaded yet
2026-03-28 19:01:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/99/d69919b27e0e123e0739ba5b8dff042d/pa/AD33035_3c148d21ad3ab5eaf55c6fa4051d17df.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:01:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/99/d69919b27e0e123e0739ba5b8dff042d/pa/AD33035_5e5b2aa3821ffc682f28eba3732b9037.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:01:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/fc/e2fc3de8c023f4680ae5980fc45e1086/pa/SR45817_c57fee9b5d270f06bf609bc9d94f8984.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F7b%252F8d7bb95a2c478917cc2c03efdf7a5550%252Fpa%252FEW29368_f6b497b102a461ba836fcae1cafcdb93.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/7b/8d7bb95a2c478917cc2c03efdf7a5550/pa/EW29368_f6b497b102a461ba836fcae1cafcdb93.jpg not downloaded yet
2026-03-28 19:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F7b%252F8d7bb95a2c478917cc2c03efdf7a5550%252Fpa%252FEW29368_db2c73264477e6c32e9fa6b883491553.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/7b/8d7bb95a2c478917cc2c03efdf7a5550/pa/EW29368_db2c73264477e6c32e9fa6b883491553.jpg not downloaded yet
2026-03-28 19:01:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img99/d8/99d8daf0854f81383878cbaa25a6afa1/pa/XK63885_8571fadb4798735e63b0b0da256db3b8.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F7b%252F8d7bb95a2c478917cc2c03efdf7a5550%252Fpa%252FEW29368_9bf98fc399ad52907db60a8f245b4f72.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/7b/8d7bb95a2c478917cc2c03efdf7a5550/pa/EW29368_9bf98fc399ad52907db60a8f245b4f72.jpg not downloaded yet
2026-03-28 19:01:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img82/93/8293cda6ebdb7e0de6737d6aa3d0fe55/pa/LL30088_e482e63966769857b9742e77bd0ce533.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:01:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/f7/3cf759b784f0f8e17dcab15a2e8e9e5c/pa/SN61945_49973c4ddb3d2d8999f8f87e16d69284.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:01:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/fc/e2fc3de8c023f4680ae5980fc45e1086/pa/SR45817_eb53fb1be925b05c101570645e040099.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:01:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/f7/3cf759b784f0f8e17dcab15a2e8e9e5c/pa/SN61945_c9260713991c8efb71b8d802e7d3329f.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:01:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/fc/e2fc3de8c023f4680ae5980fc45e1086/pa/SR45817_615ff6b9c87ac440dae87f8c1317d5ff.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:01:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/f7/3cf759b784f0f8e17dcab15a2e8e9e5c/pa/SN61945_831a9c53ee705ede1e9225ee13c70c20.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:01:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:01:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bdd20cd50>
2026-03-28 19:01:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:01:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:01:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:01:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40f51b58-64e3-522b-b353-cfb584ce0272/40f51b58-64e3-522b-b353-cfb584ce0272_image_5.jpg HTTP/1.1" 201 0
2026-03-28 19:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F99%252Fd69919b27e0e123e0739ba5b8dff042d%252Fpa%252FAD33035_3c148d21ad3ab5eaf55c6fa4051d17df.jpg') HTTP/1.1" 204 0
2026-03-28 19:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/99/d69919b27e0e123e0739ba5b8dff042d/pa/AD33035_3c148d21ad3ab5eaf55c6fa4051d17df.jpg saved to cache
2026-03-28 19:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 40f51b58-64e3-522b-b353-cfb584ce0272
2026-03-28 19:01:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:01:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bd7389c10>
2026-03-28 19:01:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:01:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:01:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:01:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40f51b58-64e3-522b-b353-cfb584ce0272/40f51b58-64e3-522b-b353-cfb584ce0272_image_4.jpg HTTP/1.1" 201 0
2026-03-28 19:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F99%252Fd69919b27e0e123e0739ba5b8dff042d%252Fpa%252FAD33035_5e5b2aa3821ffc682f28eba3732b9037.jpg') HTTP/1.1" 204 0
2026-03-28 19:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/99/d69919b27e0e123e0739ba5b8dff042d/pa/AD33035_5e5b2aa3821ffc682f28eba3732b9037.jpg saved to cache
2026-03-28 19:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 40f51b58-64e3-522b-b353-cfb584ce0272
2026-03-28 19:01:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img82/93/8293cda6ebdb7e0de6737d6aa3d0fe55/pa/LL30088_753a44653ead6758ece7ee2e9f1ef200.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:01:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/30/7430fce1922f20b568f98dbee4fee982/pa/LE06198_118c444100459b022b55828a53dfb1eb.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:01:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/30/7430fce1922f20b568f98dbee4fee982/pa/LE06198_7c35d29a48411a1f9043388881d9dafb.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:01:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/d8/7ad8636655662408bdf1e8cefbe1b56d/pa/FE67699_33385392aeffa6a2f87c8dbcc5879d80.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:01:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img82/93/8293cda6ebdb7e0de6737d6aa3d0fe55/pa/LL30088_c68f39e386fd59f3cc9916824c74a7c3.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:01:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/f7/3cf759b784f0f8e17dcab15a2e8e9e5c/pa/SN61945_c524d714492954938b4b71035cf2cf1c.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:01:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/d8/7ad8636655662408bdf1e8cefbe1b56d/pa/FE67699_4b89cd8727c5d61a57bf8829edd83f24.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:01:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:01:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bd6277890>
2026-03-28 19:01:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:01:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:01:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:01:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_457c3195-896b-557f-a471-daa91da61c90/457c3195-896b-557f-a471-daa91da61c90_image_6.jpg HTTP/1.1" 201 0
2026-03-28 19:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252Ffc%252Fe2fc3de8c023f4680ae5980fc45e1086%252Fpa%252FSR45817_c57fee9b5d270f06bf609bc9d94f8984.jpg') HTTP/1.1" 204 0
2026-03-28 19:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/fc/e2fc3de8c023f4680ae5980fc45e1086/pa/SR45817_c57fee9b5d270f06bf609bc9d94f8984.jpg saved to cache
2026-03-28 19:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 457c3195-896b-557f-a471-daa91da61c90
2026-03-28 19:01:23 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 19:01:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:01:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bd685f190>
2026-03-28 19:01:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:01:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:01:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:01:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa4fe243-a109-598c-934e-d9090d7d464c/fa4fe243-a109-598c-934e-d9090d7d464c_image_8.jpg HTTP/1.1" 201 0
2026-03-28 19:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Fd8%252F99d8daf0854f81383878cbaa25a6afa1%252Fpa%252FXK63885_8571fadb4798735e63b0b0da256db3b8.jpg') HTTP/1.1" 204 0
2026-03-28 19:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/d8/99d8daf0854f81383878cbaa25a6afa1/pa/XK63885_8571fadb4798735e63b0b0da256db3b8.jpg saved to cache
2026-03-28 19:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item fa4fe243-a109-598c-934e-d9090d7d464c
2026-03-28 19:01:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:01:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bd6874390>
2026-03-28 19:01:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:01:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:01:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:01:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b73042b-cd7f-557a-83c4-ab3b0db13fbb/6b73042b-cd7f-557a-83c4-ab3b0db13fbb_image_0.jpg HTTP/1.1" 201 0
2026-03-28 19:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252F93%252F8293cda6ebdb7e0de6737d6aa3d0fe55%252Fpa%252FLL30088_e482e63966769857b9742e77bd0ce533.jpg') HTTP/1.1" 204 0
2026-03-28 19:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/93/8293cda6ebdb7e0de6737d6aa3d0fe55/pa/LL30088_e482e63966769857b9742e77bd0ce533.jpg saved to cache
2026-03-28 19:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6b73042b-cd7f-557a-83c4-ab3b0db13fbb
2026-03-28 19:01:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/d8/7ad8636655662408bdf1e8cefbe1b56d/pa/FE67699_eb501c97f9d57fe4baf8db98414a2d48.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:01:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/7b/8d7bb95a2c478917cc2c03efdf7a5550/pa/EW29368_9bf98fc399ad52907db60a8f245b4f72.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:01:23 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 19:01:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:01:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bd6850f10>
2026-03-28 19:01:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:01:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:01:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:01:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7e52919-9fef-5265-9a67-09711ed53cd2/e7e52919-9fef-5265-9a67-09711ed53cd2_image_0.jpg HTTP/1.1" 201 0
2026-03-28 19:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Ff7%252F3cf759b784f0f8e17dcab15a2e8e9e5c%252Fpa%252FSN61945_49973c4ddb3d2d8999f8f87e16d69284.jpg') HTTP/1.1" 204 0
2026-03-28 19:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/f7/3cf759b784f0f8e17dcab15a2e8e9e5c/pa/SN61945_49973c4ddb3d2d8999f8f87e16d69284.jpg saved to cache
2026-03-28 19:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e7e52919-9fef-5265-9a67-09711ed53cd2
2026-03-28 19:01:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:01:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bd624d810>
2026-03-28 19:01:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:01:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:01:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:01:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_457c3195-896b-557f-a471-daa91da61c90/457c3195-896b-557f-a471-daa91da61c90_image_8.jpg HTTP/1.1" 201 0
2026-03-28 19:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252Ffc%252Fe2fc3de8c023f4680ae5980fc45e1086%252Fpa%252FSR45817_eb53fb1be925b05c101570645e040099.jpg') HTTP/1.1" 204 0
2026-03-28 19:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/fc/e2fc3de8c023f4680ae5980fc45e1086/pa/SR45817_eb53fb1be925b05c101570645e040099.jpg saved to cache
2026-03-28 19:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 457c3195-896b-557f-a471-daa91da61c90
2026-03-28 19:01:23 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 19:01:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:01:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bd62a5750>
2026-03-28 19:01:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:01:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:01:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:01:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7e52919-9fef-5265-9a67-09711ed53cd2/e7e52919-9fef-5265-9a67-09711ed53cd2_image_4.jpg HTTP/1.1" 201 0
2026-03-28 19:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Ff7%252F3cf759b784f0f8e17dcab15a2e8e9e5c%252Fpa%252FSN61945_c9260713991c8efb71b8d802e7d3329f.jpg') HTTP/1.1" 204 0
2026-03-28 19:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/f7/3cf759b784f0f8e17dcab15a2e8e9e5c/pa/SN61945_c9260713991c8efb71b8d802e7d3329f.jpg saved to cache
2026-03-28 19:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e7e52919-9fef-5265-9a67-09711ed53cd2
2026-03-28 19:01:23 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 19:01:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:01:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bd62c55d0>
2026-03-28 19:01:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:01:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:01:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:01:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_457c3195-896b-557f-a471-daa91da61c90/457c3195-896b-557f-a471-daa91da61c90_image_1.jpg HTTP/1.1" 201 0
2026-03-28 19:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252Ffc%252Fe2fc3de8c023f4680ae5980fc45e1086%252Fpa%252FSR45817_615ff6b9c87ac440dae87f8c1317d5ff.jpg') HTTP/1.1" 204 0
2026-03-28 19:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/fc/e2fc3de8c023f4680ae5980fc45e1086/pa/SR45817_615ff6b9c87ac440dae87f8c1317d5ff.jpg saved to cache
2026-03-28 19:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 457c3195-896b-557f-a471-daa91da61c90
2026-03-28 19:01:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 19:01:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:01:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bd6276e90>
2026-03-28 19:01:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:01:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:01:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:01:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7e52919-9fef-5265-9a67-09711ed53cd2/e7e52919-9fef-5265-9a67-09711ed53cd2_image_3.jpg HTTP/1.1" 201 0
2026-03-28 19:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Ff7%252F3cf759b784f0f8e17dcab15a2e8e9e5c%252Fpa%252FSN61945_831a9c53ee705ede1e9225ee13c70c20.jpg') HTTP/1.1" 204 0
2026-03-28 19:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/f7/3cf759b784f0f8e17dcab15a2e8e9e5c/pa/SN61945_831a9c53ee705ede1e9225ee13c70c20.jpg saved to cache
2026-03-28 19:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e7e52919-9fef-5265-9a67-09711ed53cd2
2026-03-28 19:01:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:01:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bd62d7210>
2026-03-28 19:01:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:01:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:01:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:01:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b73042b-cd7f-557a-83c4-ab3b0db13fbb/6b73042b-cd7f-557a-83c4-ab3b0db13fbb_image_1.jpg HTTP/1.1" 201 0
2026-03-28 19:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252F93%252F8293cda6ebdb7e0de6737d6aa3d0fe55%252Fpa%252FLL30088_753a44653ead6758ece7ee2e9f1ef200.jpg') HTTP/1.1" 204 0
2026-03-28 19:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/93/8293cda6ebdb7e0de6737d6aa3d0fe55/pa/LL30088_753a44653ead6758ece7ee2e9f1ef200.jpg saved to cache
2026-03-28 19:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6b73042b-cd7f-557a-83c4-ab3b0db13fbb
2026-03-28 19:01:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:01:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bd6401cd0>
2026-03-28 19:01:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:01:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:01:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:01:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c1bedc77-12f4-5458-be21-8378521c399a/c1bedc77-12f4-5458-be21-8378521c399a_image_3.jpg HTTP/1.1" 201 0
2026-03-28 19:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252F30%252F7430fce1922f20b568f98dbee4fee982%252Fpa%252FLE06198_118c444100459b022b55828a53dfb1eb.jpg') HTTP/1.1" 204 0
2026-03-28 19:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/30/7430fce1922f20b568f98dbee4fee982/pa/LE06198_118c444100459b022b55828a53dfb1eb.jpg saved to cache
2026-03-28 19:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c1bedc77-12f4-5458-be21-8378521c399a
2026-03-28 19:01:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:01:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bd62d9d50>
2026-03-28 19:01:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:01:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:01:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:01:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c1bedc77-12f4-5458-be21-8378521c399a/c1bedc77-12f4-5458-be21-8378521c399a_image_1.jpg HTTP/1.1" 201 0
2026-03-28 19:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252F30%252F7430fce1922f20b568f98dbee4fee982%252Fpa%252FLE06198_7c35d29a48411a1f9043388881d9dafb.jpg') HTTP/1.1" 204 0
2026-03-28 19:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/30/7430fce1922f20b568f98dbee4fee982/pa/LE06198_7c35d29a48411a1f9043388881d9dafb.jpg saved to cache
2026-03-28 19:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c1bedc77-12f4-5458-be21-8378521c399a
2026-03-28 19:01:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:01:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bd6402210>
2026-03-28 19:01:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:01:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:01:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:01:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_56e25974-08fb-59db-864b-3f609a5f4900/56e25974-08fb-59db-864b-3f609a5f4900_image_3.jpg HTTP/1.1" 201 0
2026-03-28 19:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252Fd8%252F7ad8636655662408bdf1e8cefbe1b56d%252Fpa%252FFE67699_33385392aeffa6a2f87c8dbcc5879d80.jpg') HTTP/1.1" 204 0
2026-03-28 19:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/d8/7ad8636655662408bdf1e8cefbe1b56d/pa/FE67699_33385392aeffa6a2f87c8dbcc5879d80.jpg saved to cache
2026-03-28 19:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 56e25974-08fb-59db-864b-3f609a5f4900
2026-03-28 19:01:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:01:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bd63c1190>
2026-03-28 19:01:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:01:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:01:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:01:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b73042b-cd7f-557a-83c4-ab3b0db13fbb/6b73042b-cd7f-557a-83c4-ab3b0db13fbb_image_3.jpg HTTP/1.1" 201 0
2026-03-28 19:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252F93%252F8293cda6ebdb7e0de6737d6aa3d0fe55%252Fpa%252FLL30088_c68f39e386fd59f3cc9916824c74a7c3.jpg') HTTP/1.1" 204 0
2026-03-28 19:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/93/8293cda6ebdb7e0de6737d6aa3d0fe55/pa/LL30088_c68f39e386fd59f3cc9916824c74a7c3.jpg saved to cache
2026-03-28 19:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6b73042b-cd7f-557a-83c4-ab3b0db13fbb
2026-03-28 19:01:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:01:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bd624cbd0>
2026-03-28 19:01:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:01:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:01:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:01:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7e52919-9fef-5265-9a67-09711ed53cd2/e7e52919-9fef-5265-9a67-09711ed53cd2_image_9.jpg HTTP/1.1" 201 0
2026-03-28 19:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Ff7%252F3cf759b784f0f8e17dcab15a2e8e9e5c%252Fpa%252FSN61945_c524d714492954938b4b71035cf2cf1c.jpg') HTTP/1.1" 204 0
2026-03-28 19:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/f7/3cf759b784f0f8e17dcab15a2e8e9e5c/pa/SN61945_c524d714492954938b4b71035cf2cf1c.jpg saved to cache
2026-03-28 19:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e7e52919-9fef-5265-9a67-09711ed53cd2
2026-03-28 19:01:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:01:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bd72ed950>
2026-03-28 19:01:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:01:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:01:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:01:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_56e25974-08fb-59db-864b-3f609a5f4900/56e25974-08fb-59db-864b-3f609a5f4900_image_0.jpg HTTP/1.1" 201 0
2026-03-28 19:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252Fd8%252F7ad8636655662408bdf1e8cefbe1b56d%252Fpa%252FFE67699_4b89cd8727c5d61a57bf8829edd83f24.jpg') HTTP/1.1" 204 0
2026-03-28 19:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/d8/7ad8636655662408bdf1e8cefbe1b56d/pa/FE67699_4b89cd8727c5d61a57bf8829edd83f24.jpg saved to cache
2026-03-28 19:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 56e25974-08fb-59db-864b-3f609a5f4900
2026-03-28 19:01:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/7b/8d7bb95a2c478917cc2c03efdf7a5550/pa/EW29368_458f6d0e018aeffb72915016037a09e3.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:01:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:01:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/7b/8d7bb95a2c478917cc2c03efdf7a5550/pa/EW29368_f6b497b102a461ba836fcae1cafcdb93.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:01:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:01:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bd62cef10>
2026-03-28 19:01:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:01:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:01:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:01:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_56e25974-08fb-59db-864b-3f609a5f4900/56e25974-08fb-59db-864b-3f609a5f4900_image_2.jpg HTTP/1.1" 201 0
2026-03-28 19:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252Fd8%252F7ad8636655662408bdf1e8cefbe1b56d%252Fpa%252FFE67699_eb501c97f9d57fe4baf8db98414a2d48.jpg') HTTP/1.1" 204 0
2026-03-28 19:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/d8/7ad8636655662408bdf1e8cefbe1b56d/pa/FE67699_eb501c97f9d57fe4baf8db98414a2d48.jpg saved to cache
2026-03-28 19:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 56e25974-08fb-59db-864b-3f609a5f4900
2026-03-28 19:01:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:01:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bd63fe050>
2026-03-28 19:01:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:01:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:01:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:01:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_88954a77-5ac5-5492-89f5-094d7dabda53/88954a77-5ac5-5492-89f5-094d7dabda53_image_9.jpg HTTP/1.1" 201 0
2026-03-28 19:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F7b%252F8d7bb95a2c478917cc2c03efdf7a5550%252Fpa%252FEW29368_9bf98fc399ad52907db60a8f245b4f72.jpg') HTTP/1.1" 204 0
2026-03-28 19:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/7b/8d7bb95a2c478917cc2c03efdf7a5550/pa/EW29368_9bf98fc399ad52907db60a8f245b4f72.jpg saved to cache
2026-03-28 19:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 88954a77-5ac5-5492-89f5-094d7dabda53
2026-03-28 19:01:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/30/7430fce1922f20b568f98dbee4fee982/pa/LE06198_f17000af663c1594ba56b63757609e64.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:01:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/30/7430fce1922f20b568f98dbee4fee982/pa/LE06198_df0f2340d293b476c655f2d8d2796bdb.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:01:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/d8/7ad8636655662408bdf1e8cefbe1b56d/pa/FE67699_137cc146ba9c56c92657bd6978d2ae0c.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:01:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img82/93/8293cda6ebdb7e0de6737d6aa3d0fe55/pa/LL30088_2b3557bd96eb9596b3c0419128c86d41.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:01:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:01:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 19:01:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:01:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bd687ea90>
2026-03-28 19:01:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:01:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:01:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:01:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_88954a77-5ac5-5492-89f5-094d7dabda53/88954a77-5ac5-5492-89f5-094d7dabda53_image_6.jpg HTTP/1.1" 201 0
2026-03-28 19:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F7b%252F8d7bb95a2c478917cc2c03efdf7a5550%252Fpa%252FEW29368_458f6d0e018aeffb72915016037a09e3.jpg') HTTP/1.1" 204 0
2026-03-28 19:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/7b/8d7bb95a2c478917cc2c03efdf7a5550/pa/EW29368_458f6d0e018aeffb72915016037a09e3.jpg saved to cache
2026-03-28 19:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 88954a77-5ac5-5492-89f5-094d7dabda53
2026-03-28 19:01:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img82/93/8293cda6ebdb7e0de6737d6aa3d0fe55/pa/LL30088_dd952388b18daf9ac51550a1b158b608.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:01:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/7b/8d7bb95a2c478917cc2c03efdf7a5550/pa/EW29368_db2c73264477e6c32e9fa6b883491553.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:01:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/7b/8d7bb95a2c478917cc2c03efdf7a5550/pa/EW29368_fcec26882a2ad953b67156fdc38d7fea.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:01:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 19:01:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:01:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bd6242b10>
2026-03-28 19:01:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:01:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:01:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:01:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_88954a77-5ac5-5492-89f5-094d7dabda53/88954a77-5ac5-5492-89f5-094d7dabda53_image_7.jpg HTTP/1.1" 201 0
2026-03-28 19:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F7b%252F8d7bb95a2c478917cc2c03efdf7a5550%252Fpa%252FEW29368_f6b497b102a461ba836fcae1cafcdb93.jpg') HTTP/1.1" 204 0
2026-03-28 19:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/7b/8d7bb95a2c478917cc2c03efdf7a5550/pa/EW29368_f6b497b102a461ba836fcae1cafcdb93.jpg saved to cache
2026-03-28 19:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 88954a77-5ac5-5492-89f5-094d7dabda53
2026-03-28 19:01:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:01:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bd6859dd0>
2026-03-28 19:01:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:01:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:01:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:01:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c1bedc77-12f4-5458-be21-8378521c399a/c1bedc77-12f4-5458-be21-8378521c399a_image_5.jpg HTTP/1.1" 201 0
2026-03-28 19:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252F30%252F7430fce1922f20b568f98dbee4fee982%252Fpa%252FLE06198_f17000af663c1594ba56b63757609e64.jpg') HTTP/1.1" 204 0
2026-03-28 19:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/30/7430fce1922f20b568f98dbee4fee982/pa/LE06198_f17000af663c1594ba56b63757609e64.jpg saved to cache
2026-03-28 19:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c1bedc77-12f4-5458-be21-8378521c399a
2026-03-28 19:01:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:01:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bd63d6950>
2026-03-28 19:01:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:01:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:01:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:01:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c1bedc77-12f4-5458-be21-8378521c399a/c1bedc77-12f4-5458-be21-8378521c399a_image_4.jpg HTTP/1.1" 201 0
2026-03-28 19:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252F30%252F7430fce1922f20b568f98dbee4fee982%252Fpa%252FLE06198_df0f2340d293b476c655f2d8d2796bdb.jpg') HTTP/1.1" 204 0
2026-03-28 19:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/30/7430fce1922f20b568f98dbee4fee982/pa/LE06198_df0f2340d293b476c655f2d8d2796bdb.jpg saved to cache
2026-03-28 19:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c1bedc77-12f4-5458-be21-8378521c399a
2026-03-28 19:01:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:01:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bd71d9a10>
2026-03-28 19:01:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:01:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:01:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:01:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_56e25974-08fb-59db-864b-3f609a5f4900/56e25974-08fb-59db-864b-3f609a5f4900_image_1.jpg HTTP/1.1" 201 0
2026-03-28 19:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252Fd8%252F7ad8636655662408bdf1e8cefbe1b56d%252Fpa%252FFE67699_137cc146ba9c56c92657bd6978d2ae0c.jpg') HTTP/1.1" 204 0
2026-03-28 19:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/d8/7ad8636655662408bdf1e8cefbe1b56d/pa/FE67699_137cc146ba9c56c92657bd6978d2ae0c.jpg saved to cache
2026-03-28 19:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 56e25974-08fb-59db-864b-3f609a5f4900
2026-03-28 19:01:24 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 56e25974-08fb-59db-864b-3f609a5f4900, skipping ID generation
2026-03-28 19:01:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 56e25974-08fb-59db-864b-3f609a5f4900 with scrape type 1
2026-03-28 19:01:24 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 56e25974-08fb-59db-864b-3f609a5f4900 sending to next pipeline
2026-03-28 19:01:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 56e25974-08fb-59db-864b-3f609a5f4900, identifier: FE67699
2026-03-28 19:01:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:01:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bdd5c3bd0>
2026-03-28 19:01:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:01:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:01:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:01:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b73042b-cd7f-557a-83c4-ab3b0db13fbb/6b73042b-cd7f-557a-83c4-ab3b0db13fbb_image_4.jpg HTTP/1.1" 201 0
2026-03-28 19:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252F93%252F8293cda6ebdb7e0de6737d6aa3d0fe55%252Fpa%252FLL30088_2b3557bd96eb9596b3c0419128c86d41.jpg') HTTP/1.1" 204 0
2026-03-28 19:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/93/8293cda6ebdb7e0de6737d6aa3d0fe55/pa/LL30088_2b3557bd96eb9596b3c0419128c86d41.jpg saved to cache
2026-03-28 19:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6b73042b-cd7f-557a-83c4-ab3b0db13fbb
2026-03-28 19:01:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/7b/8d7bb95a2c478917cc2c03efdf7a5550/pa/EW29368_cf4d42f6f5e25e1aee611e9390bb9b14.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:01:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 56e25974-08fb-59db-864b-3f609a5f4900 with identifier: FE67699
2026-03-28 19:01:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 56e25974-08fb-59db-864b-3f609a5f4900 with identifier: FE67699
2026-03-28 19:01:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 56e25974-08fb-59db-864b-3f609a5f4900 with identifier: FE67699 to the API
2026-03-28 19:01:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 19:01:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 19:01:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img7a/d8/7ad8636655662408bdf1e8cefbe1b56d/pa/FE67699_137cc146ba9c56c92657bd6978d2ae0c.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 190,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '2.0L',
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:49:26Z',
 'fuel_type': 'petrol',
 'id': '56e25974-08fb-59db-864b-3f609a5f4900',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '49STKG',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FE67699',
 'listing': 'auction',
 'location': 'NL, Roermond',
 'make': 'Hyundai',
 'model': 'Tucson',
 'odometer': 121743,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 4,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_56e25974-08fb-59db-864b-3f609a5f4900/56e25974-08fb-59db-864b-3f609a5f4900_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72636,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7a/d8/7ad8636655662408bdf1e8cefbe1b56d/pa/FE67699_4b89cd8727c5d61a57bf8829edd83f24.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_56e25974-08fb-59db-864b-3f609a5f4900/56e25974-08fb-59db-864b-3f609a5f4900_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75980,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7a/d8/7ad8636655662408bdf1e8cefbe1b56d/pa/FE67699_137cc146ba9c56c92657bd6978d2ae0c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_56e25974-08fb-59db-864b-3f609a5f4900/56e25974-08fb-59db-864b-3f609a5f4900_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71893,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7a/d8/7ad8636655662408bdf1e8cefbe1b56d/pa/FE67699_eb501c97f9d57fe4baf8db98414a2d48.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_56e25974-08fb-59db-864b-3f609a5f4900/56e25974-08fb-59db-864b-3f609a5f4900_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57825,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7a/d8/7ad8636655662408bdf1e8cefbe1b56d/pa/FE67699_33385392aeffa6a2f87c8dbcc5879d80.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2006-05-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Hyundai Tucson 2.0 FIFA World Cup',
 'transmission': 'manual',
 'trim': 'FIFA World Cup',
 'year': 2006}
2026-03-28 19:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FE67699%27 HTTP/1.1" 200 None
2026-03-28 19:01:26 [auto1.nl] INFO: Saving data for FE67699: {'created_time': 1774724486.229651, 'last_price_update_time': 1774724486.229662, 'auction_closing_time': 1774885766.0}
2026-03-28 19:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='FE67699') HTTP/1.1" 204 0
2026-03-28 19:01:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img82/93/8293cda6ebdb7e0de6737d6aa3d0fe55/pa/LL30088_8f08f3a29e86fd193c4cb548fe2d7a42.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:01:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/30/7430fce1922f20b568f98dbee4fee982/pa/LE06198_11f64d4d1fdb0adceed28fd5cca09cb7.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:01:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/7b/8d7bb95a2c478917cc2c03efdf7a5550/pa/EW29368_0e24a84fabe7daa6b42f547fbdc1d4da.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:01:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/7b/8d7bb95a2c478917cc2c03efdf7a5550/pa/EW29368_b76a456660a1a6d5c4dfeffab438b37b.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:01:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:01:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bd721c110>
2026-03-28 19:01:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:01:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:01:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:01:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b73042b-cd7f-557a-83c4-ab3b0db13fbb/6b73042b-cd7f-557a-83c4-ab3b0db13fbb_image_5.jpg HTTP/1.1" 201 0
2026-03-28 19:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252F93%252F8293cda6ebdb7e0de6737d6aa3d0fe55%252Fpa%252FLL30088_dd952388b18daf9ac51550a1b158b608.jpg') HTTP/1.1" 204 0
2026-03-28 19:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/93/8293cda6ebdb7e0de6737d6aa3d0fe55/pa/LL30088_dd952388b18daf9ac51550a1b158b608.jpg saved to cache
2026-03-28 19:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6b73042b-cd7f-557a-83c4-ab3b0db13fbb
2026-03-28 19:01:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 19:01:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:01:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bd6239cd0>
2026-03-28 19:01:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:01:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:01:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:01:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_88954a77-5ac5-5492-89f5-094d7dabda53/88954a77-5ac5-5492-89f5-094d7dabda53_image_8.jpg HTTP/1.1" 201 0
2026-03-28 19:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F7b%252F8d7bb95a2c478917cc2c03efdf7a5550%252Fpa%252FEW29368_db2c73264477e6c32e9fa6b883491553.jpg') HTTP/1.1" 204 0
2026-03-28 19:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/7b/8d7bb95a2c478917cc2c03efdf7a5550/pa/EW29368_db2c73264477e6c32e9fa6b883491553.jpg saved to cache
2026-03-28 19:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 88954a77-5ac5-5492-89f5-094d7dabda53
2026-03-28 19:01:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 19:01:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:01:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bdd21bf10>
2026-03-28 19:01:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:01:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:01:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:01:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_88954a77-5ac5-5492-89f5-094d7dabda53/88954a77-5ac5-5492-89f5-094d7dabda53_image_5.jpg HTTP/1.1" 201 0
2026-03-28 19:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F7b%252F8d7bb95a2c478917cc2c03efdf7a5550%252Fpa%252FEW29368_fcec26882a2ad953b67156fdc38d7fea.jpg') HTTP/1.1" 204 0
2026-03-28 19:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/7b/8d7bb95a2c478917cc2c03efdf7a5550/pa/EW29368_fcec26882a2ad953b67156fdc38d7fea.jpg saved to cache
2026-03-28 19:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 88954a77-5ac5-5492-89f5-094d7dabda53
2026-03-28 19:01:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 19:01:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:01:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bd71a9790>
2026-03-28 19:01:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:01:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:01:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:01:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_88954a77-5ac5-5492-89f5-094d7dabda53/88954a77-5ac5-5492-89f5-094d7dabda53_image_4.jpg HTTP/1.1" 201 0
2026-03-28 19:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F7b%252F8d7bb95a2c478917cc2c03efdf7a5550%252Fpa%252FEW29368_cf4d42f6f5e25e1aee611e9390bb9b14.jpg') HTTP/1.1" 204 0
2026-03-28 19:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/7b/8d7bb95a2c478917cc2c03efdf7a5550/pa/EW29368_cf4d42f6f5e25e1aee611e9390bb9b14.jpg saved to cache
2026-03-28 19:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 88954a77-5ac5-5492-89f5-094d7dabda53
2026-03-28 19:01:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/99/d69919b27e0e123e0739ba5b8dff042d/pa/AD33035_e2cbb61a97676a2ea2e4b6852aeb141b.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:01:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/7b/8d7bb95a2c478917cc2c03efdf7a5550/pa/EW29368_8812676cfc01b79f3959bfa2cd219338.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:01:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/30/7430fce1922f20b568f98dbee4fee982/pa/LE06198_5e050a974d359d8a51ac4e7a758d44cb.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:01:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/7b/8d7bb95a2c478917cc2c03efdf7a5550/pa/EW29368_d891a909ff2de25be5baa55c6eab9982.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:01:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:01:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bdc115f50>
2026-03-28 19:01:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:01:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:01:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:01:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b73042b-cd7f-557a-83c4-ab3b0db13fbb/6b73042b-cd7f-557a-83c4-ab3b0db13fbb_image_2.jpg HTTP/1.1" 201 0
2026-03-28 19:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252F93%252F8293cda6ebdb7e0de6737d6aa3d0fe55%252Fpa%252FLL30088_8f08f3a29e86fd193c4cb548fe2d7a42.jpg') HTTP/1.1" 204 0
2026-03-28 19:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/93/8293cda6ebdb7e0de6737d6aa3d0fe55/pa/LL30088_8f08f3a29e86fd193c4cb548fe2d7a42.jpg saved to cache
2026-03-28 19:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6b73042b-cd7f-557a-83c4-ab3b0db13fbb
2026-03-28 19:01:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6b73042b-cd7f-557a-83c4-ab3b0db13fbb, skipping ID generation
2026-03-28 19:01:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6b73042b-cd7f-557a-83c4-ab3b0db13fbb with scrape type 1
2026-03-28 19:01:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6b73042b-cd7f-557a-83c4-ab3b0db13fbb sending to next pipeline
2026-03-28 19:01:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 6b73042b-cd7f-557a-83c4-ab3b0db13fbb, identifier: LL30088
2026-03-28 19:01:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:01:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bd7378a50>
2026-03-28 19:01:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:01:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:01:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:01:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c1bedc77-12f4-5458-be21-8378521c399a/c1bedc77-12f4-5458-be21-8378521c399a_image_2.jpg HTTP/1.1" 201 0
2026-03-28 19:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252F30%252F7430fce1922f20b568f98dbee4fee982%252Fpa%252FLE06198_11f64d4d1fdb0adceed28fd5cca09cb7.jpg') HTTP/1.1" 204 0
2026-03-28 19:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/30/7430fce1922f20b568f98dbee4fee982/pa/LE06198_11f64d4d1fdb0adceed28fd5cca09cb7.jpg saved to cache
2026-03-28 19:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c1bedc77-12f4-5458-be21-8378521c399a
2026-03-28 19:01:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:01:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bd6803fd0>
2026-03-28 19:01:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:01:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:01:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:01:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_88954a77-5ac5-5492-89f5-094d7dabda53/88954a77-5ac5-5492-89f5-094d7dabda53_image_3.jpg HTTP/1.1" 201 0
2026-03-28 19:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F7b%252F8d7bb95a2c478917cc2c03efdf7a5550%252Fpa%252FEW29368_0e24a84fabe7daa6b42f547fbdc1d4da.jpg') HTTP/1.1" 204 0
2026-03-28 19:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/7b/8d7bb95a2c478917cc2c03efdf7a5550/pa/EW29368_0e24a84fabe7daa6b42f547fbdc1d4da.jpg saved to cache
2026-03-28 19:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 88954a77-5ac5-5492-89f5-094d7dabda53
2026-03-28 19:01:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:01:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bdd4ef290>
2026-03-28 19:01:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:01:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:01:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:01:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_88954a77-5ac5-5492-89f5-094d7dabda53/88954a77-5ac5-5492-89f5-094d7dabda53_image_2.jpg HTTP/1.1" 201 0
2026-03-28 19:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F7b%252F8d7bb95a2c478917cc2c03efdf7a5550%252Fpa%252FEW29368_b76a456660a1a6d5c4dfeffab438b37b.jpg') HTTP/1.1" 204 0
2026-03-28 19:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/7b/8d7bb95a2c478917cc2c03efdf7a5550/pa/EW29368_b76a456660a1a6d5c4dfeffab438b37b.jpg saved to cache
2026-03-28 19:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 88954a77-5ac5-5492-89f5-094d7dabda53
2026-03-28 19:01:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 6b73042b-cd7f-557a-83c4-ab3b0db13fbb with identifier: LL30088
2026-03-28 19:01:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 6b73042b-cd7f-557a-83c4-ab3b0db13fbb with identifier: LL30088
2026-03-28 19:01:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 6b73042b-cd7f-557a-83c4-ab3b0db13fbb with identifier: LL30088 to the API
2026-03-28 19:01:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 19:01:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 19:01:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img82/93/8293cda6ebdb7e0de6737d6aa3d0fe55/pa/LL30088_8f08f3a29e86fd193c4cb548fe2d7a42.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.0L',
 'engine_horse_power': 68,
 'expiration_date': '2026-03-30T15:17:41Z',
 'fuel_type': 'petrol',
 'id': '6b73042b-cd7f-557a-83c4-ab3b0db13fbb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '45NKZ9',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LL30088',
 'listing': 'auction',
 'location': 'NL, Leiderdorp',
 'make': 'Peugeot',
 'model': '107',
 'odometer': 87734,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b73042b-cd7f-557a-83c4-ab3b0db13fbb/6b73042b-cd7f-557a-83c4-ab3b0db13fbb_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80978,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img82/93/8293cda6ebdb7e0de6737d6aa3d0fe55/pa/LL30088_e482e63966769857b9742e77bd0ce533.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b73042b-cd7f-557a-83c4-ab3b0db13fbb/6b73042b-cd7f-557a-83c4-ab3b0db13fbb_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92703,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img82/93/8293cda6ebdb7e0de6737d6aa3d0fe55/pa/LL30088_753a44653ead6758ece7ee2e9f1ef200.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b73042b-cd7f-557a-83c4-ab3b0db13fbb/6b73042b-cd7f-557a-83c4-ab3b0db13fbb_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72412,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img82/93/8293cda6ebdb7e0de6737d6aa3d0fe55/pa/LL30088_8f08f3a29e86fd193c4cb548fe2d7a42.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b73042b-cd7f-557a-83c4-ab3b0db13fbb/6b73042b-cd7f-557a-83c4-ab3b0db13fbb_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64576,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img82/93/8293cda6ebdb7e0de6737d6aa3d0fe55/pa/LL30088_c68f39e386fd59f3cc9916824c74a7c3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b73042b-cd7f-557a-83c4-ab3b0db13fbb/6b73042b-cd7f-557a-83c4-ab3b0db13fbb_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92790,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img82/93/8293cda6ebdb7e0de6737d6aa3d0fe55/pa/LL30088_2b3557bd96eb9596b3c0419128c86d41.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b73042b-cd7f-557a-83c4-ab3b0db13fbb/6b73042b-cd7f-557a-83c4-ab3b0db13fbb_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91591,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img82/93/8293cda6ebdb7e0de6737d6aa3d0fe55/pa/LL30088_dd952388b18daf9ac51550a1b158b608.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2010-10-14',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Peugeot 107 1.0 Filou',
 'transmission': 'manual',
 'trim': 'Filou',
 'year': 2010}
2026-03-28 19:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LL30088%27 HTTP/1.1" 200 None
2026-03-28 19:01:27 [auto1.nl] INFO: Saving data for LL30088: {'created_time': 1774724487.405923, 'last_price_update_time': 1774724487.405938, 'auction_closing_time': 1774883861.0}
2026-03-28 19:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='LL30088') HTTP/1.1" 204 0
2026-03-28 19:01:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge8/78/e878909c4317c113ebf05415750ca275/pa/ZN70459_f7cf27267767877c9ed5fe1380c5beca.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:01:27 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 19:01:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/fc/e2fc3de8c023f4680ae5980fc45e1086/pa/SR45817_d4b5bfa61fdefc0eb4481cdf91bd20d8.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:01:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/fc/e2fc3de8c023f4680ae5980fc45e1086/pa/SR45817_d7474e1fa1dde58a1075ab29b940f06c.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:01:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HW32084> (referer: https://www.auto1.com/v1/car-details-view/HW32084/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 19:01:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:01:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:01:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bd6803710>
2026-03-28 19:01:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:01:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:01:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:01:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40f51b58-64e3-522b-b353-cfb584ce0272/40f51b58-64e3-522b-b353-cfb584ce0272_image_6.jpg HTTP/1.1" 201 0
2026-03-28 19:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F99%252Fd69919b27e0e123e0739ba5b8dff042d%252Fpa%252FAD33035_e2cbb61a97676a2ea2e4b6852aeb141b.jpg') HTTP/1.1" 204 0
2026-03-28 19:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/99/d69919b27e0e123e0739ba5b8dff042d/pa/AD33035_e2cbb61a97676a2ea2e4b6852aeb141b.jpg saved to cache
2026-03-28 19:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 40f51b58-64e3-522b-b353-cfb584ce0272
2026-03-28 19:01:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:01:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bd68dd410>
2026-03-28 19:01:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:01:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:01:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:01:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_88954a77-5ac5-5492-89f5-094d7dabda53/88954a77-5ac5-5492-89f5-094d7dabda53_image_1.jpg HTTP/1.1" 201 0
2026-03-28 19:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F7b%252F8d7bb95a2c478917cc2c03efdf7a5550%252Fpa%252FEW29368_8812676cfc01b79f3959bfa2cd219338.jpg') HTTP/1.1" 204 0
2026-03-28 19:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/7b/8d7bb95a2c478917cc2c03efdf7a5550/pa/EW29368_8812676cfc01b79f3959bfa2cd219338.jpg saved to cache
2026-03-28 19:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 88954a77-5ac5-5492-89f5-094d7dabda53
2026-03-28 19:01:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:01:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bd68ae590>
2026-03-28 19:01:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:01:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:01:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:01:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c1bedc77-12f4-5458-be21-8378521c399a/c1bedc77-12f4-5458-be21-8378521c399a_image_0.jpg HTTP/1.1" 201 0
2026-03-28 19:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252F30%252F7430fce1922f20b568f98dbee4fee982%252Fpa%252FLE06198_5e050a974d359d8a51ac4e7a758d44cb.jpg') HTTP/1.1" 204 0
2026-03-28 19:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/30/7430fce1922f20b568f98dbee4fee982/pa/LE06198_5e050a974d359d8a51ac4e7a758d44cb.jpg saved to cache
2026-03-28 19:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c1bedc77-12f4-5458-be21-8378521c399a
2026-03-28 19:01:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c1bedc77-12f4-5458-be21-8378521c399a, skipping ID generation
2026-03-28 19:01:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c1bedc77-12f4-5458-be21-8378521c399a with scrape type 1
2026-03-28 19:01:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c1bedc77-12f4-5458-be21-8378521c399a sending to next pipeline
2026-03-28 19:01:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: c1bedc77-12f4-5458-be21-8378521c399a, identifier: LE06198
2026-03-28 19:01:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:01:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bd7110b10>
2026-03-28 19:01:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:01:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:01:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:01:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_88954a77-5ac5-5492-89f5-094d7dabda53/88954a77-5ac5-5492-89f5-094d7dabda53_image_0.jpg HTTP/1.1" 201 0
2026-03-28 19:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F7b%252F8d7bb95a2c478917cc2c03efdf7a5550%252Fpa%252FEW29368_d891a909ff2de25be5baa55c6eab9982.jpg') HTTP/1.1" 204 0
2026-03-28 19:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/7b/8d7bb95a2c478917cc2c03efdf7a5550/pa/EW29368_d891a909ff2de25be5baa55c6eab9982.jpg saved to cache
2026-03-28 19:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 88954a77-5ac5-5492-89f5-094d7dabda53
2026-03-28 19:01:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 88954a77-5ac5-5492-89f5-094d7dabda53, skipping ID generation
2026-03-28 19:01:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 88954a77-5ac5-5492-89f5-094d7dabda53 with scrape type 1
2026-03-28 19:01:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 88954a77-5ac5-5492-89f5-094d7dabda53 sending to next pipeline
2026-03-28 19:01:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 88954a77-5ac5-5492-89f5-094d7dabda53, identifier: EW29368
2026-03-28 19:01:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: c1bedc77-12f4-5458-be21-8378521c399a with identifier: LE06198
2026-03-28 19:01:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: c1bedc77-12f4-5458-be21-8378521c399a with identifier: LE06198
2026-03-28 19:01:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: c1bedc77-12f4-5458-be21-8378521c399a with identifier: LE06198 to the API
2026-03-28 19:01:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 19:01:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 19:01:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img74/30/7430fce1922f20b568f98dbee4fee982/pa/LE06198_5e050a974d359d8a51ac4e7a758d44cb.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '2.5L',
 'engine_horse_power': 220,
 'expiration_date': '2026-03-30T15:48:02Z',
 'fuel_type': 'petrol',
 'id': 'c1bedc77-12f4-5458-be21-8378521c399a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '10zpsx',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LE06198',
 'listing': 'auction',
 'location': 'NL, Amersfoort',
 'make': 'Ford',
 'model': 'S-Max',
 'odometer': 296356,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c1bedc77-12f4-5458-be21-8378521c399a/c1bedc77-12f4-5458-be21-8378521c399a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88804,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img74/30/7430fce1922f20b568f98dbee4fee982/pa/LE06198_5e050a974d359d8a51ac4e7a758d44cb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c1bedc77-12f4-5458-be21-8378521c399a/c1bedc77-12f4-5458-be21-8378521c399a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71781,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img74/30/7430fce1922f20b568f98dbee4fee982/pa/LE06198_7c35d29a48411a1f9043388881d9dafb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c1bedc77-12f4-5458-be21-8378521c399a/c1bedc77-12f4-5458-be21-8378521c399a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72364,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img74/30/7430fce1922f20b568f98dbee4fee982/pa/LE06198_11f64d4d1fdb0adceed28fd5cca09cb7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c1bedc77-12f4-5458-be21-8378521c399a/c1bedc77-12f4-5458-be21-8378521c399a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53440,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img74/30/7430fce1922f20b568f98dbee4fee982/pa/LE06198_118c444100459b022b55828a53dfb1eb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c1bedc77-12f4-5458-be21-8378521c399a/c1bedc77-12f4-5458-be21-8378521c399a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67079,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img74/30/7430fce1922f20b568f98dbee4fee982/pa/LE06198_df0f2340d293b476c655f2d8d2796bdb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c1bedc77-12f4-5458-be21-8378521c399a/c1bedc77-12f4-5458-be21-8378521c399a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54428,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img74/30/7430fce1922f20b568f98dbee4fee982/pa/LE06198_f17000af663c1594ba56b63757609e64.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2008-04-27',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Ford S-Max 2.5 Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2008}
2026-03-28 19:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LE06198%27 HTTP/1.1" 200 None
2026-03-28 19:01:28 [auto1.nl] INFO: Saving data for LE06198: {'created_time': 1774724488.178187, 'last_price_update_time': 1774724488.178197, 'auction_closing_time': 1774885682.0}
2026-03-28 19:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='LE06198') HTTP/1.1" 204 0
2026-03-28 19:01:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 88954a77-5ac5-5492-89f5-094d7dabda53 with identifier: EW29368
2026-03-28 19:01:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 88954a77-5ac5-5492-89f5-094d7dabda53 with identifier: EW29368
2026-03-28 19:01:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 88954a77-5ac5-5492-89f5-094d7dabda53 with identifier: EW29368 to the API
2026-03-28 19:01:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 19:01:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 19:01:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img8d/7b/8d7bb95a2c478917cc2c03efdf7a5550/pa/EW29368_d891a909ff2de25be5baa55c6eab9982.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 200,
 'expiration_date': '2026-03-30T15:51:53Z',
 'fuel_type': 'petrol',
 'id': '88954a77-5ac5-5492-89f5-094d7dabda53',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'T604PT',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EW29368',
 'listing': 'auction',
 'location': 'NL, Delft',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 180738,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_88954a77-5ac5-5492-89f5-094d7dabda53/88954a77-5ac5-5492-89f5-094d7dabda53_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71048,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/7b/8d7bb95a2c478917cc2c03efdf7a5550/pa/EW29368_d891a909ff2de25be5baa55c6eab9982.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_88954a77-5ac5-5492-89f5-094d7dabda53/88954a77-5ac5-5492-89f5-094d7dabda53_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69889,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/7b/8d7bb95a2c478917cc2c03efdf7a5550/pa/EW29368_8812676cfc01b79f3959bfa2cd219338.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_88954a77-5ac5-5492-89f5-094d7dabda53/88954a77-5ac5-5492-89f5-094d7dabda53_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71484,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/7b/8d7bb95a2c478917cc2c03efdf7a5550/pa/EW29368_b76a456660a1a6d5c4dfeffab438b37b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_88954a77-5ac5-5492-89f5-094d7dabda53/88954a77-5ac5-5492-89f5-094d7dabda53_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73230,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/7b/8d7bb95a2c478917cc2c03efdf7a5550/pa/EW29368_0e24a84fabe7daa6b42f547fbdc1d4da.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_88954a77-5ac5-5492-89f5-094d7dabda53/88954a77-5ac5-5492-89f5-094d7dabda53_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 274039,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/7b/8d7bb95a2c478917cc2c03efdf7a5550/pa/EW29368_cf4d42f6f5e25e1aee611e9390bb9b14.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_88954a77-5ac5-5492-89f5-094d7dabda53/88954a77-5ac5-5492-89f5-094d7dabda53_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 305404,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/7b/8d7bb95a2c478917cc2c03efdf7a5550/pa/EW29368_fcec26882a2ad953b67156fdc38d7fea.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_88954a77-5ac5-5492-89f5-094d7dabda53/88954a77-5ac5-5492-89f5-094d7dabda53_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 310303,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/7b/8d7bb95a2c478917cc2c03efdf7a5550/pa/EW29368_458f6d0e018aeffb72915016037a09e3.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_88954a77-5ac5-5492-89f5-094d7dabda53/88954a77-5ac5-5492-89f5-094d7dabda53_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 329676,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/7b/8d7bb95a2c478917cc2c03efdf7a5550/pa/EW29368_f6b497b102a461ba836fcae1cafcdb93.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_88954a77-5ac5-5492-89f5-094d7dabda53/88954a77-5ac5-5492-89f5-094d7dabda53_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 311596,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/7b/8d7bb95a2c478917cc2c03efdf7a5550/pa/EW29368_db2c73264477e6c32e9fa6b883491553.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_88954a77-5ac5-5492-89f5-094d7dabda53/88954a77-5ac5-5492-89f5-094d7dabda53_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65083,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/7b/8d7bb95a2c478917cc2c03efdf7a5550/pa/EW29368_9bf98fc399ad52907db60a8f245b4f72.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-09-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A3 Sportback 2.0 TFSI quattro Ambiente',
 'transmission': 'automatic',
 'trim': 'quattro Ambiente',
 'year': 2011}
2026-03-28 19:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EW29368%27 HTTP/1.1" 200 None
2026-03-28 19:01:28 [auto1.nl] INFO: Saving data for EW29368: {'created_time': 1774724488.56095, 'last_price_update_time': 1774724488.560963, 'auction_closing_time': 1774885913.0}
2026-03-28 19:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='EW29368') HTTP/1.1" 204 0
2026-03-28 19:01:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/99/d69919b27e0e123e0739ba5b8dff042d/pa/AD33035_6ff77c4e6f1e25fe8c65b9778b878f03.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:01:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge8/78/e878909c4317c113ebf05415750ca275/pa/ZN70459_fdb8bf19dda42efdeb8ce53b8cc478ac.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:01:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/fc/e2fc3de8c023f4680ae5980fc45e1086/pa/SR45817_76d7f5916f08fbc010eb4f762e8ebae3.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:01:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:01:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bd737c590>
2026-03-28 19:01:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:01:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:01:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:01:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47753836-04a1-5002-928e-0723ecea2118/47753836-04a1-5002-928e-0723ecea2118_image_3.jpg HTTP/1.1" 201 0
2026-03-28 19:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252F78%252Fe878909c4317c113ebf05415750ca275%252Fpa%252FZN70459_f7cf27267767877c9ed5fe1380c5beca.jpg') HTTP/1.1" 204 0
2026-03-28 19:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/78/e878909c4317c113ebf05415750ca275/pa/ZN70459_f7cf27267767877c9ed5fe1380c5beca.jpg saved to cache
2026-03-28 19:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 47753836-04a1-5002-928e-0723ecea2118
2026-03-28 19:01:28 [auto1.nl] INFO: Channel: 24h | Page: 17 | totalHits: 646 | hits on page: 6
2026-03-28 19:01:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:01:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bd6240c50>
2026-03-28 19:01:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:01:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:01:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:01:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_457c3195-896b-557f-a471-daa91da61c90/457c3195-896b-557f-a471-daa91da61c90_image_7.jpg HTTP/1.1" 201 0
2026-03-28 19:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252Ffc%252Fe2fc3de8c023f4680ae5980fc45e1086%252Fpa%252FSR45817_d4b5bfa61fdefc0eb4481cdf91bd20d8.jpg') HTTP/1.1" 204 0
2026-03-28 19:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/fc/e2fc3de8c023f4680ae5980fc45e1086/pa/SR45817_d4b5bfa61fdefc0eb4481cdf91bd20d8.jpg saved to cache
2026-03-28 19:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 457c3195-896b-557f-a471-daa91da61c90
2026-03-28 19:01:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:01:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bdd4efe10>
2026-03-28 19:01:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:01:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:01:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:01:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_457c3195-896b-557f-a471-daa91da61c90/457c3195-896b-557f-a471-daa91da61c90_image_3.jpg HTTP/1.1" 201 0
2026-03-28 19:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252Ffc%252Fe2fc3de8c023f4680ae5980fc45e1086%252Fpa%252FSR45817_d7474e1fa1dde58a1075ab29b940f06c.jpg') HTTP/1.1" 204 0
2026-03-28 19:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/fc/e2fc3de8c023f4680ae5980fc45e1086/pa/SR45817_d7474e1fa1dde58a1075ab29b940f06c.jpg saved to cache
2026-03-28 19:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 457c3195-896b-557f-a471-daa91da61c90
2026-03-28 19:01:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2323dac1-0e73-5dbf-8093-7e25247de99c with identifier: HW32084
2026-03-28 19:01:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2323dac1-0e73-5dbf-8093-7e25247de99c with scrape type 1
2026-03-28 19:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2323dac1-0e73-5dbf-8093-7e25247de99c
2026-03-28 19:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F71%252F9471ecc81901b5c57fd03af4059721fd%252Fpa%252FHW32084_f29368ee6bd14e46861e95c608d96625.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/71/9471ecc81901b5c57fd03af4059721fd/pa/HW32084_f29368ee6bd14e46861e95c608d96625.jpg not downloaded yet
2026-03-28 19:01:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:01:28 [auto1.nl] INFO: Found listing with ID: AW17903
2026-03-28 19:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AW17903%27 HTTP/1.1" 200 None
2026-03-28 19:01:28 [auto1.nl] INFO: Scrape type for AW17903: 0
2026-03-28 19:01:28 [auto1.nl] INFO: Found listing with ID: EP93197
2026-03-28 19:01:28 [auto1.nl] INFO: Found listing with ID: DT42929
2026-03-28 19:01:28 [auto1.nl] INFO: Found listing with ID: NC22018
2026-03-28 19:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NC22018%27 HTTP/1.1" 200 None
2026-03-28 19:01:28 [auto1.nl] INFO: Scrape type for NC22018: 0
2026-03-28 19:01:28 [auto1.nl] INFO: Found listing with ID: AV73218
2026-03-28 19:01:28 [auto1.nl] INFO: Found listing with ID: ZG49112
2026-03-28 19:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZG49112%27 HTTP/1.1" 200 None
2026-03-28 19:01:28 [auto1.nl] INFO: Scrape type for ZG49112: 0
2026-03-28 19:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F71%252F9471ecc81901b5c57fd03af4059721fd%252Fpa%252FHW32084_59070ccb3cf8bf0ded866b9602330226.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/71/9471ecc81901b5c57fd03af4059721fd/pa/HW32084_59070ccb3cf8bf0ded866b9602330226.jpg not downloaded yet
2026-03-28 19:01:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/f7/3cf759b784f0f8e17dcab15a2e8e9e5c/pa/SN61945_eeb5b5c2a06987a0ba5d9d06b1428330.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:01:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/f7/3cf759b784f0f8e17dcab15a2e8e9e5c/pa/SN61945_03c4350ad8f7648900a060b8ce79738b.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F71%252F9471ecc81901b5c57fd03af4059721fd%252Fpa%252FHW32084_37d12a269edba1bbb459883d81f84a88.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/71/9471ecc81901b5c57fd03af4059721fd/pa/HW32084_37d12a269edba1bbb459883d81f84a88.jpg not downloaded yet
2026-03-28 19:01:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:01:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bd71245d0>
2026-03-28 19:01:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:01:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:01:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:01:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40f51b58-64e3-522b-b353-cfb584ce0272/40f51b58-64e3-522b-b353-cfb584ce0272_image_0.jpg HTTP/1.1" 201 0
2026-03-28 19:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F99%252Fd69919b27e0e123e0739ba5b8dff042d%252Fpa%252FAD33035_6ff77c4e6f1e25fe8c65b9778b878f03.jpg') HTTP/1.1" 204 0
2026-03-28 19:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/99/d69919b27e0e123e0739ba5b8dff042d/pa/AD33035_6ff77c4e6f1e25fe8c65b9778b878f03.jpg saved to cache
2026-03-28 19:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 40f51b58-64e3-522b-b353-cfb584ce0272
2026-03-28 19:01:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:01:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bd71ed890>
2026-03-28 19:01:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:01:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:01:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:01:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47753836-04a1-5002-928e-0723ecea2118/47753836-04a1-5002-928e-0723ecea2118_image_2.jpg HTTP/1.1" 201 0
2026-03-28 19:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252F78%252Fe878909c4317c113ebf05415750ca275%252Fpa%252FZN70459_fdb8bf19dda42efdeb8ce53b8cc478ac.jpg') HTTP/1.1" 204 0
2026-03-28 19:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/78/e878909c4317c113ebf05415750ca275/pa/ZN70459_fdb8bf19dda42efdeb8ce53b8cc478ac.jpg saved to cache
2026-03-28 19:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 47753836-04a1-5002-928e-0723ecea2118
2026-03-28 19:01:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 47753836-04a1-5002-928e-0723ecea2118, skipping ID generation
2026-03-28 19:01:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 47753836-04a1-5002-928e-0723ecea2118 with scrape type 1
2026-03-28 19:01:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 47753836-04a1-5002-928e-0723ecea2118 sending to next pipeline
2026-03-28 19:01:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 47753836-04a1-5002-928e-0723ecea2118, identifier: ZN70459
2026-03-28 19:01:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:01:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bd71d9110>
2026-03-28 19:01:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:01:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:01:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:01:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_457c3195-896b-557f-a471-daa91da61c90/457c3195-896b-557f-a471-daa91da61c90_image_2.jpg HTTP/1.1" 201 0
2026-03-28 19:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252Ffc%252Fe2fc3de8c023f4680ae5980fc45e1086%252Fpa%252FSR45817_76d7f5916f08fbc010eb4f762e8ebae3.jpg') HTTP/1.1" 204 0
2026-03-28 19:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/fc/e2fc3de8c023f4680ae5980fc45e1086/pa/SR45817_76d7f5916f08fbc010eb4f762e8ebae3.jpg saved to cache
2026-03-28 19:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 457c3195-896b-557f-a471-daa91da61c90
2026-03-28 19:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F71%252F9471ecc81901b5c57fd03af4059721fd%252Fpa%252FHW32084_4960cf37997caa0934ed1261b5bb36bb.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/71/9471ecc81901b5c57fd03af4059721fd/pa/HW32084_4960cf37997caa0934ed1261b5bb36bb.jpg not downloaded yet
2026-03-28 19:01:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 47753836-04a1-5002-928e-0723ecea2118 with identifier: ZN70459
2026-03-28 19:01:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 47753836-04a1-5002-928e-0723ecea2118 with identifier: ZN70459
2026-03-28 19:01:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 47753836-04a1-5002-928e-0723ecea2118 with identifier: ZN70459 to the API
2026-03-28 19:01:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 19:01:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 19:01:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imge8/78/e878909c4317c113ebf05415750ca275/pa/ZN70459_fdb8bf19dda42efdeb8ce53b8cc478ac.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.2L',
 'engine_horse_power': 60,
 'expiration_date': '2026-03-30T15:21:15Z',
 'fuel_type': 'petrol',
 'id': '47753836-04a1-5002-928e-0723ecea2118',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '61NPS1',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZN70459',
 'listing': 'auction',
 'location': 'NL, Maastricht',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 176453,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47753836-04a1-5002-928e-0723ecea2118/47753836-04a1-5002-928e-0723ecea2118_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63790,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/78/e878909c4317c113ebf05415750ca275/pa/ZN70459_eb2cd9fde8bca7d729a3ede6fab02423.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47753836-04a1-5002-928e-0723ecea2118/47753836-04a1-5002-928e-0723ecea2118_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76458,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/78/e878909c4317c113ebf05415750ca275/pa/ZN70459_efd3b1e45daff11e235261d0b7919d79.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47753836-04a1-5002-928e-0723ecea2118/47753836-04a1-5002-928e-0723ecea2118_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70294,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/78/e878909c4317c113ebf05415750ca275/pa/ZN70459_fdb8bf19dda42efdeb8ce53b8cc478ac.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47753836-04a1-5002-928e-0723ecea2118/47753836-04a1-5002-928e-0723ecea2118_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60128,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/78/e878909c4317c113ebf05415750ca275/pa/ZN70459_f7cf27267767877c9ed5fe1380c5beca.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47753836-04a1-5002-928e-0723ecea2118/47753836-04a1-5002-928e-0723ecea2118_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 114459,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/78/e878909c4317c113ebf05415750ca275/pa/ZN70459_9ee16af388423f0beeddcb20a33c322f.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2010-10-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Fiesta 1.25 Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2010}
2026-03-28 19:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZN70459%27 HTTP/1.1" 200 None
2026-03-28 19:01:29 [auto1.nl] INFO: Saving data for ZN70459: {'created_time': 1774724489.515796, 'last_price_update_time': 1774724489.515807, 'auction_closing_time': 1774884075.0}
2026-03-28 19:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='ZN70459') HTTP/1.1" 204 0
2026-03-28 19:01:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga1/78/a17853b2dbdb00632b819a3b615958b5/pa/BJ61509_aeaa4ef6c62ad23f233ca97fa32d5e1a.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F71%252F9471ecc81901b5c57fd03af4059721fd%252Fpa%252FHW32084_2c3a9a642289a42a64c8037935cc7fe3.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/71/9471ecc81901b5c57fd03af4059721fd/pa/HW32084_2c3a9a642289a42a64c8037935cc7fe3.jpg not downloaded yet
2026-03-28 19:01:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img27/b3/27b342d7f90f0dc836d9d26ab964c191/pa/EC40520_d84055970efb3afa10b328d4b333e974.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:01:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/fb/fcfb8c4123ba62d64e2d9df8efc96972/pa/HN54837_ea3267ac313ee7a90d75966e482c7249.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F71%252F9471ecc81901b5c57fd03af4059721fd%252Fpa%252FHW32084_a4a839ba53317ead525f4183064bf8f3.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/71/9471ecc81901b5c57fd03af4059721fd/pa/HW32084_a4a839ba53317ead525f4183064bf8f3.jpg not downloaded yet
2026-03-28 19:01:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:01:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bd635bd10>
2026-03-28 19:01:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:01:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:01:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:01:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7e52919-9fef-5265-9a67-09711ed53cd2/e7e52919-9fef-5265-9a67-09711ed53cd2_image_2.jpg HTTP/1.1" 201 0
2026-03-28 19:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Ff7%252F3cf759b784f0f8e17dcab15a2e8e9e5c%252Fpa%252FSN61945_eeb5b5c2a06987a0ba5d9d06b1428330.jpg') HTTP/1.1" 204 0
2026-03-28 19:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/f7/3cf759b784f0f8e17dcab15a2e8e9e5c/pa/SN61945_eeb5b5c2a06987a0ba5d9d06b1428330.jpg saved to cache
2026-03-28 19:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e7e52919-9fef-5265-9a67-09711ed53cd2
2026-03-28 19:01:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:01:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bd71af1d0>
2026-03-28 19:01:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:01:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:01:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:01:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7e52919-9fef-5265-9a67-09711ed53cd2/e7e52919-9fef-5265-9a67-09711ed53cd2_image_5.jpg HTTP/1.1" 201 0
2026-03-28 19:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Ff7%252F3cf759b784f0f8e17dcab15a2e8e9e5c%252Fpa%252FSN61945_03c4350ad8f7648900a060b8ce79738b.jpg') HTTP/1.1" 204 0
2026-03-28 19:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/f7/3cf759b784f0f8e17dcab15a2e8e9e5c/pa/SN61945_03c4350ad8f7648900a060b8ce79738b.jpg saved to cache
2026-03-28 19:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e7e52919-9fef-5265-9a67-09711ed53cd2
2026-03-28 19:01:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e7e52919-9fef-5265-9a67-09711ed53cd2, skipping ID generation
2026-03-28 19:01:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e7e52919-9fef-5265-9a67-09711ed53cd2 with scrape type 1
2026-03-28 19:01:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e7e52919-9fef-5265-9a67-09711ed53cd2 sending to next pipeline
2026-03-28 19:01:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: e7e52919-9fef-5265-9a67-09711ed53cd2, identifier: SN61945
2026-03-28 19:01:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: e7e52919-9fef-5265-9a67-09711ed53cd2 with identifier: SN61945
2026-03-28 19:01:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: e7e52919-9fef-5265-9a67-09711ed53cd2 with identifier: SN61945
2026-03-28 19:01:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: e7e52919-9fef-5265-9a67-09711ed53cd2 with identifier: SN61945 to the API
2026-03-28 19:01:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 19:01:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 19:01:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img3c/f7/3cf759b784f0f8e17dcab15a2e8e9e5c/pa/SN61945_03c4350ad8f7648900a060b8ce79738b.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:26:07Z',
 'fuel_type': 'petrol',
 'id': 'e7e52919-9fef-5265-9a67-09711ed53cd2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'RP081B',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SN61945',
 'listing': 'auction',
 'location': 'NL, Rotterdam',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 59316,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7e52919-9fef-5265-9a67-09711ed53cd2/e7e52919-9fef-5265-9a67-09711ed53cd2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2823225,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/f7/3cf759b784f0f8e17dcab15a2e8e9e5c/pa/SN61945_49973c4ddb3d2d8999f8f87e16d69284.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7e52919-9fef-5265-9a67-09711ed53cd2/e7e52919-9fef-5265-9a67-09711ed53cd2_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71294,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/f7/3cf759b784f0f8e17dcab15a2e8e9e5c/pa/SN61945_453da4b33ed69ec7e277b3aa484f2bba.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7e52919-9fef-5265-9a67-09711ed53cd2/e7e52919-9fef-5265-9a67-09711ed53cd2_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65357,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/f7/3cf759b784f0f8e17dcab15a2e8e9e5c/pa/SN61945_eeb5b5c2a06987a0ba5d9d06b1428330.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7e52919-9fef-5265-9a67-09711ed53cd2/e7e52919-9fef-5265-9a67-09711ed53cd2_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2964725,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/f7/3cf759b784f0f8e17dcab15a2e8e9e5c/pa/SN61945_831a9c53ee705ede1e9225ee13c70c20.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7e52919-9fef-5265-9a67-09711ed53cd2/e7e52919-9fef-5265-9a67-09711ed53cd2_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2569772,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/f7/3cf759b784f0f8e17dcab15a2e8e9e5c/pa/SN61945_c9260713991c8efb71b8d802e7d3329f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7e52919-9fef-5265-9a67-09711ed53cd2/e7e52919-9fef-5265-9a67-09711ed53cd2_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68324,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/f7/3cf759b784f0f8e17dcab15a2e8e9e5c/pa/SN61945_03c4350ad8f7648900a060b8ce79738b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7e52919-9fef-5265-9a67-09711ed53cd2/e7e52919-9fef-5265-9a67-09711ed53cd2_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63095,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/f7/3cf759b784f0f8e17dcab15a2e8e9e5c/pa/SN61945_ea7691e270c8f9781ba323aeda52aab6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7e52919-9fef-5265-9a67-09711ed53cd2/e7e52919-9fef-5265-9a67-09711ed53cd2_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73284,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/f7/3cf759b784f0f8e17dcab15a2e8e9e5c/pa/SN61945_768e21acf9a6ccd047c349537256ba07.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7e52919-9fef-5265-9a67-09711ed53cd2/e7e52919-9fef-5265-9a67-09711ed53cd2_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65933,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/f7/3cf759b784f0f8e17dcab15a2e8e9e5c/pa/SN61945_624c864a683535760b6fef84a51ca569.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7e52919-9fef-5265-9a67-09711ed53cd2/e7e52919-9fef-5265-9a67-09711ed53cd2_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60905,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/f7/3cf759b784f0f8e17dcab15a2e8e9e5c/pa/SN61945_c524d714492954938b4b71035cf2cf1c.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-02-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Fiesta 1.0 EcoBoost ST-Line',
 'transmission': 'manual',
 'trim': 'ST-Line',
 'year': 2018}
2026-03-28 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SN61945%27 HTTP/1.1" 200 None
2026-03-28 19:01:30 [auto1.nl] INFO: Saving data for SN61945: {'created_time': 1774724490.097032, 'last_price_update_time': 1774724490.097043, 'auction_closing_time': 1774884367.0}
2026-03-28 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='SN61945') HTTP/1.1" 204 0
2026-03-28 19:01:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img99/d8/99d8daf0854f81383878cbaa25a6afa1/pa/XK63885_c93cb29f7204d25e98f255c4970eb422.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F71%252F9471ecc81901b5c57fd03af4059721fd%252Fpa%252FHW32084_10f67efd94b288c250d1d2219cee02fd.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/71/9471ecc81901b5c57fd03af4059721fd/pa/HW32084_10f67efd94b288c250d1d2219cee02fd.jpg not downloaded yet
2026-03-28 19:01:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/fb/fcfb8c4123ba62d64e2d9df8efc96972/pa/HN54837_85865f1c374bc4f9348860420f5c01e2.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:01:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:01:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img27/b3/27b342d7f90f0dc836d9d26ab964c191/pa/EC40520_342f51907c2b1ef4082512b1f03af7e0.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F71%252F9471ecc81901b5c57fd03af4059721fd%252Fpa%252FHW32084_298aea7025771d0c99ff0b23811e61d2.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/71/9471ecc81901b5c57fd03af4059721fd/pa/HW32084_298aea7025771d0c99ff0b23811e61d2.jpg not downloaded yet
2026-03-28 19:01:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:01:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bd687c950>
2026-03-28 19:01:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:01:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:01:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:01:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2b4a82bc-7f32-57c0-b814-d577ab4e12c2/2b4a82bc-7f32-57c0-b814-d577ab4e12c2_image_1.jpg HTTP/1.1" 201 0
2026-03-28 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252F78%252Fa17853b2dbdb00632b819a3b615958b5%252Fpa%252FBJ61509_aeaa4ef6c62ad23f233ca97fa32d5e1a.jpg') HTTP/1.1" 204 0
2026-03-28 19:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/78/a17853b2dbdb00632b819a3b615958b5/pa/BJ61509_aeaa4ef6c62ad23f233ca97fa32d5e1a.jpg saved to cache
2026-03-28 19:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2b4a82bc-7f32-57c0-b814-d577ab4e12c2
2026-03-28 19:01:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2b4a82bc-7f32-57c0-b814-d577ab4e12c2, skipping ID generation
2026-03-28 19:01:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2b4a82bc-7f32-57c0-b814-d577ab4e12c2 with scrape type 1
2026-03-28 19:01:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2b4a82bc-7f32-57c0-b814-d577ab4e12c2 sending to next pipeline
2026-03-28 19:01:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 2b4a82bc-7f32-57c0-b814-d577ab4e12c2, identifier: BJ61509
2026-03-28 19:01:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:01:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bd72e83d0>
2026-03-28 19:01:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:01:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:01:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:01:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2afffbfb-f694-58b9-8f01-92e4581e3ccd/2afffbfb-f694-58b9-8f01-92e4581e3ccd_image_2.jpg HTTP/1.1" 201 0
2026-03-28 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252Fb3%252F27b342d7f90f0dc836d9d26ab964c191%252Fpa%252FEC40520_d84055970efb3afa10b328d4b333e974.jpg') HTTP/1.1" 204 0
2026-03-28 19:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/b3/27b342d7f90f0dc836d9d26ab964c191/pa/EC40520_d84055970efb3afa10b328d4b333e974.jpg saved to cache
2026-03-28 19:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2afffbfb-f694-58b9-8f01-92e4581e3ccd
2026-03-28 19:01:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:01:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bd7252d90>
2026-03-28 19:01:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:01:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:01:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:01:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ecbafa2-810c-556f-93a0-421d7c30c287/4ecbafa2-810c-556f-93a0-421d7c30c287_image_7.jpg HTTP/1.1" 201 0
2026-03-28 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252Ffb%252Ffcfb8c4123ba62d64e2d9df8efc96972%252Fpa%252FHN54837_ea3267ac313ee7a90d75966e482c7249.jpg') HTTP/1.1" 204 0
2026-03-28 19:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/fb/fcfb8c4123ba62d64e2d9df8efc96972/pa/HN54837_ea3267ac313ee7a90d75966e482c7249.jpg saved to cache
2026-03-28 19:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4ecbafa2-810c-556f-93a0-421d7c30c287
2026-03-28 19:01:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img99/d8/99d8daf0854f81383878cbaa25a6afa1/pa/XK63885_a0507c804131babdad8d43cf4148e310.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F71%252F9471ecc81901b5c57fd03af4059721fd%252Fpa%252FHW32084_33f0cd38237cf3ff16bb29063c1146d7.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/71/9471ecc81901b5c57fd03af4059721fd/pa/HW32084_33f0cd38237cf3ff16bb29063c1146d7.jpg not downloaded yet
2026-03-28 19:01:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 2b4a82bc-7f32-57c0-b814-d577ab4e12c2 with identifier: BJ61509
2026-03-28 19:01:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 2b4a82bc-7f32-57c0-b814-d577ab4e12c2 with identifier: BJ61509
2026-03-28 19:01:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 2b4a82bc-7f32-57c0-b814-d577ab4e12c2 with identifier: BJ61509 to the API
2026-03-28 19:01:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 19:01:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 19:01:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imga1/78/a17853b2dbdb00632b819a3b615958b5/pa/BJ61509_aeaa4ef6c62ad23f233ca97fa32d5e1a.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 4',
 'engine': '1.2L',
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:54:31Z',
 'fuel_type': 'petrol',
 'id': '2b4a82bc-7f32-57c0-b814-d577ab4e12c2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '66JSR1',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BJ61509',
 'listing': 'auction',
 'location': 'NL, Arnhem',
 'make': 'Ford',
 'model': 'Ka',
 'odometer': 102560,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 4,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b4a82bc-7f32-57c0-b814-d577ab4e12c2/2b4a82bc-7f32-57c0-b814-d577ab4e12c2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 108647,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga1/78/a17853b2dbdb00632b819a3b615958b5/pa/BJ61509_7845ca86d1be34ef57192e4a8c3dfa3e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b4a82bc-7f32-57c0-b814-d577ab4e12c2/2b4a82bc-7f32-57c0-b814-d577ab4e12c2_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 115778,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga1/78/a17853b2dbdb00632b819a3b615958b5/pa/BJ61509_aeaa4ef6c62ad23f233ca97fa32d5e1a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b4a82bc-7f32-57c0-b814-d577ab4e12c2/2b4a82bc-7f32-57c0-b814-d577ab4e12c2_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78809,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga1/78/a17853b2dbdb00632b819a3b615958b5/pa/BJ61509_a0f0c7fe5af9d040082fd5eba29b31d0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b4a82bc-7f32-57c0-b814-d577ab4e12c2/2b4a82bc-7f32-57c0-b814-d577ab4e12c2_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63703,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga1/78/a17853b2dbdb00632b819a3b615958b5/pa/BJ61509_b44a90168938213791c8a4eec6be532e.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2009-08-13',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Ford Ka 1.2 Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2009}
2026-03-28 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BJ61509%27 HTTP/1.1" 200 None
2026-03-28 19:01:30 [auto1.nl] INFO: Saving data for BJ61509: {'created_time': 1774724490.814595, 'last_price_update_time': 1774724490.814607, 'auction_closing_time': 1774886071.0}
2026-03-28 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='BJ61509') HTTP/1.1" 204 0
2026-03-28 19:01:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img94/71/9471ecc81901b5c57fd03af4059721fd/pa/HW32084_59070ccb3cf8bf0ded866b9602330226.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F71%252F9471ecc81901b5c57fd03af4059721fd%252Fpa%252FHW32084_f51c487369dea297f454a80941eadcc5.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/71/9471ecc81901b5c57fd03af4059721fd/pa/HW32084_f51c487369dea297f454a80941eadcc5.jpg not downloaded yet
2026-03-28 19:01:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GN14496> (referer: https://www.auto1.com/v1/car-details-view/GN14496/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 19:01:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:01:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bdd205810>
2026-03-28 19:01:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:01:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:01:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:01:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa4fe243-a109-598c-934e-d9090d7d464c/fa4fe243-a109-598c-934e-d9090d7d464c_image_7.jpg HTTP/1.1" 201 0
2026-03-28 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Fd8%252F99d8daf0854f81383878cbaa25a6afa1%252Fpa%252FXK63885_c93cb29f7204d25e98f255c4970eb422.jpg') HTTP/1.1" 204 0
2026-03-28 19:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/d8/99d8daf0854f81383878cbaa25a6afa1/pa/XK63885_c93cb29f7204d25e98f255c4970eb422.jpg saved to cache
2026-03-28 19:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item fa4fe243-a109-598c-934e-d9090d7d464c
2026-03-28 19:01:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:01:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bd71a83d0>
2026-03-28 19:01:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:01:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:01:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:01:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ecbafa2-810c-556f-93a0-421d7c30c287/4ecbafa2-810c-556f-93a0-421d7c30c287_image_6.jpg HTTP/1.1" 201 0
2026-03-28 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252Ffb%252Ffcfb8c4123ba62d64e2d9df8efc96972%252Fpa%252FHN54837_85865f1c374bc4f9348860420f5c01e2.jpg') HTTP/1.1" 204 0
2026-03-28 19:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/fb/fcfb8c4123ba62d64e2d9df8efc96972/pa/HN54837_85865f1c374bc4f9348860420f5c01e2.jpg saved to cache
2026-03-28 19:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4ecbafa2-810c-556f-93a0-421d7c30c287
2026-03-28 19:01:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:01:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bd63c5b50>
2026-03-28 19:01:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:01:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:01:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:01:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2afffbfb-f694-58b9-8f01-92e4581e3ccd/2afffbfb-f694-58b9-8f01-92e4581e3ccd_image_1.jpg HTTP/1.1" 201 0
2026-03-28 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252Fb3%252F27b342d7f90f0dc836d9d26ab964c191%252Fpa%252FEC40520_342f51907c2b1ef4082512b1f03af7e0.jpg') HTTP/1.1" 204 0
2026-03-28 19:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/b3/27b342d7f90f0dc836d9d26ab964c191/pa/EC40520_342f51907c2b1ef4082512b1f03af7e0.jpg saved to cache
2026-03-28 19:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2afffbfb-f694-58b9-8f01-92e4581e3ccd
2026-03-28 19:01:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img94/71/9471ecc81901b5c57fd03af4059721fd/pa/HW32084_f29368ee6bd14e46861e95c608d96625.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:01:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:01:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bd6327450>
2026-03-28 19:01:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:01:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:01:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:01:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa4fe243-a109-598c-934e-d9090d7d464c/fa4fe243-a109-598c-934e-d9090d7d464c_image_6.jpg HTTP/1.1" 201 0
2026-03-28 19:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Fd8%252F99d8daf0854f81383878cbaa25a6afa1%252Fpa%252FXK63885_a0507c804131babdad8d43cf4148e310.jpg') HTTP/1.1" 204 0
2026-03-28 19:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/d8/99d8daf0854f81383878cbaa25a6afa1/pa/XK63885_a0507c804131babdad8d43cf4148e310.jpg saved to cache
2026-03-28 19:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item fa4fe243-a109-598c-934e-d9090d7d464c
2026-03-28 19:01:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/fc/e2fc3de8c023f4680ae5980fc45e1086/pa/SR45817_f91c1bf7a360ac792fd567132045a325.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:01:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZK31432> (referer: https://www.auto1.com/v1/car-details-view/ZK31432/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 19:01:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:01:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bd7139310>
2026-03-28 19:01:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:01:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:01:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:01:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2323dac1-0e73-5dbf-8093-7e25247de99c/2323dac1-0e73-5dbf-8093-7e25247de99c_image_1.jpg HTTP/1.1" 201 0
2026-03-28 19:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F71%252F9471ecc81901b5c57fd03af4059721fd%252Fpa%252FHW32084_59070ccb3cf8bf0ded866b9602330226.jpg') HTTP/1.1" 204 0
2026-03-28 19:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/71/9471ecc81901b5c57fd03af4059721fd/pa/HW32084_59070ccb3cf8bf0ded866b9602330226.jpg saved to cache
2026-03-28 19:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2323dac1-0e73-5dbf-8093-7e25247de99c
2026-03-28 19:01:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0896c112-e4d6-50a4-993f-d65dbf1f4d35 with identifier: GN14496
2026-03-28 19:01:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0896c112-e4d6-50a4-993f-d65dbf1f4d35 with scrape type 1
2026-03-28 19:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 4 photos for item 0896c112-e4d6-50a4-993f-d65dbf1f4d35
2026-03-28 19:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F78%252Fec78e12bb300889d36f5e1d0feff5538%252Fpa%252FGN14496_87a1e6af3fea134e63d20d5486e11e8c.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/78/ec78e12bb300889d36f5e1d0feff5538/pa/GN14496_87a1e6af3fea134e63d20d5486e11e8c.jpg not downloaded yet
2026-03-28 19:01:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/99/d69919b27e0e123e0739ba5b8dff042d/pa/AD33035_ca5d3bf45dd41f759110d1f1934d1004.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:01:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img94/71/9471ecc81901b5c57fd03af4059721fd/pa/HW32084_4960cf37997caa0934ed1261b5bb36bb.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F78%252Fec78e12bb300889d36f5e1d0feff5538%252Fpa%252FGN14496_a406c78c1822fe7334a0214ccd3d87bc.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/78/ec78e12bb300889d36f5e1d0feff5538/pa/GN14496_a406c78c1822fe7334a0214ccd3d87bc.jpg not downloaded yet
2026-03-28 19:01:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/fc/e2fc3de8c023f4680ae5980fc45e1086/pa/SR45817_dc256b80addc9d55029abd1e0f77a1e4.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:01:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:01:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bd71dfc10>
2026-03-28 19:01:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:01:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:01:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:01:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2323dac1-0e73-5dbf-8093-7e25247de99c/2323dac1-0e73-5dbf-8093-7e25247de99c_image_0.jpg HTTP/1.1" 201 0
2026-03-28 19:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F71%252F9471ecc81901b5c57fd03af4059721fd%252Fpa%252FHW32084_f29368ee6bd14e46861e95c608d96625.jpg') HTTP/1.1" 204 0
2026-03-28 19:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/71/9471ecc81901b5c57fd03af4059721fd/pa/HW32084_f29368ee6bd14e46861e95c608d96625.jpg saved to cache
2026-03-28 19:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2323dac1-0e73-5dbf-8093-7e25247de99c
2026-03-28 19:01:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/99/d69919b27e0e123e0739ba5b8dff042d/pa/AD33035_72d815cf92fc929591d51c3dd30eeb5b.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F78%252Fec78e12bb300889d36f5e1d0feff5538%252Fpa%252FGN14496_4e202668da893090db963392365b7d8e.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/78/ec78e12bb300889d36f5e1d0feff5538/pa/GN14496_4e202668da893090db963392365b7d8e.jpg not downloaded yet
2026-03-28 19:01:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/99/d69919b27e0e123e0739ba5b8dff042d/pa/AD33035_2aa5ac1b5db598f748a6b834fa621a50.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F78%252Fec78e12bb300889d36f5e1d0feff5538%252Fpa%252FGN14496_e39e3c120afb826d47ac8cb63dd07572.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/78/ec78e12bb300889d36f5e1d0feff5538/pa/GN14496_e39e3c120afb826d47ac8cb63dd07572.jpg not downloaded yet
2026-03-28 19:01:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img94/71/9471ecc81901b5c57fd03af4059721fd/pa/HW32084_2c3a9a642289a42a64c8037935cc7fe3.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:01:31 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 19:01:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:01:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bd737ded0>
2026-03-28 19:01:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:01:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:01:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:01:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_457c3195-896b-557f-a471-daa91da61c90/457c3195-896b-557f-a471-daa91da61c90_image_9.jpg HTTP/1.1" 201 0
2026-03-28 19:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252Ffc%252Fe2fc3de8c023f4680ae5980fc45e1086%252Fpa%252FSR45817_f91c1bf7a360ac792fd567132045a325.jpg') HTTP/1.1" 204 0
2026-03-28 19:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/fc/e2fc3de8c023f4680ae5980fc45e1086/pa/SR45817_f91c1bf7a360ac792fd567132045a325.jpg saved to cache
2026-03-28 19:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 457c3195-896b-557f-a471-daa91da61c90
2026-03-28 19:01:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4caaada7-42c8-5550-b0b5-915cb3d30272 with identifier: ZK31432
2026-03-28 19:01:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4caaada7-42c8-5550-b0b5-915cb3d30272 with scrape type 1
2026-03-28 19:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4caaada7-42c8-5550-b0b5-915cb3d30272
2026-03-28 19:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252F02%252F3d02a3fd37d747ca4bd7f0d387834093%252Fpa%252FZK31432_fbf37046892584a70216e0af91681bc5.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/02/3d02a3fd37d747ca4bd7f0d387834093/pa/ZK31432_fbf37046892584a70216e0af91681bc5.jpg already downloaded
2026-03-28 19:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252F02%252F3d02a3fd37d747ca4bd7f0d387834093%252Fpa%252FZK31432_da0e0664e2451f05b1ca79dbe1638878.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/02/3d02a3fd37d747ca4bd7f0d387834093/pa/ZK31432_da0e0664e2451f05b1ca79dbe1638878.jpg already downloaded
2026-03-28 19:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252F02%252F3d02a3fd37d747ca4bd7f0d387834093%252Fpa%252FZK31432_819b00ae6e0950be31332edd7be02a39.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/02/3d02a3fd37d747ca4bd7f0d387834093/pa/ZK31432_819b00ae6e0950be31332edd7be02a39.jpg already downloaded
2026-03-28 19:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252F02%252F3d02a3fd37d747ca4bd7f0d387834093%252Fpa%252FZK31432_62327e74d08b07382d793bc5d254455c.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/02/3d02a3fd37d747ca4bd7f0d387834093/pa/ZK31432_62327e74d08b07382d793bc5d254455c.jpg already downloaded
2026-03-28 19:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252F02%252F3d02a3fd37d747ca4bd7f0d387834093%252Fpa%252FZK31432_1be0522cab4782df0f12dcddfd5f3844.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/02/3d02a3fd37d747ca4bd7f0d387834093/pa/ZK31432_1be0522cab4782df0f12dcddfd5f3844.jpg already downloaded
2026-03-28 19:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252F02%252F3d02a3fd37d747ca4bd7f0d387834093%252Fpa%252FZK31432_593bfd6cd8dbf0db67f1624fda4fdcad.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/02/3d02a3fd37d747ca4bd7f0d387834093/pa/ZK31432_593bfd6cd8dbf0db67f1624fda4fdcad.jpg already downloaded
2026-03-28 19:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252F02%252F3d02a3fd37d747ca4bd7f0d387834093%252Fpa%252FZK31432_2b1bbb243a41ae06cfaeeda530d8132e.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/02/3d02a3fd37d747ca4bd7f0d387834093/pa/ZK31432_2b1bbb243a41ae06cfaeeda530d8132e.jpg already downloaded
2026-03-28 19:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252F02%252F3d02a3fd37d747ca4bd7f0d387834093%252Fpa%252FZK31432_0ba5ea9be499b58997078fc1d894b32f.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/02/3d02a3fd37d747ca4bd7f0d387834093/pa/ZK31432_0ba5ea9be499b58997078fc1d894b32f.jpg already downloaded
2026-03-28 19:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252F02%252F3d02a3fd37d747ca4bd7f0d387834093%252Fpa%252FZK31432_86c4a1ec8b35a93bfde305759435fadc.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/02/3d02a3fd37d747ca4bd7f0d387834093/pa/ZK31432_86c4a1ec8b35a93bfde305759435fadc.jpg already downloaded
2026-03-28 19:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252F02%252F3d02a3fd37d747ca4bd7f0d387834093%252Fpa%252FZK31432_815fee197d3acc12b91ea27c021099f1.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/02/3d02a3fd37d747ca4bd7f0d387834093/pa/ZK31432_815fee197d3acc12b91ea27c021099f1.jpg already downloaded
2026-03-28 19:01:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 4caaada7-42c8-5550-b0b5-915cb3d30272, identifier: ZK31432
2026-03-28 19:01:31 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 19:01:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:01:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bdd205890>
2026-03-28 19:01:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:01:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:01:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:01:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40f51b58-64e3-522b-b353-cfb584ce0272/40f51b58-64e3-522b-b353-cfb584ce0272_image_8.jpg HTTP/1.1" 201 0
2026-03-28 19:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F99%252Fd69919b27e0e123e0739ba5b8dff042d%252Fpa%252FAD33035_ca5d3bf45dd41f759110d1f1934d1004.jpg') HTTP/1.1" 204 0
2026-03-28 19:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/99/d69919b27e0e123e0739ba5b8dff042d/pa/AD33035_ca5d3bf45dd41f759110d1f1934d1004.jpg saved to cache
2026-03-28 19:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 40f51b58-64e3-522b-b353-cfb584ce0272
2026-03-28 19:01:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:01:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bd7271b10>
2026-03-28 19:01:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:01:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:01:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:01:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2323dac1-0e73-5dbf-8093-7e25247de99c/2323dac1-0e73-5dbf-8093-7e25247de99c_image_3.jpg HTTP/1.1" 201 0
2026-03-28 19:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F71%252F9471ecc81901b5c57fd03af4059721fd%252Fpa%252FHW32084_4960cf37997caa0934ed1261b5bb36bb.jpg') HTTP/1.1" 204 0
2026-03-28 19:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/71/9471ecc81901b5c57fd03af4059721fd/pa/HW32084_4960cf37997caa0934ed1261b5bb36bb.jpg saved to cache
2026-03-28 19:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2323dac1-0e73-5dbf-8093-7e25247de99c
2026-03-28 19:01:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 4caaada7-42c8-5550-b0b5-915cb3d30272 with identifier: ZK31432
2026-03-28 19:01:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 4caaada7-42c8-5550-b0b5-915cb3d30272 with identifier: ZK31432
2026-03-28 19:01:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 4caaada7-42c8-5550-b0b5-915cb3d30272 with identifier: ZK31432 to the API
2026-03-28 19:01:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 19:01:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 19:01:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ZK31432>
{'auction_title': '',
 'c_o_2_emission_value': 95,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 95,
 'expiration_date': '2026-03-30T15:11:49Z',
 'fuel_type': 'diesel',
 'id': '4caaada7-42c8-5550-b0b5-915cb3d30272',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'license_plate': 'RS591R',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZK31432',
 'listing': 'auction',
 'location': 'NL, Oosterhout',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 200768,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img3d/02/3d02a3fd37d747ca4bd7f0d387834093/pa/ZK31432_fbf37046892584a70216e0af91681bc5.jpg',
                'https://img-pa.auto1.com/img3d/02/3d02a3fd37d747ca4bd7f0d387834093/pa/ZK31432_da0e0664e2451f05b1ca79dbe1638878.jpg',
                'https://img-pa.auto1.com/img3d/02/3d02a3fd37d747ca4bd7f0d387834093/pa/ZK31432_819b00ae6e0950be31332edd7be02a39.jpg',
                'https://img-pa.auto1.com/img3d/02/3d02a3fd37d747ca4bd7f0d387834093/pa/ZK31432_62327e74d08b07382d793bc5d254455c.jpg',
                'https://img-pa.auto1.com/img3d/02/3d02a3fd37d747ca4bd7f0d387834093/pa/ZK31432_1be0522cab4782df0f12dcddfd5f3844.jpg',
                'https://img-pa.auto1.com/img3d/02/3d02a3fd37d747ca4bd7f0d387834093/pa/ZK31432_593bfd6cd8dbf0db67f1624fda4fdcad.jpg',
                'https://img-pa.auto1.com/img3d/02/3d02a3fd37d747ca4bd7f0d387834093/pa/ZK31432_2b1bbb243a41ae06cfaeeda530d8132e.jpg',
                'https://img-pa.auto1.com/img3d/02/3d02a3fd37d747ca4bd7f0d387834093/pa/ZK31432_0ba5ea9be499b58997078fc1d894b32f.jpg',
                'https://img-pa.auto1.com/img3d/02/3d02a3fd37d747ca4bd7f0d387834093/pa/ZK31432_86c4a1ec8b35a93bfde305759435fadc.jpg',
                'https://img-pa.auto1.com/img3d/02/3d02a3fd37d747ca4bd7f0d387834093/pa/ZK31432_815fee197d3acc12b91ea27c021099f1.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4caaada7-42c8-5550-b0b5-915cb3d30272/4caaada7-42c8-5550-b0b5-915cb3d30272_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62659,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/02/3d02a3fd37d747ca4bd7f0d387834093/pa/ZK31432_fbf37046892584a70216e0af91681bc5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4caaada7-42c8-5550-b0b5-915cb3d30272/4caaada7-42c8-5550-b0b5-915cb3d30272_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61683,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/02/3d02a3fd37d747ca4bd7f0d387834093/pa/ZK31432_da0e0664e2451f05b1ca79dbe1638878.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4caaada7-42c8-5550-b0b5-915cb3d30272/4caaada7-42c8-5550-b0b5-915cb3d30272_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64328,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/02/3d02a3fd37d747ca4bd7f0d387834093/pa/ZK31432_819b00ae6e0950be31332edd7be02a39.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4caaada7-42c8-5550-b0b5-915cb3d30272/4caaada7-42c8-5550-b0b5-915cb3d30272_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55987,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/02/3d02a3fd37d747ca4bd7f0d387834093/pa/ZK31432_62327e74d08b07382d793bc5d254455c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4caaada7-42c8-5550-b0b5-915cb3d30272/4caaada7-42c8-5550-b0b5-915cb3d30272_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59217,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/02/3d02a3fd37d747ca4bd7f0d387834093/pa/ZK31432_1be0522cab4782df0f12dcddfd5f3844.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4caaada7-42c8-5550-b0b5-915cb3d30272/4caaada7-42c8-5550-b0b5-915cb3d30272_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62905,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/02/3d02a3fd37d747ca4bd7f0d387834093/pa/ZK31432_593bfd6cd8dbf0db67f1624fda4fdcad.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4caaada7-42c8-5550-b0b5-915cb3d30272/4caaada7-42c8-5550-b0b5-915cb3d30272_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56210,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/02/3d02a3fd37d747ca4bd7f0d387834093/pa/ZK31432_2b1bbb243a41ae06cfaeeda530d8132e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4caaada7-42c8-5550-b0b5-915cb3d30272/4caaada7-42c8-5550-b0b5-915cb3d30272_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62938,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/02/3d02a3fd37d747ca4bd7f0d387834093/pa/ZK31432_0ba5ea9be499b58997078fc1d894b32f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4caaada7-42c8-5550-b0b5-915cb3d30272/4caaada7-42c8-5550-b0b5-915cb3d30272_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61244,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/02/3d02a3fd37d747ca4bd7f0d387834093/pa/ZK31432_86c4a1ec8b35a93bfde305759435fadc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4caaada7-42c8-5550-b0b5-915cb3d30272/4caaada7-42c8-5550-b0b5-915cb3d30272_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59586,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/02/3d02a3fd37d747ca4bd7f0d387834093/pa/ZK31432_815fee197d3acc12b91ea27c021099f1.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-03-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Fiesta 1.6 TDCi Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2015}
2026-03-28 19:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZK31432%27 HTTP/1.1" 200 None
2026-03-28 19:01:32 [auto1.nl] INFO: Saving data for ZK31432: {'created_time': 1774724492.226778, 'last_price_update_time': 1774724492.226788, 'auction_closing_time': 1774883509.0}
2026-03-28 19:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='ZK31432') HTTP/1.1" 204 0
2026-03-28 19:01:32 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 19:01:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:01:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bd68bf990>
2026-03-28 19:01:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:01:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:01:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:01:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_457c3195-896b-557f-a471-daa91da61c90/457c3195-896b-557f-a471-daa91da61c90_image_4.jpg HTTP/1.1" 201 0
2026-03-28 19:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252Ffc%252Fe2fc3de8c023f4680ae5980fc45e1086%252Fpa%252FSR45817_dc256b80addc9d55029abd1e0f77a1e4.jpg') HTTP/1.1" 204 0
2026-03-28 19:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/fc/e2fc3de8c023f4680ae5980fc45e1086/pa/SR45817_dc256b80addc9d55029abd1e0f77a1e4.jpg saved to cache
2026-03-28 19:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 457c3195-896b-557f-a471-daa91da61c90
2026-03-28 19:01:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 457c3195-896b-557f-a471-daa91da61c90, skipping ID generation
2026-03-28 19:01:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 457c3195-896b-557f-a471-daa91da61c90 with scrape type 1
2026-03-28 19:01:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 457c3195-896b-557f-a471-daa91da61c90 sending to next pipeline
2026-03-28 19:01:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 457c3195-896b-557f-a471-daa91da61c90, identifier: SR45817
2026-03-28 19:01:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img94/71/9471ecc81901b5c57fd03af4059721fd/pa/HW32084_37d12a269edba1bbb459883d81f84a88.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:01:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img27/b3/27b342d7f90f0dc836d9d26ab964c191/pa/EC40520_60c86f109c8d1d9323960e8b4a569952.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:01:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img94/71/9471ecc81901b5c57fd03af4059721fd/pa/HW32084_298aea7025771d0c99ff0b23811e61d2.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:01:32 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 19:01:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 457c3195-896b-557f-a471-daa91da61c90 with identifier: SR45817
2026-03-28 19:01:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 457c3195-896b-557f-a471-daa91da61c90 with identifier: SR45817
2026-03-28 19:01:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 457c3195-896b-557f-a471-daa91da61c90 with identifier: SR45817 to the API
2026-03-28 19:01:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 19:01:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 19:01:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imge2/fc/e2fc3de8c023f4680ae5980fc45e1086/pa/SR45817_dc256b80addc9d55029abd1e0f77a1e4.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 5',
 'engine': '1.2L',
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:01:16Z',
 'fuel_type': 'petrol',
 'id': '457c3195-896b-557f-a471-daa91da61c90',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '33JGD8',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SR45817',
 'listing': 'auction',
 'location': 'NL, Eindhoven',
 'make': 'Fiat',
 'model': '500',
 'odometer': 139864,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_457c3195-896b-557f-a471-daa91da61c90/457c3195-896b-557f-a471-daa91da61c90_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88398,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge2/fc/e2fc3de8c023f4680ae5980fc45e1086/pa/SR45817_4b79f576a917f7cbadd617ca4a8ce99a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_457c3195-896b-557f-a471-daa91da61c90/457c3195-896b-557f-a471-daa91da61c90_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2412229,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge2/fc/e2fc3de8c023f4680ae5980fc45e1086/pa/SR45817_615ff6b9c87ac440dae87f8c1317d5ff.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_457c3195-896b-557f-a471-daa91da61c90/457c3195-896b-557f-a471-daa91da61c90_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66401,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge2/fc/e2fc3de8c023f4680ae5980fc45e1086/pa/SR45817_76d7f5916f08fbc010eb4f762e8ebae3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_457c3195-896b-557f-a471-daa91da61c90/457c3195-896b-557f-a471-daa91da61c90_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83125,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge2/fc/e2fc3de8c023f4680ae5980fc45e1086/pa/SR45817_d7474e1fa1dde58a1075ab29b940f06c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_457c3195-896b-557f-a471-daa91da61c90/457c3195-896b-557f-a471-daa91da61c90_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2200733,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge2/fc/e2fc3de8c023f4680ae5980fc45e1086/pa/SR45817_dc256b80addc9d55029abd1e0f77a1e4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_457c3195-896b-557f-a471-daa91da61c90/457c3195-896b-557f-a471-daa91da61c90_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72684,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge2/fc/e2fc3de8c023f4680ae5980fc45e1086/pa/SR45817_3cc8693e6dd65a21e227bdc8e860b740.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_457c3195-896b-557f-a471-daa91da61c90/457c3195-896b-557f-a471-daa91da61c90_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69173,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge2/fc/e2fc3de8c023f4680ae5980fc45e1086/pa/SR45817_c57fee9b5d270f06bf609bc9d94f8984.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_457c3195-896b-557f-a471-daa91da61c90/457c3195-896b-557f-a471-daa91da61c90_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82694,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge2/fc/e2fc3de8c023f4680ae5980fc45e1086/pa/SR45817_d4b5bfa61fdefc0eb4481cdf91bd20d8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_457c3195-896b-557f-a471-daa91da61c90/457c3195-896b-557f-a471-daa91da61c90_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83025,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge2/fc/e2fc3de8c023f4680ae5980fc45e1086/pa/SR45817_eb53fb1be925b05c101570645e040099.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_457c3195-896b-557f-a471-daa91da61c90/457c3195-896b-557f-a471-daa91da61c90_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2373617,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge2/fc/e2fc3de8c023f4680ae5980fc45e1086/pa/SR45817_f91c1bf7a360ac792fd567132045a325.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2009-05-12',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Fiat 500 1.2 Sport',
 'transmission': 'automatic',
 'trim': 'Sport',
 'year': 2009}
2026-03-28 19:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SR45817%27 HTTP/1.1" 200 None
2026-03-28 19:01:32 [auto1.nl] INFO: Saving data for SR45817: {'created_time': 1774724492.87095, 'last_price_update_time': 1774724492.870962, 'auction_closing_time': 1774882876.0}
2026-03-28 19:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='SR45817') HTTP/1.1" 204 0
2026-03-28 19:01:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img99/d8/99d8daf0854f81383878cbaa25a6afa1/pa/XK63885_b72717698ccc1141a813ab40a3bd219f.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:01:32 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 19:01:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:01:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bd71a4150>
2026-03-28 19:01:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:01:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:01:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:01:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40f51b58-64e3-522b-b353-cfb584ce0272/40f51b58-64e3-522b-b353-cfb584ce0272_image_9.jpg HTTP/1.1" 201 0
2026-03-28 19:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F99%252Fd69919b27e0e123e0739ba5b8dff042d%252Fpa%252FAD33035_72d815cf92fc929591d51c3dd30eeb5b.jpg') HTTP/1.1" 204 0
2026-03-28 19:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/99/d69919b27e0e123e0739ba5b8dff042d/pa/AD33035_72d815cf92fc929591d51c3dd30eeb5b.jpg saved to cache
2026-03-28 19:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 40f51b58-64e3-522b-b353-cfb584ce0272
2026-03-28 19:01:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 19:01:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:01:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bd72c9590>
2026-03-28 19:01:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:01:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:01:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:01:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40f51b58-64e3-522b-b353-cfb584ce0272/40f51b58-64e3-522b-b353-cfb584ce0272_image_7.jpg HTTP/1.1" 201 0
2026-03-28 19:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F99%252Fd69919b27e0e123e0739ba5b8dff042d%252Fpa%252FAD33035_2aa5ac1b5db598f748a6b834fa621a50.jpg') HTTP/1.1" 204 0
2026-03-28 19:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/99/d69919b27e0e123e0739ba5b8dff042d/pa/AD33035_2aa5ac1b5db598f748a6b834fa621a50.jpg saved to cache
2026-03-28 19:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 40f51b58-64e3-522b-b353-cfb584ce0272
2026-03-28 19:01:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 40f51b58-64e3-522b-b353-cfb584ce0272, skipping ID generation
2026-03-28 19:01:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 40f51b58-64e3-522b-b353-cfb584ce0272 with scrape type 1
2026-03-28 19:01:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 40f51b58-64e3-522b-b353-cfb584ce0272 sending to next pipeline
2026-03-28 19:01:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 40f51b58-64e3-522b-b353-cfb584ce0272, identifier: AD33035
2026-03-28 19:01:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:01:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bd728ba10>
2026-03-28 19:01:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:01:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:01:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:01:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2323dac1-0e73-5dbf-8093-7e25247de99c/2323dac1-0e73-5dbf-8093-7e25247de99c_image_4.jpg HTTP/1.1" 201 0
2026-03-28 19:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F71%252F9471ecc81901b5c57fd03af4059721fd%252Fpa%252FHW32084_2c3a9a642289a42a64c8037935cc7fe3.jpg') HTTP/1.1" 204 0
2026-03-28 19:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/71/9471ecc81901b5c57fd03af4059721fd/pa/HW32084_2c3a9a642289a42a64c8037935cc7fe3.jpg saved to cache
2026-03-28 19:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2323dac1-0e73-5dbf-8093-7e25247de99c
2026-03-28 19:01:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 40f51b58-64e3-522b-b353-cfb584ce0272 with identifier: AD33035
2026-03-28 19:01:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 40f51b58-64e3-522b-b353-cfb584ce0272 with identifier: AD33035
2026-03-28 19:01:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 40f51b58-64e3-522b-b353-cfb584ce0272 with identifier: AD33035 to the API
2026-03-28 19:01:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 19:01:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 19:01:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgd6/99/d69919b27e0e123e0739ba5b8dff042d/pa/AD33035_2aa5ac1b5db598f748a6b834fa621a50.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 60,
 'expiration_date': '2026-03-30T15:44:37Z',
 'fuel_type': 'petrol',
 'id': '40f51b58-64e3-522b-b353-cfb584ce0272',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'HR510H',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AD33035',
 'listing': 'auction',
 'location': 'NL, Tilburg',
 'make': 'Volkswagen',
 'model': 'up!',
 'odometer': 87074,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40f51b58-64e3-522b-b353-cfb584ce0272/40f51b58-64e3-522b-b353-cfb584ce0272_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64161,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/99/d69919b27e0e123e0739ba5b8dff042d/pa/AD33035_6ff77c4e6f1e25fe8c65b9778b878f03.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40f51b58-64e3-522b-b353-cfb584ce0272/40f51b58-64e3-522b-b353-cfb584ce0272_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62092,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/99/d69919b27e0e123e0739ba5b8dff042d/pa/AD33035_a7097841ac72a026e880d59162d32f1f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40f51b58-64e3-522b-b353-cfb584ce0272/40f51b58-64e3-522b-b353-cfb584ce0272_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58214,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/99/d69919b27e0e123e0739ba5b8dff042d/pa/AD33035_1a3b8794c62533a65040722f29931260.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40f51b58-64e3-522b-b353-cfb584ce0272/40f51b58-64e3-522b-b353-cfb584ce0272_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45094,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/99/d69919b27e0e123e0739ba5b8dff042d/pa/AD33035_41422df232050fdc45ba1c676888ae76.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40f51b58-64e3-522b-b353-cfb584ce0272/40f51b58-64e3-522b-b353-cfb584ce0272_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58854,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/99/d69919b27e0e123e0739ba5b8dff042d/pa/AD33035_5e5b2aa3821ffc682f28eba3732b9037.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40f51b58-64e3-522b-b353-cfb584ce0272/40f51b58-64e3-522b-b353-cfb584ce0272_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57803,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/99/d69919b27e0e123e0739ba5b8dff042d/pa/AD33035_3c148d21ad3ab5eaf55c6fa4051d17df.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40f51b58-64e3-522b-b353-cfb584ce0272/40f51b58-64e3-522b-b353-cfb584ce0272_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51483,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/99/d69919b27e0e123e0739ba5b8dff042d/pa/AD33035_e2cbb61a97676a2ea2e4b6852aeb141b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40f51b58-64e3-522b-b353-cfb584ce0272/40f51b58-64e3-522b-b353-cfb584ce0272_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2639415,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/99/d69919b27e0e123e0739ba5b8dff042d/pa/AD33035_2aa5ac1b5db598f748a6b834fa621a50.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40f51b58-64e3-522b-b353-cfb584ce0272/40f51b58-64e3-522b-b353-cfb584ce0272_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2570043,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/99/d69919b27e0e123e0739ba5b8dff042d/pa/AD33035_ca5d3bf45dd41f759110d1f1934d1004.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40f51b58-64e3-522b-b353-cfb584ce0272/40f51b58-64e3-522b-b353-cfb584ce0272_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2816446,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/99/d69919b27e0e123e0739ba5b8dff042d/pa/AD33035_72d815cf92fc929591d51c3dd30eeb5b.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-01-12',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Volkswagen up! 1.0 Take up! BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Take  BlueMotion Tech',
 'year': 2016}
2026-03-28 19:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AD33035%27 HTTP/1.1" 200 None
2026-03-28 19:01:33 [auto1.nl] INFO: Saving data for AD33035: {'created_time': 1774724493.704316, 'last_price_update_time': 1774724493.704328, 'auction_closing_time': 1774885477.0}
2026-03-28 19:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='AD33035') HTTP/1.1" 204 0
2026-03-28 19:01:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:01:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bd7378410>
2026-03-28 19:01:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:01:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:01:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:01:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2323dac1-0e73-5dbf-8093-7e25247de99c/2323dac1-0e73-5dbf-8093-7e25247de99c_image_2.jpg HTTP/1.1" 201 0
2026-03-28 19:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F71%252F9471ecc81901b5c57fd03af4059721fd%252Fpa%252FHW32084_37d12a269edba1bbb459883d81f84a88.jpg') HTTP/1.1" 204 0
2026-03-28 19:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/71/9471ecc81901b5c57fd03af4059721fd/pa/HW32084_37d12a269edba1bbb459883d81f84a88.jpg saved to cache
2026-03-28 19:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2323dac1-0e73-5dbf-8093-7e25247de99c
2026-03-28 19:01:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:01:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bd68bd890>
2026-03-28 19:01:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:01:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:01:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:01:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2afffbfb-f694-58b9-8f01-92e4581e3ccd/2afffbfb-f694-58b9-8f01-92e4581e3ccd_image_0.jpg HTTP/1.1" 201 0
2026-03-28 19:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252Fb3%252F27b342d7f90f0dc836d9d26ab964c191%252Fpa%252FEC40520_60c86f109c8d1d9323960e8b4a569952.jpg') HTTP/1.1" 204 0
2026-03-28 19:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/b3/27b342d7f90f0dc836d9d26ab964c191/pa/EC40520_60c86f109c8d1d9323960e8b4a569952.jpg saved to cache
2026-03-28 19:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2afffbfb-f694-58b9-8f01-92e4581e3ccd
2026-03-28 19:01:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2afffbfb-f694-58b9-8f01-92e4581e3ccd, skipping ID generation
2026-03-28 19:01:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2afffbfb-f694-58b9-8f01-92e4581e3ccd with scrape type 1
2026-03-28 19:01:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2afffbfb-f694-58b9-8f01-92e4581e3ccd sending to next pipeline
2026-03-28 19:01:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 2afffbfb-f694-58b9-8f01-92e4581e3ccd, identifier: EC40520
2026-03-28 19:01:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:01:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bd6857710>
2026-03-28 19:01:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:01:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2323dac1-0e73-5dbf-8093-7e25247de99c/2323dac1-0e73-5dbf-8093-7e25247de99c_image_7.jpg HTTP/1.1" 201 0
2026-03-28 19:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F71%252F9471ecc81901b5c57fd03af4059721fd%252Fpa%252FHW32084_298aea7025771d0c99ff0b23811e61d2.jpg') HTTP/1.1" 204 0
2026-03-28 19:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/71/9471ecc81901b5c57fd03af4059721fd/pa/HW32084_298aea7025771d0c99ff0b23811e61d2.jpg saved to cache
2026-03-28 19:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2323dac1-0e73-5dbf-8093-7e25247de99c
2026-03-28 19:01:34 [auto1.nl] INFO: Channel: 24h | Page: 18 | totalHits: 646 | hits on page: 0
2026-03-28 19:01:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img99/d8/99d8daf0854f81383878cbaa25a6afa1/pa/XK63885_3ddba5f0625e68661817a3020071921a.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:01:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 2afffbfb-f694-58b9-8f01-92e4581e3ccd with identifier: EC40520
2026-03-28 19:01:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 2afffbfb-f694-58b9-8f01-92e4581e3ccd with identifier: EC40520
2026-03-28 19:01:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 2afffbfb-f694-58b9-8f01-92e4581e3ccd with identifier: EC40520 to the API
2026-03-28 19:01:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 19:01:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 19:01:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img27/b3/27b342d7f90f0dc836d9d26ab964c191/pa/EC40520_60c86f109c8d1d9323960e8b4a569952.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.2L',
 'engine_horse_power': 60,
 'expiration_date': '2026-03-30T15:56:04Z',
 'fuel_type': 'petrol',
 'id': '2afffbfb-f694-58b9-8f01-92e4581e3ccd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '78TTSK',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EC40520',
 'listing': 'auction',
 'location': 'NL, Hoofddorp',
 'make': 'Fiat',
 'model': 'Panda',
 'odometer': 165707,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2afffbfb-f694-58b9-8f01-92e4581e3ccd/2afffbfb-f694-58b9-8f01-92e4581e3ccd_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81741,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img27/b3/27b342d7f90f0dc836d9d26ab964c191/pa/EC40520_60c86f109c8d1d9323960e8b4a569952.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2afffbfb-f694-58b9-8f01-92e4581e3ccd/2afffbfb-f694-58b9-8f01-92e4581e3ccd_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80113,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img27/b3/27b342d7f90f0dc836d9d26ab964c191/pa/EC40520_342f51907c2b1ef4082512b1f03af7e0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2afffbfb-f694-58b9-8f01-92e4581e3ccd/2afffbfb-f694-58b9-8f01-92e4581e3ccd_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71087,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img27/b3/27b342d7f90f0dc836d9d26ab964c191/pa/EC40520_d84055970efb3afa10b328d4b333e974.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2afffbfb-f694-58b9-8f01-92e4581e3ccd/2afffbfb-f694-58b9-8f01-92e4581e3ccd_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71008,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img27/b3/27b342d7f90f0dc836d9d26ab964c191/pa/EC40520_97f15b9b42cf5a30c3fdef5174b6445a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2afffbfb-f694-58b9-8f01-92e4581e3ccd/2afffbfb-f694-58b9-8f01-92e4581e3ccd_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59727,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img27/b3/27b342d7f90f0dc836d9d26ab964c191/pa/EC40520_64dfb08ae047bfe63dce797e9824654d.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2007-01-25',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Fiat Panda 1.2 Dynamic',
 'transmission': 'manual',
 'trim': 'Dynamic',
 'year': 2007}
2026-03-28 19:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EC40520%27 HTTP/1.1" 200 None
2026-03-28 19:01:34 [auto1.nl] INFO: Saving data for EC40520: {'created_time': 1774724494.446989, 'last_price_update_time': 1774724494.447, 'auction_closing_time': 1774886164.0}
2026-03-28 19:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='EC40520') HTTP/1.1" 204 0
2026-03-28 19:01:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:01:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:01:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:01:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:01:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:01:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bd72f2910>
2026-03-28 19:01:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:01:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa4fe243-a109-598c-934e-d9090d7d464c/fa4fe243-a109-598c-934e-d9090d7d464c_image_5.jpg HTTP/1.1" 201 0
2026-03-28 19:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Fd8%252F99d8daf0854f81383878cbaa25a6afa1%252Fpa%252FXK63885_b72717698ccc1141a813ab40a3bd219f.jpg') HTTP/1.1" 204 0
2026-03-28 19:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/d8/99d8daf0854f81383878cbaa25a6afa1/pa/XK63885_b72717698ccc1141a813ab40a3bd219f.jpg saved to cache
2026-03-28 19:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item fa4fe243-a109-598c-934e-d9090d7d464c
2026-03-28 19:01:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:01:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bd6884d90>
2026-03-28 19:01:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:01:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa4fe243-a109-598c-934e-d9090d7d464c/fa4fe243-a109-598c-934e-d9090d7d464c_image_4.jpg HTTP/1.1" 201 0
2026-03-28 19:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Fd8%252F99d8daf0854f81383878cbaa25a6afa1%252Fpa%252FXK63885_3ddba5f0625e68661817a3020071921a.jpg') HTTP/1.1" 204 0
2026-03-28 19:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/d8/99d8daf0854f81383878cbaa25a6afa1/pa/XK63885_3ddba5f0625e68661817a3020071921a.jpg saved to cache
2026-03-28 19:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item fa4fe243-a109-598c-934e-d9090d7d464c
2026-03-28 19:01:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/78/ec78e12bb300889d36f5e1d0feff5538/pa/GN14496_e39e3c120afb826d47ac8cb63dd07572.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:01:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/78/ec78e12bb300889d36f5e1d0feff5538/pa/GN14496_87a1e6af3fea134e63d20d5486e11e8c.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:01:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:01:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:01:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img94/71/9471ecc81901b5c57fd03af4059721fd/pa/HW32084_10f67efd94b288c250d1d2219cee02fd.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:01:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:01:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img94/71/9471ecc81901b5c57fd03af4059721fd/pa/HW32084_a4a839ba53317ead525f4183064bf8f3.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:01:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img94/71/9471ecc81901b5c57fd03af4059721fd/pa/HW32084_f51c487369dea297f454a80941eadcc5.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:01:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img94/71/9471ecc81901b5c57fd03af4059721fd/pa/HW32084_33f0cd38237cf3ff16bb29063c1146d7.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:01:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img99/d8/99d8daf0854f81383878cbaa25a6afa1/pa/XK63885_ee2f7c88699093c809860cb3067a10be.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:01:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:01:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bd71df5d0>
2026-03-28 19:01:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:01:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0896c112-e4d6-50a4-993f-d65dbf1f4d35/0896c112-e4d6-50a4-993f-d65dbf1f4d35_image_3.jpg HTTP/1.1" 201 0
2026-03-28 19:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F78%252Fec78e12bb300889d36f5e1d0feff5538%252Fpa%252FGN14496_e39e3c120afb826d47ac8cb63dd07572.jpg') HTTP/1.1" 204 0
2026-03-28 19:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/78/ec78e12bb300889d36f5e1d0feff5538/pa/GN14496_e39e3c120afb826d47ac8cb63dd07572.jpg saved to cache
2026-03-28 19:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0896c112-e4d6-50a4-993f-d65dbf1f4d35
2026-03-28 19:01:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:01:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bd68dcf50>
2026-03-28 19:01:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:01:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0896c112-e4d6-50a4-993f-d65dbf1f4d35/0896c112-e4d6-50a4-993f-d65dbf1f4d35_image_0.jpg HTTP/1.1" 201 0
2026-03-28 19:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F78%252Fec78e12bb300889d36f5e1d0feff5538%252Fpa%252FGN14496_87a1e6af3fea134e63d20d5486e11e8c.jpg') HTTP/1.1" 204 0
2026-03-28 19:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/78/ec78e12bb300889d36f5e1d0feff5538/pa/GN14496_87a1e6af3fea134e63d20d5486e11e8c.jpg saved to cache
2026-03-28 19:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0896c112-e4d6-50a4-993f-d65dbf1f4d35
2026-03-28 19:01:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/78/ec78e12bb300889d36f5e1d0feff5538/pa/GN14496_4e202668da893090db963392365b7d8e.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:01:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/78/ec78e12bb300889d36f5e1d0feff5538/pa/GN14496_a406c78c1822fe7334a0214ccd3d87bc.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:01:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 19:01:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:01:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bd63c48d0>
2026-03-28 19:01:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:01:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2323dac1-0e73-5dbf-8093-7e25247de99c/2323dac1-0e73-5dbf-8093-7e25247de99c_image_6.jpg HTTP/1.1" 201 0
2026-03-28 19:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F71%252F9471ecc81901b5c57fd03af4059721fd%252Fpa%252FHW32084_10f67efd94b288c250d1d2219cee02fd.jpg') HTTP/1.1" 204 0
2026-03-28 19:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/71/9471ecc81901b5c57fd03af4059721fd/pa/HW32084_10f67efd94b288c250d1d2219cee02fd.jpg saved to cache
2026-03-28 19:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2323dac1-0e73-5dbf-8093-7e25247de99c
2026-03-28 19:01:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 19:01:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:01:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bd6855d90>
2026-03-28 19:01:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:01:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2323dac1-0e73-5dbf-8093-7e25247de99c/2323dac1-0e73-5dbf-8093-7e25247de99c_image_5.jpg HTTP/1.1" 201 0
2026-03-28 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F71%252F9471ecc81901b5c57fd03af4059721fd%252Fpa%252FHW32084_a4a839ba53317ead525f4183064bf8f3.jpg') HTTP/1.1" 204 0
2026-03-28 19:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/71/9471ecc81901b5c57fd03af4059721fd/pa/HW32084_a4a839ba53317ead525f4183064bf8f3.jpg saved to cache
2026-03-28 19:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2323dac1-0e73-5dbf-8093-7e25247de99c
2026-03-28 19:01:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 19:01:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:01:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bd71df910>
2026-03-28 19:01:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:01:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2323dac1-0e73-5dbf-8093-7e25247de99c/2323dac1-0e73-5dbf-8093-7e25247de99c_image_9.jpg HTTP/1.1" 201 0
2026-03-28 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F71%252F9471ecc81901b5c57fd03af4059721fd%252Fpa%252FHW32084_f51c487369dea297f454a80941eadcc5.jpg') HTTP/1.1" 204 0
2026-03-28 19:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/71/9471ecc81901b5c57fd03af4059721fd/pa/HW32084_f51c487369dea297f454a80941eadcc5.jpg saved to cache
2026-03-28 19:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2323dac1-0e73-5dbf-8093-7e25247de99c
2026-03-28 19:01:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 19:01:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:01:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bd72f0f10>
2026-03-28 19:01:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:01:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2323dac1-0e73-5dbf-8093-7e25247de99c/2323dac1-0e73-5dbf-8093-7e25247de99c_image_8.jpg HTTP/1.1" 201 0
2026-03-28 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F71%252F9471ecc81901b5c57fd03af4059721fd%252Fpa%252FHW32084_33f0cd38237cf3ff16bb29063c1146d7.jpg') HTTP/1.1" 204 0
2026-03-28 19:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/71/9471ecc81901b5c57fd03af4059721fd/pa/HW32084_33f0cd38237cf3ff16bb29063c1146d7.jpg saved to cache
2026-03-28 19:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2323dac1-0e73-5dbf-8093-7e25247de99c
2026-03-28 19:01:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2323dac1-0e73-5dbf-8093-7e25247de99c, skipping ID generation
2026-03-28 19:01:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2323dac1-0e73-5dbf-8093-7e25247de99c with scrape type 1
2026-03-28 19:01:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2323dac1-0e73-5dbf-8093-7e25247de99c sending to next pipeline
2026-03-28 19:01:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 2323dac1-0e73-5dbf-8093-7e25247de99c, identifier: HW32084
2026-03-28 19:01:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:01:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bd63902d0>
2026-03-28 19:01:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:01:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa4fe243-a109-598c-934e-d9090d7d464c/fa4fe243-a109-598c-934e-d9090d7d464c_image_3.jpg HTTP/1.1" 201 0
2026-03-28 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Fd8%252F99d8daf0854f81383878cbaa25a6afa1%252Fpa%252FXK63885_ee2f7c88699093c809860cb3067a10be.jpg') HTTP/1.1" 204 0
2026-03-28 19:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/d8/99d8daf0854f81383878cbaa25a6afa1/pa/XK63885_ee2f7c88699093c809860cb3067a10be.jpg saved to cache
2026-03-28 19:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item fa4fe243-a109-598c-934e-d9090d7d464c
2026-03-28 19:01:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 2323dac1-0e73-5dbf-8093-7e25247de99c with identifier: HW32084
2026-03-28 19:01:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 2323dac1-0e73-5dbf-8093-7e25247de99c with identifier: HW32084
2026-03-28 19:01:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 2323dac1-0e73-5dbf-8093-7e25247de99c with identifier: HW32084 to the API
2026-03-28 19:01:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 19:01:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 19:01:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img94/71/9471ecc81901b5c57fd03af4059721fd/pa/HW32084_33f0cd38237cf3ff16bb29063c1146d7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 148,
 'category': None,
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 156,
 'expiration_date': '2026-03-30T15:16:22Z',
 'fuel_type': 'petrol',
 'id': '2323dac1-0e73-5dbf-8093-7e25247de99c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'G857KZ',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HW32084',
 'listing': 'auction',
 'location': 'NL, Nijmegen',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 154003,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2323dac1-0e73-5dbf-8093-7e25247de99c/2323dac1-0e73-5dbf-8093-7e25247de99c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 111016,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img94/71/9471ecc81901b5c57fd03af4059721fd/pa/HW32084_f29368ee6bd14e46861e95c608d96625.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2323dac1-0e73-5dbf-8093-7e25247de99c/2323dac1-0e73-5dbf-8093-7e25247de99c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 113584,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img94/71/9471ecc81901b5c57fd03af4059721fd/pa/HW32084_59070ccb3cf8bf0ded866b9602330226.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2323dac1-0e73-5dbf-8093-7e25247de99c/2323dac1-0e73-5dbf-8093-7e25247de99c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 108749,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img94/71/9471ecc81901b5c57fd03af4059721fd/pa/HW32084_37d12a269edba1bbb459883d81f84a88.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2323dac1-0e73-5dbf-8093-7e25247de99c/2323dac1-0e73-5dbf-8093-7e25247de99c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 104730,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img94/71/9471ecc81901b5c57fd03af4059721fd/pa/HW32084_4960cf37997caa0934ed1261b5bb36bb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2323dac1-0e73-5dbf-8093-7e25247de99c/2323dac1-0e73-5dbf-8093-7e25247de99c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 104755,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img94/71/9471ecc81901b5c57fd03af4059721fd/pa/HW32084_2c3a9a642289a42a64c8037935cc7fe3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2323dac1-0e73-5dbf-8093-7e25247de99c/2323dac1-0e73-5dbf-8093-7e25247de99c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3132709,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img94/71/9471ecc81901b5c57fd03af4059721fd/pa/HW32084_a4a839ba53317ead525f4183064bf8f3.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2323dac1-0e73-5dbf-8093-7e25247de99c/2323dac1-0e73-5dbf-8093-7e25247de99c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2469471,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img94/71/9471ecc81901b5c57fd03af4059721fd/pa/HW32084_10f67efd94b288c250d1d2219cee02fd.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2323dac1-0e73-5dbf-8093-7e25247de99c/2323dac1-0e73-5dbf-8093-7e25247de99c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102747,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img94/71/9471ecc81901b5c57fd03af4059721fd/pa/HW32084_298aea7025771d0c99ff0b23811e61d2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2323dac1-0e73-5dbf-8093-7e25247de99c/2323dac1-0e73-5dbf-8093-7e25247de99c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3420898,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img94/71/9471ecc81901b5c57fd03af4059721fd/pa/HW32084_33f0cd38237cf3ff16bb29063c1146d7.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2323dac1-0e73-5dbf-8093-7e25247de99c/2323dac1-0e73-5dbf-8093-7e25247de99c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2770405,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img94/71/9471ecc81901b5c57fd03af4059721fd/pa/HW32084_f51c487369dea297f454a80941eadcc5.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-10-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 180 T AMG Line',
 'transmission': 'automatic',
 'trim': 'T AMG Line',
 'year': 2019}
2026-03-28 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HW32084%27 HTTP/1.1" 200 None
2026-03-28 19:01:35 [auto1.nl] INFO: Saving data for HW32084: {'created_time': 1774724495.869126, 'last_price_update_time': 1774724495.869138, 'auction_closing_time': 1774883782.0}
2026-03-28 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='HW32084') HTTP/1.1" 204 0
2026-03-28 19:01:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/fb/fcfb8c4123ba62d64e2d9df8efc96972/pa/HN54837_ea784cec9db2bf3333c2b5e58b90afa4.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:01:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JA39510/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 19:01:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JA81822/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 19:01:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NJ31093> (referer: https://www.auto1.com/v1/car-details-view/NJ31093/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 19:01:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HD36341/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 19:01:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:01:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bd71d8510>
2026-03-28 19:01:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:01:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0896c112-e4d6-50a4-993f-d65dbf1f4d35/0896c112-e4d6-50a4-993f-d65dbf1f4d35_image_2.jpg HTTP/1.1" 201 0
2026-03-28 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F78%252Fec78e12bb300889d36f5e1d0feff5538%252Fpa%252FGN14496_4e202668da893090db963392365b7d8e.jpg') HTTP/1.1" 204 0
2026-03-28 19:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/78/ec78e12bb300889d36f5e1d0feff5538/pa/GN14496_4e202668da893090db963392365b7d8e.jpg saved to cache
2026-03-28 19:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0896c112-e4d6-50a4-993f-d65dbf1f4d35
2026-03-28 19:01:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:01:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bd71b9e10>
2026-03-28 19:01:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:01:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0896c112-e4d6-50a4-993f-d65dbf1f4d35/0896c112-e4d6-50a4-993f-d65dbf1f4d35_image_1.jpg HTTP/1.1" 201 0
2026-03-28 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F78%252Fec78e12bb300889d36f5e1d0feff5538%252Fpa%252FGN14496_a406c78c1822fe7334a0214ccd3d87bc.jpg') HTTP/1.1" 204 0
2026-03-28 19:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/78/ec78e12bb300889d36f5e1d0feff5538/pa/GN14496_a406c78c1822fe7334a0214ccd3d87bc.jpg saved to cache
2026-03-28 19:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0896c112-e4d6-50a4-993f-d65dbf1f4d35
2026-03-28 19:01:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0896c112-e4d6-50a4-993f-d65dbf1f4d35, skipping ID generation
2026-03-28 19:01:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0896c112-e4d6-50a4-993f-d65dbf1f4d35 with scrape type 1
2026-03-28 19:01:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0896c112-e4d6-50a4-993f-d65dbf1f4d35 sending to next pipeline
2026-03-28 19:01:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 0896c112-e4d6-50a4-993f-d65dbf1f4d35, identifier: GN14496
2026-03-28 19:01:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 0896c112-e4d6-50a4-993f-d65dbf1f4d35 with identifier: GN14496
2026-03-28 19:01:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 0896c112-e4d6-50a4-993f-d65dbf1f4d35 with identifier: GN14496
2026-03-28 19:01:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 0896c112-e4d6-50a4-993f-d65dbf1f4d35 with identifier: GN14496 to the API
2026-03-28 19:01:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 19:01:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 19:01:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgec/78/ec78e12bb300889d36f5e1d0feff5538/pa/GN14496_a406c78c1822fe7334a0214ccd3d87bc.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '2.0L',
 'engine_horse_power': 143,
 'expiration_date': '2026-03-30T15:25:23Z',
 'fuel_type': 'petrol',
 'id': '0896c112-e4d6-50a4-993f-d65dbf1f4d35',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'TN273H',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GN14496',
 'listing': 'auction',
 'location': 'NL, Rotterdam',
 'make': 'BMW',
 'model': '1er',
 'odometer': 158610,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 4,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0896c112-e4d6-50a4-993f-d65dbf1f4d35/0896c112-e4d6-50a4-993f-d65dbf1f4d35_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73901,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/78/ec78e12bb300889d36f5e1d0feff5538/pa/GN14496_87a1e6af3fea134e63d20d5486e11e8c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0896c112-e4d6-50a4-993f-d65dbf1f4d35/0896c112-e4d6-50a4-993f-d65dbf1f4d35_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73012,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/78/ec78e12bb300889d36f5e1d0feff5538/pa/GN14496_a406c78c1822fe7334a0214ccd3d87bc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0896c112-e4d6-50a4-993f-d65dbf1f4d35/0896c112-e4d6-50a4-993f-d65dbf1f4d35_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75307,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/78/ec78e12bb300889d36f5e1d0feff5538/pa/GN14496_4e202668da893090db963392365b7d8e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0896c112-e4d6-50a4-993f-d65dbf1f4d35/0896c112-e4d6-50a4-993f-d65dbf1f4d35_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61289,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/78/ec78e12bb300889d36f5e1d0feff5538/pa/GN14496_e39e3c120afb826d47ac8cb63dd07572.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2007-09-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1er 118i',
 'transmission': 'manual',
 'trim': '',
 'year': 2007}
2026-03-28 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GN14496%27 HTTP/1.1" 200 None
2026-03-28 19:01:36 [auto1.nl] INFO: Saving data for GN14496: {'created_time': 1774724496.437203, 'last_price_update_time': 1774724496.437214, 'auction_closing_time': 1774884323.0}
2026-03-28 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='GN14496') HTTP/1.1" 204 0
2026-03-28 19:01:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:01:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:01:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:01:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:01:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:01:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GD33520/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 19:01:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:01:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 19:01:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:01:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bd622a910>
2026-03-28 19:01:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:01:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ecbafa2-810c-556f-93a0-421d7c30c287/4ecbafa2-810c-556f-93a0-421d7c30c287_image_3.jpg HTTP/1.1" 201 0
2026-03-28 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252Ffb%252Ffcfb8c4123ba62d64e2d9df8efc96972%252Fpa%252FHN54837_ea784cec9db2bf3333c2b5e58b90afa4.jpg') HTTP/1.1" 204 0
2026-03-28 19:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/fb/fcfb8c4123ba62d64e2d9df8efc96972/pa/HN54837_ea784cec9db2bf3333c2b5e58b90afa4.jpg saved to cache
2026-03-28 19:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4ecbafa2-810c-556f-93a0-421d7c30c287
2026-03-28 19:01:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4ecbafa2-810c-556f-93a0-421d7c30c287, skipping ID generation
2026-03-28 19:01:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4ecbafa2-810c-556f-93a0-421d7c30c287 with scrape type 1
2026-03-28 19:01:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4ecbafa2-810c-556f-93a0-421d7c30c287 sending to next pipeline
2026-03-28 19:01:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 4ecbafa2-810c-556f-93a0-421d7c30c287, identifier: HN54837
2026-03-28 19:01:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9dcd5990-dc58-5159-9e16-8167e7bda145 with identifier: NJ31093
2026-03-28 19:01:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9dcd5990-dc58-5159-9e16-8167e7bda145 with scrape type 1
2026-03-28 19:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 9dcd5990-dc58-5159-9e16-8167e7bda145
2026-03-28 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F42%252F2842b73e0f3336446b359a31afb287b5%252Fpa%252FNJ31093_3e705889b4b047f2b46d2c477cb8488b.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/42/2842b73e0f3336446b359a31afb287b5/pa/NJ31093_3e705889b4b047f2b46d2c477cb8488b.jpg not downloaded yet
2026-03-28 19:01:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AB54003/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 19:01:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 4ecbafa2-810c-556f-93a0-421d7c30c287 with identifier: HN54837
2026-03-28 19:01:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 4ecbafa2-810c-556f-93a0-421d7c30c287 with identifier: HN54837
2026-03-28 19:01:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 4ecbafa2-810c-556f-93a0-421d7c30c287 with identifier: HN54837 to the API
2026-03-28 19:01:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 19:01:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 19:01:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgfc/fb/fcfb8c4123ba62d64e2d9df8efc96972/pa/HN54837_ea784cec9db2bf3333c2b5e58b90afa4.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 146,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:03:36Z',
 'fuel_type': 'petrol',
 'id': '4ecbafa2-810c-556f-93a0-421d7c30c287',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'G290TX',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HN54837',
 'listing': 'auction',
 'location': 'NL, Amsterdam',
 'make': 'Mercedes-Benz',
 'model': 'GLA-Klasse',
 'odometer': 33977,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ecbafa2-810c-556f-93a0-421d7c30c287/4ecbafa2-810c-556f-93a0-421d7c30c287_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69306,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfc/fb/fcfb8c4123ba62d64e2d9df8efc96972/pa/HN54837_aa0c8cb7b1905bc9134dc3ac4dc0955c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ecbafa2-810c-556f-93a0-421d7c30c287/4ecbafa2-810c-556f-93a0-421d7c30c287_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67010,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfc/fb/fcfb8c4123ba62d64e2d9df8efc96972/pa/HN54837_d89cf3b8e0c7f7d6d43399d9660024a7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ecbafa2-810c-556f-93a0-421d7c30c287/4ecbafa2-810c-556f-93a0-421d7c30c287_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2993670,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgfc/fb/fcfb8c4123ba62d64e2d9df8efc96972/pa/HN54837_38bbb0197a2896ecb667dd0441d0e4c3.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ecbafa2-810c-556f-93a0-421d7c30c287/4ecbafa2-810c-556f-93a0-421d7c30c287_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2892172,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgfc/fb/fcfb8c4123ba62d64e2d9df8efc96972/pa/HN54837_ea784cec9db2bf3333c2b5e58b90afa4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ecbafa2-810c-556f-93a0-421d7c30c287/4ecbafa2-810c-556f-93a0-421d7c30c287_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2880386,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgfc/fb/fcfb8c4123ba62d64e2d9df8efc96972/pa/HN54837_3287844d9874349e6f0c69a36937e9fc.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ecbafa2-810c-556f-93a0-421d7c30c287/4ecbafa2-810c-556f-93a0-421d7c30c287_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2978896,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgfc/fb/fcfb8c4123ba62d64e2d9df8efc96972/pa/HN54837_dfc183e781a9fc2c9a31d2ff7b585562.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ecbafa2-810c-556f-93a0-421d7c30c287/4ecbafa2-810c-556f-93a0-421d7c30c287_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55455,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfc/fb/fcfb8c4123ba62d64e2d9df8efc96972/pa/HN54837_85865f1c374bc4f9348860420f5c01e2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ecbafa2-810c-556f-93a0-421d7c30c287/4ecbafa2-810c-556f-93a0-421d7c30c287_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75094,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfc/fb/fcfb8c4123ba62d64e2d9df8efc96972/pa/HN54837_ea3267ac313ee7a90d75966e482c7249.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ecbafa2-810c-556f-93a0-421d7c30c287/4ecbafa2-810c-556f-93a0-421d7c30c287_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66845,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfc/fb/fcfb8c4123ba62d64e2d9df8efc96972/pa/HN54837_506e26ff2f96ce39cac6ac2867f7df69.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ecbafa2-810c-556f-93a0-421d7c30c287/4ecbafa2-810c-556f-93a0-421d7c30c287_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63572,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfc/fb/fcfb8c4123ba62d64e2d9df8efc96972/pa/HN54837_abe8a0757bb556dbf7b4473921b2e2d2.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-12-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz GLA-Klasse GLA 180 AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2019}
2026-03-28 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HN54837%27 HTTP/1.1" 200 None
2026-03-28 19:01:37 [auto1.nl] INFO: Saving data for HN54837: {'created_time': 1774724497.237239, 'last_price_update_time': 1774724497.237248, 'auction_closing_time': 1774883016.0}
2026-03-28 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='HN54837') HTTP/1.1" 204 0
2026-03-28 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F42%252F2842b73e0f3336446b359a31afb287b5%252Fpa%252FNJ31093_5e3146d4daa8ad58d80afcd368af6978.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/42/2842b73e0f3336446b359a31afb287b5/pa/NJ31093_5e3146d4daa8ad58d80afcd368af6978.jpg not downloaded yet
2026-03-28 19:01:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F42%252F2842b73e0f3336446b359a31afb287b5%252Fpa%252FNJ31093_d1296a9ff87ca0e013ca1d0480d6e5e1.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/42/2842b73e0f3336446b359a31afb287b5/pa/NJ31093_d1296a9ff87ca0e013ca1d0480d6e5e1.jpg not downloaded yet
2026-03-28 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F42%252F2842b73e0f3336446b359a31afb287b5%252Fpa%252FNJ31093_0ec538b39a99eae04c62113b745e0456.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/42/2842b73e0f3336446b359a31afb287b5/pa/NJ31093_0ec538b39a99eae04c62113b745e0456.jpg not downloaded yet
2026-03-28 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F42%252F2842b73e0f3336446b359a31afb287b5%252Fpa%252FNJ31093_dfe1b7ad15b11597df3accdcbef136de.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/42/2842b73e0f3336446b359a31afb287b5/pa/NJ31093_dfe1b7ad15b11597df3accdcbef136de.jpg not downloaded yet
2026-03-28 19:01:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/42/2842b73e0f3336446b359a31afb287b5/pa/NJ31093_3e705889b4b047f2b46d2c477cb8488b.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:01:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img99/d8/99d8daf0854f81383878cbaa25a6afa1/pa/XK63885_bc8c7067c6b5fed3ee632a1ded82bed6.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:01:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img99/d8/99d8daf0854f81383878cbaa25a6afa1/pa/XK63885_82d62c78c3d926b464c2c76b1fe94ff8.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:01:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/42/2842b73e0f3336446b359a31afb287b5/pa/NJ31093_5e3146d4daa8ad58d80afcd368af6978.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:01:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:01:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bd68ecd10>
2026-03-28 19:01:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:01:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:01:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:01:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9dcd5990-dc58-5159-9e16-8167e7bda145/9dcd5990-dc58-5159-9e16-8167e7bda145_image_0.jpg HTTP/1.1" 201 0
2026-03-28 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F42%252F2842b73e0f3336446b359a31afb287b5%252Fpa%252FNJ31093_3e705889b4b047f2b46d2c477cb8488b.jpg') HTTP/1.1" 204 0
2026-03-28 19:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/42/2842b73e0f3336446b359a31afb287b5/pa/NJ31093_3e705889b4b047f2b46d2c477cb8488b.jpg saved to cache
2026-03-28 19:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9dcd5990-dc58-5159-9e16-8167e7bda145
2026-03-28 19:01:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 19:01:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:01:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bd71d0110>
2026-03-28 19:01:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:01:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:01:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:01:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa4fe243-a109-598c-934e-d9090d7d464c/fa4fe243-a109-598c-934e-d9090d7d464c_image_0.jpg HTTP/1.1" 201 0
2026-03-28 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Fd8%252F99d8daf0854f81383878cbaa25a6afa1%252Fpa%252FXK63885_bc8c7067c6b5fed3ee632a1ded82bed6.jpg') HTTP/1.1" 204 0
2026-03-28 19:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/d8/99d8daf0854f81383878cbaa25a6afa1/pa/XK63885_bc8c7067c6b5fed3ee632a1ded82bed6.jpg saved to cache
2026-03-28 19:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fa4fe243-a109-598c-934e-d9090d7d464c
2026-03-28 19:01:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 19:01:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:01:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bd71d4dd0>
2026-03-28 19:01:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:01:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:01:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:01:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa4fe243-a109-598c-934e-d9090d7d464c/fa4fe243-a109-598c-934e-d9090d7d464c_image_2.jpg HTTP/1.1" 201 0
2026-03-28 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Fd8%252F99d8daf0854f81383878cbaa25a6afa1%252Fpa%252FXK63885_82d62c78c3d926b464c2c76b1fe94ff8.jpg') HTTP/1.1" 204 0
2026-03-28 19:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/d8/99d8daf0854f81383878cbaa25a6afa1/pa/XK63885_82d62c78c3d926b464c2c76b1fe94ff8.jpg saved to cache
2026-03-28 19:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item fa4fe243-a109-598c-934e-d9090d7d464c
2026-03-28 19:01:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fa4fe243-a109-598c-934e-d9090d7d464c, skipping ID generation
2026-03-28 19:01:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fa4fe243-a109-598c-934e-d9090d7d464c with scrape type 1
2026-03-28 19:01:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fa4fe243-a109-598c-934e-d9090d7d464c sending to next pipeline
2026-03-28 19:01:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: fa4fe243-a109-598c-934e-d9090d7d464c, identifier: XK63885
2026-03-28 19:01:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:01:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bd68ee110>
2026-03-28 19:01:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:01:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:01:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:01:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9dcd5990-dc58-5159-9e16-8167e7bda145/9dcd5990-dc58-5159-9e16-8167e7bda145_image_1.jpg HTTP/1.1" 201 0
2026-03-28 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F42%252F2842b73e0f3336446b359a31afb287b5%252Fpa%252FNJ31093_5e3146d4daa8ad58d80afcd368af6978.jpg') HTTP/1.1" 204 0
2026-03-28 19:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/42/2842b73e0f3336446b359a31afb287b5/pa/NJ31093_5e3146d4daa8ad58d80afcd368af6978.jpg saved to cache
2026-03-28 19:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9dcd5990-dc58-5159-9e16-8167e7bda145
2026-03-28 19:01:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: fa4fe243-a109-598c-934e-d9090d7d464c with identifier: XK63885
2026-03-28 19:01:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: fa4fe243-a109-598c-934e-d9090d7d464c with identifier: XK63885
2026-03-28 19:01:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: fa4fe243-a109-598c-934e-d9090d7d464c with identifier: XK63885 to the API
2026-03-28 19:01:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 19:01:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 19:01:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img99/d8/99d8daf0854f81383878cbaa25a6afa1/pa/XK63885_82d62c78c3d926b464c2c76b1fe94ff8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 154,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 160,
 'expiration_date': '2026-03-30T15:52:39Z',
 'fuel_type': 'petrol',
 'id': 'fa4fe243-a109-598c-934e-d9090d7d464c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'L111ZB',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XK63885',
 'listing': 'auction',
 'location': 'NL, Rotterdam',
 'make': 'Mazda',
 'model': 'MX-5',
 'odometer': 43045,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa4fe243-a109-598c-934e-d9090d7d464c/fa4fe243-a109-598c-934e-d9090d7d464c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1919982,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img99/d8/99d8daf0854f81383878cbaa25a6afa1/pa/XK63885_bc8c7067c6b5fed3ee632a1ded82bed6.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa4fe243-a109-598c-934e-d9090d7d464c/fa4fe243-a109-598c-934e-d9090d7d464c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55929,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img99/d8/99d8daf0854f81383878cbaa25a6afa1/pa/XK63885_1ba14f88652ff96280cc2b08066339fe.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa4fe243-a109-598c-934e-d9090d7d464c/fa4fe243-a109-598c-934e-d9090d7d464c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2171116,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img99/d8/99d8daf0854f81383878cbaa25a6afa1/pa/XK63885_82d62c78c3d926b464c2c76b1fe94ff8.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa4fe243-a109-598c-934e-d9090d7d464c/fa4fe243-a109-598c-934e-d9090d7d464c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56077,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img99/d8/99d8daf0854f81383878cbaa25a6afa1/pa/XK63885_ee2f7c88699093c809860cb3067a10be.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa4fe243-a109-598c-934e-d9090d7d464c/fa4fe243-a109-598c-934e-d9090d7d464c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76545,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img99/d8/99d8daf0854f81383878cbaa25a6afa1/pa/XK63885_3ddba5f0625e68661817a3020071921a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa4fe243-a109-598c-934e-d9090d7d464c/fa4fe243-a109-598c-934e-d9090d7d464c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73750,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img99/d8/99d8daf0854f81383878cbaa25a6afa1/pa/XK63885_b72717698ccc1141a813ab40a3bd219f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa4fe243-a109-598c-934e-d9090d7d464c/fa4fe243-a109-598c-934e-d9090d7d464c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56950,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img99/d8/99d8daf0854f81383878cbaa25a6afa1/pa/XK63885_a0507c804131babdad8d43cf4148e310.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa4fe243-a109-598c-934e-d9090d7d464c/fa4fe243-a109-598c-934e-d9090d7d464c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61331,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img99/d8/99d8daf0854f81383878cbaa25a6afa1/pa/XK63885_c93cb29f7204d25e98f255c4970eb422.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa4fe243-a109-598c-934e-d9090d7d464c/fa4fe243-a109-598c-934e-d9090d7d464c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1877512,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img99/d8/99d8daf0854f81383878cbaa25a6afa1/pa/XK63885_8571fadb4798735e63b0b0da256db3b8.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa4fe243-a109-598c-934e-d9090d7d464c/fa4fe243-a109-598c-934e-d9090d7d464c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78854,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img99/d8/99d8daf0854f81383878cbaa25a6afa1/pa/XK63885_509643b2aae3e5426bf5688df9aa7342.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-05-28',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Mazda MX-5 2.0 Sports-Line',
 'transmission': 'manual',
 'trim': 'Sports-Line',
 'year': 2018}
2026-03-28 19:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XK63885%27 HTTP/1.1" 200 None
2026-03-28 19:01:38 [auto1.nl] INFO: Saving data for XK63885: {'created_time': 1774724498.241946, 'last_price_update_time': 1774724498.241957, 'auction_closing_time': 1774885959.0}
2026-03-28 19:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='XK63885') HTTP/1.1" 204 0
2026-03-28 19:01:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/42/2842b73e0f3336446b359a31afb287b5/pa/NJ31093_d1296a9ff87ca0e013ca1d0480d6e5e1.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:01:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/42/2842b73e0f3336446b359a31afb287b5/pa/NJ31093_0ec538b39a99eae04c62113b745e0456.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:01:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/42/2842b73e0f3336446b359a31afb287b5/pa/NJ31093_dfe1b7ad15b11597df3accdcbef136de.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:01:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JH71745> (referer: https://www.auto1.com/v1/car-details-view/JH71745/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 19:01:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VE70887> (referer: https://www.auto1.com/v1/car-details-view/VE70887/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 19:01:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:01:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:01:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZP46172> (referer: https://www.auto1.com/v1/car-details-view/ZP46172/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 19:01:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GU70185/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 19:01:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XU82529/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 19:01:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VZ65695/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 19:01:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:01:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:01:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:01:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bd63fa990>
2026-03-28 19:01:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:01:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:01:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:01:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9dcd5990-dc58-5159-9e16-8167e7bda145/9dcd5990-dc58-5159-9e16-8167e7bda145_image_2.jpg HTTP/1.1" 201 0
2026-03-28 19:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F42%252F2842b73e0f3336446b359a31afb287b5%252Fpa%252FNJ31093_d1296a9ff87ca0e013ca1d0480d6e5e1.jpg') HTTP/1.1" 204 0
2026-03-28 19:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/42/2842b73e0f3336446b359a31afb287b5/pa/NJ31093_d1296a9ff87ca0e013ca1d0480d6e5e1.jpg saved to cache
2026-03-28 19:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9dcd5990-dc58-5159-9e16-8167e7bda145
2026-03-28 19:01:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:01:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bdd4f2e50>
2026-03-28 19:01:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:01:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:01:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:01:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9dcd5990-dc58-5159-9e16-8167e7bda145/9dcd5990-dc58-5159-9e16-8167e7bda145_image_3.jpg HTTP/1.1" 201 0
2026-03-28 19:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F42%252F2842b73e0f3336446b359a31afb287b5%252Fpa%252FNJ31093_0ec538b39a99eae04c62113b745e0456.jpg') HTTP/1.1" 204 0
2026-03-28 19:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/42/2842b73e0f3336446b359a31afb287b5/pa/NJ31093_0ec538b39a99eae04c62113b745e0456.jpg saved to cache
2026-03-28 19:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9dcd5990-dc58-5159-9e16-8167e7bda145
2026-03-28 19:01:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:01:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bd71d9d10>
2026-03-28 19:01:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:01:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:01:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:01:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9dcd5990-dc58-5159-9e16-8167e7bda145/9dcd5990-dc58-5159-9e16-8167e7bda145_image_4.jpg HTTP/1.1" 201 0
2026-03-28 19:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F42%252F2842b73e0f3336446b359a31afb287b5%252Fpa%252FNJ31093_dfe1b7ad15b11597df3accdcbef136de.jpg') HTTP/1.1" 204 0
2026-03-28 19:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/42/2842b73e0f3336446b359a31afb287b5/pa/NJ31093_dfe1b7ad15b11597df3accdcbef136de.jpg saved to cache
2026-03-28 19:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9dcd5990-dc58-5159-9e16-8167e7bda145
2026-03-28 19:01:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9dcd5990-dc58-5159-9e16-8167e7bda145, skipping ID generation
2026-03-28 19:01:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9dcd5990-dc58-5159-9e16-8167e7bda145 with scrape type 1
2026-03-28 19:01:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9dcd5990-dc58-5159-9e16-8167e7bda145 sending to next pipeline
2026-03-28 19:01:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 9dcd5990-dc58-5159-9e16-8167e7bda145, identifier: NJ31093
2026-03-28 19:01:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 9dcd5990-dc58-5159-9e16-8167e7bda145 with identifier: NJ31093
2026-03-28 19:01:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 9dcd5990-dc58-5159-9e16-8167e7bda145 with identifier: NJ31093
2026-03-28 19:01:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 9dcd5990-dc58-5159-9e16-8167e7bda145 with identifier: NJ31093 to the API
2026-03-28 19:01:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 19:01:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 19:01:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img28/42/2842b73e0f3336446b359a31afb287b5/pa/NJ31093_dfe1b7ad15b11597df3accdcbef136de.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 152,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 4',
 'engine': '2.0L',
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:45:29Z',
 'fuel_type': 'petrol',
 'id': '9dcd5990-dc58-5159-9e16-8167e7bda145',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '03-JGT-4',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NJ31093',
 'listing': 'auction',
 'location': 'NL, Groningen',
 'make': 'BMW',
 'model': '1er',
 'odometer': 181368,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9dcd5990-dc58-5159-9e16-8167e7bda145/9dcd5990-dc58-5159-9e16-8167e7bda145_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93594,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img28/42/2842b73e0f3336446b359a31afb287b5/pa/NJ31093_3e705889b4b047f2b46d2c477cb8488b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9dcd5990-dc58-5159-9e16-8167e7bda145/9dcd5990-dc58-5159-9e16-8167e7bda145_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103487,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img28/42/2842b73e0f3336446b359a31afb287b5/pa/NJ31093_5e3146d4daa8ad58d80afcd368af6978.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9dcd5990-dc58-5159-9e16-8167e7bda145/9dcd5990-dc58-5159-9e16-8167e7bda145_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94420,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img28/42/2842b73e0f3336446b359a31afb287b5/pa/NJ31093_d1296a9ff87ca0e013ca1d0480d6e5e1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9dcd5990-dc58-5159-9e16-8167e7bda145/9dcd5990-dc58-5159-9e16-8167e7bda145_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74436,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img28/42/2842b73e0f3336446b359a31afb287b5/pa/NJ31093_0ec538b39a99eae04c62113b745e0456.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9dcd5990-dc58-5159-9e16-8167e7bda145/9dcd5990-dc58-5159-9e16-8167e7bda145_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102830,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img28/42/2842b73e0f3336446b359a31afb287b5/pa/NJ31093_dfe1b7ad15b11597df3accdcbef136de.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2009-05-21',
 'seats_number': 6,
 'seller_name': None,
 'title': 'BMW 1er 116i',
 'transmission': 'automatic',
 'trim': '',
 'year': 2009}
2026-03-28 19:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NJ31093%27 HTTP/1.1" 200 None
2026-03-28 19:01:38 [auto1.nl] INFO: Saving data for NJ31093: {'created_time': 1774724498.998722, 'last_price_update_time': 1774724498.998734, 'auction_closing_time': 1774885529.0}
2026-03-28 19:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='NJ31093') HTTP/1.1" 204 0
2026-03-28 19:01:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 44e3d968-bcbc-5d27-9e67-ea84945e2713 with identifier: JH71745
2026-03-28 19:01:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 44e3d968-bcbc-5d27-9e67-ea84945e2713 with scrape type 1
2026-03-28 19:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 44e3d968-bcbc-5d27-9e67-ea84945e2713
2026-03-28 19:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252Fd5%252F2bd56a16a8287f638f031dc6b0fa143c%252Fpa%252FJH71745_06bfdcc81d45f23dcfb22594a9806113.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/d5/2bd56a16a8287f638f031dc6b0fa143c/pa/JH71745_06bfdcc81d45f23dcfb22594a9806113.jpg not downloaded yet
2026-03-28 19:01:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6bc7060c-073b-58de-beef-c8508d6409d4 with identifier: VE70887
2026-03-28 19:01:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6bc7060c-073b-58de-beef-c8508d6409d4 with scrape type 1
2026-03-28 19:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6bc7060c-073b-58de-beef-c8508d6409d4
2026-03-28 19:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F0a%252Fbb0a7454d6d044f8265b1047e89c04d8%252Fpa%252FVE70887_e6cc73352ecda0e3dc5c7ae790508f5a.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/0a/bb0a7454d6d044f8265b1047e89c04d8/pa/VE70887_e6cc73352ecda0e3dc5c7ae790508f5a.jpg not downloaded yet
2026-03-28 19:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252Fd5%252F2bd56a16a8287f638f031dc6b0fa143c%252Fpa%252FJH71745_c5a6b7dcba580f3e0d368e7c025ccbe5.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/d5/2bd56a16a8287f638f031dc6b0fa143c/pa/JH71745_c5a6b7dcba580f3e0d368e7c025ccbe5.jpg not downloaded yet
2026-03-28 19:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F0a%252Fbb0a7454d6d044f8265b1047e89c04d8%252Fpa%252FVE70887_7237d7eb3850c3fbd7c30a49f308dff4.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/0a/bb0a7454d6d044f8265b1047e89c04d8/pa/VE70887_7237d7eb3850c3fbd7c30a49f308dff4.jpg not downloaded yet
2026-03-28 19:01:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ef3178cd-1a74-54a7-822f-6f70cbf8384a with identifier: ZP46172
2026-03-28 19:01:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ef3178cd-1a74-54a7-822f-6f70cbf8384a with scrape type 1
2026-03-28 19:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item ef3178cd-1a74-54a7-822f-6f70cbf8384a
2026-03-28 19:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252F74%252F78748a4eb97f59c70aee1baf44fa250c%252Fpa%252FZP46172_023c0c8bd0bc565540a01bcf301be264.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/74/78748a4eb97f59c70aee1baf44fa250c/pa/ZP46172_023c0c8bd0bc565540a01bcf301be264.jpg not downloaded yet
2026-03-28 19:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252Fd5%252F2bd56a16a8287f638f031dc6b0fa143c%252Fpa%252FJH71745_b6ecf096548baaf28f10d8c47bd3987b.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/d5/2bd56a16a8287f638f031dc6b0fa143c/pa/JH71745_b6ecf096548baaf28f10d8c47bd3987b.jpg not downloaded yet
2026-03-28 19:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F0a%252Fbb0a7454d6d044f8265b1047e89c04d8%252Fpa%252FVE70887_97c8be0b76ebd63a5bd6ca7a03c45c2d.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/0a/bb0a7454d6d044f8265b1047e89c04d8/pa/VE70887_97c8be0b76ebd63a5bd6ca7a03c45c2d.jpg not downloaded yet
2026-03-28 19:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252F74%252F78748a4eb97f59c70aee1baf44fa250c%252Fpa%252FZP46172_d388b9a5882daeb43128650b17f24a78.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/74/78748a4eb97f59c70aee1baf44fa250c/pa/ZP46172_d388b9a5882daeb43128650b17f24a78.jpg not downloaded yet
2026-03-28 19:01:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:01:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252Fd5%252F2bd56a16a8287f638f031dc6b0fa143c%252Fpa%252FJH71745_533dd9d0aad9292b4c420ae1d5779bb7.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/d5/2bd56a16a8287f638f031dc6b0fa143c/pa/JH71745_533dd9d0aad9292b4c420ae1d5779bb7.jpg not downloaded yet
2026-03-28 19:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F0a%252Fbb0a7454d6d044f8265b1047e89c04d8%252Fpa%252FVE70887_f2a8e19357b5dc4f290e3cc7cb6c588c.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/0a/bb0a7454d6d044f8265b1047e89c04d8/pa/VE70887_f2a8e19357b5dc4f290e3cc7cb6c588c.jpg not downloaded yet
2026-03-28 19:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252F74%252F78748a4eb97f59c70aee1baf44fa250c%252Fpa%252FZP46172_60de5cf153ab1c3e357d35578d00abac.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/74/78748a4eb97f59c70aee1baf44fa250c/pa/ZP46172_60de5cf153ab1c3e357d35578d00abac.jpg not downloaded yet
2026-03-28 19:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252Fd5%252F2bd56a16a8287f638f031dc6b0fa143c%252Fpa%252FJH71745_21a9e48267204475d81136b16092ddac.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/d5/2bd56a16a8287f638f031dc6b0fa143c/pa/JH71745_21a9e48267204475d81136b16092ddac.jpg not downloaded yet
2026-03-28 19:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F0a%252Fbb0a7454d6d044f8265b1047e89c04d8%252Fpa%252FVE70887_c187d94edf1d0a79a6abf4cbad6c2c82.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/0a/bb0a7454d6d044f8265b1047e89c04d8/pa/VE70887_c187d94edf1d0a79a6abf4cbad6c2c82.jpg not downloaded yet
2026-03-28 19:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252F74%252F78748a4eb97f59c70aee1baf44fa250c%252Fpa%252FZP46172_8c99f96ae28aa9514e71f59bd86cd49e.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/74/78748a4eb97f59c70aee1baf44fa250c/pa/ZP46172_8c99f96ae28aa9514e71f59bd86cd49e.jpg not downloaded yet
2026-03-28 19:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252Fd5%252F2bd56a16a8287f638f031dc6b0fa143c%252Fpa%252FJH71745_c49c1154d710b3422755fc89c93d906c.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/d5/2bd56a16a8287f638f031dc6b0fa143c/pa/JH71745_c49c1154d710b3422755fc89c93d906c.jpg not downloaded yet
2026-03-28 19:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F0a%252Fbb0a7454d6d044f8265b1047e89c04d8%252Fpa%252FVE70887_0f7975bb2c8ce4020c4a3347a96197cf.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/0a/bb0a7454d6d044f8265b1047e89c04d8/pa/VE70887_0f7975bb2c8ce4020c4a3347a96197cf.jpg not downloaded yet
2026-03-28 19:01:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img78/74/78748a4eb97f59c70aee1baf44fa250c/pa/ZP46172_023c0c8bd0bc565540a01bcf301be264.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252F74%252F78748a4eb97f59c70aee1baf44fa250c%252Fpa%252FZP46172_78f718b61c190a7b96a599fcc2380fb9.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/74/78748a4eb97f59c70aee1baf44fa250c/pa/ZP46172_78f718b61c190a7b96a599fcc2380fb9.jpg not downloaded yet
2026-03-28 19:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252Fd5%252F2bd56a16a8287f638f031dc6b0fa143c%252Fpa%252FJH71745_2201d39f684eb0a7f7302121cf482eeb.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/d5/2bd56a16a8287f638f031dc6b0fa143c/pa/JH71745_2201d39f684eb0a7f7302121cf482eeb.jpg not downloaded yet
2026-03-28 19:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F0a%252Fbb0a7454d6d044f8265b1047e89c04d8%252Fpa%252FVE70887_a83e87cb80fa13fede9e43e2e837479a.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/0a/bb0a7454d6d044f8265b1047e89c04d8/pa/VE70887_a83e87cb80fa13fede9e43e2e837479a.jpg not downloaded yet
2026-03-28 19:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252Fd5%252F2bd56a16a8287f638f031dc6b0fa143c%252Fpa%252FJH71745_662eaaa1a9ae8bf799422a3a31ea0f95.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/d5/2bd56a16a8287f638f031dc6b0fa143c/pa/JH71745_662eaaa1a9ae8bf799422a3a31ea0f95.jpg not downloaded yet
2026-03-28 19:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F0a%252Fbb0a7454d6d044f8265b1047e89c04d8%252Fpa%252FVE70887_054ed7cb234fbb9794ca20840baf199d.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/0a/bb0a7454d6d044f8265b1047e89c04d8/pa/VE70887_054ed7cb234fbb9794ca20840baf199d.jpg not downloaded yet
2026-03-28 19:01:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/0a/bb0a7454d6d044f8265b1047e89c04d8/pa/VE70887_97c8be0b76ebd63a5bd6ca7a03c45c2d.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252Fd5%252F2bd56a16a8287f638f031dc6b0fa143c%252Fpa%252FJH71745_b815804da6f379145e86a22890b123a7.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/d5/2bd56a16a8287f638f031dc6b0fa143c/pa/JH71745_b815804da6f379145e86a22890b123a7.jpg not downloaded yet
2026-03-28 19:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F0a%252Fbb0a7454d6d044f8265b1047e89c04d8%252Fpa%252FVE70887_050831dba0d34ffd1515b15397bc1259.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/0a/bb0a7454d6d044f8265b1047e89c04d8/pa/VE70887_050831dba0d34ffd1515b15397bc1259.jpg not downloaded yet
2026-03-28 19:01:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2b/d5/2bd56a16a8287f638f031dc6b0fa143c/pa/JH71745_b6ecf096548baaf28f10d8c47bd3987b.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252Fd5%252F2bd56a16a8287f638f031dc6b0fa143c%252Fpa%252FJH71745_e53c5154782e2001fceb1a5e376e3d72.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/d5/2bd56a16a8287f638f031dc6b0fa143c/pa/JH71745_e53c5154782e2001fceb1a5e376e3d72.jpg not downloaded yet
2026-03-28 19:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F0a%252Fbb0a7454d6d044f8265b1047e89c04d8%252Fpa%252FVE70887_66581679a43eed279b6ab4981f43feaa.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/0a/bb0a7454d6d044f8265b1047e89c04d8/pa/VE70887_66581679a43eed279b6ab4981f43feaa.jpg not downloaded yet
2026-03-28 19:01:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:01:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bd7202950>
2026-03-28 19:01:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:01:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:01:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:01:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef3178cd-1a74-54a7-822f-6f70cbf8384a/ef3178cd-1a74-54a7-822f-6f70cbf8384a_image_0.jpg HTTP/1.1" 201 0
2026-03-28 19:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252F74%252F78748a4eb97f59c70aee1baf44fa250c%252Fpa%252FZP46172_023c0c8bd0bc565540a01bcf301be264.jpg') HTTP/1.1" 204 0
2026-03-28 19:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/74/78748a4eb97f59c70aee1baf44fa250c/pa/ZP46172_023c0c8bd0bc565540a01bcf301be264.jpg saved to cache
2026-03-28 19:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ef3178cd-1a74-54a7-822f-6f70cbf8384a
2026-03-28 19:01:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:01:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bd71dc9d0>
2026-03-28 19:01:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:01:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:01:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:01:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6bc7060c-073b-58de-beef-c8508d6409d4/6bc7060c-073b-58de-beef-c8508d6409d4_image_2.jpg HTTP/1.1" 201 0
2026-03-28 19:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F0a%252Fbb0a7454d6d044f8265b1047e89c04d8%252Fpa%252FVE70887_97c8be0b76ebd63a5bd6ca7a03c45c2d.jpg') HTTP/1.1" 204 0
2026-03-28 19:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/0a/bb0a7454d6d044f8265b1047e89c04d8/pa/VE70887_97c8be0b76ebd63a5bd6ca7a03c45c2d.jpg saved to cache
2026-03-28 19:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6bc7060c-073b-58de-beef-c8508d6409d4
2026-03-28 19:01:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/0a/bb0a7454d6d044f8265b1047e89c04d8/pa/VE70887_0f7975bb2c8ce4020c4a3347a96197cf.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:01:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:01:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bd6397710>
2026-03-28 19:01:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:01:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:01:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:01:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44e3d968-bcbc-5d27-9e67-ea84945e2713/44e3d968-bcbc-5d27-9e67-ea84945e2713_image_2.jpg HTTP/1.1" 201 0
2026-03-28 19:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252Fd5%252F2bd56a16a8287f638f031dc6b0fa143c%252Fpa%252FJH71745_b6ecf096548baaf28f10d8c47bd3987b.jpg') HTTP/1.1" 204 0
2026-03-28 19:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/d5/2bd56a16a8287f638f031dc6b0fa143c/pa/JH71745_b6ecf096548baaf28f10d8c47bd3987b.jpg saved to cache
2026-03-28 19:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 44e3d968-bcbc-5d27-9e67-ea84945e2713
2026-03-28 19:01:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/0a/bb0a7454d6d044f8265b1047e89c04d8/pa/VE70887_e6cc73352ecda0e3dc5c7ae790508f5a.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:01:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2b/d5/2bd56a16a8287f638f031dc6b0fa143c/pa/JH71745_06bfdcc81d45f23dcfb22594a9806113.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:01:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2b/d5/2bd56a16a8287f638f031dc6b0fa143c/pa/JH71745_c5a6b7dcba580f3e0d368e7c025ccbe5.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:01:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/0a/bb0a7454d6d044f8265b1047e89c04d8/pa/VE70887_054ed7cb234fbb9794ca20840baf199d.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:01:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:01:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bd73db650>
2026-03-28 19:01:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:01:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:01:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:01:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6bc7060c-073b-58de-beef-c8508d6409d4/6bc7060c-073b-58de-beef-c8508d6409d4_image_5.jpg HTTP/1.1" 201 0
2026-03-28 19:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F0a%252Fbb0a7454d6d044f8265b1047e89c04d8%252Fpa%252FVE70887_0f7975bb2c8ce4020c4a3347a96197cf.jpg') HTTP/1.1" 204 0
2026-03-28 19:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/0a/bb0a7454d6d044f8265b1047e89c04d8/pa/VE70887_0f7975bb2c8ce4020c4a3347a96197cf.jpg saved to cache
2026-03-28 19:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6bc7060c-073b-58de-beef-c8508d6409d4
2026-03-28 19:01:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/0a/bb0a7454d6d044f8265b1047e89c04d8/pa/VE70887_050831dba0d34ffd1515b15397bc1259.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:01:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/0a/bb0a7454d6d044f8265b1047e89c04d8/pa/VE70887_66581679a43eed279b6ab4981f43feaa.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:01:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 19:01:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:01:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bd6806590>
2026-03-28 19:01:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:01:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:01:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:01:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6bc7060c-073b-58de-beef-c8508d6409d4/6bc7060c-073b-58de-beef-c8508d6409d4_image_0.jpg HTTP/1.1" 201 0
2026-03-28 19:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F0a%252Fbb0a7454d6d044f8265b1047e89c04d8%252Fpa%252FVE70887_e6cc73352ecda0e3dc5c7ae790508f5a.jpg') HTTP/1.1" 204 0
2026-03-28 19:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/0a/bb0a7454d6d044f8265b1047e89c04d8/pa/VE70887_e6cc73352ecda0e3dc5c7ae790508f5a.jpg saved to cache
2026-03-28 19:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6bc7060c-073b-58de-beef-c8508d6409d4
2026-03-28 19:01:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2b/d5/2bd56a16a8287f638f031dc6b0fa143c/pa/JH71745_e53c5154782e2001fceb1a5e376e3d72.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:01:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/0a/bb0a7454d6d044f8265b1047e89c04d8/pa/VE70887_7237d7eb3850c3fbd7c30a49f308dff4.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:01:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 19:01:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:01:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bd7203090>
2026-03-28 19:01:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:01:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:01:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44e3d968-bcbc-5d27-9e67-ea84945e2713/44e3d968-bcbc-5d27-9e67-ea84945e2713_image_0.jpg HTTP/1.1" 201 0
2026-03-28 19:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252Fd5%252F2bd56a16a8287f638f031dc6b0fa143c%252Fpa%252FJH71745_06bfdcc81d45f23dcfb22594a9806113.jpg') HTTP/1.1" 204 0
2026-03-28 19:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/d5/2bd56a16a8287f638f031dc6b0fa143c/pa/JH71745_06bfdcc81d45f23dcfb22594a9806113.jpg saved to cache
2026-03-28 19:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 44e3d968-bcbc-5d27-9e67-ea84945e2713
2026-03-28 19:01:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 19:01:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:01:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bd63d5a90>
2026-03-28 19:01:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:01:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44e3d968-bcbc-5d27-9e67-ea84945e2713/44e3d968-bcbc-5d27-9e67-ea84945e2713_image_1.jpg HTTP/1.1" 201 0
2026-03-28 19:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252Fd5%252F2bd56a16a8287f638f031dc6b0fa143c%252Fpa%252FJH71745_c5a6b7dcba580f3e0d368e7c025ccbe5.jpg') HTTP/1.1" 204 0
2026-03-28 19:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/d5/2bd56a16a8287f638f031dc6b0fa143c/pa/JH71745_c5a6b7dcba580f3e0d368e7c025ccbe5.jpg saved to cache
2026-03-28 19:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 44e3d968-bcbc-5d27-9e67-ea84945e2713
2026-03-28 19:01:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 19:01:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:01:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bd68bdb10>
2026-03-28 19:01:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:01:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6bc7060c-073b-58de-beef-c8508d6409d4/6bc7060c-073b-58de-beef-c8508d6409d4_image_7.jpg HTTP/1.1" 201 0
2026-03-28 19:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F0a%252Fbb0a7454d6d044f8265b1047e89c04d8%252Fpa%252FVE70887_054ed7cb234fbb9794ca20840baf199d.jpg') HTTP/1.1" 204 0
2026-03-28 19:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/0a/bb0a7454d6d044f8265b1047e89c04d8/pa/VE70887_054ed7cb234fbb9794ca20840baf199d.jpg saved to cache
2026-03-28 19:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6bc7060c-073b-58de-beef-c8508d6409d4
2026-03-28 19:01:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:01:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bd635b890>
2026-03-28 19:01:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:01:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6bc7060c-073b-58de-beef-c8508d6409d4/6bc7060c-073b-58de-beef-c8508d6409d4_image_8.jpg HTTP/1.1" 201 0
2026-03-28 19:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F0a%252Fbb0a7454d6d044f8265b1047e89c04d8%252Fpa%252FVE70887_050831dba0d34ffd1515b15397bc1259.jpg') HTTP/1.1" 204 0
2026-03-28 19:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/0a/bb0a7454d6d044f8265b1047e89c04d8/pa/VE70887_050831dba0d34ffd1515b15397bc1259.jpg saved to cache
2026-03-28 19:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6bc7060c-073b-58de-beef-c8508d6409d4
2026-03-28 19:01:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:01:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bd728ab50>
2026-03-28 19:01:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:01:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6bc7060c-073b-58de-beef-c8508d6409d4/6bc7060c-073b-58de-beef-c8508d6409d4_image_9.jpg HTTP/1.1" 201 0
2026-03-28 19:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F0a%252Fbb0a7454d6d044f8265b1047e89c04d8%252Fpa%252FVE70887_66581679a43eed279b6ab4981f43feaa.jpg') HTTP/1.1" 204 0
2026-03-28 19:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/0a/bb0a7454d6d044f8265b1047e89c04d8/pa/VE70887_66581679a43eed279b6ab4981f43feaa.jpg saved to cache
2026-03-28 19:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6bc7060c-073b-58de-beef-c8508d6409d4
2026-03-28 19:01:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GD33520> (referer: https://www.auto1.com/v1/car-details-view/GD33520/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 19:01:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AB54003> (referer: https://www.auto1.com/v1/car-details-view/AB54003/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 19:01:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JA39510> (referer: https://www.auto1.com/v1/car-details-view/JA39510/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 19:01:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VZ65695> (referer: https://www.auto1.com/v1/car-details-view/VZ65695/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 19:01:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:01:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XU82529> (referer: https://www.auto1.com/v1/car-details-view/XU82529/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 19:01:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:01:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bd63fe9d0>
2026-03-28 19:01:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:01:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44e3d968-bcbc-5d27-9e67-ea84945e2713/44e3d968-bcbc-5d27-9e67-ea84945e2713_image_9.jpg HTTP/1.1" 201 0
2026-03-28 19:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252Fd5%252F2bd56a16a8287f638f031dc6b0fa143c%252Fpa%252FJH71745_e53c5154782e2001fceb1a5e376e3d72.jpg') HTTP/1.1" 204 0
2026-03-28 19:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/d5/2bd56a16a8287f638f031dc6b0fa143c/pa/JH71745_e53c5154782e2001fceb1a5e376e3d72.jpg saved to cache
2026-03-28 19:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 44e3d968-bcbc-5d27-9e67-ea84945e2713
2026-03-28 19:01:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 19:01:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:01:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bd72c9150>
2026-03-28 19:01:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:01:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6bc7060c-073b-58de-beef-c8508d6409d4/6bc7060c-073b-58de-beef-c8508d6409d4_image_1.jpg HTTP/1.1" 201 0
2026-03-28 19:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F0a%252Fbb0a7454d6d044f8265b1047e89c04d8%252Fpa%252FVE70887_7237d7eb3850c3fbd7c30a49f308dff4.jpg') HTTP/1.1" 204 0
2026-03-28 19:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/0a/bb0a7454d6d044f8265b1047e89c04d8/pa/VE70887_7237d7eb3850c3fbd7c30a49f308dff4.jpg saved to cache
2026-03-28 19:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6bc7060c-073b-58de-beef-c8508d6409d4
2026-03-28 19:01:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d6898af0-474d-5809-b3f5-b9bfdc46a8dd with identifier: GD33520
2026-03-28 19:01:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d6898af0-474d-5809-b3f5-b9bfdc46a8dd with scrape type 1
2026-03-28 19:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item d6898af0-474d-5809-b3f5-b9bfdc46a8dd
2026-03-28 19:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F74%252Fb57435d1ad9f90020e6ec322db0a9b7a%252Fpa%252FGD33520_8a0f899f4b1c9cc0a382df71b84f8004.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/74/b57435d1ad9f90020e6ec322db0a9b7a/pa/GD33520_8a0f899f4b1c9cc0a382df71b84f8004.jpg not downloaded yet
2026-03-28 19:01:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8e6087bb-7fb1-5752-9efd-86bcbca3bd04 with identifier: AB54003
2026-03-28 19:01:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8e6087bb-7fb1-5752-9efd-86bcbca3bd04 with scrape type 1
2026-03-28 19:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8e6087bb-7fb1-5752-9efd-86bcbca3bd04
2026-03-28 19:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F10%252F7010e65fe5afc60f34edfde6de61a9e5%252Fpa%252FAB54003_c0f1b0c6907219f30cd983b17b3a20a3.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/10/7010e65fe5afc60f34edfde6de61a9e5/pa/AB54003_c0f1b0c6907219f30cd983b17b3a20a3.jpg not downloaded yet
2026-03-28 19:01:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8ea6a973-540e-591c-a7e6-4b7cc45585c6 with identifier: JA39510
2026-03-28 19:01:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8ea6a973-540e-591c-a7e6-4b7cc45585c6 with scrape type 1
2026-03-28 19:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8ea6a973-540e-591c-a7e6-4b7cc45585c6
2026-03-28 19:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F6e%252Fb26e0ecaeb888cbc80b7ac3e2d07f8ea%252Fpa%252FJA39510_5614310eccb2bfec6bd5075718c29548.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/6e/b26e0ecaeb888cbc80b7ac3e2d07f8ea/pa/JA39510_5614310eccb2bfec6bd5075718c29548.jpg not downloaded yet
2026-03-28 19:01:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8a0b0f05-0f96-5994-be70-04a2adef2a1d with identifier: VZ65695
2026-03-28 19:01:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8a0b0f05-0f96-5994-be70-04a2adef2a1d with scrape type 1
2026-03-28 19:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 8a0b0f05-0f96-5994-be70-04a2adef2a1d
2026-03-28 19:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252F9d%252Fc19da74caa957efa0bf0e0736809002a%252Fpa%252FVZ65695_4984bf959b0aba0c784814a503d4dc1e.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/9d/c19da74caa957efa0bf0e0736809002a/pa/VZ65695_4984bf959b0aba0c784814a503d4dc1e.jpg not downloaded yet
2026-03-28 19:01:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9ae0b164-4798-5bb4-9fab-9fc1b2249c69 with identifier: XU82529
2026-03-28 19:01:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9ae0b164-4798-5bb4-9fab-9fc1b2249c69 with scrape type 1
2026-03-28 19:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9ae0b164-4798-5bb4-9fab-9fc1b2249c69
2026-03-28 19:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Fa8%252F03a801e23e6839b8ac2f4286813d179b%252Fpa%252FXU82529_2b232f9407af6176b6d2f162a29127f3.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/a8/03a801e23e6839b8ac2f4286813d179b/pa/XU82529_2b232f9407af6176b6d2f162a29127f3.jpg not downloaded yet
2026-03-28 19:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F74%252Fb57435d1ad9f90020e6ec322db0a9b7a%252Fpa%252FGD33520_6b329f0e3d7ef3864beeac7d7a3eff96.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/74/b57435d1ad9f90020e6ec322db0a9b7a/pa/GD33520_6b329f0e3d7ef3864beeac7d7a3eff96.jpg not downloaded yet
2026-03-28 19:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F10%252F7010e65fe5afc60f34edfde6de61a9e5%252Fpa%252FAB54003_c3ffa57d024049ee40510056d0adb729.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/10/7010e65fe5afc60f34edfde6de61a9e5/pa/AB54003_c3ffa57d024049ee40510056d0adb729.jpg not downloaded yet
2026-03-28 19:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F6e%252Fb26e0ecaeb888cbc80b7ac3e2d07f8ea%252Fpa%252FJA39510_953ad81fb8bb7ebca56f41d16ae8584f.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/6e/b26e0ecaeb888cbc80b7ac3e2d07f8ea/pa/JA39510_953ad81fb8bb7ebca56f41d16ae8584f.jpg not downloaded yet
2026-03-28 19:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252F9d%252Fc19da74caa957efa0bf0e0736809002a%252Fpa%252FVZ65695_127591d6efc7ea0a52528d5f3591c3b1.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/9d/c19da74caa957efa0bf0e0736809002a/pa/VZ65695_127591d6efc7ea0a52528d5f3591c3b1.jpg not downloaded yet
2026-03-28 19:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Fa8%252F03a801e23e6839b8ac2f4286813d179b%252Fpa%252FXU82529_942c3f9fd485e2d23a5048e44b825254.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/a8/03a801e23e6839b8ac2f4286813d179b/pa/XU82529_942c3f9fd485e2d23a5048e44b825254.jpg not downloaded yet
2026-03-28 19:01:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img78/74/78748a4eb97f59c70aee1baf44fa250c/pa/ZP46172_78f718b61c190a7b96a599fcc2380fb9.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:01:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2b/d5/2bd56a16a8287f638f031dc6b0fa143c/pa/JH71745_c49c1154d710b3422755fc89c93d906c.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:01:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img78/74/78748a4eb97f59c70aee1baf44fa250c/pa/ZP46172_8c99f96ae28aa9514e71f59bd86cd49e.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F74%252Fb57435d1ad9f90020e6ec322db0a9b7a%252Fpa%252FGD33520_89b94b56a4ab83c5707e53364a1854bd.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/74/b57435d1ad9f90020e6ec322db0a9b7a/pa/GD33520_89b94b56a4ab83c5707e53364a1854bd.jpg not downloaded yet
2026-03-28 19:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F10%252F7010e65fe5afc60f34edfde6de61a9e5%252Fpa%252FAB54003_fd31a25b9f066b95c8efcbaf4836d4fa.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/10/7010e65fe5afc60f34edfde6de61a9e5/pa/AB54003_fd31a25b9f066b95c8efcbaf4836d4fa.jpg not downloaded yet
2026-03-28 19:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F6e%252Fb26e0ecaeb888cbc80b7ac3e2d07f8ea%252Fpa%252FJA39510_3eaf2e1f1439dae5ec4198419b979a58.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/6e/b26e0ecaeb888cbc80b7ac3e2d07f8ea/pa/JA39510_3eaf2e1f1439dae5ec4198419b979a58.jpg not downloaded yet
2026-03-28 19:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252F9d%252Fc19da74caa957efa0bf0e0736809002a%252Fpa%252FVZ65695_e8e76606979873607b34061e60c4e149.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/9d/c19da74caa957efa0bf0e0736809002a/pa/VZ65695_e8e76606979873607b34061e60c4e149.jpg not downloaded yet
2026-03-28 19:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Fa8%252F03a801e23e6839b8ac2f4286813d179b%252Fpa%252FXU82529_e438f5d98f1de745b60c416648d531e7.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/a8/03a801e23e6839b8ac2f4286813d179b/pa/XU82529_e438f5d98f1de745b60c416648d531e7.jpg not downloaded yet
2026-03-28 19:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F74%252Fb57435d1ad9f90020e6ec322db0a9b7a%252Fpa%252FGD33520_1532bb95c705200beb6b4deb26041bf9.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/74/b57435d1ad9f90020e6ec322db0a9b7a/pa/GD33520_1532bb95c705200beb6b4deb26041bf9.jpg not downloaded yet
2026-03-28 19:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F10%252F7010e65fe5afc60f34edfde6de61a9e5%252Fpa%252FAB54003_c923a2a347f496739748102752a0fb74.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/10/7010e65fe5afc60f34edfde6de61a9e5/pa/AB54003_c923a2a347f496739748102752a0fb74.jpg not downloaded yet
2026-03-28 19:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F6e%252Fb26e0ecaeb888cbc80b7ac3e2d07f8ea%252Fpa%252FJA39510_4e1eaa78f6911c33b24edf643e8e4d68.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/6e/b26e0ecaeb888cbc80b7ac3e2d07f8ea/pa/JA39510_4e1eaa78f6911c33b24edf643e8e4d68.jpg not downloaded yet
2026-03-28 19:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252F9d%252Fc19da74caa957efa0bf0e0736809002a%252Fpa%252FVZ65695_630bfbf3e9efd5e5ff2a86bd99aa58d3.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/9d/c19da74caa957efa0bf0e0736809002a/pa/VZ65695_630bfbf3e9efd5e5ff2a86bd99aa58d3.jpg not downloaded yet
2026-03-28 19:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Fa8%252F03a801e23e6839b8ac2f4286813d179b%252Fpa%252FXU82529_eee769f96b410556197b940ef2b100eb.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/a8/03a801e23e6839b8ac2f4286813d179b/pa/XU82529_eee769f96b410556197b940ef2b100eb.jpg not downloaded yet
2026-03-28 19:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F74%252Fb57435d1ad9f90020e6ec322db0a9b7a%252Fpa%252FGD33520_08b4bf8bd0afb85eeb45b391b43cb6f5.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/74/b57435d1ad9f90020e6ec322db0a9b7a/pa/GD33520_08b4bf8bd0afb85eeb45b391b43cb6f5.jpg not downloaded yet
2026-03-28 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F10%252F7010e65fe5afc60f34edfde6de61a9e5%252Fpa%252FAB54003_53f4b9d86ca9c7e9fadd2a6e1623005f.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/10/7010e65fe5afc60f34edfde6de61a9e5/pa/AB54003_53f4b9d86ca9c7e9fadd2a6e1623005f.jpg not downloaded yet
2026-03-28 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F6e%252Fb26e0ecaeb888cbc80b7ac3e2d07f8ea%252Fpa%252FJA39510_c2c03a58aeeadf199862449ee472b7c2.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/6e/b26e0ecaeb888cbc80b7ac3e2d07f8ea/pa/JA39510_c2c03a58aeeadf199862449ee472b7c2.jpg not downloaded yet
2026-03-28 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252F9d%252Fc19da74caa957efa0bf0e0736809002a%252Fpa%252FVZ65695_c732a90fcfa8012d8dc8088ce734d638.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/9d/c19da74caa957efa0bf0e0736809002a/pa/VZ65695_c732a90fcfa8012d8dc8088ce734d638.jpg not downloaded yet
2026-03-28 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Fa8%252F03a801e23e6839b8ac2f4286813d179b%252Fpa%252FXU82529_1477557ca164ae62d389d04ba91cc501.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/a8/03a801e23e6839b8ac2f4286813d179b/pa/XU82529_1477557ca164ae62d389d04ba91cc501.jpg not downloaded yet
2026-03-28 19:01:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:01:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bd62c4f50>
2026-03-28 19:01:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:01:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef3178cd-1a74-54a7-822f-6f70cbf8384a/ef3178cd-1a74-54a7-822f-6f70cbf8384a_image_4.jpg HTTP/1.1" 201 0
2026-03-28 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252F74%252F78748a4eb97f59c70aee1baf44fa250c%252Fpa%252FZP46172_78f718b61c190a7b96a599fcc2380fb9.jpg') HTTP/1.1" 204 0
2026-03-28 19:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/74/78748a4eb97f59c70aee1baf44fa250c/pa/ZP46172_78f718b61c190a7b96a599fcc2380fb9.jpg saved to cache
2026-03-28 19:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ef3178cd-1a74-54a7-822f-6f70cbf8384a
2026-03-28 19:01:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:01:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bdd20ccd0>
2026-03-28 19:01:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:01:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44e3d968-bcbc-5d27-9e67-ea84945e2713/44e3d968-bcbc-5d27-9e67-ea84945e2713_image_5.jpg HTTP/1.1" 201 0
2026-03-28 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252Fd5%252F2bd56a16a8287f638f031dc6b0fa143c%252Fpa%252FJH71745_c49c1154d710b3422755fc89c93d906c.jpg') HTTP/1.1" 204 0
2026-03-28 19:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/d5/2bd56a16a8287f638f031dc6b0fa143c/pa/JH71745_c49c1154d710b3422755fc89c93d906c.jpg saved to cache
2026-03-28 19:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 44e3d968-bcbc-5d27-9e67-ea84945e2713
2026-03-28 19:01:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:01:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bd73679d0>
2026-03-28 19:01:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:01:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef3178cd-1a74-54a7-822f-6f70cbf8384a/ef3178cd-1a74-54a7-822f-6f70cbf8384a_image_3.jpg HTTP/1.1" 201 0
2026-03-28 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252F74%252F78748a4eb97f59c70aee1baf44fa250c%252Fpa%252FZP46172_8c99f96ae28aa9514e71f59bd86cd49e.jpg') HTTP/1.1" 204 0
2026-03-28 19:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/74/78748a4eb97f59c70aee1baf44fa250c/pa/ZP46172_8c99f96ae28aa9514e71f59bd86cd49e.jpg saved to cache
2026-03-28 19:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ef3178cd-1a74-54a7-822f-6f70cbf8384a
2026-03-28 19:01:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2b/d5/2bd56a16a8287f638f031dc6b0fa143c/pa/JH71745_21a9e48267204475d81136b16092ddac.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:01:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/0a/bb0a7454d6d044f8265b1047e89c04d8/pa/VE70887_f2a8e19357b5dc4f290e3cc7cb6c588c.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F10%252F7010e65fe5afc60f34edfde6de61a9e5%252Fpa%252FAB54003_14b95610b794ed87963cb78eb067287b.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/10/7010e65fe5afc60f34edfde6de61a9e5/pa/AB54003_14b95610b794ed87963cb78eb067287b.jpg not downloaded yet
2026-03-28 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F6e%252Fb26e0ecaeb888cbc80b7ac3e2d07f8ea%252Fpa%252FJA39510_01663c9cf11ac4813e1bec2fe60eb8d2.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/6e/b26e0ecaeb888cbc80b7ac3e2d07f8ea/pa/JA39510_01663c9cf11ac4813e1bec2fe60eb8d2.jpg not downloaded yet
2026-03-28 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Fa8%252F03a801e23e6839b8ac2f4286813d179b%252Fpa%252FXU82529_9106e884787ee1a08096c448fc10a523.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/a8/03a801e23e6839b8ac2f4286813d179b/pa/XU82529_9106e884787ee1a08096c448fc10a523.jpg not downloaded yet
2026-03-28 19:01:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img78/74/78748a4eb97f59c70aee1baf44fa250c/pa/ZP46172_60de5cf153ab1c3e357d35578d00abac.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:01:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HD36341> (referer: https://www.auto1.com/v1/car-details-view/HD36341/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F10%252F7010e65fe5afc60f34edfde6de61a9e5%252Fpa%252FAB54003_f5e2a6e765ea5fcf7448299c3bc36b9a.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/10/7010e65fe5afc60f34edfde6de61a9e5/pa/AB54003_f5e2a6e765ea5fcf7448299c3bc36b9a.jpg not downloaded yet
2026-03-28 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F6e%252Fb26e0ecaeb888cbc80b7ac3e2d07f8ea%252Fpa%252FJA39510_0cbc3400ab650145c95bfcb81c69ed94.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/6e/b26e0ecaeb888cbc80b7ac3e2d07f8ea/pa/JA39510_0cbc3400ab650145c95bfcb81c69ed94.jpg not downloaded yet
2026-03-28 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Fa8%252F03a801e23e6839b8ac2f4286813d179b%252Fpa%252FXU82529_90b0f3713ce804e7bab72a252a9f2720.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/a8/03a801e23e6839b8ac2f4286813d179b/pa/XU82529_90b0f3713ce804e7bab72a252a9f2720.jpg not downloaded yet
2026-03-28 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F10%252F7010e65fe5afc60f34edfde6de61a9e5%252Fpa%252FAB54003_710a43b24498d679ab16eda40b066670.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/10/7010e65fe5afc60f34edfde6de61a9e5/pa/AB54003_710a43b24498d679ab16eda40b066670.jpg not downloaded yet
2026-03-28 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F6e%252Fb26e0ecaeb888cbc80b7ac3e2d07f8ea%252Fpa%252FJA39510_4ab5617d693daa1378169d116ee816d4.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/6e/b26e0ecaeb888cbc80b7ac3e2d07f8ea/pa/JA39510_4ab5617d693daa1378169d116ee816d4.jpg not downloaded yet
2026-03-28 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Fa8%252F03a801e23e6839b8ac2f4286813d179b%252Fpa%252FXU82529_8ab19b3ab6c777cc91a3362a44660d92.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/a8/03a801e23e6839b8ac2f4286813d179b/pa/XU82529_8ab19b3ab6c777cc91a3362a44660d92.jpg not downloaded yet
2026-03-28 19:01:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/a8/03a801e23e6839b8ac2f4286813d179b/pa/XU82529_942c3f9fd485e2d23a5048e44b825254.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:01:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JA81822> (referer: https://www.auto1.com/v1/car-details-view/JA81822/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 19:01:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:01:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bd6248f50>
2026-03-28 19:01:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:01:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44e3d968-bcbc-5d27-9e67-ea84945e2713/44e3d968-bcbc-5d27-9e67-ea84945e2713_image_4.jpg HTTP/1.1" 201 0
2026-03-28 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252Fd5%252F2bd56a16a8287f638f031dc6b0fa143c%252Fpa%252FJH71745_21a9e48267204475d81136b16092ddac.jpg') HTTP/1.1" 204 0
2026-03-28 19:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/d5/2bd56a16a8287f638f031dc6b0fa143c/pa/JH71745_21a9e48267204475d81136b16092ddac.jpg saved to cache
2026-03-28 19:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 44e3d968-bcbc-5d27-9e67-ea84945e2713
2026-03-28 19:01:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:01:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bd63a8650>
2026-03-28 19:01:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:01:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6bc7060c-073b-58de-beef-c8508d6409d4/6bc7060c-073b-58de-beef-c8508d6409d4_image_3.jpg HTTP/1.1" 201 0
2026-03-28 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F0a%252Fbb0a7454d6d044f8265b1047e89c04d8%252Fpa%252FVE70887_f2a8e19357b5dc4f290e3cc7cb6c588c.jpg') HTTP/1.1" 204 0
2026-03-28 19:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/0a/bb0a7454d6d044f8265b1047e89c04d8/pa/VE70887_f2a8e19357b5dc4f290e3cc7cb6c588c.jpg saved to cache
2026-03-28 19:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6bc7060c-073b-58de-beef-c8508d6409d4
2026-03-28 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F10%252F7010e65fe5afc60f34edfde6de61a9e5%252Fpa%252FAB54003_247f362c4d00a383cf0099aa39e54ec4.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/10/7010e65fe5afc60f34edfde6de61a9e5/pa/AB54003_247f362c4d00a383cf0099aa39e54ec4.jpg not downloaded yet
2026-03-28 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F6e%252Fb26e0ecaeb888cbc80b7ac3e2d07f8ea%252Fpa%252FJA39510_34812893ef409eb25f045c886c73ea99.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/6e/b26e0ecaeb888cbc80b7ac3e2d07f8ea/pa/JA39510_34812893ef409eb25f045c886c73ea99.jpg not downloaded yet
2026-03-28 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Fa8%252F03a801e23e6839b8ac2f4286813d179b%252Fpa%252FXU82529_9e2ee47df834d11ad4243b51ba923e55.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/a8/03a801e23e6839b8ac2f4286813d179b/pa/XU82529_9e2ee47df834d11ad4243b51ba923e55.jpg not downloaded yet
2026-03-28 19:01:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GU70185> (referer: https://www.auto1.com/v1/car-details-view/GU70185/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 19:01:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:01:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bd72f4d90>
2026-03-28 19:01:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:01:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef3178cd-1a74-54a7-822f-6f70cbf8384a/ef3178cd-1a74-54a7-822f-6f70cbf8384a_image_2.jpg HTTP/1.1" 201 0
2026-03-28 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252F74%252F78748a4eb97f59c70aee1baf44fa250c%252Fpa%252FZP46172_60de5cf153ab1c3e357d35578d00abac.jpg') HTTP/1.1" 204 0
2026-03-28 19:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/74/78748a4eb97f59c70aee1baf44fa250c/pa/ZP46172_60de5cf153ab1c3e357d35578d00abac.jpg saved to cache
2026-03-28 19:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ef3178cd-1a74-54a7-822f-6f70cbf8384a
2026-03-28 19:01:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 418766cd-2652-531c-ae84-79122e35eebb with identifier: HD36341
2026-03-28 19:01:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 418766cd-2652-531c-ae84-79122e35eebb with scrape type 1
2026-03-28 19:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 418766cd-2652-531c-ae84-79122e35eebb
2026-03-28 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252F5c%252F495ca80b91f6aede95a5b12be31ce101%252Fpa%252FHD36341_b4e56bb5ce7517da6a4ee254a9e877b1.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/5c/495ca80b91f6aede95a5b12be31ce101/pa/HD36341_b4e56bb5ce7517da6a4ee254a9e877b1.jpg not downloaded yet
2026-03-28 19:01:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2b/d5/2bd56a16a8287f638f031dc6b0fa143c/pa/JH71745_533dd9d0aad9292b4c420ae1d5779bb7.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F10%252F7010e65fe5afc60f34edfde6de61a9e5%252Fpa%252FAB54003_add7f015570b0af50c2f3c96ca77e0b8.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/10/7010e65fe5afc60f34edfde6de61a9e5/pa/AB54003_add7f015570b0af50c2f3c96ca77e0b8.jpg not downloaded yet
2026-03-28 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F6e%252Fb26e0ecaeb888cbc80b7ac3e2d07f8ea%252Fpa%252FJA39510_9f072a3dbec8773bad7ccba868174287.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/6e/b26e0ecaeb888cbc80b7ac3e2d07f8ea/pa/JA39510_9f072a3dbec8773bad7ccba868174287.jpg not downloaded yet
2026-03-28 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Fa8%252F03a801e23e6839b8ac2f4286813d179b%252Fpa%252FXU82529_ed77531baa59dee9e862fd34af7d0300.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/a8/03a801e23e6839b8ac2f4286813d179b/pa/XU82529_ed77531baa59dee9e862fd34af7d0300.jpg not downloaded yet
2026-03-28 19:01:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc1/9d/c19da74caa957efa0bf0e0736809002a/pa/VZ65695_127591d6efc7ea0a52528d5f3591c3b1.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252F5c%252F495ca80b91f6aede95a5b12be31ce101%252Fpa%252FHD36341_b8465f82d900d7986e0cb8e9ac3f977c.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/5c/495ca80b91f6aede95a5b12be31ce101/pa/HD36341_b8465f82d900d7986e0cb8e9ac3f977c.jpg not downloaded yet
2026-03-28 19:01:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:01:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bd71d7c90>
2026-03-28 19:01:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:01:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9ae0b164-4798-5bb4-9fab-9fc1b2249c69/9ae0b164-4798-5bb4-9fab-9fc1b2249c69_image_1.jpg HTTP/1.1" 201 0
2026-03-28 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Fa8%252F03a801e23e6839b8ac2f4286813d179b%252Fpa%252FXU82529_942c3f9fd485e2d23a5048e44b825254.jpg') HTTP/1.1" 204 0
2026-03-28 19:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/a8/03a801e23e6839b8ac2f4286813d179b/pa/XU82529_942c3f9fd485e2d23a5048e44b825254.jpg saved to cache
2026-03-28 19:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9ae0b164-4798-5bb4-9fab-9fc1b2249c69
2026-03-28 19:01:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 598b1327-4c58-5b56-962a-8a6cc715d2f9 with identifier: JA81822
2026-03-28 19:01:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 598b1327-4c58-5b56-962a-8a6cc715d2f9 with scrape type 1
2026-03-28 19:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 598b1327-4c58-5b56-962a-8a6cc715d2f9
2026-03-28 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F17%252F9517e25f62662c7d4a5b91c18a27b826%252Fpa%252FJA81822_b1d76a1dbd07423bfa1f2190053e7b91.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/17/9517e25f62662c7d4a5b91c18a27b826/pa/JA81822_b1d76a1dbd07423bfa1f2190053e7b91.jpg not downloaded yet
2026-03-28 19:01:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb2/6e/b26e0ecaeb888cbc80b7ac3e2d07f8ea/pa/JA39510_953ad81fb8bb7ebca56f41d16ae8584f.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252F5c%252F495ca80b91f6aede95a5b12be31ce101%252Fpa%252FHD36341_4437e3467f6f9837f36bcb63fa18a151.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/5c/495ca80b91f6aede95a5b12be31ce101/pa/HD36341_4437e3467f6f9837f36bcb63fa18a151.jpg not downloaded yet
2026-03-28 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F17%252F9517e25f62662c7d4a5b91c18a27b826%252Fpa%252FJA81822_46b043a2ef4a9a06024bbd568d7280dc.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/17/9517e25f62662c7d4a5b91c18a27b826/pa/JA81822_46b043a2ef4a9a06024bbd568d7280dc.jpg not downloaded yet
2026-03-28 19:01:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c0f3daf4-1b50-5132-8844-a271f81c8908 with identifier: GU70185
2026-03-28 19:01:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c0f3daf4-1b50-5132-8844-a271f81c8908 with scrape type 1
2026-03-28 19:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c0f3daf4-1b50-5132-8844-a271f81c8908
2026-03-28 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F2a%252Fd22a7fecef685c48cd26db72bb9e2d36%252Fpa%252FGU70185_41243b1316a8989c664d71d862d08b2f.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/2a/d22a7fecef685c48cd26db72bb9e2d36/pa/GU70185_41243b1316a8989c664d71d862d08b2f.jpg not downloaded yet
2026-03-28 19:01:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/a8/03a801e23e6839b8ac2f4286813d179b/pa/XU82529_1477557ca164ae62d389d04ba91cc501.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252F5c%252F495ca80b91f6aede95a5b12be31ce101%252Fpa%252FHD36341_836c20de04336cc6c60e2877be393dfb.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/5c/495ca80b91f6aede95a5b12be31ce101/pa/HD36341_836c20de04336cc6c60e2877be393dfb.jpg not downloaded yet
2026-03-28 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F17%252F9517e25f62662c7d4a5b91c18a27b826%252Fpa%252FJA81822_af2ae41e0761027d2c899d91d13bd29c.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/17/9517e25f62662c7d4a5b91c18a27b826/pa/JA81822_af2ae41e0761027d2c899d91d13bd29c.jpg not downloaded yet
2026-03-28 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F2a%252Fd22a7fecef685c48cd26db72bb9e2d36%252Fpa%252FGU70185_8509ab3b2c6e0e236939d85826bad705.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/2a/d22a7fecef685c48cd26db72bb9e2d36/pa/GU70185_8509ab3b2c6e0e236939d85826bad705.jpg not downloaded yet
2026-03-28 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252F5c%252F495ca80b91f6aede95a5b12be31ce101%252Fpa%252FHD36341_ca782a5cc0b5cb54937d9520e39d1d66.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/5c/495ca80b91f6aede95a5b12be31ce101/pa/HD36341_ca782a5cc0b5cb54937d9520e39d1d66.jpg not downloaded yet
2026-03-28 19:01:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:01:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bd6256750>
2026-03-28 19:01:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:01:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44e3d968-bcbc-5d27-9e67-ea84945e2713/44e3d968-bcbc-5d27-9e67-ea84945e2713_image_3.jpg HTTP/1.1" 201 0
2026-03-28 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252Fd5%252F2bd56a16a8287f638f031dc6b0fa143c%252Fpa%252FJH71745_533dd9d0aad9292b4c420ae1d5779bb7.jpg') HTTP/1.1" 204 0
2026-03-28 19:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/d5/2bd56a16a8287f638f031dc6b0fa143c/pa/JH71745_533dd9d0aad9292b4c420ae1d5779bb7.jpg saved to cache
2026-03-28 19:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 44e3d968-bcbc-5d27-9e67-ea84945e2713
2026-03-28 19:01:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:01:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bdd5c2c10>
2026-03-28 19:01:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:01:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a0b0f05-0f96-5994-be70-04a2adef2a1d/8a0b0f05-0f96-5994-be70-04a2adef2a1d_image_1.jpg HTTP/1.1" 201 0
2026-03-28 19:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252F9d%252Fc19da74caa957efa0bf0e0736809002a%252Fpa%252FVZ65695_127591d6efc7ea0a52528d5f3591c3b1.jpg') HTTP/1.1" 204 0
2026-03-28 19:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/9d/c19da74caa957efa0bf0e0736809002a/pa/VZ65695_127591d6efc7ea0a52528d5f3591c3b1.jpg saved to cache
2026-03-28 19:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8a0b0f05-0f96-5994-be70-04a2adef2a1d
2026-03-28 19:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F17%252F9517e25f62662c7d4a5b91c18a27b826%252Fpa%252FJA81822_b0884041f7568afcb7ec04dd608ceb1b.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/17/9517e25f62662c7d4a5b91c18a27b826/pa/JA81822_b0884041f7568afcb7ec04dd608ceb1b.jpg not downloaded yet
2026-03-28 19:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F2a%252Fd22a7fecef685c48cd26db72bb9e2d36%252Fpa%252FGU70185_2ec04e6a30a861c463f9671729ad798c.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/2a/d22a7fecef685c48cd26db72bb9e2d36/pa/GU70185_2ec04e6a30a861c463f9671729ad798c.jpg not downloaded yet
2026-03-28 19:01:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/a8/03a801e23e6839b8ac2f4286813d179b/pa/XU82529_9106e884787ee1a08096c448fc10a523.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:01:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:01:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bd71ac710>
2026-03-28 19:01:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:01:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ea6a973-540e-591c-a7e6-4b7cc45585c6/8ea6a973-540e-591c-a7e6-4b7cc45585c6_image_1.jpg HTTP/1.1" 201 0
2026-03-28 19:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F6e%252Fb26e0ecaeb888cbc80b7ac3e2d07f8ea%252Fpa%252FJA39510_953ad81fb8bb7ebca56f41d16ae8584f.jpg') HTTP/1.1" 204 0
2026-03-28 19:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/6e/b26e0ecaeb888cbc80b7ac3e2d07f8ea/pa/JA39510_953ad81fb8bb7ebca56f41d16ae8584f.jpg saved to cache
2026-03-28 19:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8ea6a973-540e-591c-a7e6-4b7cc45585c6
2026-03-28 19:01:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc1/9d/c19da74caa957efa0bf0e0736809002a/pa/VZ65695_c732a90fcfa8012d8dc8088ce734d638.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F17%252F9517e25f62662c7d4a5b91c18a27b826%252Fpa%252FJA81822_31cb8d24f92120a90c84e2a0295a8c54.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/17/9517e25f62662c7d4a5b91c18a27b826/pa/JA81822_31cb8d24f92120a90c84e2a0295a8c54.jpg not downloaded yet
2026-03-28 19:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F2a%252Fd22a7fecef685c48cd26db72bb9e2d36%252Fpa%252FGU70185_d258fe40a542d5e76ea9c73368a4a0b3.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/2a/d22a7fecef685c48cd26db72bb9e2d36/pa/GU70185_d258fe40a542d5e76ea9c73368a4a0b3.jpg not downloaded yet
2026-03-28 19:01:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/a8/03a801e23e6839b8ac2f4286813d179b/pa/XU82529_90b0f3713ce804e7bab72a252a9f2720.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:01:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb2/6e/b26e0ecaeb888cbc80b7ac3e2d07f8ea/pa/JA39510_01663c9cf11ac4813e1bec2fe60eb8d2.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F2a%252Fd22a7fecef685c48cd26db72bb9e2d36%252Fpa%252FGU70185_0093077767f6dcea138a2c0e6b85cf10.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/2a/d22a7fecef685c48cd26db72bb9e2d36/pa/GU70185_0093077767f6dcea138a2c0e6b85cf10.jpg not downloaded yet
2026-03-28 19:01:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:01:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bd7272cd0>
2026-03-28 19:01:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:01:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9ae0b164-4798-5bb4-9fab-9fc1b2249c69/9ae0b164-4798-5bb4-9fab-9fc1b2249c69_image_4.jpg HTTP/1.1" 201 0
2026-03-28 19:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Fa8%252F03a801e23e6839b8ac2f4286813d179b%252Fpa%252FXU82529_1477557ca164ae62d389d04ba91cc501.jpg') HTTP/1.1" 204 0
2026-03-28 19:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/a8/03a801e23e6839b8ac2f4286813d179b/pa/XU82529_1477557ca164ae62d389d04ba91cc501.jpg saved to cache
2026-03-28 19:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9ae0b164-4798-5bb4-9fab-9fc1b2249c69
2026-03-28 19:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F2a%252Fd22a7fecef685c48cd26db72bb9e2d36%252Fpa%252FGU70185_2e43c9ee4e0ef44410efe98dda05164e.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/2a/d22a7fecef685c48cd26db72bb9e2d36/pa/GU70185_2e43c9ee4e0ef44410efe98dda05164e.jpg not downloaded yet
2026-03-28 19:01:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/a8/03a801e23e6839b8ac2f4286813d179b/pa/XU82529_8ab19b3ab6c777cc91a3362a44660d92.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F2a%252Fd22a7fecef685c48cd26db72bb9e2d36%252Fpa%252FGU70185_d83411a56fad1b2b1aba1c8a01247cbd.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/2a/d22a7fecef685c48cd26db72bb9e2d36/pa/GU70185_d83411a56fad1b2b1aba1c8a01247cbd.jpg not downloaded yet
2026-03-28 19:01:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:01:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bd625d150>
2026-03-28 19:01:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:01:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9ae0b164-4798-5bb4-9fab-9fc1b2249c69/9ae0b164-4798-5bb4-9fab-9fc1b2249c69_image_5.jpg HTTP/1.1" 201 0
2026-03-28 19:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Fa8%252F03a801e23e6839b8ac2f4286813d179b%252Fpa%252FXU82529_9106e884787ee1a08096c448fc10a523.jpg') HTTP/1.1" 204 0
2026-03-28 19:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/a8/03a801e23e6839b8ac2f4286813d179b/pa/XU82529_9106e884787ee1a08096c448fc10a523.jpg saved to cache
2026-03-28 19:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9ae0b164-4798-5bb4-9fab-9fc1b2249c69
2026-03-28 19:01:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:01:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bd71ac690>
2026-03-28 19:01:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:01:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a0b0f05-0f96-5994-be70-04a2adef2a1d/8a0b0f05-0f96-5994-be70-04a2adef2a1d_image_4.jpg HTTP/1.1" 201 0
2026-03-28 19:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252F9d%252Fc19da74caa957efa0bf0e0736809002a%252Fpa%252FVZ65695_c732a90fcfa8012d8dc8088ce734d638.jpg') HTTP/1.1" 204 0
2026-03-28 19:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/9d/c19da74caa957efa0bf0e0736809002a/pa/VZ65695_c732a90fcfa8012d8dc8088ce734d638.jpg saved to cache
2026-03-28 19:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8a0b0f05-0f96-5994-be70-04a2adef2a1d
2026-03-28 19:01:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2b/d5/2bd56a16a8287f638f031dc6b0fa143c/pa/JH71745_2201d39f684eb0a7f7302121cf482eeb.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F2a%252Fd22a7fecef685c48cd26db72bb9e2d36%252Fpa%252FGU70185_9fe99650376651dc8423b537d1d17239.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/2a/d22a7fecef685c48cd26db72bb9e2d36/pa/GU70185_9fe99650376651dc8423b537d1d17239.jpg not downloaded yet
2026-03-28 19:01:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/a8/03a801e23e6839b8ac2f4286813d179b/pa/XU82529_9e2ee47df834d11ad4243b51ba923e55.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:01:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:01:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bd6273b90>
2026-03-28 19:01:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:01:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9ae0b164-4798-5bb4-9fab-9fc1b2249c69/9ae0b164-4798-5bb4-9fab-9fc1b2249c69_image_6.jpg HTTP/1.1" 201 0
2026-03-28 19:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Fa8%252F03a801e23e6839b8ac2f4286813d179b%252Fpa%252FXU82529_90b0f3713ce804e7bab72a252a9f2720.jpg') HTTP/1.1" 204 0
2026-03-28 19:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/a8/03a801e23e6839b8ac2f4286813d179b/pa/XU82529_90b0f3713ce804e7bab72a252a9f2720.jpg saved to cache
2026-03-28 19:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9ae0b164-4798-5bb4-9fab-9fc1b2249c69
2026-03-28 19:01:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:01:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bd73c2d10>
2026-03-28 19:01:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:01:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ea6a973-540e-591c-a7e6-4b7cc45585c6/8ea6a973-540e-591c-a7e6-4b7cc45585c6_image_5.jpg HTTP/1.1" 201 0
2026-03-28 19:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F6e%252Fb26e0ecaeb888cbc80b7ac3e2d07f8ea%252Fpa%252FJA39510_01663c9cf11ac4813e1bec2fe60eb8d2.jpg') HTTP/1.1" 204 0
2026-03-28 19:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/6e/b26e0ecaeb888cbc80b7ac3e2d07f8ea/pa/JA39510_01663c9cf11ac4813e1bec2fe60eb8d2.jpg saved to cache
2026-03-28 19:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8ea6a973-540e-591c-a7e6-4b7cc45585c6
2026-03-28 19:01:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2b/d5/2bd56a16a8287f638f031dc6b0fa143c/pa/JH71745_662eaaa1a9ae8bf799422a3a31ea0f95.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:01:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/0a/bb0a7454d6d044f8265b1047e89c04d8/pa/VE70887_a83e87cb80fa13fede9e43e2e837479a.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:01:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/a8/03a801e23e6839b8ac2f4286813d179b/pa/XU82529_ed77531baa59dee9e862fd34af7d0300.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F2a%252Fd22a7fecef685c48cd26db72bb9e2d36%252Fpa%252FGU70185_6cbf9356ce8cfd9541d98e59349b3a76.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/2a/d22a7fecef685c48cd26db72bb9e2d36/pa/GU70185_6cbf9356ce8cfd9541d98e59349b3a76.jpg not downloaded yet
2026-03-28 19:01:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb2/6e/b26e0ecaeb888cbc80b7ac3e2d07f8ea/pa/JA39510_34812893ef409eb25f045c886c73ea99.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F2a%252Fd22a7fecef685c48cd26db72bb9e2d36%252Fpa%252FGU70185_0d8ac4a3abccdb1aaa6b5a10f95fc7bb.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/2a/d22a7fecef685c48cd26db72bb9e2d36/pa/GU70185_0d8ac4a3abccdb1aaa6b5a10f95fc7bb.jpg not downloaded yet
2026-03-28 19:01:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:01:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bd623eb50>
2026-03-28 19:01:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:01:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9ae0b164-4798-5bb4-9fab-9fc1b2249c69/9ae0b164-4798-5bb4-9fab-9fc1b2249c69_image_7.jpg HTTP/1.1" 201 0
2026-03-28 19:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Fa8%252F03a801e23e6839b8ac2f4286813d179b%252Fpa%252FXU82529_8ab19b3ab6c777cc91a3362a44660d92.jpg') HTTP/1.1" 204 0
2026-03-28 19:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/a8/03a801e23e6839b8ac2f4286813d179b/pa/XU82529_8ab19b3ab6c777cc91a3362a44660d92.jpg saved to cache
2026-03-28 19:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9ae0b164-4798-5bb4-9fab-9fc1b2249c69
2026-03-28 19:01:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 19:01:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:01:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bd626c410>
2026-03-28 19:01:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:01:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44e3d968-bcbc-5d27-9e67-ea84945e2713/44e3d968-bcbc-5d27-9e67-ea84945e2713_image_6.jpg HTTP/1.1" 201 0
2026-03-28 19:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252Fd5%252F2bd56a16a8287f638f031dc6b0fa143c%252Fpa%252FJH71745_2201d39f684eb0a7f7302121cf482eeb.jpg') HTTP/1.1" 204 0
2026-03-28 19:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/d5/2bd56a16a8287f638f031dc6b0fa143c/pa/JH71745_2201d39f684eb0a7f7302121cf482eeb.jpg saved to cache
2026-03-28 19:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 44e3d968-bcbc-5d27-9e67-ea84945e2713
2026-03-28 19:01:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/0a/bb0a7454d6d044f8265b1047e89c04d8/pa/VE70887_c187d94edf1d0a79a6abf4cbad6c2c82.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:01:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img95/17/9517e25f62662c7d4a5b91c18a27b826/pa/JA81822_b1d76a1dbd07423bfa1f2190053e7b91.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:01:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd2/2a/d22a7fecef685c48cd26db72bb9e2d36/pa/GU70185_d258fe40a542d5e76ea9c73368a4a0b3.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:01:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:01:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bd635aa10>
2026-03-28 19:01:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:01:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9ae0b164-4798-5bb4-9fab-9fc1b2249c69/9ae0b164-4798-5bb4-9fab-9fc1b2249c69_image_8.jpg HTTP/1.1" 201 0
2026-03-28 19:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Fa8%252F03a801e23e6839b8ac2f4286813d179b%252Fpa%252FXU82529_9e2ee47df834d11ad4243b51ba923e55.jpg') HTTP/1.1" 204 0
2026-03-28 19:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/a8/03a801e23e6839b8ac2f4286813d179b/pa/XU82529_9e2ee47df834d11ad4243b51ba923e55.jpg saved to cache
2026-03-28 19:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9ae0b164-4798-5bb4-9fab-9fc1b2249c69
2026-03-28 19:01:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img49/5c/495ca80b91f6aede95a5b12be31ce101/pa/HD36341_4437e3467f6f9837f36bcb63fa18a151.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:01:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img49/5c/495ca80b91f6aede95a5b12be31ce101/pa/HD36341_ca782a5cc0b5cb54937d9520e39d1d66.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:01:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2b/d5/2bd56a16a8287f638f031dc6b0fa143c/pa/JH71745_b815804da6f379145e86a22890b123a7.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:01:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 19:01:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:01:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bd68869d0>
2026-03-28 19:01:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:01:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44e3d968-bcbc-5d27-9e67-ea84945e2713/44e3d968-bcbc-5d27-9e67-ea84945e2713_image_7.jpg HTTP/1.1" 201 0
2026-03-28 19:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252Fd5%252F2bd56a16a8287f638f031dc6b0fa143c%252Fpa%252FJH71745_662eaaa1a9ae8bf799422a3a31ea0f95.jpg') HTTP/1.1" 204 0
2026-03-28 19:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/d5/2bd56a16a8287f638f031dc6b0fa143c/pa/JH71745_662eaaa1a9ae8bf799422a3a31ea0f95.jpg saved to cache
2026-03-28 19:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 44e3d968-bcbc-5d27-9e67-ea84945e2713
2026-03-28 19:01:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 19:01:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:01:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bd686d3d0>
2026-03-28 19:01:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:01:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6bc7060c-073b-58de-beef-c8508d6409d4/6bc7060c-073b-58de-beef-c8508d6409d4_image_6.jpg HTTP/1.1" 201 0
2026-03-28 19:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F0a%252Fbb0a7454d6d044f8265b1047e89c04d8%252Fpa%252FVE70887_a83e87cb80fa13fede9e43e2e837479a.jpg') HTTP/1.1" 204 0
2026-03-28 19:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/0a/bb0a7454d6d044f8265b1047e89c04d8/pa/VE70887_a83e87cb80fa13fede9e43e2e837479a.jpg saved to cache
2026-03-28 19:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6bc7060c-073b-58de-beef-c8508d6409d4
2026-03-28 19:01:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:01:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bdd21bd90>
2026-03-28 19:01:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:01:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9ae0b164-4798-5bb4-9fab-9fc1b2249c69/9ae0b164-4798-5bb4-9fab-9fc1b2249c69_image_9.jpg HTTP/1.1" 201 0
2026-03-28 19:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Fa8%252F03a801e23e6839b8ac2f4286813d179b%252Fpa%252FXU82529_ed77531baa59dee9e862fd34af7d0300.jpg') HTTP/1.1" 204 0
2026-03-28 19:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/a8/03a801e23e6839b8ac2f4286813d179b/pa/XU82529_ed77531baa59dee9e862fd34af7d0300.jpg saved to cache
2026-03-28 19:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9ae0b164-4798-5bb4-9fab-9fc1b2249c69
2026-03-28 19:01:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:01:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0beae91d50>
2026-03-28 19:01:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:01:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ea6a973-540e-591c-a7e6-4b7cc45585c6/8ea6a973-540e-591c-a7e6-4b7cc45585c6_image_8.jpg HTTP/1.1" 201 0
2026-03-28 19:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F6e%252Fb26e0ecaeb888cbc80b7ac3e2d07f8ea%252Fpa%252FJA39510_34812893ef409eb25f045c886c73ea99.jpg') HTTP/1.1" 204 0
2026-03-28 19:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/6e/b26e0ecaeb888cbc80b7ac3e2d07f8ea/pa/JA39510_34812893ef409eb25f045c886c73ea99.jpg saved to cache
2026-03-28 19:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8ea6a973-540e-591c-a7e6-4b7cc45585c6
2026-03-28 19:01:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img95/17/9517e25f62662c7d4a5b91c18a27b826/pa/JA81822_31cb8d24f92120a90c84e2a0295a8c54.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:01:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd2/2a/d22a7fecef685c48cd26db72bb9e2d36/pa/GU70185_2e43c9ee4e0ef44410efe98dda05164e.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:01:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 19:01:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:01:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bd639b2d0>
2026-03-28 19:01:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:01:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6bc7060c-073b-58de-beef-c8508d6409d4/6bc7060c-073b-58de-beef-c8508d6409d4_image_4.jpg HTTP/1.1" 201 0
2026-03-28 19:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F0a%252Fbb0a7454d6d044f8265b1047e89c04d8%252Fpa%252FVE70887_c187d94edf1d0a79a6abf4cbad6c2c82.jpg') HTTP/1.1" 204 0
2026-03-28 19:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/0a/bb0a7454d6d044f8265b1047e89c04d8/pa/VE70887_c187d94edf1d0a79a6abf4cbad6c2c82.jpg saved to cache
2026-03-28 19:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6bc7060c-073b-58de-beef-c8508d6409d4
2026-03-28 19:01:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6bc7060c-073b-58de-beef-c8508d6409d4, skipping ID generation
2026-03-28 19:01:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6bc7060c-073b-58de-beef-c8508d6409d4 with scrape type 1
2026-03-28 19:01:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6bc7060c-073b-58de-beef-c8508d6409d4 sending to next pipeline
2026-03-28 19:01:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 6bc7060c-073b-58de-beef-c8508d6409d4, identifier: VE70887
2026-03-28 19:01:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:01:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bea962850>
2026-03-28 19:01:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:01:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_598b1327-4c58-5b56-962a-8a6cc715d2f9/598b1327-4c58-5b56-962a-8a6cc715d2f9_image_0.jpg HTTP/1.1" 201 0
2026-03-28 19:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F17%252F9517e25f62662c7d4a5b91c18a27b826%252Fpa%252FJA81822_b1d76a1dbd07423bfa1f2190053e7b91.jpg') HTTP/1.1" 204 0
2026-03-28 19:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/17/9517e25f62662c7d4a5b91c18a27b826/pa/JA81822_b1d76a1dbd07423bfa1f2190053e7b91.jpg saved to cache
2026-03-28 19:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 598b1327-4c58-5b56-962a-8a6cc715d2f9
2026-03-28 19:01:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:01:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bd63e03d0>
2026-03-28 19:01:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:01:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0f3daf4-1b50-5132-8844-a271f81c8908/c0f3daf4-1b50-5132-8844-a271f81c8908_image_3.jpg HTTP/1.1" 201 0
2026-03-28 19:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F2a%252Fd22a7fecef685c48cd26db72bb9e2d36%252Fpa%252FGU70185_d258fe40a542d5e76ea9c73368a4a0b3.jpg') HTTP/1.1" 204 0
2026-03-28 19:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/2a/d22a7fecef685c48cd26db72bb9e2d36/pa/GU70185_d258fe40a542d5e76ea9c73368a4a0b3.jpg saved to cache
2026-03-28 19:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c0f3daf4-1b50-5132-8844-a271f81c8908
2026-03-28 19:01:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:01:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bd71a9190>
2026-03-28 19:01:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:01:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_418766cd-2652-531c-ae84-79122e35eebb/418766cd-2652-531c-ae84-79122e35eebb_image_2.jpg HTTP/1.1" 201 0
2026-03-28 19:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252F5c%252F495ca80b91f6aede95a5b12be31ce101%252Fpa%252FHD36341_4437e3467f6f9837f36bcb63fa18a151.jpg') HTTP/1.1" 204 0
2026-03-28 19:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/5c/495ca80b91f6aede95a5b12be31ce101/pa/HD36341_4437e3467f6f9837f36bcb63fa18a151.jpg saved to cache
2026-03-28 19:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 418766cd-2652-531c-ae84-79122e35eebb
2026-03-28 19:01:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:01:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bd682bc50>
2026-03-28 19:01:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:01:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_418766cd-2652-531c-ae84-79122e35eebb/418766cd-2652-531c-ae84-79122e35eebb_image_4.jpg HTTP/1.1" 201 0
2026-03-28 19:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252F5c%252F495ca80b91f6aede95a5b12be31ce101%252Fpa%252FHD36341_ca782a5cc0b5cb54937d9520e39d1d66.jpg') HTTP/1.1" 204 0
2026-03-28 19:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/5c/495ca80b91f6aede95a5b12be31ce101/pa/HD36341_ca782a5cc0b5cb54937d9520e39d1d66.jpg saved to cache
2026-03-28 19:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 418766cd-2652-531c-ae84-79122e35eebb
2026-03-28 19:01:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 19:01:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:01:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bd625f590>
2026-03-28 19:01:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:01:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44e3d968-bcbc-5d27-9e67-ea84945e2713/44e3d968-bcbc-5d27-9e67-ea84945e2713_image_8.jpg HTTP/1.1" 201 0
2026-03-28 19:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252Fd5%252F2bd56a16a8287f638f031dc6b0fa143c%252Fpa%252FJH71745_b815804da6f379145e86a22890b123a7.jpg') HTTP/1.1" 204 0
2026-03-28 19:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/d5/2bd56a16a8287f638f031dc6b0fa143c/pa/JH71745_b815804da6f379145e86a22890b123a7.jpg saved to cache
2026-03-28 19:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 44e3d968-bcbc-5d27-9e67-ea84945e2713
2026-03-28 19:01:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 44e3d968-bcbc-5d27-9e67-ea84945e2713, skipping ID generation
2026-03-28 19:01:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 44e3d968-bcbc-5d27-9e67-ea84945e2713 with scrape type 1
2026-03-28 19:01:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 44e3d968-bcbc-5d27-9e67-ea84945e2713 sending to next pipeline
2026-03-28 19:01:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 44e3d968-bcbc-5d27-9e67-ea84945e2713, identifier: JH71745
2026-03-28 19:01:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 6bc7060c-073b-58de-beef-c8508d6409d4 with identifier: VE70887
2026-03-28 19:01:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 6bc7060c-073b-58de-beef-c8508d6409d4 with identifier: VE70887
2026-03-28 19:01:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 6bc7060c-073b-58de-beef-c8508d6409d4 with identifier: VE70887 to the API
2026-03-28 19:01:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 19:01:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 19:01:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgbb/0a/bb0a7454d6d044f8265b1047e89c04d8/pa/VE70887_c187d94edf1d0a79a6abf4cbad6c2c82.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:59:58Z',
 'fuel_type': 'diesel',
 'id': '6bc7060c-073b-58de-beef-c8508d6409d4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'GH004N',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VE70887',
 'listing': 'auction',
 'location': 'NL, Haarlem',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 385226,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bc7060c-073b-58de-beef-c8508d6409d4/6bc7060c-073b-58de-beef-c8508d6409d4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2561474,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/0a/bb0a7454d6d044f8265b1047e89c04d8/pa/VE70887_e6cc73352ecda0e3dc5c7ae790508f5a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bc7060c-073b-58de-beef-c8508d6409d4/6bc7060c-073b-58de-beef-c8508d6409d4_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2544143,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/0a/bb0a7454d6d044f8265b1047e89c04d8/pa/VE70887_7237d7eb3850c3fbd7c30a49f308dff4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bc7060c-073b-58de-beef-c8508d6409d4/6bc7060c-073b-58de-beef-c8508d6409d4_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63472,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/0a/bb0a7454d6d044f8265b1047e89c04d8/pa/VE70887_97c8be0b76ebd63a5bd6ca7a03c45c2d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bc7060c-073b-58de-beef-c8508d6409d4/6bc7060c-073b-58de-beef-c8508d6409d4_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60024,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/0a/bb0a7454d6d044f8265b1047e89c04d8/pa/VE70887_f2a8e19357b5dc4f290e3cc7cb6c588c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bc7060c-073b-58de-beef-c8508d6409d4/6bc7060c-073b-58de-beef-c8508d6409d4_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2603753,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/0a/bb0a7454d6d044f8265b1047e89c04d8/pa/VE70887_c187d94edf1d0a79a6abf4cbad6c2c82.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bc7060c-073b-58de-beef-c8508d6409d4/6bc7060c-073b-58de-beef-c8508d6409d4_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62853,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/0a/bb0a7454d6d044f8265b1047e89c04d8/pa/VE70887_0f7975bb2c8ce4020c4a3347a96197cf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bc7060c-073b-58de-beef-c8508d6409d4/6bc7060c-073b-58de-beef-c8508d6409d4_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2363945,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/0a/bb0a7454d6d044f8265b1047e89c04d8/pa/VE70887_a83e87cb80fa13fede9e43e2e837479a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bc7060c-073b-58de-beef-c8508d6409d4/6bc7060c-073b-58de-beef-c8508d6409d4_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2373018,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/0a/bb0a7454d6d044f8265b1047e89c04d8/pa/VE70887_054ed7cb234fbb9794ca20840baf199d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bc7060c-073b-58de-beef-c8508d6409d4/6bc7060c-073b-58de-beef-c8508d6409d4_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56259,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/0a/bb0a7454d6d044f8265b1047e89c04d8/pa/VE70887_050831dba0d34ffd1515b15397bc1259.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bc7060c-073b-58de-beef-c8508d6409d4/6bc7060c-073b-58de-beef-c8508d6409d4_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64061,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/0a/bb0a7454d6d044f8265b1047e89c04d8/pa/VE70887_66581679a43eed279b6ab4981f43feaa.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-06-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VII 2.0 TDI Highline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Highline BlueMotion Tech',
 'year': 2015}
2026-03-28 19:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VE70887%27 HTTP/1.1" 200 None
2026-03-28 19:01:44 [auto1.nl] INFO: Saving data for VE70887: {'created_time': 1774724504.456962, 'last_price_update_time': 1774724504.456973, 'auction_closing_time': 1774886398.0}
2026-03-28 19:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='VE70887') HTTP/1.1" 204 0
2026-03-28 19:01:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 44e3d968-bcbc-5d27-9e67-ea84945e2713 with identifier: JH71745
2026-03-28 19:01:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 44e3d968-bcbc-5d27-9e67-ea84945e2713 with identifier: JH71745
2026-03-28 19:01:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 44e3d968-bcbc-5d27-9e67-ea84945e2713 with identifier: JH71745 to the API
2026-03-28 19:01:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 19:01:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 19:01:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img2b/d5/2bd56a16a8287f638f031dc6b0fa143c/pa/JH71745_b815804da6f379145e86a22890b123a7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 149,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 160,
 'expiration_date': '2026-03-30T15:42:15Z',
 'fuel_type': 'petrol',
 'id': '44e3d968-bcbc-5d27-9e67-ea84945e2713',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'K805HP',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JH71745',
 'listing': 'auction',
 'location': 'NL, Eindhoven',
 'make': 'Ford',
 'model': 'S-Max',
 'odometer': 113278,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44e3d968-bcbc-5d27-9e67-ea84945e2713/44e3d968-bcbc-5d27-9e67-ea84945e2713_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2832103,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img2b/d5/2bd56a16a8287f638f031dc6b0fa143c/pa/JH71745_06bfdcc81d45f23dcfb22594a9806113.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44e3d968-bcbc-5d27-9e67-ea84945e2713/44e3d968-bcbc-5d27-9e67-ea84945e2713_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2835475,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img2b/d5/2bd56a16a8287f638f031dc6b0fa143c/pa/JH71745_c5a6b7dcba580f3e0d368e7c025ccbe5.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44e3d968-bcbc-5d27-9e67-ea84945e2713/44e3d968-bcbc-5d27-9e67-ea84945e2713_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62472,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2b/d5/2bd56a16a8287f638f031dc6b0fa143c/pa/JH71745_b6ecf096548baaf28f10d8c47bd3987b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44e3d968-bcbc-5d27-9e67-ea84945e2713/44e3d968-bcbc-5d27-9e67-ea84945e2713_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68732,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2b/d5/2bd56a16a8287f638f031dc6b0fa143c/pa/JH71745_533dd9d0aad9292b4c420ae1d5779bb7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44e3d968-bcbc-5d27-9e67-ea84945e2713/44e3d968-bcbc-5d27-9e67-ea84945e2713_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57900,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2b/d5/2bd56a16a8287f638f031dc6b0fa143c/pa/JH71745_21a9e48267204475d81136b16092ddac.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44e3d968-bcbc-5d27-9e67-ea84945e2713/44e3d968-bcbc-5d27-9e67-ea84945e2713_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58791,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2b/d5/2bd56a16a8287f638f031dc6b0fa143c/pa/JH71745_c49c1154d710b3422755fc89c93d906c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44e3d968-bcbc-5d27-9e67-ea84945e2713/44e3d968-bcbc-5d27-9e67-ea84945e2713_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2257077,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img2b/d5/2bd56a16a8287f638f031dc6b0fa143c/pa/JH71745_2201d39f684eb0a7f7302121cf482eeb.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44e3d968-bcbc-5d27-9e67-ea84945e2713/44e3d968-bcbc-5d27-9e67-ea84945e2713_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2379961,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img2b/d5/2bd56a16a8287f638f031dc6b0fa143c/pa/JH71745_662eaaa1a9ae8bf799422a3a31ea0f95.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44e3d968-bcbc-5d27-9e67-ea84945e2713/44e3d968-bcbc-5d27-9e67-ea84945e2713_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2802267,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img2b/d5/2bd56a16a8287f638f031dc6b0fa143c/pa/JH71745_b815804da6f379145e86a22890b123a7.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44e3d968-bcbc-5d27-9e67-ea84945e2713/44e3d968-bcbc-5d27-9e67-ea84945e2713_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60656,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2b/d5/2bd56a16a8287f638f031dc6b0fa143c/pa/JH71745_e53c5154782e2001fceb1a5e376e3d72.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-02-14',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Ford S-Max 1.5 EcoBoost Business',
 'transmission': 'manual',
 'trim': 'Business',
 'year': 2018}
2026-03-28 19:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JH71745%27 HTTP/1.1" 200 None
2026-03-28 19:01:44 [auto1.nl] INFO: Saving data for JH71745: {'created_time': 1774724504.893789, 'last_price_update_time': 1774724504.893798, 'auction_closing_time': 1774885335.0}
2026-03-28 19:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='JH71745') HTTP/1.1" 204 0
2026-03-28 19:01:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:01:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bd71a8990>
2026-03-28 19:01:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:01:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_598b1327-4c58-5b56-962a-8a6cc715d2f9/598b1327-4c58-5b56-962a-8a6cc715d2f9_image_4.jpg HTTP/1.1" 201 0
2026-03-28 19:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F17%252F9517e25f62662c7d4a5b91c18a27b826%252Fpa%252FJA81822_31cb8d24f92120a90c84e2a0295a8c54.jpg') HTTP/1.1" 204 0
2026-03-28 19:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/17/9517e25f62662c7d4a5b91c18a27b826/pa/JA81822_31cb8d24f92120a90c84e2a0295a8c54.jpg saved to cache
2026-03-28 19:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 598b1327-4c58-5b56-962a-8a6cc715d2f9
2026-03-28 19:01:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:01:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bdd1ffb10>
2026-03-28 19:01:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:01:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0f3daf4-1b50-5132-8844-a271f81c8908/c0f3daf4-1b50-5132-8844-a271f81c8908_image_5.jpg HTTP/1.1" 201 0
2026-03-28 19:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F2a%252Fd22a7fecef685c48cd26db72bb9e2d36%252Fpa%252FGU70185_2e43c9ee4e0ef44410efe98dda05164e.jpg') HTTP/1.1" 204 0
2026-03-28 19:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/2a/d22a7fecef685c48cd26db72bb9e2d36/pa/GU70185_2e43c9ee4e0ef44410efe98dda05164e.jpg saved to cache
2026-03-28 19:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c0f3daf4-1b50-5132-8844-a271f81c8908
2026-03-28 19:01:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd2/2a/d22a7fecef685c48cd26db72bb9e2d36/pa/GU70185_2ec04e6a30a861c463f9671729ad798c.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:01:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd2/2a/d22a7fecef685c48cd26db72bb9e2d36/pa/GU70185_0093077767f6dcea138a2c0e6b85cf10.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:01:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img95/17/9517e25f62662c7d4a5b91c18a27b826/pa/JA81822_af2ae41e0761027d2c899d91d13bd29c.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:01:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img49/5c/495ca80b91f6aede95a5b12be31ce101/pa/HD36341_836c20de04336cc6c60e2877be393dfb.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:01:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 19:01:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:01:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bd6855e50>
2026-03-28 19:01:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:01:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:01:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:01:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0f3daf4-1b50-5132-8844-a271f81c8908/c0f3daf4-1b50-5132-8844-a271f81c8908_image_2.jpg HTTP/1.1" 201 0
2026-03-28 19:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F2a%252Fd22a7fecef685c48cd26db72bb9e2d36%252Fpa%252FGU70185_2ec04e6a30a861c463f9671729ad798c.jpg') HTTP/1.1" 204 0
2026-03-28 19:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/2a/d22a7fecef685c48cd26db72bb9e2d36/pa/GU70185_2ec04e6a30a861c463f9671729ad798c.jpg saved to cache
2026-03-28 19:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c0f3daf4-1b50-5132-8844-a271f81c8908
2026-03-28 19:01:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd2/2a/d22a7fecef685c48cd26db72bb9e2d36/pa/GU70185_8509ab3b2c6e0e236939d85826bad705.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:01:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img95/17/9517e25f62662c7d4a5b91c18a27b826/pa/JA81822_b0884041f7568afcb7ec04dd608ceb1b.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:01:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd2/2a/d22a7fecef685c48cd26db72bb9e2d36/pa/GU70185_0d8ac4a3abccdb1aaa6b5a10f95fc7bb.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:01:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 19:01:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:01:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bd63d4d90>
2026-03-28 19:01:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:01:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:01:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:01:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0f3daf4-1b50-5132-8844-a271f81c8908/c0f3daf4-1b50-5132-8844-a271f81c8908_image_4.jpg HTTP/1.1" 201 0
2026-03-28 19:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F2a%252Fd22a7fecef685c48cd26db72bb9e2d36%252Fpa%252FGU70185_0093077767f6dcea138a2c0e6b85cf10.jpg') HTTP/1.1" 204 0
2026-03-28 19:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/2a/d22a7fecef685c48cd26db72bb9e2d36/pa/GU70185_0093077767f6dcea138a2c0e6b85cf10.jpg saved to cache
2026-03-28 19:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c0f3daf4-1b50-5132-8844-a271f81c8908
2026-03-28 19:01:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:01:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bd72519d0>
2026-03-28 19:01:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:01:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:01:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:01:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_598b1327-4c58-5b56-962a-8a6cc715d2f9/598b1327-4c58-5b56-962a-8a6cc715d2f9_image_2.jpg HTTP/1.1" 201 0
2026-03-28 19:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F17%252F9517e25f62662c7d4a5b91c18a27b826%252Fpa%252FJA81822_af2ae41e0761027d2c899d91d13bd29c.jpg') HTTP/1.1" 204 0
2026-03-28 19:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/17/9517e25f62662c7d4a5b91c18a27b826/pa/JA81822_af2ae41e0761027d2c899d91d13bd29c.jpg saved to cache
2026-03-28 19:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 598b1327-4c58-5b56-962a-8a6cc715d2f9
2026-03-28 19:01:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:01:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bd71d5290>
2026-03-28 19:01:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:01:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:01:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:01:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_418766cd-2652-531c-ae84-79122e35eebb/418766cd-2652-531c-ae84-79122e35eebb_image_3.jpg HTTP/1.1" 201 0
2026-03-28 19:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252F5c%252F495ca80b91f6aede95a5b12be31ce101%252Fpa%252FHD36341_836c20de04336cc6c60e2877be393dfb.jpg') HTTP/1.1" 204 0
2026-03-28 19:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/5c/495ca80b91f6aede95a5b12be31ce101/pa/HD36341_836c20de04336cc6c60e2877be393dfb.jpg saved to cache
2026-03-28 19:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 418766cd-2652-531c-ae84-79122e35eebb
2026-03-28 19:01:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img70/10/7010e65fe5afc60f34edfde6de61a9e5/pa/AB54003_add7f015570b0af50c2f3c96ca77e0b8.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:01:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img95/17/9517e25f62662c7d4a5b91c18a27b826/pa/JA81822_46b043a2ef4a9a06024bbd568d7280dc.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:01:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img49/5c/495ca80b91f6aede95a5b12be31ce101/pa/HD36341_b8465f82d900d7986e0cb8e9ac3f977c.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:01:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb2/6e/b26e0ecaeb888cbc80b7ac3e2d07f8ea/pa/JA39510_9f072a3dbec8773bad7ccba868174287.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:01:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:01:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bdd5c3c50>
2026-03-28 19:01:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:01:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:01:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:01:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0f3daf4-1b50-5132-8844-a271f81c8908/c0f3daf4-1b50-5132-8844-a271f81c8908_image_1.jpg HTTP/1.1" 201 0
2026-03-28 19:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F2a%252Fd22a7fecef685c48cd26db72bb9e2d36%252Fpa%252FGU70185_8509ab3b2c6e0e236939d85826bad705.jpg') HTTP/1.1" 204 0
2026-03-28 19:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/2a/d22a7fecef685c48cd26db72bb9e2d36/pa/GU70185_8509ab3b2c6e0e236939d85826bad705.jpg saved to cache
2026-03-28 19:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c0f3daf4-1b50-5132-8844-a271f81c8908
2026-03-28 19:01:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:01:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bd6828ed0>
2026-03-28 19:01:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:01:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:01:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:01:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_598b1327-4c58-5b56-962a-8a6cc715d2f9/598b1327-4c58-5b56-962a-8a6cc715d2f9_image_3.jpg HTTP/1.1" 201 0
2026-03-28 19:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F17%252F9517e25f62662c7d4a5b91c18a27b826%252Fpa%252FJA81822_b0884041f7568afcb7ec04dd608ceb1b.jpg') HTTP/1.1" 204 0
2026-03-28 19:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/17/9517e25f62662c7d4a5b91c18a27b826/pa/JA81822_b0884041f7568afcb7ec04dd608ceb1b.jpg saved to cache
2026-03-28 19:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 598b1327-4c58-5b56-962a-8a6cc715d2f9
2026-03-28 19:01:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:01:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bd685aed0>
2026-03-28 19:01:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:01:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:01:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:01:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0f3daf4-1b50-5132-8844-a271f81c8908/c0f3daf4-1b50-5132-8844-a271f81c8908_image_9.jpg HTTP/1.1" 201 0
2026-03-28 19:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F2a%252Fd22a7fecef685c48cd26db72bb9e2d36%252Fpa%252FGU70185_0d8ac4a3abccdb1aaa6b5a10f95fc7bb.jpg') HTTP/1.1" 204 0
2026-03-28 19:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/2a/d22a7fecef685c48cd26db72bb9e2d36/pa/GU70185_0d8ac4a3abccdb1aaa6b5a10f95fc7bb.jpg saved to cache
2026-03-28 19:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c0f3daf4-1b50-5132-8844-a271f81c8908
2026-03-28 19:01:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img49/5c/495ca80b91f6aede95a5b12be31ce101/pa/HD36341_b4e56bb5ce7517da6a4ee254a9e877b1.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:01:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:01:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bd6829e50>
2026-03-28 19:01:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:01:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:01:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:01:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e6087bb-7fb1-5752-9efd-86bcbca3bd04/8e6087bb-7fb1-5752-9efd-86bcbca3bd04_image_9.jpg HTTP/1.1" 201 0
2026-03-28 19:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F10%252F7010e65fe5afc60f34edfde6de61a9e5%252Fpa%252FAB54003_add7f015570b0af50c2f3c96ca77e0b8.jpg') HTTP/1.1" 204 0
2026-03-28 19:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/10/7010e65fe5afc60f34edfde6de61a9e5/pa/AB54003_add7f015570b0af50c2f3c96ca77e0b8.jpg saved to cache
2026-03-28 19:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8e6087bb-7fb1-5752-9efd-86bcbca3bd04
2026-03-28 19:01:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:01:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bd62165d0>
2026-03-28 19:01:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:01:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:01:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:01:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_598b1327-4c58-5b56-962a-8a6cc715d2f9/598b1327-4c58-5b56-962a-8a6cc715d2f9_image_1.jpg HTTP/1.1" 201 0
2026-03-28 19:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F17%252F9517e25f62662c7d4a5b91c18a27b826%252Fpa%252FJA81822_46b043a2ef4a9a06024bbd568d7280dc.jpg') HTTP/1.1" 204 0
2026-03-28 19:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/17/9517e25f62662c7d4a5b91c18a27b826/pa/JA81822_46b043a2ef4a9a06024bbd568d7280dc.jpg saved to cache
2026-03-28 19:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 598b1327-4c58-5b56-962a-8a6cc715d2f9
2026-03-28 19:01:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 598b1327-4c58-5b56-962a-8a6cc715d2f9, skipping ID generation
2026-03-28 19:01:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 598b1327-4c58-5b56-962a-8a6cc715d2f9 with scrape type 1
2026-03-28 19:01:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 598b1327-4c58-5b56-962a-8a6cc715d2f9 sending to next pipeline
2026-03-28 19:01:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 598b1327-4c58-5b56-962a-8a6cc715d2f9, identifier: JA81822
2026-03-28 19:01:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:01:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bd7107d10>
2026-03-28 19:01:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:01:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:01:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:01:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_418766cd-2652-531c-ae84-79122e35eebb/418766cd-2652-531c-ae84-79122e35eebb_image_1.jpg HTTP/1.1" 201 0
2026-03-28 19:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252F5c%252F495ca80b91f6aede95a5b12be31ce101%252Fpa%252FHD36341_b8465f82d900d7986e0cb8e9ac3f977c.jpg') HTTP/1.1" 204 0
2026-03-28 19:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/5c/495ca80b91f6aede95a5b12be31ce101/pa/HD36341_b8465f82d900d7986e0cb8e9ac3f977c.jpg saved to cache
2026-03-28 19:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 418766cd-2652-531c-ae84-79122e35eebb
2026-03-28 19:01:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:01:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bd6858190>
2026-03-28 19:01:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:01:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:01:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:01:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ea6a973-540e-591c-a7e6-4b7cc45585c6/8ea6a973-540e-591c-a7e6-4b7cc45585c6_image_9.jpg HTTP/1.1" 201 0
2026-03-28 19:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F6e%252Fb26e0ecaeb888cbc80b7ac3e2d07f8ea%252Fpa%252FJA39510_9f072a3dbec8773bad7ccba868174287.jpg') HTTP/1.1" 204 0
2026-03-28 19:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/6e/b26e0ecaeb888cbc80b7ac3e2d07f8ea/pa/JA39510_9f072a3dbec8773bad7ccba868174287.jpg saved to cache
2026-03-28 19:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8ea6a973-540e-591c-a7e6-4b7cc45585c6
2026-03-28 19:01:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 598b1327-4c58-5b56-962a-8a6cc715d2f9 with identifier: JA81822
2026-03-28 19:01:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 598b1327-4c58-5b56-962a-8a6cc715d2f9 with identifier: JA81822
2026-03-28 19:01:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 598b1327-4c58-5b56-962a-8a6cc715d2f9 with identifier: JA81822 to the API
2026-03-28 19:01:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 19:01:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 19:01:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img95/17/9517e25f62662c7d4a5b91c18a27b826/pa/JA81822_46b043a2ef4a9a06024bbd568d7280dc.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 159,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:29:26Z',
 'fuel_type': 'petrol',
 'id': '598b1327-4c58-5b56-962a-8a6cc715d2f9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '41ZGS6',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JA81822',
 'listing': 'auction',
 'location': 'NL, Rotterdam',
 'make': 'Peugeot',
 'model': '5008',
 'odometer': 204370,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_598b1327-4c58-5b56-962a-8a6cc715d2f9/598b1327-4c58-5b56-962a-8a6cc715d2f9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64788,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img95/17/9517e25f62662c7d4a5b91c18a27b826/pa/JA81822_b1d76a1dbd07423bfa1f2190053e7b91.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_598b1327-4c58-5b56-962a-8a6cc715d2f9/598b1327-4c58-5b56-962a-8a6cc715d2f9_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68784,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img95/17/9517e25f62662c7d4a5b91c18a27b826/pa/JA81822_46b043a2ef4a9a06024bbd568d7280dc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_598b1327-4c58-5b56-962a-8a6cc715d2f9/598b1327-4c58-5b56-962a-8a6cc715d2f9_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59864,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img95/17/9517e25f62662c7d4a5b91c18a27b826/pa/JA81822_af2ae41e0761027d2c899d91d13bd29c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_598b1327-4c58-5b56-962a-8a6cc715d2f9/598b1327-4c58-5b56-962a-8a6cc715d2f9_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71227,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img95/17/9517e25f62662c7d4a5b91c18a27b826/pa/JA81822_b0884041f7568afcb7ec04dd608ceb1b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_598b1327-4c58-5b56-962a-8a6cc715d2f9/598b1327-4c58-5b56-962a-8a6cc715d2f9_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62765,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img95/17/9517e25f62662c7d4a5b91c18a27b826/pa/JA81822_31cb8d24f92120a90c84e2a0295a8c54.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-11-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 5008 1.6 Access',
 'transmission': 'manual',
 'trim': 'Access',
 'year': 2012}
2026-03-28 19:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JA81822%27 HTTP/1.1" 200 None
2026-03-28 19:01:46 [auto1.nl] INFO: Saving data for JA81822: {'created_time': 1774724506.233107, 'last_price_update_time': 1774724506.233117, 'auction_closing_time': 1774884566.0}
2026-03-28 19:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='JA81822') HTTP/1.1" 204 0
2026-03-28 19:01:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd2/2a/d22a7fecef685c48cd26db72bb9e2d36/pa/GU70185_d83411a56fad1b2b1aba1c8a01247cbd.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:01:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img70/10/7010e65fe5afc60f34edfde6de61a9e5/pa/AB54003_710a43b24498d679ab16eda40b066670.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:01:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb2/6e/b26e0ecaeb888cbc80b7ac3e2d07f8ea/pa/JA39510_0cbc3400ab650145c95bfcb81c69ed94.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:01:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb2/6e/b26e0ecaeb888cbc80b7ac3e2d07f8ea/pa/JA39510_4ab5617d693daa1378169d116ee816d4.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:01:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd2/2a/d22a7fecef685c48cd26db72bb9e2d36/pa/GU70185_6cbf9356ce8cfd9541d98e59349b3a76.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:01:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:01:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bd62150d0>
2026-03-28 19:01:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:01:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:01:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:01:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_418766cd-2652-531c-ae84-79122e35eebb/418766cd-2652-531c-ae84-79122e35eebb_image_0.jpg HTTP/1.1" 201 0
2026-03-28 19:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252F5c%252F495ca80b91f6aede95a5b12be31ce101%252Fpa%252FHD36341_b4e56bb5ce7517da6a4ee254a9e877b1.jpg') HTTP/1.1" 204 0
2026-03-28 19:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/5c/495ca80b91f6aede95a5b12be31ce101/pa/HD36341_b4e56bb5ce7517da6a4ee254a9e877b1.jpg saved to cache
2026-03-28 19:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 418766cd-2652-531c-ae84-79122e35eebb
2026-03-28 19:01:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 418766cd-2652-531c-ae84-79122e35eebb, skipping ID generation
2026-03-28 19:01:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 418766cd-2652-531c-ae84-79122e35eebb with scrape type 1
2026-03-28 19:01:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 418766cd-2652-531c-ae84-79122e35eebb sending to next pipeline
2026-03-28 19:01:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 418766cd-2652-531c-ae84-79122e35eebb, identifier: HD36341
2026-03-28 19:01:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 418766cd-2652-531c-ae84-79122e35eebb with identifier: HD36341
2026-03-28 19:01:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 418766cd-2652-531c-ae84-79122e35eebb with identifier: HD36341
2026-03-28 19:01:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 418766cd-2652-531c-ae84-79122e35eebb with identifier: HD36341 to the API
2026-03-28 19:01:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 19:01:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 19:01:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img49/5c/495ca80b91f6aede95a5b12be31ce101/pa/HD36341_b4e56bb5ce7517da6a4ee254a9e877b1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.2L',
 'engine_horse_power': 77,
 'expiration_date': '2026-03-30T15:41:44Z',
 'fuel_type': 'petrol',
 'id': '418766cd-2652-531c-ae84-79122e35eebb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '09JZH3',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HD36341',
 'listing': 'auction',
 'location': 'NL, Den Haag',
 'make': 'Hyundai',
 'model': 'i20',
 'odometer': 176730,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_418766cd-2652-531c-ae84-79122e35eebb/418766cd-2652-531c-ae84-79122e35eebb_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80924,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img49/5c/495ca80b91f6aede95a5b12be31ce101/pa/HD36341_b4e56bb5ce7517da6a4ee254a9e877b1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_418766cd-2652-531c-ae84-79122e35eebb/418766cd-2652-531c-ae84-79122e35eebb_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72600,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img49/5c/495ca80b91f6aede95a5b12be31ce101/pa/HD36341_b8465f82d900d7986e0cb8e9ac3f977c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_418766cd-2652-531c-ae84-79122e35eebb/418766cd-2652-531c-ae84-79122e35eebb_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67865,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img49/5c/495ca80b91f6aede95a5b12be31ce101/pa/HD36341_4437e3467f6f9837f36bcb63fa18a151.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_418766cd-2652-531c-ae84-79122e35eebb/418766cd-2652-531c-ae84-79122e35eebb_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60386,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img49/5c/495ca80b91f6aede95a5b12be31ce101/pa/HD36341_836c20de04336cc6c60e2877be393dfb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_418766cd-2652-531c-ae84-79122e35eebb/418766cd-2652-531c-ae84-79122e35eebb_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101482,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img49/5c/495ca80b91f6aede95a5b12be31ce101/pa/HD36341_ca782a5cc0b5cb54937d9520e39d1d66.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2009-09-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Hyundai i20 1.2 Classic',
 'transmission': 'manual',
 'trim': 'Classic',
 'year': 2009}
2026-03-28 19:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HD36341%27 HTTP/1.1" 200 None
2026-03-28 19:01:46 [auto1.nl] INFO: Saving data for HD36341: {'created_time': 1774724506.780562, 'last_price_update_time': 1774724506.780575, 'auction_closing_time': 1774885304.0}
2026-03-28 19:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='HD36341') HTTP/1.1" 204 0
2026-03-28 19:01:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb5/74/b57435d1ad9f90020e6ec322db0a9b7a/pa/GD33520_08b4bf8bd0afb85eeb45b391b43cb6f5.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:01:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img70/10/7010e65fe5afc60f34edfde6de61a9e5/pa/AB54003_53f4b9d86ca9c7e9fadd2a6e1623005f.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:01:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img70/10/7010e65fe5afc60f34edfde6de61a9e5/pa/AB54003_14b95610b794ed87963cb78eb067287b.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:01:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb2/6e/b26e0ecaeb888cbc80b7ac3e2d07f8ea/pa/JA39510_c2c03a58aeeadf199862449ee472b7c2.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:01:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 19:01:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:01:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bd68832d0>
2026-03-28 19:01:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:01:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:01:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:01:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0f3daf4-1b50-5132-8844-a271f81c8908/c0f3daf4-1b50-5132-8844-a271f81c8908_image_6.jpg HTTP/1.1" 201 0
2026-03-28 19:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F2a%252Fd22a7fecef685c48cd26db72bb9e2d36%252Fpa%252FGU70185_d83411a56fad1b2b1aba1c8a01247cbd.jpg') HTTP/1.1" 204 0
2026-03-28 19:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/2a/d22a7fecef685c48cd26db72bb9e2d36/pa/GU70185_d83411a56fad1b2b1aba1c8a01247cbd.jpg saved to cache
2026-03-28 19:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c0f3daf4-1b50-5132-8844-a271f81c8908
2026-03-28 19:01:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:01:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bd72b7490>
2026-03-28 19:01:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:01:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:01:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:01:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e6087bb-7fb1-5752-9efd-86bcbca3bd04/8e6087bb-7fb1-5752-9efd-86bcbca3bd04_image_7.jpg HTTP/1.1" 201 0
2026-03-28 19:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F10%252F7010e65fe5afc60f34edfde6de61a9e5%252Fpa%252FAB54003_710a43b24498d679ab16eda40b066670.jpg') HTTP/1.1" 204 0
2026-03-28 19:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/10/7010e65fe5afc60f34edfde6de61a9e5/pa/AB54003_710a43b24498d679ab16eda40b066670.jpg saved to cache
2026-03-28 19:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8e6087bb-7fb1-5752-9efd-86bcbca3bd04
2026-03-28 19:01:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:01:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bd68be150>
2026-03-28 19:01:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:01:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:01:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ea6a973-540e-591c-a7e6-4b7cc45585c6/8ea6a973-540e-591c-a7e6-4b7cc45585c6_image_6.jpg HTTP/1.1" 201 0
2026-03-28 19:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F6e%252Fb26e0ecaeb888cbc80b7ac3e2d07f8ea%252Fpa%252FJA39510_0cbc3400ab650145c95bfcb81c69ed94.jpg') HTTP/1.1" 204 0
2026-03-28 19:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/6e/b26e0ecaeb888cbc80b7ac3e2d07f8ea/pa/JA39510_0cbc3400ab650145c95bfcb81c69ed94.jpg saved to cache
2026-03-28 19:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8ea6a973-540e-591c-a7e6-4b7cc45585c6
2026-03-28 19:01:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:01:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bd721e290>
2026-03-28 19:01:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:01:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ea6a973-540e-591c-a7e6-4b7cc45585c6/8ea6a973-540e-591c-a7e6-4b7cc45585c6_image_7.jpg HTTP/1.1" 201 0
2026-03-28 19:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F6e%252Fb26e0ecaeb888cbc80b7ac3e2d07f8ea%252Fpa%252FJA39510_4ab5617d693daa1378169d116ee816d4.jpg') HTTP/1.1" 204 0
2026-03-28 19:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/6e/b26e0ecaeb888cbc80b7ac3e2d07f8ea/pa/JA39510_4ab5617d693daa1378169d116ee816d4.jpg saved to cache
2026-03-28 19:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8ea6a973-540e-591c-a7e6-4b7cc45585c6
2026-03-28 19:01:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 19:01:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:01:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bdd4e0a50>
2026-03-28 19:01:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:01:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0f3daf4-1b50-5132-8844-a271f81c8908/c0f3daf4-1b50-5132-8844-a271f81c8908_image_8.jpg HTTP/1.1" 201 0
2026-03-28 19:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F2a%252Fd22a7fecef685c48cd26db72bb9e2d36%252Fpa%252FGU70185_6cbf9356ce8cfd9541d98e59349b3a76.jpg') HTTP/1.1" 204 0
2026-03-28 19:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/2a/d22a7fecef685c48cd26db72bb9e2d36/pa/GU70185_6cbf9356ce8cfd9541d98e59349b3a76.jpg saved to cache
2026-03-28 19:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c0f3daf4-1b50-5132-8844-a271f81c8908
2026-03-28 19:01:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd2/2a/d22a7fecef685c48cd26db72bb9e2d36/pa/GU70185_9fe99650376651dc8423b537d1d17239.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:01:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:01:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bd71e3450>
2026-03-28 19:01:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:01:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6898af0-474d-5809-b3f5-b9bfdc46a8dd/d6898af0-474d-5809-b3f5-b9bfdc46a8dd_image_4.jpg HTTP/1.1" 201 0
2026-03-28 19:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F74%252Fb57435d1ad9f90020e6ec322db0a9b7a%252Fpa%252FGD33520_08b4bf8bd0afb85eeb45b391b43cb6f5.jpg') HTTP/1.1" 204 0
2026-03-28 19:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/74/b57435d1ad9f90020e6ec322db0a9b7a/pa/GD33520_08b4bf8bd0afb85eeb45b391b43cb6f5.jpg saved to cache
2026-03-28 19:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d6898af0-474d-5809-b3f5-b9bfdc46a8dd
2026-03-28 19:01:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:01:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bd68a4050>
2026-03-28 19:01:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:01:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e6087bb-7fb1-5752-9efd-86bcbca3bd04/8e6087bb-7fb1-5752-9efd-86bcbca3bd04_image_4.jpg HTTP/1.1" 201 0
2026-03-28 19:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F10%252F7010e65fe5afc60f34edfde6de61a9e5%252Fpa%252FAB54003_53f4b9d86ca9c7e9fadd2a6e1623005f.jpg') HTTP/1.1" 204 0
2026-03-28 19:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/10/7010e65fe5afc60f34edfde6de61a9e5/pa/AB54003_53f4b9d86ca9c7e9fadd2a6e1623005f.jpg saved to cache
2026-03-28 19:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8e6087bb-7fb1-5752-9efd-86bcbca3bd04
2026-03-28 19:01:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:01:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bd623f8d0>
2026-03-28 19:01:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:01:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e6087bb-7fb1-5752-9efd-86bcbca3bd04/8e6087bb-7fb1-5752-9efd-86bcbca3bd04_image_5.jpg HTTP/1.1" 201 0
2026-03-28 19:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F10%252F7010e65fe5afc60f34edfde6de61a9e5%252Fpa%252FAB54003_14b95610b794ed87963cb78eb067287b.jpg') HTTP/1.1" 204 0
2026-03-28 19:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/10/7010e65fe5afc60f34edfde6de61a9e5/pa/AB54003_14b95610b794ed87963cb78eb067287b.jpg saved to cache
2026-03-28 19:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8e6087bb-7fb1-5752-9efd-86bcbca3bd04
2026-03-28 19:01:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:01:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bd687e5d0>
2026-03-28 19:01:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:01:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ea6a973-540e-591c-a7e6-4b7cc45585c6/8ea6a973-540e-591c-a7e6-4b7cc45585c6_image_4.jpg HTTP/1.1" 201 0
2026-03-28 19:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F6e%252Fb26e0ecaeb888cbc80b7ac3e2d07f8ea%252Fpa%252FJA39510_c2c03a58aeeadf199862449ee472b7c2.jpg') HTTP/1.1" 204 0
2026-03-28 19:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/6e/b26e0ecaeb888cbc80b7ac3e2d07f8ea/pa/JA39510_c2c03a58aeeadf199862449ee472b7c2.jpg saved to cache
2026-03-28 19:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8ea6a973-540e-591c-a7e6-4b7cc45585c6
2026-03-28 19:01:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img70/10/7010e65fe5afc60f34edfde6de61a9e5/pa/AB54003_c923a2a347f496739748102752a0fb74.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:01:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb5/74/b57435d1ad9f90020e6ec322db0a9b7a/pa/GD33520_1532bb95c705200beb6b4deb26041bf9.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:01:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb2/6e/b26e0ecaeb888cbc80b7ac3e2d07f8ea/pa/JA39510_4e1eaa78f6911c33b24edf643e8e4d68.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:01:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc1/9d/c19da74caa957efa0bf0e0736809002a/pa/VZ65695_630bfbf3e9efd5e5ff2a86bd99aa58d3.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:01:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 19:01:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:01:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bd71ace90>
2026-03-28 19:01:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:01:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0f3daf4-1b50-5132-8844-a271f81c8908/c0f3daf4-1b50-5132-8844-a271f81c8908_image_7.jpg HTTP/1.1" 201 0
2026-03-28 19:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F2a%252Fd22a7fecef685c48cd26db72bb9e2d36%252Fpa%252FGU70185_9fe99650376651dc8423b537d1d17239.jpg') HTTP/1.1" 204 0
2026-03-28 19:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/2a/d22a7fecef685c48cd26db72bb9e2d36/pa/GU70185_9fe99650376651dc8423b537d1d17239.jpg saved to cache
2026-03-28 19:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c0f3daf4-1b50-5132-8844-a271f81c8908
2026-03-28 19:01:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/a8/03a801e23e6839b8ac2f4286813d179b/pa/XU82529_e438f5d98f1de745b60c416648d531e7.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:01:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc1/9d/c19da74caa957efa0bf0e0736809002a/pa/VZ65695_e8e76606979873607b34061e60c4e149.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:01:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img70/10/7010e65fe5afc60f34edfde6de61a9e5/pa/AB54003_fd31a25b9f066b95c8efcbaf4836d4fa.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:01:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:01:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bde0b1bd0>
2026-03-28 19:01:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:01:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e6087bb-7fb1-5752-9efd-86bcbca3bd04/8e6087bb-7fb1-5752-9efd-86bcbca3bd04_image_3.jpg HTTP/1.1" 201 0
2026-03-28 19:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F10%252F7010e65fe5afc60f34edfde6de61a9e5%252Fpa%252FAB54003_c923a2a347f496739748102752a0fb74.jpg') HTTP/1.1" 204 0
2026-03-28 19:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/10/7010e65fe5afc60f34edfde6de61a9e5/pa/AB54003_c923a2a347f496739748102752a0fb74.jpg saved to cache
2026-03-28 19:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8e6087bb-7fb1-5752-9efd-86bcbca3bd04
2026-03-28 19:01:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:01:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bd623f8d0>
2026-03-28 19:01:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:01:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6898af0-474d-5809-b3f5-b9bfdc46a8dd/d6898af0-474d-5809-b3f5-b9bfdc46a8dd_image_3.jpg HTTP/1.1" 201 0
2026-03-28 19:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F74%252Fb57435d1ad9f90020e6ec322db0a9b7a%252Fpa%252FGD33520_1532bb95c705200beb6b4deb26041bf9.jpg') HTTP/1.1" 204 0
2026-03-28 19:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/74/b57435d1ad9f90020e6ec322db0a9b7a/pa/GD33520_1532bb95c705200beb6b4deb26041bf9.jpg saved to cache
2026-03-28 19:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d6898af0-474d-5809-b3f5-b9bfdc46a8dd
2026-03-28 19:01:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:01:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bd68bec10>
2026-03-28 19:01:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:01:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ea6a973-540e-591c-a7e6-4b7cc45585c6/8ea6a973-540e-591c-a7e6-4b7cc45585c6_image_3.jpg HTTP/1.1" 201 0
2026-03-28 19:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F6e%252Fb26e0ecaeb888cbc80b7ac3e2d07f8ea%252Fpa%252FJA39510_4e1eaa78f6911c33b24edf643e8e4d68.jpg') HTTP/1.1" 204 0
2026-03-28 19:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/6e/b26e0ecaeb888cbc80b7ac3e2d07f8ea/pa/JA39510_4e1eaa78f6911c33b24edf643e8e4d68.jpg saved to cache
2026-03-28 19:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8ea6a973-540e-591c-a7e6-4b7cc45585c6
2026-03-28 19:01:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:01:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bd686cad0>
2026-03-28 19:01:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:01:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a0b0f05-0f96-5994-be70-04a2adef2a1d/8a0b0f05-0f96-5994-be70-04a2adef2a1d_image_3.jpg HTTP/1.1" 201 0
2026-03-28 19:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252F9d%252Fc19da74caa957efa0bf0e0736809002a%252Fpa%252FVZ65695_630bfbf3e9efd5e5ff2a86bd99aa58d3.jpg') HTTP/1.1" 204 0
2026-03-28 19:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/9d/c19da74caa957efa0bf0e0736809002a/pa/VZ65695_630bfbf3e9efd5e5ff2a86bd99aa58d3.jpg saved to cache
2026-03-28 19:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8a0b0f05-0f96-5994-be70-04a2adef2a1d
2026-03-28 19:01:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd2/2a/d22a7fecef685c48cd26db72bb9e2d36/pa/GU70185_41243b1316a8989c664d71d862d08b2f.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:01:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb2/6e/b26e0ecaeb888cbc80b7ac3e2d07f8ea/pa/JA39510_3eaf2e1f1439dae5ec4198419b979a58.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:01:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb5/74/b57435d1ad9f90020e6ec322db0a9b7a/pa/GD33520_89b94b56a4ab83c5707e53364a1854bd.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:01:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb5/74/b57435d1ad9f90020e6ec322db0a9b7a/pa/GD33520_6b329f0e3d7ef3864beeac7d7a3eff96.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:01:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:01:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bd711d210>
2026-03-28 19:01:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:01:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9ae0b164-4798-5bb4-9fab-9fc1b2249c69/9ae0b164-4798-5bb4-9fab-9fc1b2249c69_image_2.jpg HTTP/1.1" 201 0
2026-03-28 19:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Fa8%252F03a801e23e6839b8ac2f4286813d179b%252Fpa%252FXU82529_e438f5d98f1de745b60c416648d531e7.jpg') HTTP/1.1" 204 0
2026-03-28 19:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/a8/03a801e23e6839b8ac2f4286813d179b/pa/XU82529_e438f5d98f1de745b60c416648d531e7.jpg saved to cache
2026-03-28 19:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9ae0b164-4798-5bb4-9fab-9fc1b2249c69
2026-03-28 19:01:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:01:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bd7252a10>
2026-03-28 19:01:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:01:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a0b0f05-0f96-5994-be70-04a2adef2a1d/8a0b0f05-0f96-5994-be70-04a2adef2a1d_image_2.jpg HTTP/1.1" 201 0
2026-03-28 19:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252F9d%252Fc19da74caa957efa0bf0e0736809002a%252Fpa%252FVZ65695_e8e76606979873607b34061e60c4e149.jpg') HTTP/1.1" 204 0
2026-03-28 19:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/9d/c19da74caa957efa0bf0e0736809002a/pa/VZ65695_e8e76606979873607b34061e60c4e149.jpg saved to cache
2026-03-28 19:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8a0b0f05-0f96-5994-be70-04a2adef2a1d
2026-03-28 19:01:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:01:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bd71d0390>
2026-03-28 19:01:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:01:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e6087bb-7fb1-5752-9efd-86bcbca3bd04/8e6087bb-7fb1-5752-9efd-86bcbca3bd04_image_2.jpg HTTP/1.1" 201 0
2026-03-28 19:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F10%252F7010e65fe5afc60f34edfde6de61a9e5%252Fpa%252FAB54003_fd31a25b9f066b95c8efcbaf4836d4fa.jpg') HTTP/1.1" 204 0
2026-03-28 19:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/10/7010e65fe5afc60f34edfde6de61a9e5/pa/AB54003_fd31a25b9f066b95c8efcbaf4836d4fa.jpg saved to cache
2026-03-28 19:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8e6087bb-7fb1-5752-9efd-86bcbca3bd04
2026-03-28 19:01:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb2/6e/b26e0ecaeb888cbc80b7ac3e2d07f8ea/pa/JA39510_5614310eccb2bfec6bd5075718c29548.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:01:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc1/9d/c19da74caa957efa0bf0e0736809002a/pa/VZ65695_4984bf959b0aba0c784814a503d4dc1e.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:01:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 19:01:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:01:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bd71acb50>
2026-03-28 19:01:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:01:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0f3daf4-1b50-5132-8844-a271f81c8908/c0f3daf4-1b50-5132-8844-a271f81c8908_image_0.jpg HTTP/1.1" 201 0
2026-03-28 19:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F2a%252Fd22a7fecef685c48cd26db72bb9e2d36%252Fpa%252FGU70185_41243b1316a8989c664d71d862d08b2f.jpg') HTTP/1.1" 204 0
2026-03-28 19:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/2a/d22a7fecef685c48cd26db72bb9e2d36/pa/GU70185_41243b1316a8989c664d71d862d08b2f.jpg saved to cache
2026-03-28 19:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c0f3daf4-1b50-5132-8844-a271f81c8908
2026-03-28 19:01:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c0f3daf4-1b50-5132-8844-a271f81c8908, skipping ID generation
2026-03-28 19:01:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c0f3daf4-1b50-5132-8844-a271f81c8908 with scrape type 1
2026-03-28 19:01:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c0f3daf4-1b50-5132-8844-a271f81c8908 sending to next pipeline
2026-03-28 19:01:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: c0f3daf4-1b50-5132-8844-a271f81c8908, identifier: GU70185
2026-03-28 19:01:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:01:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bd6829b50>
2026-03-28 19:01:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:01:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ea6a973-540e-591c-a7e6-4b7cc45585c6/8ea6a973-540e-591c-a7e6-4b7cc45585c6_image_2.jpg HTTP/1.1" 201 0
2026-03-28 19:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F6e%252Fb26e0ecaeb888cbc80b7ac3e2d07f8ea%252Fpa%252FJA39510_3eaf2e1f1439dae5ec4198419b979a58.jpg') HTTP/1.1" 204 0
2026-03-28 19:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/6e/b26e0ecaeb888cbc80b7ac3e2d07f8ea/pa/JA39510_3eaf2e1f1439dae5ec4198419b979a58.jpg saved to cache
2026-03-28 19:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8ea6a973-540e-591c-a7e6-4b7cc45585c6
2026-03-28 19:01:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:01:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bd71abdd0>
2026-03-28 19:01:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:01:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6898af0-474d-5809-b3f5-b9bfdc46a8dd/d6898af0-474d-5809-b3f5-b9bfdc46a8dd_image_2.jpg HTTP/1.1" 201 0
2026-03-28 19:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F74%252Fb57435d1ad9f90020e6ec322db0a9b7a%252Fpa%252FGD33520_89b94b56a4ab83c5707e53364a1854bd.jpg') HTTP/1.1" 204 0
2026-03-28 19:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/74/b57435d1ad9f90020e6ec322db0a9b7a/pa/GD33520_89b94b56a4ab83c5707e53364a1854bd.jpg saved to cache
2026-03-28 19:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d6898af0-474d-5809-b3f5-b9bfdc46a8dd
2026-03-28 19:01:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:01:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bdd4cf0d0>
2026-03-28 19:01:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:01:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6898af0-474d-5809-b3f5-b9bfdc46a8dd/d6898af0-474d-5809-b3f5-b9bfdc46a8dd_image_1.jpg HTTP/1.1" 201 0
2026-03-28 19:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F74%252Fb57435d1ad9f90020e6ec322db0a9b7a%252Fpa%252FGD33520_6b329f0e3d7ef3864beeac7d7a3eff96.jpg') HTTP/1.1" 204 0
2026-03-28 19:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/74/b57435d1ad9f90020e6ec322db0a9b7a/pa/GD33520_6b329f0e3d7ef3864beeac7d7a3eff96.jpg saved to cache
2026-03-28 19:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d6898af0-474d-5809-b3f5-b9bfdc46a8dd
2026-03-28 19:01:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: c0f3daf4-1b50-5132-8844-a271f81c8908 with identifier: GU70185
2026-03-28 19:01:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: c0f3daf4-1b50-5132-8844-a271f81c8908 with identifier: GU70185
2026-03-28 19:01:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: c0f3daf4-1b50-5132-8844-a271f81c8908 with identifier: GU70185 to the API
2026-03-28 19:01:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 19:01:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 19:01:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgd2/2a/d22a7fecef685c48cd26db72bb9e2d36/pa/GU70185_41243b1316a8989c664d71d862d08b2f.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 99,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 82,
 'expiration_date': '2026-03-30T15:40:27Z',
 'fuel_type': 'petrol',
 'id': 'c0f3daf4-1b50-5132-8844-a271f81c8908',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'RT026J',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GU70185',
 'listing': 'auction',
 'location': 'NL, Breukelen',
 'make': 'Peugeot',
 'model': '208',
 'odometer': 91209,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0f3daf4-1b50-5132-8844-a271f81c8908/c0f3daf4-1b50-5132-8844-a271f81c8908_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2573991,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/2a/d22a7fecef685c48cd26db72bb9e2d36/pa/GU70185_41243b1316a8989c664d71d862d08b2f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0f3daf4-1b50-5132-8844-a271f81c8908/c0f3daf4-1b50-5132-8844-a271f81c8908_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66994,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/2a/d22a7fecef685c48cd26db72bb9e2d36/pa/GU70185_8509ab3b2c6e0e236939d85826bad705.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0f3daf4-1b50-5132-8844-a271f81c8908/c0f3daf4-1b50-5132-8844-a271f81c8908_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2897448,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/2a/d22a7fecef685c48cd26db72bb9e2d36/pa/GU70185_2ec04e6a30a861c463f9671729ad798c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0f3daf4-1b50-5132-8844-a271f81c8908/c0f3daf4-1b50-5132-8844-a271f81c8908_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51739,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/2a/d22a7fecef685c48cd26db72bb9e2d36/pa/GU70185_d258fe40a542d5e76ea9c73368a4a0b3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0f3daf4-1b50-5132-8844-a271f81c8908/c0f3daf4-1b50-5132-8844-a271f81c8908_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2806658,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/2a/d22a7fecef685c48cd26db72bb9e2d36/pa/GU70185_0093077767f6dcea138a2c0e6b85cf10.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0f3daf4-1b50-5132-8844-a271f81c8908/c0f3daf4-1b50-5132-8844-a271f81c8908_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67308,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/2a/d22a7fecef685c48cd26db72bb9e2d36/pa/GU70185_2e43c9ee4e0ef44410efe98dda05164e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0f3daf4-1b50-5132-8844-a271f81c8908/c0f3daf4-1b50-5132-8844-a271f81c8908_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2798142,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/2a/d22a7fecef685c48cd26db72bb9e2d36/pa/GU70185_d83411a56fad1b2b1aba1c8a01247cbd.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0f3daf4-1b50-5132-8844-a271f81c8908/c0f3daf4-1b50-5132-8844-a271f81c8908_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2719491,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/2a/d22a7fecef685c48cd26db72bb9e2d36/pa/GU70185_9fe99650376651dc8423b537d1d17239.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0f3daf4-1b50-5132-8844-a271f81c8908/c0f3daf4-1b50-5132-8844-a271f81c8908_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2557451,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/2a/d22a7fecef685c48cd26db72bb9e2d36/pa/GU70185_6cbf9356ce8cfd9541d98e59349b3a76.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0f3daf4-1b50-5132-8844-a271f81c8908/c0f3daf4-1b50-5132-8844-a271f81c8908_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67411,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/2a/d22a7fecef685c48cd26db72bb9e2d36/pa/GU70185_0d8ac4a3abccdb1aaa6b5a10f95fc7bb.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-03-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 208 1.2 e-VTi Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2018}
2026-03-28 19:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GU70185%27 HTTP/1.1" 200 None
2026-03-28 19:01:48 [auto1.nl] INFO: Saving data for GU70185: {'created_time': 1774724508.82616, 'last_price_update_time': 1774724508.826175, 'auction_closing_time': 1774885227.0}
2026-03-28 19:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='GU70185') HTTP/1.1" 204 0
2026-03-28 19:01:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img70/10/7010e65fe5afc60f34edfde6de61a9e5/pa/AB54003_c0f1b0c6907219f30cd983b17b3a20a3.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:01:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb5/74/b57435d1ad9f90020e6ec322db0a9b7a/pa/GD33520_8a0f899f4b1c9cc0a382df71b84f8004.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:01:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img78/74/78748a4eb97f59c70aee1baf44fa250c/pa/ZP46172_d388b9a5882daeb43128650b17f24a78.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:01:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:01:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bdd1fc290>
2026-03-28 19:01:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:01:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ea6a973-540e-591c-a7e6-4b7cc45585c6/8ea6a973-540e-591c-a7e6-4b7cc45585c6_image_0.jpg HTTP/1.1" 201 0
2026-03-28 19:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F6e%252Fb26e0ecaeb888cbc80b7ac3e2d07f8ea%252Fpa%252FJA39510_5614310eccb2bfec6bd5075718c29548.jpg') HTTP/1.1" 204 0
2026-03-28 19:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/6e/b26e0ecaeb888cbc80b7ac3e2d07f8ea/pa/JA39510_5614310eccb2bfec6bd5075718c29548.jpg saved to cache
2026-03-28 19:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8ea6a973-540e-591c-a7e6-4b7cc45585c6
2026-03-28 19:01:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8ea6a973-540e-591c-a7e6-4b7cc45585c6, skipping ID generation
2026-03-28 19:01:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8ea6a973-540e-591c-a7e6-4b7cc45585c6 with scrape type 1
2026-03-28 19:01:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8ea6a973-540e-591c-a7e6-4b7cc45585c6 sending to next pipeline
2026-03-28 19:01:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 8ea6a973-540e-591c-a7e6-4b7cc45585c6, identifier: JA39510
2026-03-28 19:01:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:01:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bd6887910>
2026-03-28 19:01:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:01:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a0b0f05-0f96-5994-be70-04a2adef2a1d/8a0b0f05-0f96-5994-be70-04a2adef2a1d_image_0.jpg HTTP/1.1" 201 0
2026-03-28 19:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252F9d%252Fc19da74caa957efa0bf0e0736809002a%252Fpa%252FVZ65695_4984bf959b0aba0c784814a503d4dc1e.jpg') HTTP/1.1" 204 0
2026-03-28 19:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/9d/c19da74caa957efa0bf0e0736809002a/pa/VZ65695_4984bf959b0aba0c784814a503d4dc1e.jpg saved to cache
2026-03-28 19:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8a0b0f05-0f96-5994-be70-04a2adef2a1d
2026-03-28 19:01:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8a0b0f05-0f96-5994-be70-04a2adef2a1d, skipping ID generation
2026-03-28 19:01:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8a0b0f05-0f96-5994-be70-04a2adef2a1d with scrape type 1
2026-03-28 19:01:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8a0b0f05-0f96-5994-be70-04a2adef2a1d sending to next pipeline
2026-03-28 19:01:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 8a0b0f05-0f96-5994-be70-04a2adef2a1d, identifier: VZ65695
2026-03-28 19:01:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 8ea6a973-540e-591c-a7e6-4b7cc45585c6 with identifier: JA39510
2026-03-28 19:01:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 8ea6a973-540e-591c-a7e6-4b7cc45585c6 with identifier: JA39510
2026-03-28 19:01:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 8ea6a973-540e-591c-a7e6-4b7cc45585c6 with identifier: JA39510 to the API
2026-03-28 19:01:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 19:01:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 19:01:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgb2/6e/b26e0ecaeb888cbc80b7ac3e2d07f8ea/pa/JA39510_5614310eccb2bfec6bd5075718c29548.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 128,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 155,
 'expiration_date': '2026-03-30T15:59:36Z',
 'fuel_type': 'petrol',
 'id': '8ea6a973-540e-591c-a7e6-4b7cc45585c6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'ZR030K',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JA39510',
 'listing': 'auction',
 'location': 'NL, Koog aan de Zaan',
 'make': 'Mercedes-Benz',
 'model': 'CLA-Klasse',
 'odometer': 166884,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ea6a973-540e-591c-a7e6-4b7cc45585c6/8ea6a973-540e-591c-a7e6-4b7cc45585c6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89843,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/6e/b26e0ecaeb888cbc80b7ac3e2d07f8ea/pa/JA39510_5614310eccb2bfec6bd5075718c29548.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ea6a973-540e-591c-a7e6-4b7cc45585c6/8ea6a973-540e-591c-a7e6-4b7cc45585c6_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85846,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/6e/b26e0ecaeb888cbc80b7ac3e2d07f8ea/pa/JA39510_953ad81fb8bb7ebca56f41d16ae8584f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ea6a973-540e-591c-a7e6-4b7cc45585c6/8ea6a973-540e-591c-a7e6-4b7cc45585c6_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85828,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/6e/b26e0ecaeb888cbc80b7ac3e2d07f8ea/pa/JA39510_3eaf2e1f1439dae5ec4198419b979a58.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ea6a973-540e-591c-a7e6-4b7cc45585c6/8ea6a973-540e-591c-a7e6-4b7cc45585c6_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75451,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/6e/b26e0ecaeb888cbc80b7ac3e2d07f8ea/pa/JA39510_4e1eaa78f6911c33b24edf643e8e4d68.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ea6a973-540e-591c-a7e6-4b7cc45585c6/8ea6a973-540e-591c-a7e6-4b7cc45585c6_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85592,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/6e/b26e0ecaeb888cbc80b7ac3e2d07f8ea/pa/JA39510_c2c03a58aeeadf199862449ee472b7c2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ea6a973-540e-591c-a7e6-4b7cc45585c6/8ea6a973-540e-591c-a7e6-4b7cc45585c6_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90364,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/6e/b26e0ecaeb888cbc80b7ac3e2d07f8ea/pa/JA39510_01663c9cf11ac4813e1bec2fe60eb8d2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ea6a973-540e-591c-a7e6-4b7cc45585c6/8ea6a973-540e-591c-a7e6-4b7cc45585c6_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71624,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/6e/b26e0ecaeb888cbc80b7ac3e2d07f8ea/pa/JA39510_0cbc3400ab650145c95bfcb81c69ed94.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ea6a973-540e-591c-a7e6-4b7cc45585c6/8ea6a973-540e-591c-a7e6-4b7cc45585c6_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79755,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/6e/b26e0ecaeb888cbc80b7ac3e2d07f8ea/pa/JA39510_4ab5617d693daa1378169d116ee816d4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ea6a973-540e-591c-a7e6-4b7cc45585c6/8ea6a973-540e-591c-a7e6-4b7cc45585c6_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79980,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/6e/b26e0ecaeb888cbc80b7ac3e2d07f8ea/pa/JA39510_34812893ef409eb25f045c886c73ea99.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ea6a973-540e-591c-a7e6-4b7cc45585c6/8ea6a973-540e-591c-a7e6-4b7cc45585c6_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80100,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/6e/b26e0ecaeb888cbc80b7ac3e2d07f8ea/pa/JA39510_9f072a3dbec8773bad7ccba868174287.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-08-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz CLA-Klasse CLA 200 Shooting Brake AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2015}
2026-03-28 19:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JA39510%27 HTTP/1.1" 200 None
2026-03-28 19:01:49 [auto1.nl] INFO: Saving data for JA39510: {'created_time': 1774724509.500465, 'last_price_update_time': 1774724509.500474, 'auction_closing_time': 1774886376.0}
2026-03-28 19:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='JA39510') HTTP/1.1" 204 0
2026-03-28 19:01:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 8a0b0f05-0f96-5994-be70-04a2adef2a1d with identifier: VZ65695
2026-03-28 19:01:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 8a0b0f05-0f96-5994-be70-04a2adef2a1d with identifier: VZ65695
2026-03-28 19:01:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 8a0b0f05-0f96-5994-be70-04a2adef2a1d with identifier: VZ65695 to the API
2026-03-28 19:01:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 19:01:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 19:01:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgc1/9d/c19da74caa957efa0bf0e0736809002a/pa/VZ65695_4984bf959b0aba0c784814a503d4dc1e.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 149,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 4',
 'engine': '1.6L',
 'engine_horse_power': 175,
 'expiration_date': '2026-03-30T15:12:11Z',
 'fuel_type': 'petrol',
 'id': '8a0b0f05-0f96-5994-be70-04a2adef2a1d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '54xtsx',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VZ65695',
 'listing': 'auction',
 'location': 'NL, Den Haag',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 180854,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a0b0f05-0f96-5994-be70-04a2adef2a1d/8a0b0f05-0f96-5994-be70-04a2adef2a1d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73809,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc1/9d/c19da74caa957efa0bf0e0736809002a/pa/VZ65695_4984bf959b0aba0c784814a503d4dc1e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a0b0f05-0f96-5994-be70-04a2adef2a1d/8a0b0f05-0f96-5994-be70-04a2adef2a1d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79633,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc1/9d/c19da74caa957efa0bf0e0736809002a/pa/VZ65695_127591d6efc7ea0a52528d5f3591c3b1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a0b0f05-0f96-5994-be70-04a2adef2a1d/8a0b0f05-0f96-5994-be70-04a2adef2a1d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70309,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc1/9d/c19da74caa957efa0bf0e0736809002a/pa/VZ65695_e8e76606979873607b34061e60c4e149.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a0b0f05-0f96-5994-be70-04a2adef2a1d/8a0b0f05-0f96-5994-be70-04a2adef2a1d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83963,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc1/9d/c19da74caa957efa0bf0e0736809002a/pa/VZ65695_630bfbf3e9efd5e5ff2a86bd99aa58d3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a0b0f05-0f96-5994-be70-04a2adef2a1d/8a0b0f05-0f96-5994-be70-04a2adef2a1d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70628,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc1/9d/c19da74caa957efa0bf0e0736809002a/pa/VZ65695_c732a90fcfa8012d8dc8088ce734d638.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2007-10-03',
 'seats_number': 4,
 'seller_name': None,
 'title': 'MINI Cooper S',
 'transmission': 'manual',
 'trim': '',
 'year': 2007}
2026-03-28 19:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VZ65695%27 HTTP/1.1" 200 None
2026-03-28 19:01:49 [auto1.nl] INFO: Saving data for VZ65695: {'created_time': 1774724509.870854, 'last_price_update_time': 1774724509.870864, 'auction_closing_time': 1774883531.0}
2026-03-28 19:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='VZ65695') HTTP/1.1" 204 0
2026-03-28 19:01:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:01:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bd6268790>
2026-03-28 19:01:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:01:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e6087bb-7fb1-5752-9efd-86bcbca3bd04/8e6087bb-7fb1-5752-9efd-86bcbca3bd04_image_0.jpg HTTP/1.1" 201 0
2026-03-28 19:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F10%252F7010e65fe5afc60f34edfde6de61a9e5%252Fpa%252FAB54003_c0f1b0c6907219f30cd983b17b3a20a3.jpg') HTTP/1.1" 204 0
2026-03-28 19:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/10/7010e65fe5afc60f34edfde6de61a9e5/pa/AB54003_c0f1b0c6907219f30cd983b17b3a20a3.jpg saved to cache
2026-03-28 19:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8e6087bb-7fb1-5752-9efd-86bcbca3bd04
2026-03-28 19:01:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:01:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bd68804d0>
2026-03-28 19:01:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:01:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6898af0-474d-5809-b3f5-b9bfdc46a8dd/d6898af0-474d-5809-b3f5-b9bfdc46a8dd_image_0.jpg HTTP/1.1" 201 0
2026-03-28 19:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F74%252Fb57435d1ad9f90020e6ec322db0a9b7a%252Fpa%252FGD33520_8a0f899f4b1c9cc0a382df71b84f8004.jpg') HTTP/1.1" 204 0
2026-03-28 19:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/74/b57435d1ad9f90020e6ec322db0a9b7a/pa/GD33520_8a0f899f4b1c9cc0a382df71b84f8004.jpg saved to cache
2026-03-28 19:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d6898af0-474d-5809-b3f5-b9bfdc46a8dd
2026-03-28 19:01:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d6898af0-474d-5809-b3f5-b9bfdc46a8dd, skipping ID generation
2026-03-28 19:01:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d6898af0-474d-5809-b3f5-b9bfdc46a8dd with scrape type 1
2026-03-28 19:01:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d6898af0-474d-5809-b3f5-b9bfdc46a8dd sending to next pipeline
2026-03-28 19:01:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: d6898af0-474d-5809-b3f5-b9bfdc46a8dd, identifier: GD33520
2026-03-28 19:01:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:01:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bd682a0d0>
2026-03-28 19:01:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:01:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:01:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:01:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef3178cd-1a74-54a7-822f-6f70cbf8384a/ef3178cd-1a74-54a7-822f-6f70cbf8384a_image_1.jpg HTTP/1.1" 201 0
2026-03-28 19:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252F74%252F78748a4eb97f59c70aee1baf44fa250c%252Fpa%252FZP46172_d388b9a5882daeb43128650b17f24a78.jpg') HTTP/1.1" 204 0
2026-03-28 19:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/74/78748a4eb97f59c70aee1baf44fa250c/pa/ZP46172_d388b9a5882daeb43128650b17f24a78.jpg saved to cache
2026-03-28 19:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ef3178cd-1a74-54a7-822f-6f70cbf8384a
2026-03-28 19:01:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ef3178cd-1a74-54a7-822f-6f70cbf8384a, skipping ID generation
2026-03-28 19:01:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ef3178cd-1a74-54a7-822f-6f70cbf8384a with scrape type 1
2026-03-28 19:01:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ef3178cd-1a74-54a7-822f-6f70cbf8384a sending to next pipeline
2026-03-28 19:01:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: ef3178cd-1a74-54a7-822f-6f70cbf8384a, identifier: ZP46172
2026-03-28 19:01:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img70/10/7010e65fe5afc60f34edfde6de61a9e5/pa/AB54003_f5e2a6e765ea5fcf7448299c3bc36b9a.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:01:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: d6898af0-474d-5809-b3f5-b9bfdc46a8dd with identifier: GD33520
2026-03-28 19:01:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: d6898af0-474d-5809-b3f5-b9bfdc46a8dd with identifier: GD33520
2026-03-28 19:01:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: d6898af0-474d-5809-b3f5-b9bfdc46a8dd with identifier: GD33520 to the API
2026-03-28 19:01:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 19:01:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 19:01:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgb5/74/b57435d1ad9f90020e6ec322db0a9b7a/pa/GD33520_8a0f899f4b1c9cc0a382df71b84f8004.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 105,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.2L',
 'engine_horse_power': 82,
 'expiration_date': '2026-03-30T15:13:00Z',
 'fuel_type': 'petrol',
 'id': 'd6898af0-474d-5809-b3f5-b9bfdc46a8dd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '8XHD24',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GD33520',
 'listing': 'auction',
 'location': 'NL, Amsterdam',
 'make': 'Citroen',
 'model': 'C4 Cactus',
 'odometer': 230320,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6898af0-474d-5809-b3f5-b9bfdc46a8dd/d6898af0-474d-5809-b3f5-b9bfdc46a8dd_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88538,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb5/74/b57435d1ad9f90020e6ec322db0a9b7a/pa/GD33520_8a0f899f4b1c9cc0a382df71b84f8004.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6898af0-474d-5809-b3f5-b9bfdc46a8dd/d6898af0-474d-5809-b3f5-b9bfdc46a8dd_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66385,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb5/74/b57435d1ad9f90020e6ec322db0a9b7a/pa/GD33520_6b329f0e3d7ef3864beeac7d7a3eff96.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6898af0-474d-5809-b3f5-b9bfdc46a8dd/d6898af0-474d-5809-b3f5-b9bfdc46a8dd_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88051,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb5/74/b57435d1ad9f90020e6ec322db0a9b7a/pa/GD33520_89b94b56a4ab83c5707e53364a1854bd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6898af0-474d-5809-b3f5-b9bfdc46a8dd/d6898af0-474d-5809-b3f5-b9bfdc46a8dd_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80142,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb5/74/b57435d1ad9f90020e6ec322db0a9b7a/pa/GD33520_1532bb95c705200beb6b4deb26041bf9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6898af0-474d-5809-b3f5-b9bfdc46a8dd/d6898af0-474d-5809-b3f5-b9bfdc46a8dd_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60888,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb5/74/b57435d1ad9f90020e6ec322db0a9b7a/pa/GD33520_08b4bf8bd0afb85eeb45b391b43cb6f5.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-07-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C4 Cactus 1.2 VTi Feel',
 'transmission': 'manual',
 'trim': 'Feel',
 'year': 2014}
2026-03-28 19:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GD33520%27 HTTP/1.1" 200 None
2026-03-28 19:01:50 [auto1.nl] INFO: Saving data for GD33520: {'created_time': 1774724510.561971, 'last_price_update_time': 1774724510.561986, 'auction_closing_time': 1774883580.0}
2026-03-28 19:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='GD33520') HTTP/1.1" 204 0
2026-03-28 19:01:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: ef3178cd-1a74-54a7-822f-6f70cbf8384a with identifier: ZP46172
2026-03-28 19:01:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: ef3178cd-1a74-54a7-822f-6f70cbf8384a with identifier: ZP46172
2026-03-28 19:01:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: ef3178cd-1a74-54a7-822f-6f70cbf8384a with identifier: ZP46172 to the API
2026-03-28 19:01:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 19:01:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 19:01:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img78/74/78748a4eb97f59c70aee1baf44fa250c/pa/ZP46172_d388b9a5882daeb43128650b17f24a78.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 159,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 4',
 'engine': '1.5L',
 'engine_horse_power': 102,
 'expiration_date': '2026-03-30T15:09:29Z',
 'fuel_type': 'petrol',
 'id': 'ef3178cd-1a74-54a7-822f-6f70cbf8384a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '42SFLL',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZP46172',
 'listing': 'auction',
 'location': 'NL, Eindhoven',
 'make': 'Suzuki',
 'model': 'Swift',
 'odometer': 207374,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef3178cd-1a74-54a7-822f-6f70cbf8384a/ef3178cd-1a74-54a7-822f-6f70cbf8384a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87407,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img78/74/78748a4eb97f59c70aee1baf44fa250c/pa/ZP46172_023c0c8bd0bc565540a01bcf301be264.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef3178cd-1a74-54a7-822f-6f70cbf8384a/ef3178cd-1a74-54a7-822f-6f70cbf8384a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82705,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img78/74/78748a4eb97f59c70aee1baf44fa250c/pa/ZP46172_d388b9a5882daeb43128650b17f24a78.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef3178cd-1a74-54a7-822f-6f70cbf8384a/ef3178cd-1a74-54a7-822f-6f70cbf8384a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70468,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img78/74/78748a4eb97f59c70aee1baf44fa250c/pa/ZP46172_60de5cf153ab1c3e357d35578d00abac.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef3178cd-1a74-54a7-822f-6f70cbf8384a/ef3178cd-1a74-54a7-822f-6f70cbf8384a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62092,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img78/74/78748a4eb97f59c70aee1baf44fa250c/pa/ZP46172_8c99f96ae28aa9514e71f59bd86cd49e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef3178cd-1a74-54a7-822f-6f70cbf8384a/ef3178cd-1a74-54a7-822f-6f70cbf8384a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62108,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img78/74/78748a4eb97f59c70aee1baf44fa250c/pa/ZP46172_78f718b61c190a7b96a599fcc2380fb9.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2005-12-01',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Suzuki Swift 1.5 Classic',
 'transmission': 'manual',
 'trim': 'Classic',
 'year': 2005}
2026-03-28 19:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZP46172%27 HTTP/1.1" 200 None
2026-03-28 19:01:50 [auto1.nl] INFO: Saving data for ZP46172: {'created_time': 1774724510.942737, 'last_price_update_time': 1774724510.94275, 'auction_closing_time': 1774883369.0}
2026-03-28 19:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='ZP46172') HTTP/1.1" 204 0
2026-03-28 19:01:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img70/10/7010e65fe5afc60f34edfde6de61a9e5/pa/AB54003_247f362c4d00a383cf0099aa39e54ec4.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:01:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 19:01:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:01:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bd7241650>
2026-03-28 19:01:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:01:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:01:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:01:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e6087bb-7fb1-5752-9efd-86bcbca3bd04/8e6087bb-7fb1-5752-9efd-86bcbca3bd04_image_6.jpg HTTP/1.1" 201 0
2026-03-28 19:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F10%252F7010e65fe5afc60f34edfde6de61a9e5%252Fpa%252FAB54003_f5e2a6e765ea5fcf7448299c3bc36b9a.jpg') HTTP/1.1" 204 0
2026-03-28 19:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/10/7010e65fe5afc60f34edfde6de61a9e5/pa/AB54003_f5e2a6e765ea5fcf7448299c3bc36b9a.jpg saved to cache
2026-03-28 19:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8e6087bb-7fb1-5752-9efd-86bcbca3bd04
2026-03-28 19:01:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/a8/03a801e23e6839b8ac2f4286813d179b/pa/XU82529_eee769f96b410556197b940ef2b100eb.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:01:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 19:01:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:01:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bd71e0e50>
2026-03-28 19:01:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:01:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:01:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:01:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e6087bb-7fb1-5752-9efd-86bcbca3bd04/8e6087bb-7fb1-5752-9efd-86bcbca3bd04_image_8.jpg HTTP/1.1" 201 0
2026-03-28 19:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F10%252F7010e65fe5afc60f34edfde6de61a9e5%252Fpa%252FAB54003_247f362c4d00a383cf0099aa39e54ec4.jpg') HTTP/1.1" 204 0
2026-03-28 19:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/10/7010e65fe5afc60f34edfde6de61a9e5/pa/AB54003_247f362c4d00a383cf0099aa39e54ec4.jpg saved to cache
2026-03-28 19:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8e6087bb-7fb1-5752-9efd-86bcbca3bd04
2026-03-28 19:01:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 19:01:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:01:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bd7267610>
2026-03-28 19:01:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:01:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:01:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:01:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9ae0b164-4798-5bb4-9fab-9fc1b2249c69/9ae0b164-4798-5bb4-9fab-9fc1b2249c69_image_3.jpg HTTP/1.1" 201 0
2026-03-28 19:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Fa8%252F03a801e23e6839b8ac2f4286813d179b%252Fpa%252FXU82529_eee769f96b410556197b940ef2b100eb.jpg') HTTP/1.1" 204 0
2026-03-28 19:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/a8/03a801e23e6839b8ac2f4286813d179b/pa/XU82529_eee769f96b410556197b940ef2b100eb.jpg saved to cache
2026-03-28 19:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9ae0b164-4798-5bb4-9fab-9fc1b2249c69
2026-03-28 19:01:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/a8/03a801e23e6839b8ac2f4286813d179b/pa/XU82529_2b232f9407af6176b6d2f162a29127f3.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:01:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img70/10/7010e65fe5afc60f34edfde6de61a9e5/pa/AB54003_c3ffa57d024049ee40510056d0adb729.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:01:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 19:01:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:01:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bd63d47d0>
2026-03-28 19:01:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:01:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:01:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:01:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9ae0b164-4798-5bb4-9fab-9fc1b2249c69/9ae0b164-4798-5bb4-9fab-9fc1b2249c69_image_0.jpg HTTP/1.1" 201 0
2026-03-28 19:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Fa8%252F03a801e23e6839b8ac2f4286813d179b%252Fpa%252FXU82529_2b232f9407af6176b6d2f162a29127f3.jpg') HTTP/1.1" 204 0
2026-03-28 19:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/a8/03a801e23e6839b8ac2f4286813d179b/pa/XU82529_2b232f9407af6176b6d2f162a29127f3.jpg saved to cache
2026-03-28 19:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9ae0b164-4798-5bb4-9fab-9fc1b2249c69
2026-03-28 19:01:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9ae0b164-4798-5bb4-9fab-9fc1b2249c69, skipping ID generation
2026-03-28 19:01:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9ae0b164-4798-5bb4-9fab-9fc1b2249c69 with scrape type 1
2026-03-28 19:01:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9ae0b164-4798-5bb4-9fab-9fc1b2249c69 sending to next pipeline
2026-03-28 19:01:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 9ae0b164-4798-5bb4-9fab-9fc1b2249c69, identifier: XU82529
2026-03-28 19:01:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 19:01:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:01:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bdd5b76d0>
2026-03-28 19:01:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:01:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:01:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:01:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e6087bb-7fb1-5752-9efd-86bcbca3bd04/8e6087bb-7fb1-5752-9efd-86bcbca3bd04_image_1.jpg HTTP/1.1" 201 0
2026-03-28 19:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F10%252F7010e65fe5afc60f34edfde6de61a9e5%252Fpa%252FAB54003_c3ffa57d024049ee40510056d0adb729.jpg') HTTP/1.1" 204 0
2026-03-28 19:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/10/7010e65fe5afc60f34edfde6de61a9e5/pa/AB54003_c3ffa57d024049ee40510056d0adb729.jpg saved to cache
2026-03-28 19:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8e6087bb-7fb1-5752-9efd-86bcbca3bd04
2026-03-28 19:01:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8e6087bb-7fb1-5752-9efd-86bcbca3bd04, skipping ID generation
2026-03-28 19:01:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8e6087bb-7fb1-5752-9efd-86bcbca3bd04 with scrape type 1
2026-03-28 19:01:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8e6087bb-7fb1-5752-9efd-86bcbca3bd04 sending to next pipeline
2026-03-28 19:01:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 8e6087bb-7fb1-5752-9efd-86bcbca3bd04, identifier: AB54003
2026-03-28 19:01:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 9ae0b164-4798-5bb4-9fab-9fc1b2249c69 with identifier: XU82529
2026-03-28 19:01:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 9ae0b164-4798-5bb4-9fab-9fc1b2249c69 with identifier: XU82529
2026-03-28 19:01:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 9ae0b164-4798-5bb4-9fab-9fc1b2249c69 with identifier: XU82529 to the API
2026-03-28 19:01:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 19:01:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 19:01:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img03/a8/03a801e23e6839b8ac2f4286813d179b/pa/XU82529_2b232f9407af6176b6d2f162a29127f3.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 5',
 'engine': '4.4L',
 'engine_horse_power': 408,
 'expiration_date': '2026-03-30T15:40:19Z',
 'fuel_type': 'petrol',
 'id': '9ae0b164-4798-5bb4-9fab-9fc1b2249c69',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'license_plate': 'GLK10D',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XU82529',
 'listing': 'auction',
 'location': 'NL, Eindhoven',
 'make': 'BMW',
 'model': '7er',
 'odometer': 85432,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9ae0b164-4798-5bb4-9fab-9fc1b2249c69/9ae0b164-4798-5bb4-9fab-9fc1b2249c69_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2249478,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img03/a8/03a801e23e6839b8ac2f4286813d179b/pa/XU82529_2b232f9407af6176b6d2f162a29127f3.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9ae0b164-4798-5bb4-9fab-9fc1b2249c69/9ae0b164-4798-5bb4-9fab-9fc1b2249c69_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72510,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img03/a8/03a801e23e6839b8ac2f4286813d179b/pa/XU82529_942c3f9fd485e2d23a5048e44b825254.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9ae0b164-4798-5bb4-9fab-9fc1b2249c69/9ae0b164-4798-5bb4-9fab-9fc1b2249c69_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63783,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img03/a8/03a801e23e6839b8ac2f4286813d179b/pa/XU82529_e438f5d98f1de745b60c416648d531e7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9ae0b164-4798-5bb4-9fab-9fc1b2249c69/9ae0b164-4798-5bb4-9fab-9fc1b2249c69_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2201515,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img03/a8/03a801e23e6839b8ac2f4286813d179b/pa/XU82529_eee769f96b410556197b940ef2b100eb.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9ae0b164-4798-5bb4-9fab-9fc1b2249c69/9ae0b164-4798-5bb4-9fab-9fc1b2249c69_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69067,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img03/a8/03a801e23e6839b8ac2f4286813d179b/pa/XU82529_1477557ca164ae62d389d04ba91cc501.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9ae0b164-4798-5bb4-9fab-9fc1b2249c69/9ae0b164-4798-5bb4-9fab-9fc1b2249c69_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74152,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img03/a8/03a801e23e6839b8ac2f4286813d179b/pa/XU82529_9106e884787ee1a08096c448fc10a523.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9ae0b164-4798-5bb4-9fab-9fc1b2249c69/9ae0b164-4798-5bb4-9fab-9fc1b2249c69_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64581,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img03/a8/03a801e23e6839b8ac2f4286813d179b/pa/XU82529_90b0f3713ce804e7bab72a252a9f2720.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9ae0b164-4798-5bb4-9fab-9fc1b2249c69/9ae0b164-4798-5bb4-9fab-9fc1b2249c69_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72440,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img03/a8/03a801e23e6839b8ac2f4286813d179b/pa/XU82529_8ab19b3ab6c777cc91a3362a44660d92.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9ae0b164-4798-5bb4-9fab-9fc1b2249c69/9ae0b164-4798-5bb4-9fab-9fc1b2249c69_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79648,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img03/a8/03a801e23e6839b8ac2f4286813d179b/pa/XU82529_9e2ee47df834d11ad4243b51ba923e55.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9ae0b164-4798-5bb4-9fab-9fc1b2249c69/9ae0b164-4798-5bb4-9fab-9fc1b2249c69_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72205,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img03/a8/03a801e23e6839b8ac2f4286813d179b/pa/XU82529_ed77531baa59dee9e862fd34af7d0300.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2009-04-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 7er 750i L',
 'transmission': 'automatic',
 'trim': 'L',
 'year': 2009}
2026-03-28 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XU82529%27 HTTP/1.1" 200 None
2026-03-28 19:01:52 [auto1.nl] INFO: Saving data for XU82529: {'created_time': 1774724512.21818, 'last_price_update_time': 1774724512.218193, 'auction_closing_time': 1774885219.0}
2026-03-28 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='XU82529') HTTP/1.1" 204 0
2026-03-28 19:01:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 8e6087bb-7fb1-5752-9efd-86bcbca3bd04 with identifier: AB54003
2026-03-28 19:01:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 8e6087bb-7fb1-5752-9efd-86bcbca3bd04 with identifier: AB54003
2026-03-28 19:01:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 8e6087bb-7fb1-5752-9efd-86bcbca3bd04 with identifier: AB54003 to the API
2026-03-28 19:01:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 19:01:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 19:01:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img70/10/7010e65fe5afc60f34edfde6de61a9e5/pa/AB54003_c3ffa57d024049ee40510056d0adb729.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 43,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 220,
 'expiration_date': '2026-03-30T15:22:01Z',
 'fuel_type': 'hybrid',
 'id': '8e6087bb-7fb1-5752-9efd-86bcbca3bd04',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'X590DN',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AB54003',
 'listing': 'auction',
 'location': 'NL, Den Haag',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 88448,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e6087bb-7fb1-5752-9efd-86bcbca3bd04/8e6087bb-7fb1-5752-9efd-86bcbca3bd04_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78659,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img70/10/7010e65fe5afc60f34edfde6de61a9e5/pa/AB54003_c0f1b0c6907219f30cd983b17b3a20a3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e6087bb-7fb1-5752-9efd-86bcbca3bd04/8e6087bb-7fb1-5752-9efd-86bcbca3bd04_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2856174,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img70/10/7010e65fe5afc60f34edfde6de61a9e5/pa/AB54003_c3ffa57d024049ee40510056d0adb729.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e6087bb-7fb1-5752-9efd-86bcbca3bd04/8e6087bb-7fb1-5752-9efd-86bcbca3bd04_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79909,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img70/10/7010e65fe5afc60f34edfde6de61a9e5/pa/AB54003_fd31a25b9f066b95c8efcbaf4836d4fa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e6087bb-7fb1-5752-9efd-86bcbca3bd04/8e6087bb-7fb1-5752-9efd-86bcbca3bd04_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67672,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img70/10/7010e65fe5afc60f34edfde6de61a9e5/pa/AB54003_c923a2a347f496739748102752a0fb74.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e6087bb-7fb1-5752-9efd-86bcbca3bd04/8e6087bb-7fb1-5752-9efd-86bcbca3bd04_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66912,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img70/10/7010e65fe5afc60f34edfde6de61a9e5/pa/AB54003_53f4b9d86ca9c7e9fadd2a6e1623005f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e6087bb-7fb1-5752-9efd-86bcbca3bd04/8e6087bb-7fb1-5752-9efd-86bcbca3bd04_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66472,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img70/10/7010e65fe5afc60f34edfde6de61a9e5/pa/AB54003_14b95610b794ed87963cb78eb067287b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e6087bb-7fb1-5752-9efd-86bcbca3bd04/8e6087bb-7fb1-5752-9efd-86bcbca3bd04_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2349108,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img70/10/7010e65fe5afc60f34edfde6de61a9e5/pa/AB54003_f5e2a6e765ea5fcf7448299c3bc36b9a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e6087bb-7fb1-5752-9efd-86bcbca3bd04/8e6087bb-7fb1-5752-9efd-86bcbca3bd04_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71745,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img70/10/7010e65fe5afc60f34edfde6de61a9e5/pa/AB54003_710a43b24498d679ab16eda40b066670.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e6087bb-7fb1-5752-9efd-86bcbca3bd04/8e6087bb-7fb1-5752-9efd-86bcbca3bd04_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2729414,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img70/10/7010e65fe5afc60f34edfde6de61a9e5/pa/AB54003_247f362c4d00a383cf0099aa39e54ec4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e6087bb-7fb1-5752-9efd-86bcbca3bd04/8e6087bb-7fb1-5752-9efd-86bcbca3bd04_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62901,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img70/10/7010e65fe5afc60f34edfde6de61a9e5/pa/AB54003_add7f015570b0af50c2f3c96ca77e0b8.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-03-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 xDrive 25e M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2021}
2026-03-28 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AB54003%27 HTTP/1.1" 200 None
2026-03-28 19:01:52 [auto1.nl] INFO: Saving data for AB54003: {'created_time': 1774724512.597275, 'last_price_update_time': 1774724512.597321, 'auction_closing_time': 1774884121.0}
2026-03-28 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='AB54003') HTTP/1.1" 204 0
2026-03-28 19:02:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PS01910/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 19:02:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:02:06 [scrapy.extensions.logstats] INFO: Crawled 109 pages (at 70 pages/min), scraped 100 items (at 41 items/min)
2026-03-28 19:02:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 189MiB
2026-03-28 19:02:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PS01910> (referer: https://www.auto1.com/v1/car-details-view/PS01910/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 19:02:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 124fbde1-ed8c-5bee-98c0-6a40c825edbc with identifier: PS01910
2026-03-28 19:02:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 124fbde1-ed8c-5bee-98c0-6a40c825edbc with scrape type 1
2026-03-28 19:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 124fbde1-ed8c-5bee-98c0-6a40c825edbc
2026-03-28 19:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252Ffb%252F1afbe18e18ba6370d1966bb09611f578%252Fpa%252FPS01910_9c43d4e9fc617070c3be3de542dd02ea.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/fb/1afbe18e18ba6370d1966bb09611f578/pa/PS01910_9c43d4e9fc617070c3be3de542dd02ea.jpg not downloaded yet
2026-03-28 19:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252Ffb%252F1afbe18e18ba6370d1966bb09611f578%252Fpa%252FPS01910_c85427005a2a256b5af54b4fb0b0e9c3.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/fb/1afbe18e18ba6370d1966bb09611f578/pa/PS01910_c85427005a2a256b5af54b4fb0b0e9c3.jpg not downloaded yet
2026-03-28 19:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252Ffb%252F1afbe18e18ba6370d1966bb09611f578%252Fpa%252FPS01910_9b4b0bc46189c3ee15c41645ff7fcd03.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/fb/1afbe18e18ba6370d1966bb09611f578/pa/PS01910_9b4b0bc46189c3ee15c41645ff7fcd03.jpg not downloaded yet
2026-03-28 19:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252Ffb%252F1afbe18e18ba6370d1966bb09611f578%252Fpa%252FPS01910_87e13661580df38c60274ad292ac5410.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/fb/1afbe18e18ba6370d1966bb09611f578/pa/PS01910_87e13661580df38c60274ad292ac5410.jpg not downloaded yet
2026-03-28 19:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252Ffb%252F1afbe18e18ba6370d1966bb09611f578%252Fpa%252FPS01910_5b6435b7ec49c8a6b1585dc5b2ca6f29.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/fb/1afbe18e18ba6370d1966bb09611f578/pa/PS01910_5b6435b7ec49c8a6b1585dc5b2ca6f29.jpg not downloaded yet
2026-03-28 19:02:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/fb/1afbe18e18ba6370d1966bb09611f578/pa/PS01910_9c43d4e9fc617070c3be3de542dd02ea.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:02:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/fb/1afbe18e18ba6370d1966bb09611f578/pa/PS01910_87e13661580df38c60274ad292ac5410.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:02:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/fb/1afbe18e18ba6370d1966bb09611f578/pa/PS01910_5b6435b7ec49c8a6b1585dc5b2ca6f29.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:02:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:02:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bd72c1450>
2026-03-28 19:02:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:02:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:02:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:02:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_124fbde1-ed8c-5bee-98c0-6a40c825edbc/124fbde1-ed8c-5bee-98c0-6a40c825edbc_image_0.jpg HTTP/1.1" 201 0
2026-03-28 19:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252Ffb%252F1afbe18e18ba6370d1966bb09611f578%252Fpa%252FPS01910_9c43d4e9fc617070c3be3de542dd02ea.jpg') HTTP/1.1" 204 0
2026-03-28 19:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/fb/1afbe18e18ba6370d1966bb09611f578/pa/PS01910_9c43d4e9fc617070c3be3de542dd02ea.jpg saved to cache
2026-03-28 19:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 124fbde1-ed8c-5bee-98c0-6a40c825edbc
2026-03-28 19:02:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/fb/1afbe18e18ba6370d1966bb09611f578/pa/PS01910_c85427005a2a256b5af54b4fb0b0e9c3.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:02:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:02:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bd737e250>
2026-03-28 19:02:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:02:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:02:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:02:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_124fbde1-ed8c-5bee-98c0-6a40c825edbc/124fbde1-ed8c-5bee-98c0-6a40c825edbc_image_3.jpg HTTP/1.1" 201 0
2026-03-28 19:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252Ffb%252F1afbe18e18ba6370d1966bb09611f578%252Fpa%252FPS01910_87e13661580df38c60274ad292ac5410.jpg') HTTP/1.1" 204 0
2026-03-28 19:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/fb/1afbe18e18ba6370d1966bb09611f578/pa/PS01910_87e13661580df38c60274ad292ac5410.jpg saved to cache
2026-03-28 19:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 124fbde1-ed8c-5bee-98c0-6a40c825edbc
2026-03-28 19:02:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:02:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bd624a990>
2026-03-28 19:02:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:02:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:02:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:02:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_124fbde1-ed8c-5bee-98c0-6a40c825edbc/124fbde1-ed8c-5bee-98c0-6a40c825edbc_image_4.jpg HTTP/1.1" 201 0
2026-03-28 19:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252Ffb%252F1afbe18e18ba6370d1966bb09611f578%252Fpa%252FPS01910_5b6435b7ec49c8a6b1585dc5b2ca6f29.jpg') HTTP/1.1" 204 0
2026-03-28 19:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/fb/1afbe18e18ba6370d1966bb09611f578/pa/PS01910_5b6435b7ec49c8a6b1585dc5b2ca6f29.jpg saved to cache
2026-03-28 19:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 124fbde1-ed8c-5bee-98c0-6a40c825edbc
2026-03-28 19:02:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/fb/1afbe18e18ba6370d1966bb09611f578/pa/PS01910_9b4b0bc46189c3ee15c41645ff7fcd03.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:02:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:02:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bd71af190>
2026-03-28 19:02:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:02:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:02:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:02:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_124fbde1-ed8c-5bee-98c0-6a40c825edbc/124fbde1-ed8c-5bee-98c0-6a40c825edbc_image_1.jpg HTTP/1.1" 201 0
2026-03-28 19:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252Ffb%252F1afbe18e18ba6370d1966bb09611f578%252Fpa%252FPS01910_c85427005a2a256b5af54b4fb0b0e9c3.jpg') HTTP/1.1" 204 0
2026-03-28 19:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/fb/1afbe18e18ba6370d1966bb09611f578/pa/PS01910_c85427005a2a256b5af54b4fb0b0e9c3.jpg saved to cache
2026-03-28 19:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 124fbde1-ed8c-5bee-98c0-6a40c825edbc
2026-03-28 19:02:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:02:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0bd6854cd0>
2026-03-28 19:02:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:02:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:02:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:02:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_124fbde1-ed8c-5bee-98c0-6a40c825edbc/124fbde1-ed8c-5bee-98c0-6a40c825edbc_image_2.jpg HTTP/1.1" 201 0
2026-03-28 19:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252Ffb%252F1afbe18e18ba6370d1966bb09611f578%252Fpa%252FPS01910_9b4b0bc46189c3ee15c41645ff7fcd03.jpg') HTTP/1.1" 204 0
2026-03-28 19:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/fb/1afbe18e18ba6370d1966bb09611f578/pa/PS01910_9b4b0bc46189c3ee15c41645ff7fcd03.jpg saved to cache
2026-03-28 19:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 124fbde1-ed8c-5bee-98c0-6a40c825edbc
2026-03-28 19:02:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 124fbde1-ed8c-5bee-98c0-6a40c825edbc, skipping ID generation
2026-03-28 19:02:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 124fbde1-ed8c-5bee-98c0-6a40c825edbc with scrape type 1
2026-03-28 19:02:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 124fbde1-ed8c-5bee-98c0-6a40c825edbc sending to next pipeline
2026-03-28 19:02:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 124fbde1-ed8c-5bee-98c0-6a40c825edbc, identifier: PS01910
2026-03-28 19:02:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 124fbde1-ed8c-5bee-98c0-6a40c825edbc with identifier: PS01910
2026-03-28 19:02:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 124fbde1-ed8c-5bee-98c0-6a40c825edbc with identifier: PS01910
2026-03-28 19:02:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 124fbde1-ed8c-5bee-98c0-6a40c825edbc with identifier: PS01910 to the API
2026-03-28 19:02:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 19:02:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 19:02:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img1a/fb/1afbe18e18ba6370d1966bb09611f578/pa/PS01910_9b4b0bc46189c3ee15c41645ff7fcd03.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 185,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.8L',
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:34:07Z',
 'fuel_type': 'petrol',
 'id': '124fbde1-ed8c-5bee-98c0-6a40c825edbc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '44SNNB',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PS01910',
 'listing': 'auction',
 'location': 'NL, Eindhoven',
 'make': 'Opel',
 'model': 'Vectra',
 'odometer': 234561,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_124fbde1-ed8c-5bee-98c0-6a40c825edbc/124fbde1-ed8c-5bee-98c0-6a40c825edbc_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92156,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/fb/1afbe18e18ba6370d1966bb09611f578/pa/PS01910_9c43d4e9fc617070c3be3de542dd02ea.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_124fbde1-ed8c-5bee-98c0-6a40c825edbc/124fbde1-ed8c-5bee-98c0-6a40c825edbc_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81033,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/fb/1afbe18e18ba6370d1966bb09611f578/pa/PS01910_c85427005a2a256b5af54b4fb0b0e9c3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_124fbde1-ed8c-5bee-98c0-6a40c825edbc/124fbde1-ed8c-5bee-98c0-6a40c825edbc_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81541,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/fb/1afbe18e18ba6370d1966bb09611f578/pa/PS01910_9b4b0bc46189c3ee15c41645ff7fcd03.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_124fbde1-ed8c-5bee-98c0-6a40c825edbc/124fbde1-ed8c-5bee-98c0-6a40c825edbc_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67891,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/fb/1afbe18e18ba6370d1966bb09611f578/pa/PS01910_87e13661580df38c60274ad292ac5410.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_124fbde1-ed8c-5bee-98c0-6a40c825edbc/124fbde1-ed8c-5bee-98c0-6a40c825edbc_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 104893,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/fb/1afbe18e18ba6370d1966bb09611f578/pa/PS01910_5b6435b7ec49c8a6b1585dc5b2ca6f29.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2006-03-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Vectra 1.8 Cosmo',
 'transmission': 'manual',
 'trim': 'Cosmo',
 'year': 2006}
2026-03-28 19:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PS01910%27 HTTP/1.1" 200 None
2026-03-28 19:02:08 [auto1.nl] INFO: Saving data for PS01910: {'created_time': 1774724528.89852, 'last_price_update_time': 1774724528.89853, 'auction_closing_time': 1774884847.0}
2026-03-28 19:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='PS01910') HTTP/1.1" 204 0
2026-03-28 19:02:08 [scrapy.core.engine] INFO: Closing spider (finished)
2026-03-28 19:02:08 [auto1.nl] INFO: auto1.nl Batch config: batch 1/2
2026-03-28 19:02:08 [auto1.nl] INFO: auto1.nl Crawl ended with reason finished, scrape types: {<ScrapeType.NEW: 1>: 0, <ScrapeType.NEW_DUPLICATE_ID: 4>: 0, <ScrapeType.PRICE_UPDATE: 2>: 0, <ScrapeType.AUCTION_UPDATE: 3>: 0, <ScrapeType.SKIPPED: 0>: 3, <ScrapeType.BATCH_SKIPPED: 5>: 3}
2026-03-28 19:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20last_price_update_time%20lt%201774292529 HTTP/1.1" 200 None
2026-03-28 19:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='AB60896') HTTP/1.1" 204 0
2026-03-28 19:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='AL68144') HTTP/1.1" 204 0
2026-03-28 19:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='AN90048') HTTP/1.1" 204 0
2026-03-28 19:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='AP52018') HTTP/1.1" 204 0
2026-03-28 19:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='AX70589') HTTP/1.1" 204 0
2026-03-28 19:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='BG04233') HTTP/1.1" 204 0
2026-03-28 19:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='BL78058') HTTP/1.1" 204 0
2026-03-28 19:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='BR41247') HTTP/1.1" 204 0
2026-03-28 19:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='BU08983') HTTP/1.1" 204 0
2026-03-28 19:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='CC53902') HTTP/1.1" 204 0
2026-03-28 19:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='CG64663') HTTP/1.1" 204 0
2026-03-28 19:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='CH53022') HTTP/1.1" 204 0
2026-03-28 19:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='CJ08263') HTTP/1.1" 204 0
2026-03-28 19:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='CP58546') HTTP/1.1" 204 0
2026-03-28 19:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='CV57323') HTTP/1.1" 204 0
2026-03-28 19:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='CX69054') HTTP/1.1" 204 0
2026-03-28 19:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='DK51587') HTTP/1.1" 204 0
2026-03-28 19:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='EE69876') HTTP/1.1" 204 0
2026-03-28 19:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='EG13412') HTTP/1.1" 204 0
2026-03-28 19:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='ER33676') HTTP/1.1" 204 0
2026-03-28 19:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='EX16067') HTTP/1.1" 204 0
2026-03-28 19:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='FB66036') HTTP/1.1" 204 0
2026-03-28 19:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='FN26944') HTTP/1.1" 204 0
2026-03-28 19:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='FR92202') HTTP/1.1" 204 0
2026-03-28 19:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='GB81385') HTTP/1.1" 204 0
2026-03-28 19:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='GC07226') HTTP/1.1" 204 0
2026-03-28 19:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='HE27738') HTTP/1.1" 204 0
2026-03-28 19:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='HE68335') HTTP/1.1" 204 0
2026-03-28 19:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='JB51817') HTTP/1.1" 204 0
2026-03-28 19:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='JU15957') HTTP/1.1" 204 0
2026-03-28 19:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='KF52500') HTTP/1.1" 204 0
2026-03-28 19:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='KH44977') HTTP/1.1" 204 0
2026-03-28 19:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='KJ49026') HTTP/1.1" 204 0
2026-03-28 19:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='KM32475') HTTP/1.1" 204 0
2026-03-28 19:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='KR30932') HTTP/1.1" 204 0
2026-03-28 19:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='KS25693') HTTP/1.1" 204 0
2026-03-28 19:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='KU08030') HTTP/1.1" 204 0
2026-03-28 19:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='LH95977') HTTP/1.1" 204 0
2026-03-28 19:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='LS52883') HTTP/1.1" 204 0
2026-03-28 19:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='LY83343') HTTP/1.1" 204 0
2026-03-28 19:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='MB43165') HTTP/1.1" 204 0
2026-03-28 19:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='MD58026') HTTP/1.1" 204 0
2026-03-28 19:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='ND24425') HTTP/1.1" 204 0
2026-03-28 19:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='ND24551') HTTP/1.1" 204 0
2026-03-28 19:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='NE79175') HTTP/1.1" 204 0
2026-03-28 19:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='NG83103') HTTP/1.1" 204 0
2026-03-28 19:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='NP30024') HTTP/1.1" 204 0
2026-03-28 19:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='NU47705') HTTP/1.1" 204 0
2026-03-28 19:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='NW89978') HTTP/1.1" 204 0
2026-03-28 19:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='NY13996') HTTP/1.1" 204 0
2026-03-28 19:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='NY66479') HTTP/1.1" 204 0
2026-03-28 19:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='PC36608') HTTP/1.1" 204 0
2026-03-28 19:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='PH72543') HTTP/1.1" 204 0
2026-03-28 19:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='PL94204') HTTP/1.1" 204 0
2026-03-28 19:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='PS60855') HTTP/1.1" 204 0
2026-03-28 19:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='PU08657') HTTP/1.1" 204 0
2026-03-28 19:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='PW78514') HTTP/1.1" 204 0
2026-03-28 19:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='RC52730') HTTP/1.1" 204 0
2026-03-28 19:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='RD99814') HTTP/1.1" 204 0
2026-03-28 19:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='RH02026') HTTP/1.1" 204 0
2026-03-28 19:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='RT04333') HTTP/1.1" 204 0
2026-03-28 19:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='RV11429') HTTP/1.1" 204 0
2026-03-28 19:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='RW32296') HTTP/1.1" 204 0
2026-03-28 19:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='RY59251') HTTP/1.1" 204 0
2026-03-28 19:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='RZ77423') HTTP/1.1" 204 0
2026-03-28 19:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='SG08993') HTTP/1.1" 204 0
2026-03-28 19:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='SV30103') HTTP/1.1" 204 0
2026-03-28 19:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='TA42308') HTTP/1.1" 204 0
2026-03-28 19:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='TC74533') HTTP/1.1" 204 0
2026-03-28 19:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='TN28630') HTTP/1.1" 204 0
2026-03-28 19:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='TV63591') HTTP/1.1" 204 0
2026-03-28 19:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='UE71777') HTTP/1.1" 204 0
2026-03-28 19:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='UG49445') HTTP/1.1" 204 0
2026-03-28 19:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='UH29082') HTTP/1.1" 204 0
2026-03-28 19:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='UJ12956') HTTP/1.1" 204 0
2026-03-28 19:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='UM48415') HTTP/1.1" 204 0
2026-03-28 19:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='UM70079') HTTP/1.1" 204 0
2026-03-28 19:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='UW39695') HTTP/1.1" 204 0
2026-03-28 19:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='VA28711') HTTP/1.1" 204 0
2026-03-28 19:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='VG82378') HTTP/1.1" 204 0
2026-03-28 19:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='VP88503') HTTP/1.1" 204 0
2026-03-28 19:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='WM17216') HTTP/1.1" 204 0
2026-03-28 19:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='WU42137') HTTP/1.1" 204 0
2026-03-28 19:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='XB12995') HTTP/1.1" 204 0
2026-03-28 19:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='XD93271') HTTP/1.1" 204 0
2026-03-28 19:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='XE04187') HTTP/1.1" 204 0
2026-03-28 19:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='XE24732') HTTP/1.1" 204 0
2026-03-28 19:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='XE93255') HTTP/1.1" 204 0
2026-03-28 19:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='XN55457') HTTP/1.1" 204 0
2026-03-28 19:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='XV70610') HTTP/1.1" 204 0
2026-03-28 19:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='YC28377') HTTP/1.1" 204 0
2026-03-28 19:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='YH93392') HTTP/1.1" 204 0
2026-03-28 19:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='YU41907') HTTP/1.1" 204 0
2026-03-28 19:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='ZA01500') HTTP/1.1" 204 0
2026-03-28 19:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='ZE22789') HTTP/1.1" 204 0
2026-03-28 19:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='ZJ76743') HTTP/1.1" 204 0
2026-03-28 19:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='ZM62757') HTTP/1.1" 204 0
2026-03-28 19:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='ZX27967') HTTP/1.1" 204 0
2026-03-28 19:02:10 [scrapy.extensions.feedexport] INFO: Stored jsonlines feed (101 items) in: file:///var/lib/scrapyd/items/sourcing_v2/auto1.nl/task_27_2026-03-28T19_00_00.jl
2026-03-28 19:02:10 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/request_bytes': 587875,
 'downloader/request_count': 344,
 'downloader/request_method_count/GET': 324,
 'downloader/request_method_count/POST': 20,
 'downloader/response_bytes': 149543160,
 'downloader/response_count': 344,
 'downloader/response_status_count/200': 344,
 'dupefilter/filtered': 7,
 'elapsed_time_seconds': 123.176876,
 'feedexport/success_count/FileFeedStorage': 1,
 'finish_reason': 'finished',
 'finish_time': datetime.datetime(2026, 3, 28, 19, 2, 10, 113576, tzinfo=datetime.timezone.utc),
 'item_scraped_count': 101,
 'log_count/DEBUG': 3667,
 'log_count/INFO': 3709,
 'memusage/max': 199086080,
 'memusage/startup': 150065152,
 'photo_download_count': 234,
 'request_depth_max': 21,
 'response_received_count': 110,
 'scheduler/dequeued': 344,
 'scheduler/dequeued/memory': 344,
 'scheduler/enqueued': 344,
 'scheduler/enqueued/memory': 344,
 'scrape_type/batch_skipped': 342,
 'scrape_type/new': 44,
 'scrape_type/price_update': 57,
 'scrape_type/skipped': 236,
 'scrapy-zyte-api/429': 0,
 'scrapy-zyte-api/attempts': 110,
 'scrapy-zyte-api/error_ratio': 0.0,
 'scrapy-zyte-api/errors': 0,
 'scrapy-zyte-api/fatal_errors': 0,
 'scrapy-zyte-api/mean_connection_seconds': 3.197522797308522,
 'scrapy-zyte-api/mean_response_seconds': 3.219507056652484,
 'scrapy-zyte-api/processed': 110,
 'scrapy-zyte-api/request_args/customHttpRequestHeaders': 110,
 'scrapy-zyte-api/request_args/experimental.requestCookies': 109,
 'scrapy-zyte-api/request_args/experimental.responseCookies': 110,
 'scrapy-zyte-api/request_args/httpRequestBody': 20,
 'scrapy-zyte-api/request_args/httpRequestMethod': 20,
 'scrapy-zyte-api/request_args/httpResponseBody': 110,
 'scrapy-zyte-api/request_args/httpResponseHeaders': 110,
 'scrapy-zyte-api/request_args/sessionContext': 110,
 'scrapy-zyte-api/request_args/url': 110,
 'scrapy-zyte-api/status_codes/200': 110,
 'scrapy-zyte-api/success': 110,
 'scrapy-zyte-api/success_ratio': 1.0,
 'scrapy-zyte-api/throttle_ratio': 0.0,
 'source/items_encountered': 686,
 'source/total_available': 646,
 'start_time': datetime.datetime(2026, 3, 28, 19, 0, 6, 936700, tzinfo=datetime.timezone.utc)}
2026-03-28 19:02:10 [scrapy.core.engine] INFO: Spider closed (finished)
2026-03-28 19:02:10 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7f0bdd23a590>
2026-03-28 19:02:10 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7f0bdd388490>